Reverse screen transmission method and device, equipment and storage medium

Abstract

The embodiment of the invention discloses a reverse screen transmission method and device, equipment and a storage medium. The method comprises the following steps: starting to acquire a screen picture stream in real time when a reverse screen transmission instruction is received, determining a first frame picture corresponding to a reverse screen transmission instruction receiving moment in the screen picture stream as an initial to-be-transmitted picture, and reversely transmitting the initial to-be-transmitted picture to a sending device corresponding to the reverse screen transmission instruction; according to the target screen transmission mode of the current period, determining a to-be-transmitted picture in the current screen picture stream corresponding to the current period, and reversely transmitting the to-be-transmitted picture; determining the picture size of each frame of picture in the current screen picture stream, and determining a target screen transmission mode of the next period according to the basic picture size and each picture size; the basic picture size is the picture size with the highest proportion in the screen picture stream. According to the technical scheme provided by the embodiment of the invention, the data volume required for carrying out reverse screen transmission on each sending device is reduced, and the occupation of excessive device performance and bandwidth is avoided.

Description

Technical Field

[0001] The present invention relates to the field of data transmission technology, and in particular to a reverse screen transmission method, device, equipment and storage medium. Background Art

[0002] With the continuous development of smart terminal technology, screen projection technology has gradually been applied to scenarios where multiple smart terminal devices are interconnected, such as conference scenarios. Taking conference scenarios as an example, mobile phones and computers are often used as sending devices, and conference tablets and TVs used to display content in meetings are used as receiving devices. Screen projection technology is often used to project video information from the sending device to the receiving device for playback, and the function of reverse screen transmission from the receiving device to the sending device has also been gradually developed.

[0003] When the existing reverse screen transmission function is implemented, the screen image is often captured in real time through the screen transmission software installed in the receiving device, and the screen image is only simply compressed before being transmitted to the sending device. For example, the existing reverse screen transmission often compresses the video stream in the receiving device to 1080p data at 30 frames per second for reverse screen transmission. The overall data volume is large, which will greatly consume the data processing performance of the receiving device, causing the receiving device to be stuck.

[0004] In the prior art, most of the receiving devices directly capture the 4k screen, compress it to 1080p and send it to the sending device in real time. At the same time, they need to receive control instructions transmitted by other sending devices to perform screen transmission and audio and video conferencing. Since operations such as screenshots, compression and transmission consume a lot of performance, it is difficult for the receiving device to support the operation of transmission instructions from other sending devices. At the same time, since reverse screen transmission for a sending device consumes a lot of bandwidth performance, it can only support reverse screen transmission for a small number of sending devices at the same time, and it is difficult to support the reverse screen transmission needs of multiple sending devices in paperless offices. Summary of the invention

[0005] The present invention provides a reverse screen transmission method, apparatus, equipment and storage medium, so that when a receiving device receives a reverse screen transmission instruction, it is not necessary to compress all screen images and transmit them to a sending device, and the data to be transmitted can be filtered according to the change of the image size in the screen image stream, thereby realizing reverse screen transmission to multiple sending devices at the same time, improving the equipment capacity utilization rate and meeting the needs of paperless office.

[0006] In a first aspect, an embodiment of the present invention provides a reverse screen transmission method, comprising:

[0007] Starting from receiving the reverse screen transmission instruction, the screen image stream is acquired in real time, the first frame image in the screen image stream corresponding to the time when the reverse screen transmission instruction is received is determined as the initial image to be transmitted, and the initial image to be transmitted is transmitted in reverse to the sending device corresponding to the reverse screen transmission instruction;

[0008] According to the target screen transmission mode of the current cycle, determine the picture to be transmitted in the current screen picture stream corresponding to the current cycle, and transmit the picture to be transmitted in reverse;

[0009] Determine the screen size of each frame in the current screen image stream, and determine the target screen transmission mode of the next cycle according to the basic image size and each image size; the basic image size is the image size with the highest proportion in the screen image stream;

[0010] Among them, the target screen transmission mode includes the initial screen transmission mode and the high-speed switching screen transmission mode; when the current cycle is the first cycle, the target screen transmission mode is the initial screen transmission mode.

[0011] In a second aspect, an embodiment of the present invention further provides a reverse screen transmission device, comprising:

[0012] An initial picture transmission module is used to obtain a screen picture stream in real time starting from receiving a reverse screen transmission instruction, determine the first frame of the screen picture stream corresponding to the moment of receiving the reverse screen transmission instruction as the initial picture to be transmitted, and reversely transmit the initial picture to be transmitted to a sending device corresponding to the reverse screen transmission instruction;

[0013] The periodic screen transmission module is used to determine the screen to be transmitted in the current screen screen stream corresponding to the current period according to the target screen transmission mode of the current period, and transmit the screen to be transmitted in reverse;

[0014] The screen transmission mode determination module is used to determine the screen size of each frame in the current screen image stream, and determine the target screen transmission mode of the next cycle according to the basic image size and each image size; the basic image size is the image size with the highest proportion in the screen image stream;

[0015] Among them, the target screen transmission mode includes the initial screen transmission mode and the high-speed switching screen transmission mode; when the current cycle is the first cycle, the target screen transmission mode is the initial screen transmission mode.

[0016] In a third aspect, an embodiment of the present invention further provides a reverse screen transmission device, including:

[0017] at least one processor; and

[0018] a memory communicatively connected to at least one processor; wherein,

[0019] The memory stores a computer program that can be executed by at least one processor, and the computer program is executed by at least one processor so that the at least one processor can execute the reverse screen transmission method provided in an embodiment of the present invention.

[0020] In a fourth aspect, an embodiment of the present invention further provides a storage medium comprising computer executable instructions, which, when executed by a computer processor, are used to execute the reverse screen transmission method provided by an embodiment of the present invention.

[0021] A reverse screen transmission method, device, equipment and storage medium provided by an embodiment of the present invention obtains a screen image stream in real time from the receipt of a reverse screen transmission instruction, determines the first frame image in the screen image stream corresponding to the moment of receiving the reverse screen transmission instruction as the initial image to be transmitted, and reversely transmits the initial image to be transmitted to a sending device corresponding to the reverse screen transmission instruction; determines the image to be transmitted in the current screen image stream corresponding to the current period according to the target screen transmission mode of the current period, and reversely transmits the image to be transmitted; determines the image size of each frame image in the current screen image stream, and determines the target screen transmission mode of the next period according to the basic image size and each image size; the basic image size is the image size with the highest proportion in the screen image stream; wherein the target screen transmission mode includes the initial screen transmission mode and the high-speed switching screen transmission mode; when the current period is the first period, the target screen transmission mode is the initial screen transmission mode. By adopting the above technical solution, after the reverse screen transmission instruction is initially received, the first frame of the picture corresponding to the instruction reception moment is transmitted immediately, and different target screen transmission modes are determined based on the real-time acquisition of the change in the picture size in the screen picture stream, and the pictures in the screen picture stream in the corresponding period are screened under different target screen transmission modes, so that different scene requirements are determined according to the change in the picture size, and the reverse screen transmission method is adjusted according to the requirements of different scenes, thereby avoiding the transmission of invalid screen pictures, reducing the amount of data required for reverse screen transmission for each sending device, avoiding excessive occupation of device performance and bandwidth, and improving device capacity utilization, thereby realizing reverse screen transmission for multiple sending devices at the same time without affecting the normal core functions of the receiving device, meeting the needs of paperless conference room office.

[0022] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0024] Figure 1 A flowchart of a reverse screen transmission method provided in Embodiment 1 of the present invention;

[0025] Figure 2 A flowchart of a reverse screen transmission method provided in Embodiment 2 of the present invention;

[0026] Figure 3 An example diagram of a process for determining a first target picture according to a picture size change relationship of each frame picture in a current picture stream provided in a second embodiment of the present invention;

[0027] Figure 4 A flowchart of a second embodiment of the present invention, which provides a method for cyclically transmitting each to-be-transmitted screen to a sending device corresponding to each reverse screen transmission instruction according to the reception time of each reverse screen transmission instruction;

[0028] Figure 5 A schematic diagram of the structure of a reverse screen transmission device provided in Embodiment 3 of the present invention;

[0029] Figure 6 A structural schematic diagram of a reverse screen transmission device provided in Example 4 of the present invention. DETAILED DESCRIPTION

[0030] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0031] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0032] With the increasing popularity of smart devices in paperless office, mobile phones and computers are often used as sending devices, and conference tablets and TVs used for content display in meetings are used as receiving devices in paperless office. In paperless office, in addition to projecting the screen information in the sending device to the receiving device for display, the screen information displayed in the receiving device can also be transmitted back to the sending device for display through the reverse screen transmission control function. However, when the existing reverse screen transmission operation is implemented, the receiving device only performs a simple compression on the captured screen image and then transmits it. The overall data volume is large. In addition to consuming a large amount of receiving device resources when implementing image processing, it may occupy a lot of bandwidth when performing reverse transmission. It cannot meet the needs of multiple sending devices requesting reverse screen transmission from the same receiving device in the paperless office scenario. Therefore, the embodiment of the present invention provides a reverse screen transmission method, which analyzes the change relationship between the sizes of each picture in the screen picture stream in the receiving device, determines different types of screen transmission modes, and then screens and allocates the pictures in the screen picture stream according to different screen transmission modes, and only transmits the pictures that must be transmitted in reverse, which not only meets the needs of the sending device to obtain reverse screen transmission information, but also reduces the number of pictures sent by the receiving device to each sending device, and realizes reverse screen transmission to multiple sending devices at the same time, improves the utilization rate of equipment capacity, and meets the needs of paperless office. The reverse screen transmission method provided by the present invention is explained in conjunction with specific embodiments below.

[0033] Embodiment 1

[0034] Figure 1This is a flowchart of a reverse screen transmission method provided in the first embodiment of the present invention. The embodiment of the present invention can be applied to the situation where the receiving device transmits the screen to the sending device in the paperless office. The method can be executed by a reverse screen transmission device. The reverse screen transmission device can be implemented by software and / or hardware. The reverse screen transmission device can be configured in the reverse screen transmission device. Optionally, the reverse screen transmission device can be a notebook, a desktop computer, a smart tablet, etc., or a television and a conference tablet as a receiving device in the paperless office, etc., and the embodiment of the present invention does not limit this.

[0035] like Figure 1 As shown, a reverse screen transmission method provided by an embodiment of the present invention specifically includes the following steps:

[0036] S101. Start acquiring the screen image stream in real time after receiving the reverse screen transmission instruction, determine the first frame image in the screen image stream corresponding to the moment when the reverse screen transmission instruction is received as the initial image to be transmitted, and reversely transmit the initial image to be transmitted to the sending device corresponding to the reverse screen transmission instruction.

[0037] In this embodiment, the sending device can be specifically understood as a device that transmits the screen or performs other control operations to the receiving device in a paperless office scenario. Optionally, the sending device can be a mobile phone, computer or other device held by each participant in the paperless office scenario. The reverse screen transmission instruction can be specifically understood as an instruction sent by the sending device to the receiving device to trigger the receiving device to perform a reverse screen transmission operation to the sending device that sent the instruction. The screen image stream can be specifically understood as an image stream composed of real-time playback images in the receiving device. The initial image to be transmitted can be specifically understood as the first image to be transmitted to the sending device that issued the reverse screen transmission instruction.

[0038] Specifically, when the receiving device receives the reverse screen transmission instruction sent by the sending device, it can be considered that it needs to provide reverse screen transmission service to the sending device that sent the reverse screen transmission instruction. From the receipt of the reverse screen transmission instruction, the screen image stream being displayed by the device is obtained in real time. The receiving time of the reverse screen transmission instruction can be considered as the starting time when the sending device hopes to receive the reverse screen transmission image. Therefore, the first frame image in the screen image stream corresponding to the receiving time of the reverse screen transmission instruction can be determined as the initial image to be transmitted, and the initial image to be transmitted is reversely transmitted to the sending device corresponding to the reverse screen transmission instruction, thereby starting the subsequent reverse screen transmission service for the sending device.

[0039] S102, according to the target screen transmission mode of the current cycle, determining the picture to be transmitted in the current screen picture stream corresponding to the current cycle, and reversely transmitting the picture to be transmitted.

[0040] Among them, the target screen transmission mode includes the initial screen transmission mode and the high-speed switching screen transmission mode; when the current cycle is the first cycle, the target screen transmission mode is the initial screen transmission mode.

[0041] In this embodiment, the current cycle can be specifically understood as the reverse screen transmission time cycle corresponding to the current moment, which is set according to the actual situation. Optionally, when executing the reverse screen transmission task, since the screen switching situation of the screen picture stream in the receiving device will continue to change over time, the number of pictures and the screening method to be transmitted reversely to the sending device for different picture switching situations are different. Therefore, a reverse screen transmission time cycle can be pre-set according to the actual situation, assuming that the screen picture stream in the receiving device is in the same picture switching situation during the time period, and the reverse screen transmission time cycle corresponding to the current moment is determined as the current cycle. Exemplarily, the length of a reverse screen transmission time cycle can be 1.5s, which is not limited by the embodiment of the present invention.

[0042] In this embodiment, the target screen transmission mode can be specifically understood as a mode determined according to actual conditions during the reverse screen transmission process, and used to filter the screen image stream to achieve control of the reverse screen transmission frame rate. The initial screen transmission mode can be specifically understood as a mode set for a scenario where the refresh frequency of the content displayed by the receiving device is not high, and used to filter the screen image stream to achieve control of the reverse screen transmission frame rate. The high-speed switching screen transmission mode can be specifically understood as a mode set for a scenario where the refresh frequency of the content displayed by the receiving device is high, and used to filter the screen image stream to achieve control of the reverse screen transmission frame rate. The current screen image stream can be specifically understood as the screen image stream corresponding to the current cycle time in the screen image stream acquired in real time. The picture to be transmitted can be specifically understood as the picture obtained by filtering the target screen transmission mode and needs to be transmitted to the sending device.

[0043] Specifically, when the current cycle is the first cycle, since the receiving device has just started to reversely transmit the screen to the sending device, it is impossible to predetermine the refresh frequency of the content displayed in the current screen image stream corresponding to the current cycle, so the target screen transmission mode can be pre-set as the initial screen transmission mode. First, it is ensured that the current screen image stream is screened based on the initial screen transmission mode in the first cycle, and the images to be transmitted that can be reversely transmitted are determined, and the images to be transmitted are reversely transmitted to the corresponding sending device. When the current cycle is not the first cycle, the current screen image stream can be screened and the images to be transmitted can be determined according to the target screen transmission mode corresponding to the current cycle, and the method of reversely transmitting the images to be transmitted to the sending device can be clarified according to the target screen transmission mode, and then the images to be transmitted are reversely transmitted to the corresponding sending device according to the image transmission method corresponding to the target screen transmission mode.

[0044] In an embodiment of the present invention, the reverse screen transmission process is divided into multiple cycles, and a target screen transmission mode suitable for refreshing the content of the screen stream display in the cycle is adopted for different cycles, and the current screen picture stream is screened through the target screen transmission mode. On the basis of reducing the number of pictures that need to be reversely transmitted, the validity of the screened pictures to be transmitted is guaranteed, so that the sending device receiving the reverse screen transmission will not miss the valid information in the current screen picture stream, reducing the amount of data required for reverse screen transmission for each sending device, avoiding excessive occupation of device performance and bandwidth, and improving device capacity utilization.

[0045] S103: Determine the picture size of each frame in the current screen picture stream, and determine the target screen transmission mode of the next cycle according to the basic picture size and each picture size.

[0046] Among them, the basic picture size is the picture size that accounts for the largest proportion in the screen picture stream.

[0047] In this embodiment, the picture size can be specifically understood as the size of the picture. The basic picture size can be specifically understood as the picture size with the highest proportion among the picture sizes corresponding to the frames constituting the screen picture stream, which can also be understood as the size of most pictures in the screen picture stream. For example, assuming that the screen picture stream contains 200 pictures with a picture size of 120kb, 80 pictures with a picture size of 180kb and 40 pictures with a picture size of 40kb within 2 minutes, 120kb can be defined as the basic picture size of the screen picture stream.

[0048] Specifically, due to the frequent screen changes in operating software or playing videos, the corresponding sizes of each screen in the screen stream will increase, and the basic screen size is the screen size with the highest proportion in the screen stream. It can be considered that the screen size should be larger than the basic screen size when the screen content switches at high speed. Therefore, while the current screen stream is reversely transmitted in the current cycle, the size of each frame in the current screen stream can be counted, and each screen size can be compared with the basic screen size according to preset rules to determine the refresh frequency of the screen content in the current screen stream in the current cycle and other information, clarify the reverse screen transmission scenario that may be faced in the next cycle, and then set the target screen transmission mode for the next cycle.

[0049] Optionally, the basic screen size can be updated in real time according to the screen image stream acquired in real time, or it can be determined by counting the screen image sizes of the screen image stream within the previous preset number of cycles. For the statistics of the screen image stream within the previous preset number of cycles, the basic screen size can be updated in the statistical process according to the same cycle as the reverse screen transmission time cycle, such as after the first reverse screen transmission time cycle, the screen size with the highest proportion in the first reverse screen transmission time cycle is updated to the basic screen size; after the second reverse screen transmission time cycle, the screen size with the highest proportion in the first and second reverse screen transmission time cycles is updated to the basic screen size, until the number of cycles reaches the preset number, and the basic screen size is kept unchanged in subsequent cycles.

[0050] For example, taking a reverse screen transmission time period of 1.5s and a preset number of 80 as an example, within the preset number of reverse screen transmission time periods after the reverse screen transmission instruction is received, each time a reverse screen transmission time period passes, the reverse screen transmission time period and the screen size with the highest proportion in the previous reverse screen transmission time period are updated to a new basic screen size, and after the preset number of reverse screen transmission time periods pass, the basic screen size obtained by the last update is used as the basic screen size of subsequent periods and will not change. The above example is used as an example only for determining the basic screen size, and the embodiment of the present invention does not limit this.

[0051] The technical solution of this embodiment is to acquire the screen image stream in real time since the reverse screen transmission instruction is received, determine the first frame image in the screen image stream corresponding to the moment of receiving the reverse screen transmission instruction as the initial image to be transmitted, and reversely transmit the initial image to be transmitted to the sending device corresponding to the reverse screen transmission instruction; determine the image to be transmitted in the current screen image stream corresponding to the current period according to the target screen transmission mode of the current period, and reversely transmit the image to be transmitted; determine the picture size of each frame in the current screen image stream, and determine the target screen transmission mode of the next period according to the basic picture size and each picture size; the basic picture size is the picture size with the highest proportion in the screen image stream; wherein the target screen transmission mode includes the initial screen transmission mode and the high-speed switching screen transmission mode; when the current period is the first period, the target screen transmission mode is the initial screen transmission mode. By adopting the above technical solution, after the reverse screen transmission instruction is initially received, the first frame of the picture corresponding to the instruction reception moment is transmitted immediately, and different target screen transmission modes are determined based on the real-time acquisition of the change in the picture size in the screen picture stream, and the pictures in the screen picture stream in the corresponding period are screened under different target screen transmission modes, so that different scene requirements are determined according to the change in the picture size, and the reverse screen transmission method is adjusted according to the requirements of different scenes, thereby avoiding the transmission of invalid screen pictures, reducing the amount of data required for reverse screen transmission for each sending device, avoiding excessive occupation of device performance and bandwidth, and improving device capacity utilization, thereby realizing reverse screen transmission for multiple sending devices at the same time without affecting the normal core functions of the receiving device, meeting the needs of paperless conference room office.

[0052] Embodiment 2

[0053] Figure 2A flowchart of a reverse screen transmission method provided in the second embodiment of the present invention is provided. The technical solution of the embodiment of the present invention is further optimized on the basis of the above optional technical solutions. For the initial screen transmission mode, by analyzing the size change relationship between different frames in the current picture stream corresponding to the current cycle, the pictures to be transmitted corresponding to the application switching and other operations in the current picture stream are determined. In the initial screen transmission mode, the pictures that have not changed significantly in the current picture stream are filtered, thereby reducing the number of pictures to be transmitted that need to be transmitted in reverse. For the high-speed switching screen transmission mode, the number of sending devices that need to perform reverse screen transmission at the same time is determined according to the number of reverse screen transmission instructions received by the receiving device. When the number of sending devices is small and meets the bandwidth and device performance requirements, the pictures to be transmitted with a fixed frame rate can be transmitted to the sending device to ensure the continuity of the pictures received by each sending device; when the number of sending devices is large, if more pictures are transmitted to each sending device, the execution of the main functions of the receiving device will be affected, and it is difficult to meet the bandwidth requirements. By cyclically transmitting each frame in the current screen picture stream to different sending devices according to the receiving time of the reverse screen transmission instruction, it is ensured that each sending device can display the key pictures while reducing the number of pictures to be transmitted to each sending device. According to different usage scenarios, different scene requirements are determined according to the changes in the screen size, and different types of target screen transmission modes are adopted. While meeting the equipment performance and bandwidth requirements, the acquisition of effective information of each sending device is guaranteed, the transmission of invalid screen images is avoided, and the amount of data required for reverse screen transmission for each sending device is reduced. The utilization rate of equipment capacity is improved, and reverse screen transmission of multiple sending devices is realized at the same time without affecting the normal core functions of the receiving device.

[0054] like Figure 2 As shown, a reverse screen transmission method provided by the second embodiment of the present invention specifically includes the following steps:

[0055] S201, starting from receiving the reverse screen transmission instruction, real-time acquisition of the screen image stream begins, determining the first frame of the screen image stream corresponding to the moment of receiving the reverse screen transmission instruction as the initial image to be transmitted, and reversely transmitting the initial image to be transmitted to the sending device corresponding to the reverse screen transmission instruction. When the target screen transmission mode is the initial screen transmission mode, execute S202; when the target screen transmission mode is the high-speed switching screen transmission mode, execute S205.

[0056] S202: Determine a first target picture according to a picture size change relationship of each frame picture in the current picture stream.

[0057] Specifically, when the target screen transmission mode is the initial screen transmission mode, the picture sizes of each frame in the current picture stream are compared in turn. If the picture sizes of two adjacent frames change greatly, it can be considered that the picture displayed by the receiving device has changed within the corresponding time of the two frames, and the changed content needs to be presented in the sending device in reverse. Generally speaking, the content contained in the later picture in the time sequence is the content displayed after the switch. Therefore, when it is determined that the picture displayed by the receiving device has changed, the changed picture in the current picture stream can be determined as the first target picture.

[0058] Optional, Figure 3 A flowchart of determining a first target picture according to a picture size change relationship of each frame picture in a current picture stream is provided in the second embodiment of the present invention, as shown in FIG. Figure 3 As shown, the specific steps include:

[0059] S2021. Divide the current screen picture stream into at least two adjacent frame groups according to a time relationship.

[0060] In this embodiment, the adjacent frame group can be specifically understood as a picture group consisting of two picture frames that are adjacent in time sequence in the current screen picture stream.

[0061] Specifically, the current screen picture stream is composed of multiple picture frames displayed in time sequence, so the picture frames in the current screen picture stream can be grouped in pairs according to the time relationship, and a picture group composed of two picture frames adjacent in time sequence can be determined as an adjacent frame group.

[0062] For example, assuming that the current screen image stream includes 10 frames, which are numbered 1-10 respectively, the adjacent frame groups obtained by dividing them according to the time relationship can be represented as (1,2), (2,3), (3,4), (4,5), (5,6), (6,7), (7,8), (8,9) and (9,10) respectively.

[0063] S2022: For each adjacent frame group, if the picture size change ratio is greater than a preset ratio threshold, determine the second frame picture in the adjacent frame group as the first target picture.

[0064] In this embodiment, the preset ratio threshold value can be specifically understood as a ratio of the screen size determined according to the change of the screen size when the screen display screen switches, and is used to determine whether the screen display screen changes.

[0065] Specifically, for each adjacent frame group, it can be divided into a first frame and a second frame. By comparing the size of the first frame with the size of the second frame, the size change ratio of the first frame relative to the second frame can be obtained. If the size change ratio is greater than a preset ratio threshold, it can be considered that the content displayed in the second frame is significantly different from that in the first frame, and because the first frame may have been reversely transmitted and displayed in the sending device, the second frame can be determined as the first target frame that needs to be reversely transmitted.

[0066] For example, assuming that the receiving device displays a desktop screen at the current moment, and the screen size of one frame is 98kb, if the content displayed by the receiving device stays on the desktop screen within 1s, then the screen size of each frame in the screen screen stream within 1s is 98kb. Since the display screen is not updated, there is no need to reversely transmit the screen to the sending device, that is, there is no first target screen that needs to be reversely transmitted in the screen screen stream within 1s. When the receiving device displays the user switching applications for the desktop, the screen size of the screen displayed by the receiving device will change. For example, at the moment of opening the application, the screen size will change to about 150kb instantly. When the receiving device displays a simple application interface, the screen size of the screen displayed by the receiving device will change to about 60kb. When the screen size of two adjacent frames suddenly changes, and the size change ratio is greater than the preset ratio threshold, it can be considered that the screen content displayed by the receiving device must have changed, and the changed screen content needs to be reversely transmitted to the sending device for display. At this time, the second frame in the adjacent frame group can be determined as the first target screen that needs to be reversely transmitted.

[0067] S203: Determine the first target picture and the last frame picture in the current screen picture stream as pictures to be transmitted.

[0068] Specifically, except when the picture size in the current screen picture stream changes significantly, the display picture in the sending device needs to be updated, that is, the first target picture whose picture content changes is used as the picture to be transmitted. In order to ensure the real-time display of the picture in the sending device and avoid the omission of the first target picture determined according to the change of the picture size, in the initial screen transmission mode, it is guaranteed that one frame of the picture is fixedly transmitted to the sending device every cycle. In the embodiment of the present invention, the last frame of the picture in the current screen picture stream corresponding to each current cycle can be determined as the picture that needs to be fixedly transmitted, and the first target picture and the last frame of the picture determined in the current screen picture stream are determined as the pictures to be transmitted.

[0069] S204, reversely transmit the picture to be transmitted, and execute S209.

[0070] Specifically, when the target screen transmission mode is the initial screen transmission mode, each sending device that sends a reverse screen transmission instruction can be used as a target device for reverse transmission of the screen to be transmitted, and the determined screen to be transmitted can be sent to each target device respectively.

[0071] S205: Determine the number of reverse screen transmission instructions.

[0072] Specifically, in a paperless office scenario, one receiving device often corresponds to multiple sending devices. Therefore, when the receiving device displays the screen, it may receive reverse screen transmission instructions from different sending devices, and it is also necessary to perform reverse screen transmission to different sending devices. However, due to the frequent screen switching in the current screen image stream in the high-speed switching screen transmission mode, the number of images that need to be reversely transmitted is too large, and the bandwidth cannot support the simultaneous reverse transmission of too many images. Therefore, it is necessary to first determine the number of reverse screen transmission instructions received by the receiving device to determine the number of sending devices that need to receive the images to be transmitted.

[0073] S206: Determine whether the number of instructions is less than a preset number threshold, if so, execute S207, if not, execute S208.

[0074] In this embodiment, the preset number threshold may be specifically understood as a threshold of the number of devices that is predetermined according to bandwidth transmission capability and can be simultaneously supported for reverse transmission of images at a higher frame rate.

[0075] Specifically, when it is determined that the number of instructions is less than the preset number threshold, it can be considered that the number of sending devices that need to perform reverse screen transmission is small, and the current bandwidth can support the completion of reverse screen transmission of the sending device corresponding to the reverse screen transmission instruction at a higher frame rate in the high-speed switching mode, and S207 is executed at this time. When it is determined that the number of instructions is greater than or equal to the preset number threshold, it can be considered that the number of sending devices that need to perform reverse screen transmission is large, and the current bandwidth cannot support the completion of reverse screen transmission of the sending device corresponding to the reverse screen transmission instruction at a higher frame rate in the high-speed switching mode, and S208 is executed at this time.

[0076] S207, determine the picture extracted from the current screen picture stream according to the preset frame rate as the picture to be transmitted, and transmit the picture to be transmitted in reverse to the sending device corresponding to each reverse screen transmission instruction, and execute S209.

[0077] In this embodiment, the preset frame rate can be specifically understood as a frame rate set according to actual conditions, which satisfies both bandwidth requirements and picture content switching frequency.

[0078] Specifically, pictures are uniformly extracted from the current screen picture stream according to the preset frame rate, and the extracted pictures are determined as pictures to be transmitted, and each picture to be transmitted is transmitted in reverse order to the sending device corresponding to the reverse screen transmission instruction according to the time sequence.

[0079] For example, assuming that the frame rate of the current screen image stream is 30 frames per second and the preset frame rate is 20 frames per second, 20 frames can be evenly extracted from the 30 frames per second corresponding to the current screen image stream as the images to be transmitted.

[0080] S208. Determine each frame in the current screen image stream as a picture to be transmitted, and according to the reception time of each reverse screen transmission instruction, cyclically transmit each picture to be transmitted to the sending device corresponding to each reverse screen transmission instruction, and execute S209.

[0081] Specifically, when it is determined that the number of instructions is greater than or equal to the preset number threshold, it can be considered that the number of sending devices that need to perform reverse screen transmission is large. In order to ensure that each sending device can receive the reverse screen transmission from the receiving device, and the received content will change with the high-speed switching of the screen, each frame in the current screen stream can be determined as a to-be-transmitted screen. According to the reception time of each reverse screen transmission instruction, the order in which the sending devices corresponding to each reverse screen transmission instruction need to receive the reverse screen transmission is determined, and then each to-be-transmitted screen is sent to each sending device in a cyclic manner according to the time sequence in a transmission mode of one frame of to-be-transmitted screen for each sending device, so that the reverse screen transmission screen received in each sending device will be refreshed over time. This ensures the uniformity of the reverse screen transmission screen received in each sending device, and reduces the bandwidth occupied by the reverse screen transmission for each sending device.

[0082] It is understandable that when in high-speed switching screen transmission mode, the frequency of switching of the picture content in the current screen image stream displayed by the receiving device is very high. In the paperless office scenario, the attention of the holder of the sending device is mostly focused on the picture displayed by the receiving device, and only a relatively low-frequency refresh needs to be ensured in each sending device. Therefore, the method of cyclically sending each picture to be transmitted to different sending devices in the embodiment of the present invention is sufficient to meet actual user needs.

[0083] Optional, Figure 4 A flowchart of a second embodiment of the present invention is provided for cyclically transmitting each to-be-transmitted screen to a sending device corresponding to each reverse screen transmission instruction according to the reception time of each reverse screen transmission instruction, such as Figure 4 As shown, the specific steps include:

[0084] S2081. Sort the sending devices corresponding to each reverse screen transmission instruction according to the reception time of each reverse screen transmission instruction.

[0085] S2082, cyclically transmitting each picture to be transmitted to each sending device according to the sorting order.

[0086] The pictures to be transmitted received by two sending devices with adjacent sorting orders are two pictures to be transmitted with adjacent time order.

[0087] Exemplarily, when the number of instructions is greater than or equal to the preset number threshold, it can be considered that the number of sending devices that need to perform reverse screen transmission is large, and the current bandwidth cannot support the reverse screen transmission of the sending device corresponding to the reverse screen transmission instruction at a higher frame rate in the high-speed switching mode. At this moment, the receiving device sends each picture to be transmitted to each sending device one by one. Assuming that in a paperless office scenario, a receiving device supports reverse screen transmission to a maximum of 15 sending devices at the same time, and there are 60 frames of pictures in 1 second in the current screen picture stream, the 15 sending devices can be sorted according to the receiving time of each reverse screen transmission instruction received by the receiving device, and the first frame of the picture to be transmitted corresponding to the current screen picture stream is transmitted to the first sending device in the sorting, and the second frame of the picture to be transmitted is transmitted to the second sending device in the sorting, and the cycle is repeated until all the pictures to be transmitted are sent. Based on the above situation where a maximum of 15 sending devices are connected, each sending device can obtain 4 frames of pictures in 1 second.

[0088] S209: Obtain the maximum value and the minimum value of the previous picture in the screen picture stream corresponding to the previous cycle.

[0089] Specifically, since the situation of the screen image stream corresponding to the previous cycle is known in the current cycle, the maximum size and minimum size of each frame in the screen image stream corresponding to the previous cycle can be determined and determined as the maximum value and minimum value of the previous image respectively.

[0090] Optionally, when the current cycle is the first cycle, the maximum picture size in the current screen picture stream corresponding to the current cycle can be determined as the maximum value of the previous picture, and the minimum picture size in the current screen picture stream can be determined as the minimum value of the previous picture.

[0091] S210: Determine a screen switching state standard value according to a basic screen size, a maximum value of a previous screen, and a minimum value of a previous screen.

[0092] In this embodiment, the screen switching state standard value can be specifically understood as a standard value used to determine whether high-speed screen switching is performed in the screen picture flow.

[0093] Specifically, the ratio of the maximum value of the previous screen to the minimum value of the previous screen is determined as the screen size ratio, and the product of the sum of the screen size ratio plus one and the basic screen size is determined as the screen switching state standard value. That is, the method for determining the screen switching state standard value can be expressed by the following formula:

[0094] A=(m*(n+1))

[0095] Wherein, n is the screen size ratio, m is the basic screen size, and A is the standard value of the screen switching state.

[0096] S211. Determine the picture size of each frame in the current screen picture stream. If the picture sizes are all larger than the standard value of the screen switching state, determine the target screen transmission mode of the next cycle as the high-speed switching screen transmission mode; otherwise, determine the target screen transmission mode of the next cycle as the initial screen transmission mode.

[0097] Specifically, since the standard value of the screen switching state represents the demarcation standard for judging static images and dynamic images, when software operations or video playback occur, the screen changes more frequently, which will cause the size of each frame to reach several times that of the static image. Therefore, the screen size of each frame in the current screen screen stream can be determined, and each screen size can be compared with the standard value of the screen switching state. If the screen sizes in the current cycle are all larger than the standard value of the screen switching state, it can be considered that the content displayed in the receiving device in the current cycle has undergone a high-speed screen switching. In order to avoid missing screen transmission, the target screen transmission mode of the next cycle can be determined as a high-speed switching screen transmission mode, so that the next cycle can complete the reverse screen transmission task for each sending device according to the high-speed switching screen transmission mode; and if the screen sizes in the current cycle are not all larger than the standard value of the screen switching state, it can be considered that the content displayed in the receiving device in the current cycle is not frequently switched, and there is no need to send the screen displayed in the receiving device to the sending device at a higher frame rate, which occupies a large bandwidth and device performance. At this time, the target screen transmission mode of the next cycle can be determined as the initial screen transmission mode to reduce the transmission of unnecessary pictures and save the device performance of the receiving device.

[0098] Furthermore, after the initial screen to be transmitted is transmitted in reverse to the sending device corresponding to the reverse screen transmission instruction, it also includes: when receiving the annotation instruction, determining the target screen transmission mode of the current cycle as the high-speed switching screen transmission mode.

[0099] Specifically, when executing the reverse screen transmission task, it is necessary to first complete the reverse transmission of the screen corresponding to the moment of command reception when the reverse screen transmission instruction is received. After that, in addition to completing the determination of the target screen transmission mode of the next cycle based on the size of the screen image stream in each cycle, it is also necessary to constantly monitor whether the annotation instruction given by the sending device has been received. Since the sending device will control the receiving device to display the screen information of the received annotation after issuing the annotation instruction, and the annotation is parsed in real time, that is, after receiving the annotation instruction, the screen displayed by the receiving device will enter high-speed switching. At this time, the target screen transmission mode of the corresponding cycle when the annotation instruction is received can be determined as the high-speed switching screen transmission mode to ensure that the annotation content can be timely reversely transmitted to the sending device.

[0100] The technical solution of this embodiment determines the target screen transmission mode according to the size of the screen image in the current cycle and the reception of the annotation instruction, so that the receiving device can select the appropriate target screen transmission mode for reverse transmission of the image according to different usage scenarios. For the initial screen transmission mode, by analyzing the size change relationship between different frames in the current image stream corresponding to the current cycle, the images to be transmitted corresponding to the application switching operation in the current image stream are determined, and the images in the current image stream that have not changed significantly are filtered in the initial screen transmission mode, thereby reducing the number of images to be transmitted that need to be reversely transmitted. For high-speed switching screen transmission mode, the number of sending devices that need to perform reverse screen transmission at the same time is determined according to the number of reverse screen transmission instructions received by the receiving device. When the number of sending devices is small and meets the bandwidth and device performance requirements, the screen to be transmitted with a fixed frame rate can be transmitted to the sending device to ensure the continuity of the screen received by each sending device; when the number of sending devices is large, if a large number of screens are transmitted to each sending device, it will affect the execution of the main functions of the receiving device and it is difficult to meet the bandwidth requirements. By cyclically transmitting each frame of the current screen image stream to different sending devices according to the receiving time of the reverse screen transmission instruction, it is ensured that each sending device can display the key screen while reducing the number of screens that need to be transmitted to each sending device. For different usage scenarios, different scene requirements are determined according to the changes in the screen size, and different types of target screen transmission modes are adopted. Under the condition of meeting the device performance and bandwidth requirements, the acquisition of effective information of each sending device is guaranteed, the transmission of invalid screen images is avoided, and the amount of data required for reverse screen transmission for each sending device is reduced, the device capacity utilization rate is improved, and the reverse screen transmission of multiple sending devices is realized at the same time without affecting the normal core functions of the receiving device.

[0101] Embodiment 3

[0102] Figure 5 A schematic diagram of the structure of a reverse screen transmission device provided in the third embodiment of the present invention is shown in FIG. Figure 5 As shown, the reverse screen transmission device includes: an initial picture transmission module 31, a periodic picture transmission module 32 and a screen transmission mode determination module 33.

[0103] Among them, the initial picture transmission module 31 is used to obtain the screen picture stream in real time from the receipt of the reverse screen transmission instruction, determine the first frame picture in the screen picture stream corresponding to the moment of receiving the reverse screen transmission instruction as the initial picture to be transmitted, and reversely transmit the initial picture to be transmitted to the sending device corresponding to the reverse screen transmission instruction; the periodic picture transmission module 32 is used to determine the picture to be transmitted in the current screen picture stream corresponding to the current period according to the target screen transmission mode of the current period, and reversely transmit the picture to be transmitted; the screen transmission mode determination module 33 is used to determine the picture size of each frame in the current screen picture stream, and determine the target screen transmission mode of the next period according to the basic picture size and each picture size; the basic picture size is the picture size with the highest proportion in the screen picture stream; wherein, the target screen transmission mode includes the initial screen transmission mode and the high-speed switching screen transmission mode; when the current period is the first period, the target screen transmission mode is the initial screen transmission mode.

[0104] The technical solution of this embodiment, after initially receiving the reverse screen transmission instruction, immediately transmits the first frame of the picture corresponding to the instruction reception moment, determines different target screen transmission modes based on the real-time acquisition of the change of the picture size in the screen picture stream, and implements the screening of the pictures in the screen picture stream within the corresponding period under different target screen transmission modes, realizes the determination of different scene requirements according to the change of the picture size, and adjusts the reverse screen transmission method according to the requirements of different scenes, avoids the transmission of invalid screen pictures, reduces the amount of data required for reverse screen transmission for each sending device, avoids excessive occupation of device performance and bandwidth, improves the utilization rate of device capacity, and thus can realize reverse screen transmission for multiple sending devices at the same time without affecting the use of the normal core functions of the receiving device, meeting the needs of paperless conference room office.

[0105] Optionally, when the target screen transmission mode is the initial screen transmission mode, the periodic screen transmission module 32 includes:

[0106] A first picture determination unit, configured to determine a first target picture according to a picture size change relationship of each frame picture in a current picture stream;

[0107] The second picture determination unit is used to determine the first target picture and the last frame picture in the current screen picture stream as pictures to be transmitted.

[0108] Optionally, the first picture determination unit is specifically configured to:

[0109] Dividing the current screen picture stream into at least two adjacent frame groups according to a time relationship;

[0110] For each adjacent frame group, if the picture size change ratio is greater than a preset ratio threshold, the second frame picture in the adjacent frame group is determined as the first target picture.

[0111] Optionally, when the target screen transmission mode is the high-speed switching screen transmission mode, the periodic screen transmission module 32 includes:

[0112] An instruction quantity determination unit, used to determine the instruction quantity of the reverse screen transmission instruction;

[0113] A first picture transmission unit is used to determine the pictures extracted from the current screen picture stream according to the preset frame rate as the pictures to be transmitted if the number of instructions is less than a preset number threshold, and to reversely transmit the pictures to be transmitted to the sending devices corresponding to each reverse screen transmission instruction respectively;

[0114] The second picture transmission unit is used to determine each frame of the current screen picture stream as a picture to be transmitted if the number of instructions is greater than or equal to a preset number threshold, and cyclically transmit each picture to be transmitted to the sending device corresponding to each reverse screen transmission instruction according to the reception time of each reverse screen transmission instruction.

[0115] Optionally, the second picture transmission unit is specifically used to:

[0116] According to the receiving time of each reverse screen transmission instruction, the sending devices corresponding to each reverse screen transmission instruction are sorted;

[0117] Cyclic transmission of each picture to be transmitted to each sending device according to the sorting order;

[0118] The pictures to be transmitted received by two sending devices with adjacent sorting orders are two pictures to be transmitted with adjacent time order.

[0119] Optionally, the screen transmission mode determination module 33 includes:

[0120] A picture value acquisition unit, used to acquire a previous picture maximum value and a previous picture minimum value in a screen picture stream corresponding to a previous cycle;

[0121] A standard value determination unit, used to determine a screen switching state standard value according to a basic screen size, a maximum value of a previous screen, and a minimum value of a previous screen;

[0122] The screen transmission mode determination unit is used to determine the picture size of each frame in the current screen picture stream. If the picture sizes are all larger than the standard value of the screen switching state, the target screen transmission mode of the next cycle is determined as the high-speed switching screen transmission mode; otherwise, the target screen transmission mode of the next cycle is determined as the initial screen transmission mode.

[0123] Optionally, after the initial screen to be transmitted is transmitted in reverse to a sending device corresponding to the reverse screen transmission instruction, the method further includes:

[0124] When the annotation instruction is received, the target screen transmission mode of the current cycle is determined to be the high-speed switching screen transmission mode.

[0125] The reverse screen transmission device provided in the embodiment of the present invention can execute the reverse screen transmission method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0126] Embodiment 4

[0127] Figure 6 A schematic diagram of the structure of a reverse screen transmission device provided for Embodiment 4 of the present invention. The reverse screen transmission device 40 may be an electronic device, intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are provided as examples only and are not intended to limit the implementation of the present invention described and / or claimed herein.

[0128] like Figure 6 As shown, the reverse screen transmission device 40 includes at least one processor 41, and a memory connected to the at least one processor 41, such as a read-only memory (ROM) 42, a random access memory (RAM) 43, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 41 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 42 or the computer program loaded from the storage unit 48 to the random access memory (RAM) 43. In the RAM 43, various programs and data required for the operation of the reverse screen transmission device 40 can also be stored. The processor 41, the ROM 42, and the RAM 43 are connected to each other through a bus 44. An input / output (I / O) interface 45 is also connected to the bus 44.

[0129] Multiple components in the reverse screen transmission device 40 are connected to the I / O interface 45, including: an input unit 46, such as a keyboard, a mouse, etc.; an output unit 47, such as various types of displays, speakers, etc.; a storage unit 48, such as a disk, an optical disk, etc.; and a communication unit 49, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 49 allows the reverse screen transmission device 40 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0130] The processor 41 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 41 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 41 executes the various methods and processes described above, such as the reverse screen transmission method.

[0131] In some embodiments, the reverse screen transmission method can be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 48. In some embodiments, part or all of the computer program can be loaded and / or installed on the reverse screen transmission device 40 via the ROM 42 and / or the communication unit 49. When the computer program is loaded into the RAM 43 and executed by the processor 41, one or more steps of the reverse screen transmission method described above can be performed. Alternatively, in other embodiments, the processor 41 can be configured to perform the reverse screen transmission method in any other appropriate manner (for example, by means of firmware).

[0132] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0133] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0134] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0135] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0136] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0137] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0138] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0139] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A reverse screen transmission method, characterized in that: include: Starting from receiving the reverse screen transmission instruction, the screen image stream is acquired in real time, the first frame image in the screen image stream corresponding to the time when the reverse screen transmission instruction is received is determined as the initial image to be transmitted, and the initial image to be transmitted is transmitted in reverse to the sending device corresponding to the reverse screen transmission instruction; According to the target screen transmission mode of the current cycle, determine the picture to be transmitted in the current screen picture stream corresponding to the current cycle, and transmit the picture to be transmitted in reverse direction; Determine the picture size of each frame in the current screen picture stream, and determine the target screen transmission mode of the next cycle according to the basic picture size and each of the picture sizes; the basic picture size is the picture size with the highest proportion in the screen picture stream; Among them, the target screen transmission mode includes an initial screen transmission mode and a high-speed switching screen transmission mode; when the current cycle is the first cycle, the target screen transmission mode is the initial screen transmission mode.

2. The method according to claim 1, characterized in that When the target screen transmission mode is the initial screen transmission mode, determining the picture to be transmitted in the current screen picture stream corresponding to the current cycle includes: Determining a first target picture according to a picture size change relationship of each frame picture in the current picture stream; The first target picture and the last frame picture in the current screen picture stream are determined as pictures to be transmitted.

3. The method according to claim 2, characterized in that The determining the first target picture according to the picture size change relationship of each frame picture in the current picture stream includes: Dividing the current screen picture stream into at least two adjacent frame groups according to a time relationship; For each of the adjacent frame groups, if the picture size change ratio is greater than a preset ratio threshold, the second frame picture in the adjacent frame group is determined as the first target picture.

4. The method according to claim 1, characterized in that When the target screen transmission mode is the high-speed switching screen transmission mode, determining the picture to be transmitted in the current screen picture stream corresponding to the current cycle, and reversely transmitting the picture to be transmitted, includes: Determine the instruction quantity of the reverse screen transmission instruction; If the number of instructions is less than a preset number threshold, the pictures extracted from the current screen picture stream according to the preset frame rate are determined as the pictures to be transmitted, and the pictures to be transmitted are respectively transmitted in reverse to the sending devices corresponding to the reverse screen transmission instructions; If the number of instructions is greater than or equal to a preset threshold, each frame in the current screen image stream is determined as a image to be transmitted, and according to the reception time of each reverse screen transmission instruction, each image to be transmitted is cyclically transmitted to the sending device corresponding to each reverse screen transmission instruction.

5. The method according to claim 4, characterized in that The method of cyclically transmitting each of the to-be-transmitted pictures to a sending device corresponding to each of the reverse screen transmission instructions according to the reception time of each of the reverse screen transmission instructions comprises: According to the reception time of each reverse screen transmission instruction, the sending devices corresponding to each reverse screen transmission instruction are sorted; Circularly transmitting the to-be-transmitted pictures to the sending devices according to the sorting order; The pictures to be transmitted received by the two sending devices that are adjacent in sorting order are two pictures to be transmitted that are adjacent in time order.

6. The method according to claim 1, characterized in that The step of determining the picture size of each frame in the current screen picture stream, and determining the target screen transmission mode of the next cycle according to the basic picture size and each of the picture sizes, includes: Get the maximum value and the minimum value of the previous picture in the screen picture stream corresponding to the previous cycle; Determining a screen switching state standard value according to the basic screen size, the previous screen maximum value, and the previous screen minimum value; Determine the picture size of each frame in the current screen picture stream. If each of the picture sizes is larger than the standard value of the screen switching state, determine the target screen transmission mode of the next cycle as the high-speed switching screen transmission mode; otherwise, determine the target screen transmission mode of the next cycle as the initial screen transmission mode.

7. The method according to any one of claims 1 to 6, characterized in that: After the initial screen to be transmitted is transmitted in reverse to the sending device corresponding to the reverse screen transmission instruction, the method further includes: When the annotation instruction is received, the target screen transmission mode of the current cycle is determined to be the high-speed switching screen transmission mode.

8. A reverse screen transmission device, characterized in that: include: An initial picture transmission module is used to acquire a screen picture stream in real time starting from receiving a reverse screen transmission instruction, determine the first frame of the screen picture stream corresponding to the moment of receiving the reverse screen transmission instruction as an initial picture to be transmitted, and reversely transmit the initial picture to be transmitted to a sending device corresponding to the reverse screen transmission instruction; A periodic picture transmission module, used for determining the picture to be transmitted in the current screen picture stream corresponding to the current period according to the target screen transmission mode of the current period, and transmitting the picture to be transmitted in reverse direction; A screen transmission mode determination module, used to determine the screen size of each frame in the current screen picture stream, and determine the target screen transmission mode of the next cycle according to the basic picture size and each of the picture sizes; the basic picture size is the picture size with the highest proportion in the screen picture stream; Among them, the target screen transmission mode includes an initial screen transmission mode and a high-speed switching screen transmission mode; when the current cycle is the first cycle, the target screen transmission mode is the initial screen transmission mode.

9. A reverse screen transmission device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the reverse screen transmission method described in any one of claims 1-7.

10. A storage medium containing computer executable instructions, characterized in that: The computer executable instructions are used to execute the reverse screen transmission method as described in any one of claims 1 to 7 when executed by a computer processor.

Images