Screen transmission method and device, equipment and storage medium

Abstract

The embodiment of the invention discloses a screen transmission method and device, equipment and a storage medium, a screen transmission device responds to a screen transmission instruction, a first attribute information table is sent to sending equipment, so that the sending equipment confirms target screen attribute information closest to the first screen attribute information from the first attribute information table, and the target screen attribute information is sent to the sending equipment. The first screen attribute information is screen attribute information of the sending equipment; receiving a first screen transmission picture which is sent by the sending equipment and is generated according to the target screen attribute information, and sending the first screen transmission picture to the receiving equipment; obtaining first screen attribute information, and comparing the first screen attribute information with the first attribute information table; if the first attribute information table does not contain the first screen attribute information, the first screen attribute information is updated and recorded into the first attribute information table, hot plug is triggered, the screen transmission instruction is responded again, and the updated first attribute information table is sent to the sending device, so that the problem that the user experience is poor can be solved, and the user experience is improved.

Description

Technical Field

[0001] Embodiments of the present application relate to the technical field of screen mirroring, and in particular, to a screen mirroring method, apparatus, device, and storage medium. Background Art

[0002] With the development of Internet technology and computer technology, different electronic devices can share screen images through screen mirroring technology. Among them, the electronic device used for screen mirroring is called the sending device, and the electronic device receiving the screen mirroring is called the receiving device. The sending device and the receiving device perform screen mirroring through a screen mirroring device.

[0003] Each electronic device's screen has screen attribute information, and the screen attribute information of different electronic devices may be different. When performing screen mirroring through a screen mirroring device between electronic devices with different screen attribute information, there are generally black borders on the screen image displayed on the sending device.

[0004] In the related art, to eliminate the black borders on the screen image displayed on the sending device, it usually manually changes the display attribute information of the sending device to the screen attribute information of the sending device itself to achieve full-screen display on the sending device. This way of manually adjusting the display attribute information of the sending device requires the user to manually adjust each time for screen mirroring, resulting in a poor user experience. Summary of the Invention

[0005] Embodiments of the present application provide a screen mirroring method, apparatus, device, and storage medium, which can solve the problem of poor user experience, achieve full-screen display of the sending device, and improve the user experience.

[0006] In a first aspect, an embodiment of the present application provides a screen mirroring method for a screen mirroring device, and the method includes:

[0007] In response to a screen mirroring instruction, send a first attribute information table to the sending device, so that the sending device confirms the target screen attribute information closest to the first screen attribute information from the first attribute information table. The first attribute information table includes the screen attribute information pre-recorded by the screen mirroring device, and the first screen attribute information is the screen attribute information of the sending device;

[0008] Receive the first screen mirroring image sent by the sending device, and send the first screen mirroring image to the receiving device. The first screen mirroring image is generated by the sending device according to the target screen attribute information;

[0009] Obtain the first screen attribute information, and compare the first screen attribute information with the first attribute information table;

[0010] If the first attribute information table does not contain the first screen attribute information, update and record the first screen attribute information in the first attribute information table, trigger hot plugging, and re-respond to the screen mirroring instruction to send the updated first attribute information table to the sending device.

[0011] In a second aspect, an embodiment of the present application provides a screen mirroring method for a sending device. The method includes:

[0012] Receiving a first attribute information table sent by a screen mirroring device;

[0013] Confirming target screen attribute information closest to the first screen attribute information according to the first attribute information table, and performing rendering and display according to the target screen attribute information to obtain a first screen mirroring image. The first screen attribute information is the screen attribute information of the sending device;

[0014] Sending the first screen mirroring image to the screen mirroring device.

[0015] In a third aspect, an embodiment of the present application provides a screen mirroring device for a screen mirroring device. The device includes:

[0016] An instruction response module, configured to respond to a screen mirroring instruction and send a first attribute information table to a sending device, so that the sending device confirms target screen attribute information closest to the first screen attribute information from the first attribute information table. The first attribute information table includes screen attribute information pre-recorded by the screen mirroring device, and the first screen attribute information is the screen attribute information of the sending device;

[0017] A screen mirroring module, configured to receive a first screen mirroring image sent by the sending device and send the first screen mirroring image to a receiving device. The first screen mirroring image is generated by the sending device according to the target screen attribute information;

[0018] An attribute information comparison module, configured to obtain the first screen attribute information and compare the first screen attribute information with the first attribute information table;

[0019] A hot plugging module, configured to, if the first attribute information table does not contain the first screen attribute information, update and record the first screen attribute information in the first attribute information table, trigger hot plugging, and re-respond to the screen mirroring instruction to send the updated first attribute information table to the sending device.

[0020] In a fourth aspect, an embodiment of the present application provides a screen mirroring device, including:

[0021] A memory and one or more processors;

[0022] The memory is configured to store one or more programs;

[0023] When one or more programs are executed by one or more processors, the one or more processors implement the screen mirroring method as described in the first aspect or the second aspect.

[0024] In a fifth aspect, an embodiment of the present application provides a storage medium storing computer-executable instructions, which are used to execute the screen mirroring method as described in the first aspect or the second aspect when executed by a computer processor.

[0025] In the embodiment of the present application, the screen mirroring device responds to the screen mirroring instruction to send the first attribute information table to the sending device. After receiving the first screen mirroring image generated by the sending device according to the target screen information closest to the first screen attribute information in the first attribute information table, the first screen attribute information of the sending device is obtained. When the first attribute information table does not contain the first screen attribute information, the first screen attribute information is updated and recorded in the first attribute information table, and hot plugging is triggered. Then, in response to the screen mirroring instruction again, the updated first attribute information table is sent to the sending device. By adopting the above technical means, the first screen attribute information of the sending device can be obtained by the screen mirroring device. When the first attribute information table does not contain the first screen attribute information, the first screen attribute information is updated and recorded in the first attribute information table, hot plugging is triggered, and the updated first attribute information table is sent to the sending device in response to the screen mirroring instruction again, so that the sending device can confirm the corresponding first screen attribute information in the first attribute information table as the target attribute information, and generate the corresponding first screen mirroring image based on the target attribute information, thereby solving the problem of poor user experience, realizing that the sending device can automatically perform full-screen display according to the first screen attribute information during screen mirroring, avoiding the display screen of the sending device from having black edges and affecting the user's visual perception, and thus improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 is a schematic diagram of screen mirroring display in a related art provided by an embodiment of the present application;

[0027] Figure 2 is a flowchart of a screen mirroring method provided by an embodiment of the present application;

[0028] Figure 3 is a schematic diagram of the first attribute information table provided by an embodiment of the present application;

[0029] Figure 4 is a schematic diagram of the interface connection between the screen mirroring device and the sending device provided by an embodiment of the present application;

[0030] Figure 5 is a schematic diagram of screen mirroring display provided by an embodiment of the present application;

[0031] Figure 6 is a flowchart of another screen mirroring method provided by an embodiment of the present application;

[0032] Figure 7 It is a schematic structural diagram of a screen transmission device provided by an embodiment of the present application;

[0033] Figure 8 It is a schematic structural diagram of another screen transmission device provided by an embodiment of the present application;

[0034] Figure 9 It is a schematic structural diagram of a screen transmission device provided by an embodiment of the present application. Detailed implementation manners

[0035] In order to make the objectives, technical solutions and advantages of the present application clearer, the following further describes the specific embodiments of the present application in detail with reference to the accompanying drawings. It can be understood that the specific embodiments described herein are only used to explain the present application, rather than limiting the present application. Additionally, it should be noted that for the convenience of description, only parts related to the present application are shown in the drawings rather than all the content. Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe the operations (or steps) as sequential processes, many of the operations can be implemented in parallel, concurrently or simultaneously. In addition, the order of the operations can be rearranged. When the operations are completed, the process can be terminated, but there may also be additional steps not included in the drawings. The process can correspond to a method, function, procedure, subroutine, subprogram, etc.

[0036] With the continuous development of screen transmission technology and the continuous update and iteration of electronic devices, in the related art, screen transmission is performed through a screen transmitter with a Type-C interface. This screen transmitter with a Type-C interface accesses the sending device in the form of a DP (DisplayPort, a high-definition digital display interface standard) monitor through the digital interface standard (USB-C DisplayPort (DP Alt Mode)), and obtains the screen image of the sending device and transmits the screen to the receiving device for display by copying the screen.

[0037] In the related art, when an electronic device is connected to an external display, such as a DP display, the electronic device is default to adapt to the screen attribute information (such as resolution and aspect ratio) of the external display. When a screen transmitter with a Type-C interface is connected to a sending device in the manner of a DP display, it is default that the sending device will adapt to the screen attribute information supported inside the screen transmitter, and the screen attribute information supported inside the screen transmitter is the screen attribute information of the receiving device recorded in advance. Therefore, it is default that the sending device will adapt to the screen attribute information of the receiving device. Then, when the screen attribute information of the receiving device is different or mismatched with the screen attribute information of the sending device, there are generally black edges in the screen image displayed by the sending device itself during the screen transmission process to adapt to the full-screen display of the receiving device. Figure 1 is a schematic diagram of screen transmission and display in a related art provided by an embodiment of the present application. Refer to Figure 1 , when the screen attribute information of the receiving device 12 is a resolution of 3840×2160 and the screen attribute information of the sending device 11 is a resolution of 1512×982, when the sending device 11 and the receiving device 12 perform screen transmission through the screen transmitter 10, the sending device 11 adapts to the screen attribute information of the receiving device 12, and the picture will be scaled, resulting in black edges in the display picture of the sending device. Since the sharer generally views the display picture of the sending device 11 for sharing, when the sending device 11 scales the picture to generate black edges, it will affect the viewing experience of the sharer, and when the picture scaling is serious, it will also affect the normal viewing of the sharer. To eliminate the black edges on the screen image displayed on the sending device 11, it usually changes the display attribute information of the sending device 11 to the screen attribute information of the sending device 11 itself manually to achieve full-screen display on the sending device 11. This way of manually adjusting the display attribute information of the sending device 11 requires the user to manually adjust each time for screen mirroring, and the user experience is poor.

[0038] The screen mirroring method, device, equipment and storage medium provided by this application are designed to, during screen mirroring, obtain the first screen attribute information of the sending device through a screen mirroring device, and when the first attribute information table does not contain the first screen attribute information, update and record the first screen attribute information in the first attribute information table, trigger hot plugging and re-respond to the screen mirroring instruction to send the updated first attribute information table to the sending device, so that the sending device can confirm the corresponding first screen attribute information in the first attribute information table as the target attribute information, and generate a corresponding first screen mirroring image based on the target attribute information, thereby enabling the sending device to automatically perform full-screen display according to the first screen attribute information during screen mirroring, avoiding the appearance of black edges in the display image of the sending device and affecting the user's visual experience, and improving the user experience. Compared with the traditional screen mirroring method, it manually changes the display attribute information of the sending device to the screen attribute information of the sending device itself to achieve full-screen display on the sending device. This method of manually adjusting the display attribute information of the sending device requires the user to manually adjust each time for screen mirroring, resulting in a poor user experience. Based on this, the screen mirroring method of the embodiments of this application is provided to solve the problem of poor user experience in the existing screen mirroring process.

[0039] Figure 2 The flowchart of a screen mirroring method provided by an embodiment of this application is given. The screen mirroring method provided in this embodiment can be executed by a screen mirroring device. The screen mirroring device can be implemented in software and / or hardware. The screen mirroring device can be composed of two or more physical entities or one physical entity. Generally speaking, the screen mirroring device can be a screen mirroring device such as a screen mirroring transmitter.

[0040] The following takes the screen mirroring transmitter as the main body for executing the screen mirroring method as an example for description. Refer to Figure 2 , this screen mirroring method is for a screen mirroring transmitter, and this screen mirroring method specifically includes:

[0041] S101. In response to the screen mirroring instruction, send the first attribute information table to the sending device, so that the sending device can confirm the target screen attribute information closest to the first screen attribute information from the first attribute information table. The first attribute information table includes the screen attribute information pre-recorded by the screen mirroring transmitter, and the first screen attribute information is the screen attribute information of the sending device.

[0042] Screen mirroring can be understood as sharing the screen image of a sending device to a receiving device through a screen mirroring device, so as to achieve screen sharing between different electronic devices. The screen mirroring device provided in this embodiment is a screen mirroring device with a Type-c interface, an HDMI interface, and / or a DP interface. When such an interface screen mirroring device is inserted into the sending device, it is connected to the sending device in the manner of a DP monitor. By default, the sending device will adapt to the screen attribute information supported inside the screen mirroring device. The screen mirroring device stores a first attribute information table, which can be understood as the screen attribute information that the screen mirroring device itself can support for screen mirroring. These screen attribute information are obtained by pairing or connecting with the receiving device or the sending device.

[0043] Before screen mirroring, it is necessary to pair the screen mirroring device with the receiving device. The pairing can be performed through a wired connection or a wireless communication method. If the pairing is performed through a wired connection method, a corresponding pairing instruction is generated based on the insertion operation of the screen mirroring device. If the pairing is performed through a wireless method, a corresponding pairing instruction is generated based on the successful wireless communication connection between the screen mirroring device and the receiving device. The screen mirroring device responds to the pairing instruction and performs the pairing process with the receiving device. After the screen mirroring device and the receiving device are successfully paired, the screen mirroring device obtains the second screen attribute information of the receiving device and updates and records the second screen attribute information in the first attribute information table.

[0044] It should be noted that when the screen mirroring device is used for the first time for pairing, the first attribute information table stored in itself is empty. After the screen mirroring device is successfully paired with the receiving device for the first time, the obtained second screen attribute information is added to the first attribute information table. At this time, only the second screen attribute information corresponding to the receiving device of this pairing exists in the first attribute information table.

[0045] It should be noted that the number of the second screen attribute information of the receiving device can be multiple, such as 1920x1080 and 3840x2160. Therefore, multiple corresponding screen attribute information are recorded in the first attribute information table, such as recording 1920x1080 and 3840x2160.

[0046] The first screen attribute information is the screen attribute information of the sending device. When the sending device displays according to the first screen attribute information, it can be full-screen displayed. The screen mirroring instruction can be understood as an instruction triggered by the user based on the screen mirroring requirement. The screen mirroring instruction can be triggered by the user's control operation on the screen mirroring device, or by the user's interaction input with the sending device. When the screen mirroring instruction is triggered, the screen mirroring device responds to the screen mirroring instruction and sends the first attribute information table stored in itself to the sending device, so that the sending device can confirm the target attribute information closest to the first screen information from the first attribute information table. As described above, after the screen mirroring device responds to the screen mirroring instruction and sends the first attribute information table to the sending device, the sending device can select the target screen attribute information closest to its own first screen attribute information for screen mirroring display, avoiding the large difference between the screen parameter information of the screen mirroring picture and the first screen attribute information, which affects the viewing experience, thereby improving the user's viewing experience.

[0047] It should be noted that when the first screen attribute information exists in the first attribute information table, the sending device confirms the first screen attribute information as the target screen attribute information.

[0048] S102. Receive the first screen mirroring picture sent by the sending device and send the first screen mirroring picture to the receiving device. The first screen mirroring picture is generated by the sending device according to the target screen attribute information.

[0049] After the sending device confirms the target screen attribute information, it generates the first screen mirroring picture according to the target screen attribute information and transmits the first screen mirroring picture to the screen mirroring device for screen mirroring. The screen mirroring device receives the first screen mirroring picture sent by the sending device and sends the first screen mirroring picture to the receiving device, so that the receiving device can display the corresponding screen mirroring picture to realize the screen mirroring function of the screen mirroring device.

[0050] It should be noted that after the receiving device receives the first screen mirroring picture, it can directly render and display it, or perform corresponding processing on the first screen mirroring picture according to its own screen attribute information and then display it.

[0051] After the screen mirroring device receives the first screen mirroring picture, it obtains the corresponding target screen attribute information according to the first screen mirroring picture and updates the usage times and / or usage time of the corresponding target screen attribute information recorded in the first attribute information table. It can be to increment the usage times of the corresponding target screen attribute information by one and update the recorded usage time. By updating the usage time of the corresponding target screen attribute information, the usage times and the most recent usage time corresponding to each screen attribute information can be recorded in the first attribute information table, which is convenient for subsequent addition, deletion, and processing of the corresponding screen attribute information, improving the management flexibility and practicality of the first attribute information table.

[0052] S103. Obtain the first screen attribute information and compare the first screen attribute information with the first attribute information table.

[0053] After the screen transmitter responds to the screen transmission instruction, obtain the first screen attribute information of the sending device. The screen transmitter can send a retrieval request to the sending device, and the sending device sends its own first screen attribute information to the screen transmitter based on the retrieval request, enabling the screen transmitter to obtain the first screen attribute information. It is also possible to write the first screen attribute information of the sending device itself into the screen transmitter through the screen transmission client running on the sending device through the corresponding port, enabling the screen transmitter to obtain the first screen attribute information.

[0054] After the screen transmitter obtains the first screen attribute information of the sending device, compare the first screen attribute information with the first attribute information table to determine whether the first screen attribute information exists in the first attribute information table. When it is determined that the first screen attribute information exists in the first attribute information table, it is necessary to perform an update process on the first attribute information table (update the usage times and usage time of the first screen attribute information). At the same time, it also indicates that the target screen attribute information confirmed by the aforementioned sending device from the first attribute information table is the first screen attribute information, and the sending device performs full-screen display according to its own first screen attribute information. When it is determined that the first attribute information table does not contain the first screen attribute information, it indicates that there may be picture compression or black edges in the display picture of the corresponding sending device when the first screen transmission picture is transmitted. Therefore, it is necessary to perform an update process on the first attribute information table and update and record the first screen attribute information in the first attribute information table to obtain the updated first attribute information table. As described above, by comparing the first screen attribute information with the first attribute table, when the first screen attribute information does not exist in the first attribute information table, the first screen attribute information is updated and recorded in the first attribute information table, so that the subsequent sending device can determine the corresponding first screen attribute information as the target screen attribute information according to the updated first attribute information table, so as to achieve full-screen display of the subsequent screen picture on the sending device, avoid the appearance of black edges and affect the viewing experience, and improve the user viewing experience.

[0055] In one embodiment, since the storage space of each screen transmitter is limited, the corresponding upper limit of the number of records in the first attribute information table should also be set, that is, the target number value. When the number of screen attribute information records in the first attribute information table reaches the target number value, at least one screen attribute information record must be deleted before a new screen attribute information record can be added. Therefore, when it is determined that the first attribute information table does not contain the first screen attribute information, the current number of screen attribute information records in the first attribute information table is detected, and it is determined whether the current number of screen attribute information records in the first attribute information table reaches the target number value. If the current number of screen attribute information records in the first attribute information table reaches the target number value, the first screen attribute information is used to replace the screen attribute information with the least usage times or the farthest usage time information from the current time in the first attribute information table, so as to update and record the first screen attribute information in the first attribute information table, and ensure that the number of records in the first attribute information table does not exceed the preset target number value, so as to maintain the normal operation of the screen transmitter. As described above, when the first attribute information table does not contain the first screen attribute information and the current number of screen attribute information records in the first attribute information table reaches the target number value, the first screen attribute information is used to replace the screen attribute information with the least usage times or the farthest usage time information from the current time in the first attribute information table, which can eliminate the screen attribute information with the least usage times or the farthest usage time information from the current time in the first attribute information table, avoid resource waste caused by low-frequency screen attribute information occupying storage space, improve the utilization rate of the first attribute information table, and improve the utilization rate of the storage space of the screen transmitter.

[0056] In one embodiment, after it is determined that the first attribute information table does not contain the first screen attribute information, the current number of screen attribute information records in the first attribute information table is detected. If the current number of screen attribute information records in the first attribute information table has not reached the target number value, the first screen attribute information is directly added as a new record to the first attribute information table to obtain the updated first attribute information table.

[0057] Figure 3 It is a schematic diagram of a first attribute information table provided by an embodiment of the present application. Refer to Figure 3, there are n pieces of screen attribute information recorded in the first attribute information table, and each piece of screen attribute information includes information such as resolution, frame rate, mode, and color space. Exemplarily, for example, the screen attribute information corresponding to record 1 includes resolution: 1512×928, frame rate: 60fps, mode: mirror, color space: XDR Display. The screen attribute information corresponding to record 2 includes resolution: 3000×2000, frame rate: 60fps, mode: mirror, color space: SDR. The screen transmitter records the received screen attribute information until the recorded quantity reaches the corresponding target quantity value, and then replaces the screen attribute information with the least usage times or the farthest usage time information from the current time in the first attribute information table with the newly obtained screen attribute information, so that the current quantity recorded in the first attribute information table is less than or equal to the target quantity value. It should be noted that the same screen attribute information is registered as one record in the first attribute information table.

[0058] It should be noted that the first attribute information table is stored in the form of EDID information.

[0059] The screen transmitter is connected to the sending device through the first interface and the second interface. After the screen transmitter is inserted into the sending device, in response to the screen transmission instruction, the sending device reads the first attribute information table stored in the screen transmitter through the first interface, and selects the target screen attribute information closest to the first screen attribute information from the first attribute information table. The sending device generates the first screen transmission picture according to the selected target screen attribute information, and transmits the first screen transmission picture and the corresponding audio data to the screen transmitter through the first interface. After receiving the first screen transmission picture and the corresponding audio data through the first interface, the screen transmitter performs video encoding and audio encoding processing to obtain the screen transmission data, and sends the screen transmission data to the receiving device through the communication module. The sending device writes the first screen attribute information into the screen transmitter through the second interface, and the screen transmitter updates the first attribute information table according to the received first screen attribute information.

[0060] The first interface can be a Type-c interface, an HDMI interface, and / or a DP interface. In this embodiment, the first interface is taken as an example of a DP interface for illustration. Figure 4 is a schematic diagram of the interface connection between a screen transmitter and a sending device provided by an embodiment of the present application. Refer to Figure 4, the first interface is the DP interface 101, and the second interface is the USB interface 102. The screen mirroring device 10 is connected to the sending device 11 through the DP interface 101 and the USB interface 102. After the screen mirroring device 10 is inserted into the sending device 11, in response to the screen mirroring instruction, the sending device 11 reads the first attribute information table stored in the screen information database 103 in the screen mirroring device 10 through the DP interface 101, and selects the target screen attribute information that is closest to the first screen attribute information from the first attribute information table. The sending device 11 generates the first screen mirroring picture according to the selected target screen attribute information, and transmits the first screen mirroring picture and the corresponding audio data to the screen mirroring device 10 through the DP interface 101. After receiving the first screen mirroring picture and the corresponding audio data through the DP interface 101, the screen mirroring device 10 performs video encoding and audio encoding processing to obtain the screen mirroring data, and sends the screen mirroring data to the receiving device 12 through the communication module 104. The sending device 11 writes the first screen attribute information to the screen information update module 105 in the screen mirroring device 10 through the USB interface 102. After the screen information update module 105 performs deduplication processing, it is written into the screen information database 103 to update the first attribute information table.

[0061] It should be noted that after the screen mirroring device is unplugged and powered off, the data in the screen information database in the screen mirroring device can be persistently stored.

[0062] S104. If the first attribute information table does not contain the first screen attribute information, record the update of the first screen attribute information in the first attribute information table, trigger hot plugging, and re-respond to the screen mirroring instruction to send the updated first attribute information table to the sending device.

[0063] The screen transmitter compares the first screen attribute information with the first attribute information table. If it is determined that the first attribute information table does not contain the first screen attribute information, it indicates that there may be screen compression or black edges in the display screen of the corresponding sending device when transmitting the first screen mirroring screen. Therefore, after the screen transmitter updates and records the first screen attribute information in the first attribute information table, it triggers hot plugging, and then responds to the screen mirroring instruction again. The screen transmitter sends the updated first attribute information table to the sending device based on the new screen mirroring instruction. It should be noted that the updated first attribute information table must include the first screen attribute information. Based on the description in step S101 of the embodiment of the present application, for the sending device, triggering the screen mirroring process and confirming the screen attributes during screen mirroring are necessary operations after receiving the first attribute information table. Correspondingly, after receiving the updated first attribute information table, it is also necessary to select the target screen attribute information closest to the first screen attribute information from the updated first attribute information table. It should be noted that since the first screen attribute information necessarily exists in the updated first attribute information table, the sending device selects the first screen attribute information in the first attribute information table as the target screen attribute information. The sending device generates a new first screen mirroring screen according to the new target screen attribute information, that is, the sending device generates a new first screen mirroring screen according to the first screen attribute information, and transmits the new first screen mirroring screen to the screen transmitter for screen mirroring. Based on the sending device generating a new first screen mirroring screen according to the first screen attribute information, the screen mirroring screen displayed on the sending device is now full-screen display, thus avoiding the situation of screen compression or black edges in the display screen of the sending device and improving the user's viewing experience.

[0064] As described above, when the screen transmitter determines that the first attribute information table does not contain the first screen attribute information, it updates and records the first screen attribute information in the first attribute information table and then triggers hot plugging, and responds to the screen mirroring instruction again, sending the updated first attribute information table to the sending device, enabling the sending device to automatically adjust to full-screen display, avoiding the user manually adjusting the screen attribute information of the sending device, and improving the user experience. In addition, the first screen attribute information has been stored in the first attribute information table of the screen transmitter. In the actual use scenario, based on the sending device usually being fixed, during the next screen mirroring, the sending device can directly select the corresponding first screen attribute information from the first attribute information table to display the screen mirroring screen, achieving full-screen display of the sending device and avoiding the situation of black edges in the display screen of the sending device, thereby improving the user experience.

[0065] Figure 5 is a schematic diagram of screen mirroring display provided by an embodiment of the present application. Refer to Figure 5, when the screen attribute information of the receiving device 12 is a resolution of 3840×2160, after the screen transmitter 10 is successfully paired with the receiving device 12, the screen transmitter 10 obtains the second screen attribute information of the receiving device 12, that is, the resolution 3840×2160, and updates and records the resolution 3840×2160 into the first attribute information table. Assume that only the resolution 3840×2160 is recorded in the current first attribute information table. When the first screen attribute information of the sending device 11 is a resolution of 1512×982, when the screen transmitter 10 is inserted into the sending device 11 and the screen transmission instruction is triggered, the screen transmitter 10 responds to the screen transmission instruction and sends the first attribute information table stored in itself to the sending device 11. Based on the fact that only the resolution 3840×2160 is recorded in the first attribute information table, the sending device 11 selects the resolution 3840×2160 as the target screen attribute information, generates a first screen transmission image according to the resolution 3840×2160, and displays the first screen transmission image on the sending device 11. At this time, since the resolution 3840×2160 does not match the resolution 1512×982 of the sending device 11, the sending device 11 will perform image scaling to generate a first screen transmission image adapted to the resolution 3840×2160, so that when the first screen transmission image is displayed on the sending device 11, there will be black edges on the display screen of the sending device 11 (for example Figure 1 ). The sending device 11 sends the first screen transmission image to the screen transmitter 10, and the screen transmitter 10 receives the first screen transmission image and transmits it to the receiving device 12. At the same time, the screen transmitter 10 obtains the first screen attribute information of the sending device 11, that is, obtains the resolution 1512×982. Since the resolution 1512×982 was not stored in the first attribute information table before, the screen transmitter 10 will update and record the resolution 1512×982 into the first attribute information table, and send the updated first attribute information table to the sending device 11. After receiving the updated first attribute information table, the sending device 11 selects the resolution 1512×982 from the first attribute information table as the target screen attribute information and generates a new first screen transmission image. The new first screen transmission image is as Figure 5As shown in the figure, full-screen display is implemented in the sending device 11. As described above, when the screen attribute information of the receiving device 12 and the sending device 11 is not matched, there will be a short black border on the initial display screen of the sending device 11, but then it will automatically achieve full-screen display, avoiding manual adjustment by the user, improving the automation degree of full-screen display of the sending device 11, and thus enhancing the user experience. Moreover, the amount of data corresponding to the transmission of the screen attribute information is very small, and the screen transmitter 10 can complete reception and update at an extremely fast speed. The duration of the black border on the initial display screen of the sending device 11 is very short, and the user can hardly even notice it. In addition, when the screen transmitter 10 is unplugged, the first attribute information table in the screen transmitter 10 will be persistently stored. When the screen transmitter 10 is inserted into the sending device 11 again and the screen transmission instruction is triggered, the screen transmitter 10 responds to the screen transmission instruction and sends the stored first attribute information table to the sending device 11. Since the resolution 1512×982 is recorded in the first attribute information table, the sending device 11 will select the resolution 1512×982 from the first attribute information table as the target screen attribute information and generate a corresponding screen transmission image according to the resolution 1512×982, so that the sending device 11 can achieve full-screen display during screen transmission and avoid the situation of black borders, further enhancing the user experience.

[0066] As described above, after the screen transmitter responds to the screen transmission instruction and sends the first attribute information table to the sending device, and obtains the first screen attribute information of the sending device after receiving the first screen transmission image generated by the sending device according to the target screen information closest to the first screen attribute information in the first attribute information table, when the first attribute information table does not contain the first screen attribute information, the first screen attribute information is updated and recorded in the first attribute information table, and hot plugging is triggered, and the updated first attribute information table is sent to the sending device again in response to the screen transmission instruction. By adopting the above technical means, the first screen attribute information of the sending device can be obtained through the screen transmitter, and when the first attribute information table does not contain the first screen attribute information, the first screen attribute information is updated and recorded in the first attribute information table, hot plugging is triggered and the updated first attribute information table is sent to the sending device again in response to the screen transmission instruction, so that the sending device can confirm the corresponding first screen attribute information in the first attribute information table as the target attribute information and generate a corresponding first screen transmission image based on the target attribute information, thereby solving the problem of poor user experience, realizing that the sending device can automatically perform full-screen display according to the first screen attribute information during screen transmission, and avoiding the black border on the display screen of the sending device from affecting the user's visual experience, thus enhancing the user experience.

[0067] On the other hand, referring to Figure 6 , another screen transmission method according to an embodiment of the present application is provided. This screen transmission method is executed by the above-mentioned server and is used for the sending device. Specifically, this screen transmission method includes:

[0068] S201. Receive the first attribute information table sent by the screen sharing device.

[0069] When the screen sharing device is inserted into the sending device, the screen sharing device responds to the screen sharing instruction and sends the first attribute information table to the sending device. The specific process of the screen sharing device sending the first attribute information is the same as that of the aforementioned S101 - S104, and will not be elaborated here. The sending device receives the first attribute information table sent by the screen sharing device.

[0070] S202. Confirm the target screen attribute information that is closest to the first screen attribute information according to the first attribute information table, and perform rendering and display according to the target screen attribute information to obtain the first screen sharing picture. The first screen attribute information is the screen attribute information of the sending device.

[0071] The sending device confirms the target attribute information that is closest to the first screen attribute information according to the received first attribute information table, and performs rendering and display according to the target screen attribute information to obtain the first screen sharing picture. Among them, the first screen attribute information is the screen attribute information of the sending device itself. When the first attribute information table contains the first screen attribute information, the sending device directly selects the first screen attribute information as the target screen attribute information and performs rendering and display based on the first screen attribute information to obtain the first screen sharing picture, so that the sending device realizes full - screen display. When the first attribute information table does not contain the first screen attribute information, the sending device confirms the target attribute information that is closest to the first screen attribute information according to the received first attribute information table, and performs rendering and display according to the target screen attribute information to obtain the first screen sharing picture. The first screen sharing picture obtained at this time may cause the sending device not to be full - screen displayed. Based on the screen sharing device performing the steps of the aforementioned S101 - S104, the sending device will receive a new first attribute information table. When the new first attribute information table contains the first screen attribute information, the sending device directly selects the first screen attribute information as the target screen attribute information and performs rendering and display based on the first screen attribute information to obtain a new first screen sharing picture, so that the sending device realizes full - screen display.

[0072] S203. Send the first screen sharing picture to the screen sharing device.

[0073] The sending device sends the generated first screen sharing picture to the screen sharing device for the screen sharing device to transmit the first screen sharing picture to the receiving device to realize the screen sharing function.

[0074] As described above, when transmitting the screen, the sending device receives the first attribute information table sent by the screen transmitter. Based on the foregoing S101 - S104, the final first attribute information table received by the sending device must include the first screen attribute information. Then, the sending device can select the first screen attribute information from the finally received first attribute information table as the target screen attribute information for rendering and screen transmission, thereby realizing the automatic full - screen display of the sending device, avoiding the black edges on the display screen of the sending device from affecting the user's visual experience, and further improving the user experience.

[0075] Based on the above - mentioned embodiments, Figure 7 is a schematic structural diagram of a screen - transmitting device provided by an embodiment of the present application. Refer to Figure 7 , the screen - transmitting device provided in this embodiment is used for a screen transmitter, and specifically includes: an instruction response module 21, a screen - transmitting module 22, an attribute information comparison module 23, and a hot - plug - and - play module 24.

[0076] Among them, the instruction response module 21 is configured to respond to a screen - transmitting instruction and send the first attribute information table to the sending device, so that the sending device can confirm the target screen attribute information closest to the first screen attribute information from the first attribute information table. The first attribute information table includes the screen attribute information pre - recorded by the screen transmitter, and the first screen attribute information is the screen attribute information of the sending device;

[0077] The screen - transmitting module 22 is configured to receive the first screen - transmitting picture sent by the sending device and send the first screen - transmitting picture to the receiving device. The first screen - transmitting picture is generated by the sending device according to the target screen attribute information;

[0078] The attribute information comparison module 23 is configured to obtain the first screen attribute information and compare the first screen attribute information with the first attribute information table;

[0079] The hot - plug - and - play module 24 is configured to, if the first attribute information table does not include the first screen attribute information, update and record the first screen attribute information into the first attribute information table, trigger hot - plug - and - play, and re - respond to the screen - transmitting instruction to send the updated first attribute information table to the sending device.

[0080] In one embodiment, the screen - transmitting device includes a frequency - time update module;

[0081] The frequency - time update module is configured to update and record the usage frequency and / or usage time information of the target screen attribute information corresponding in the first attribute information table.

[0082] In one embodiment, the hot - plug - and - play module 24 includes a quantity confirmation unit and an information update unit;

[0083] A quantity confirmation unit, configured to detect the current quantity of the screen attribute information recorded in the first attribute information table if the first screen attribute information is not included in the first attribute information table;

[0084] An information update unit, configured to replace the screen attribute information with the least usage times in the first attribute information table with the first screen attribute information to obtain an updated first attribute information table if the current quantity reaches the target quantity value.

[0085] In an embodiment, the quantity confirmation unit is further configured to detect the current quantity of the screen attribute information recorded in the first attribute information table if the first screen attribute information is not included in the first attribute information table;

[0086] The information update unit is further configured to replace the screen attribute information with the farthest time information from the current time in the first attribute information table with the first screen attribute information to obtain an updated first attribute information table if the current quantity reaches the target quantity value.

[0087] In an embodiment, the information update unit is further configured to newly record the first screen attribute information in the first attribute information table to obtain an updated first attribute information table if the current quantity is less than the target quantity value.

[0088] In an embodiment, the screen mirroring device further includes a pairing module

[0089] The pairing module is configured to perform pairing processing with a receiving device in response to a pairing instruction;

[0090] The information update unit is further configured to, after the pairing is completed, obtain the second screen attribute information of the receiving device and update and record the second screen attribute information in the first attribute information table.

[0091] The screen mirroring device provided by the embodiment of the present application can be used to execute the screen mirroring method provided by the above embodiment, and has corresponding functions and beneficial effects.

[0092] Based on the above embodiment, Figure 8 This is a schematic structural diagram of a screen mirroring device provided by an embodiment of the present application. Refer to Figure 8 In this embodiment, the screen mirroring device provided is for a sending device, and the screen mirroring device specifically includes: an attribute information table receiving module 25, a rendering module 26, and a screen sending module 27.

[0093] Among them, the attribute information table receiving module 25 is configured to receive the first attribute information table sent by the screen mirroring device;

[0094] A rendering module 26, configured to confirm target screen attribute information that is closest to the first screen attribute information according to the first attribute information table, perform rendering and display according to the target screen attribute information, and obtain a first screen transmission picture, where the first screen attribute information is the screen attribute information of a sending device;

[0095] A picture sending module 27, configured to send the first screen transmission picture to a screen transmitter.

[0096] The screen transmission device provided in an embodiment of the present application can be used to execute the screen transmission method provided in the foregoing embodiment, and has corresponding functions and beneficial effects.

[0097] An embodiment of the present application provides a screen transmission device. Refer to Figure 9 , the screen transmission device includes: a processor 31, a memory 32, a communication module 33, an input device 34, and an output device 35. The number of processors in the screen transmission device may be one or more, and the number of memories in the screen transmission device may be one or more. The processor, memory, communication module, input device, and output device of the screen transmission device may be connected through a bus or other means.

[0098] The memory 32, as a computer-readable storage medium, can be used to store software programs, computer-executable programs, and modules, such as program instructions / modules corresponding to the screen transmission method described in any embodiment of the present application (for example, an instruction response module, a screen transmission module, an attribute information comparison module, and a hot plug module in the screen transmission device). The memory may mainly include a program storage area and a data storage area. Among them, the program storage area may store an operating system and application programs required for at least one function; the data storage area may store data created according to the use of the device. In addition, the memory may include a high-speed random access memory, and may further include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other non-volatile solid-state storage devices. In some instances, the memory may further include a memory remotely provided relative to the processor, and these remote memories may be connected to the device through a network. Examples of the above network include, but are not limited to, the Internet, an enterprise internal network, a local area network, a mobile communication network, and combinations thereof.

[0099] The communication module 33 is used for data transmission.

[0100] The processor 31 executes various functional applications and data processing of the device by running software programs, instructions, and modules stored in the memory, that is, implements the above screen transmission method.

[0101] The input device 34 can be used to receive input digital or character information, and generate key signal inputs related to user settings and function controls of the device. The output device 35 may include a display device such as a display screen.

[0102] The screen mirroring device provided above can be used to execute the screen mirroring method provided in the above embodiments, and has corresponding functions and beneficial effects.

[0103] An embodiment of the present application further provides a storage medium storing computer-executable instructions, and the computer-executable instructions are used to execute a screen mirroring method when executed by a computer processor. The screen mirroring method includes: in response to a screen mirroring instruction, sending a first attribute information table to a sending device, so that the sending device confirms the target screen attribute information closest to the first screen attribute information from the first attribute information table, where the first attribute information table includes the screen attribute information pre-recorded by the screen mirroring device, and the first screen attribute information is the screen attribute information of the sending device; receiving a first screen mirroring picture sent by the sending device, and sending the first screen mirroring picture to a receiving device, where the first screen mirroring picture is generated by the sending device according to the target screen attribute information; obtaining the first screen attribute information, and comparing the first screen attribute information with the first attribute information table; if the first attribute information table does not include the first screen attribute information, then update and record the first screen attribute information to the first attribute information table, and trigger hot plugging, and in response to the screen mirroring instruction again, send the updated first attribute information table to the sending device

[0104] Storage medium - any of various types of memory devices or storage devices. The term "storage medium" is intended to include: installation media such as CD-ROM, floppy disk or magnetic tape device; computer system memory or random access memory such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc.; non-volatile memory such as flash memory, magnetic medium (such as hard disk or optical storage); register or other similar type of memory element, etc. The storage medium may also include other types of memory or combinations thereof. Additionally, the storage medium may be located in a first computer system in which the program is executed, or may be located in a different second computer system that is connected to the first computer system through a network (such as the Internet). The second computer system may provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media residing in different locations (such as in different computer systems connected through a network). The storage medium may store program instructions executable by one or more processors (such as specifically implemented as a computer program).

[0105] Of course, for a storage medium storing computer-executable instructions provided in an embodiment of the present application, the computer-executable instructions are not limited to the screen mirroring method as described above, and can also execute related operations in the screen mirroring methods provided in any embodiment of the present application.

[0106] The screen mirroring device, storage medium, and screen mirroring equipment provided in the above embodiments can execute the screen mirroring method provided in any embodiment of the present application. For technical details not described in detail in the above embodiments, reference can be made to the screen mirroring method provided in any embodiment of the present application.

[0107] The above is only the preferred embodiment of the present application and the technical principles applied. The present application is not limited to the specific embodiments described herein. Various obvious changes, re-adjustments, and substitutions that can be made by those skilled in the art will not depart from the protection scope of the present application. Therefore, although the present application has been described in more detail through the above embodiments, the present application is not limited to the above embodiments. Without departing from the concept of the present application, more other equivalent embodiments can be included, and the scope of the present application is determined by the scope of the claims.

Claims

1. A screen sharing method, characterized in that, For a screen mirroring device, the method includes: In response to a screen mirroring instruction, sending a first attribute information table to a sending device, so that the sending device confirms, from the first attribute information table, target screen attribute information that is closest to first screen attribute information, where the first attribute information table includes screen attribute information pre-recorded by the screen mirroring device, and the first screen attribute information is the screen attribute information of the sending device; Receiving a first screen-mirrored image sent by the sending device, and sending the first screen-mirrored image to a receiving device, where the first screen-mirrored image is generated by the sending device according to the target screen attribute information; Obtaining the first screen attribute information, and comparing the first screen attribute information with the first attribute information table; If the first attribute information table does not include the first screen attribute information, updating and recording the first screen attribute information into the first attribute information table, and triggering hot plugging, and in response to the screen mirroring instruction again, sending the updated first attribute information table to the sending device.

2. The method according to claim 1, wherein After receiving the first screen-mirrored image sent by the sending device, it includes: Updating and recording the usage times and / or usage time information of the corresponding target screen attribute information in the first attribute information table.

3. The method according to claim 2, wherein The step of, if the first attribute information table does not include the first screen attribute information, updating and recording the first screen attribute information into the first attribute information table includes: If the first attribute information table does not include the first screen attribute information, detecting the current quantity of the screen attribute information recorded in the first attribute information table; If the current quantity reaches a target quantity value, replacing the screen attribute information with the least usage times in the first attribute information table with the first screen attribute information, to obtain an updated first attribute information table.

4. The method according to claim 2, wherein The step of, if the first attribute information table does not include the first screen attribute information, updating and recording the first screen attribute information into the first attribute information table includes: If the first attribute information table does not include the first screen attribute information, detecting the current quantity of the screen attribute information recorded in the first attribute information table; If the current quantity reaches a target quantity value, replacing the screen attribute information with the farthest usage time information from the current time in the first attribute information table with the first screen attribute information, to obtain an updated first attribute information table.

5. The method according to claim 3 or 4, characterized in that After detecting the current quantity of the screen attribute information recorded in the first attribute information table when the first attribute information table does not include the first screen attribute information, it includes: If the current quantity is less than the target quantity value, newly recording the first screen attribute information into the first attribute information table, to obtain an updated first attribute information table.

6. The method according to claim 1, characterized in that Before responding to the screen mirroring instruction, it includes: In response to a pairing instruction, performing pairing processing with the receiving device; After the pairing is completed, obtaining second screen attribute information of the receiving device, and updating and recording the second screen attribute information into the first attribute information table.

7. A screen mirroring method, characterized in that, For a sending device, the method includes: Receiving the first attribute information table sent by the screen mirroring device; Confirm the target screen attribute information closest to the first screen attribute information according to the first attribute information table, and perform rendering display according to the target screen attribute information to obtain a first screen mirroring image. The first screen attribute information is the screen attribute information of the sending device; Send the first screen mirroring image to the screen mirroring device.

8. A screen transmission device, characterized in that, For a screen mirroring device, the apparatus includes: An instruction response module, configured to respond to a screen mirroring instruction and send a first attribute information table to a sending device, so that the sending device confirms the target screen attribute information closest to the first screen attribute information from the first attribute information table. The first attribute information table includes screen attribute information pre-recorded by the screen mirroring device, and the first screen attribute information is the screen attribute information of the sending device; A screen mirroring module, configured to receive the first screen mirroring image sent by the sending device and send the first screen mirroring image to a receiving device. The first screen mirroring image is generated by the sending device according to the target screen attribute information; An attribute information comparison module, configured to obtain the first screen attribute information and compare the first screen attribute information with the first attribute information table; A hot pluggable module, configured to, if the first attribute information table does not include the first screen attribute information, update and record the first screen attribute information in the first attribute information table, trigger a hot plug, re-respond to a screen mirroring instruction, and send the updated first attribute information table to the sending device.

9. A screen sharing device, characterized in that, Comprising: A memory and one or more processors; The memory is used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1-7.

10. A storage medium storing computer-executable instructions, characterized in that, The computer-executable instructions, when executed by a processor, are used to execute the method according to any one of claims 1-7.

Images