Screen projection sharing method and equipment

Abstract

The invention provides a projection screen sharing method and equipment, the method is applied to first equipment, and the method comprises the following steps: generating first data for indicating a second projection screen interface based on a first projection screen interface displayed by the first equipment through a first display screen; wherein the second projection screen interface is obtained by cutting a black edge area existing in the first projection screen interface, the second projection screen interface is used for being displayed on a second display screen in a first state by a second device, and the first state comprises one of a horizontal screen state and a vertical screen state; and sending the first data to a second device. The method can improve the screen projection display effect.

Description

Technical Field

[0001] This application relates to the field of equipment technology, and in particular to a screen sharing method and device. Background Technology

[0002] Screen sharing / remote collaboration between different devices is becoming increasingly common. Currently, devices (such as set-top boxes) can display the screen of another device projecting its own screen onto a display screen (such as a smart screen or other large screen), and this screen can be shared to another device's display screen. However, when different devices have different screen resolutions, the projected screen will contain black borders (areas that do not contain valid content and are displayed in a specific format, such as black). After the projected screen is shared to another device's display screen, there may be even more black borders on that display screen, resulting in a very small display area for valid content. This makes it difficult to clearly view the content, thus leading to poor display quality during screen sharing. Summary of the Invention

[0003] This application provides a screen mirroring and sharing method and device to improve the display effect of screen mirroring and sharing.

[0004] In a first aspect, embodiments of this application provide a screen sharing method applied to a first device. The method includes: generating first data for indicating a second screen sharing interface based on a first screen sharing interface displayed on a first display screen of the first device; wherein the second screen sharing interface is obtained by cropping the black border area existing in the first screen sharing interface, and the second screen sharing interface is used by the second device to display on a second display screen in a first state, the first state including one of landscape state and portrait state; and sending the first data to the second device.

[0005] In this method, the first device can expand the display of effective content by cropping the black border area of ​​the displayed projection interface. By sending the cropped projection interface to the second device, the effective content of the projection interface can be expanded on the second device while simultaneously sharing the projection interface, making it easier to view the content more clearly. Furthermore, the projection interface cropped by the first device can be displayed on the second display screen in its first state. Therefore, this method can share a projection interface more suitable for the state of the other end's display screen, thereby further improving the display effect of projection sharing. In summary, the above method can improve the display effect of projection sharing.

[0006] In one possible design, there are no black border areas on the top and bottom sides and / or left and right sides of the second projection interface.

[0007] This method maximizes the display of effective content in the shared screen mirroring interface, thereby improving the display effect of screen mirroring.

[0008] In one possible design, the aspect ratio of the second projection interface is the same as that of the second display screen in the first state.

[0009] The shared screen mirroring interface obtained using this method can be directly displayed on the target device's screen. Combining this method with the above approach maximizes the display of effective content within the shared screen mirroring interface, thereby improving the overall display quality of the shared screen mirroring.

[0010] In one possible design, when the second display screen is a foldable screen, the first state may also include one of a folded state and an unfolded state.

[0011] The above method can achieve the sharing and projection of the screen onto a foldable screen, while improving the display effect of the shared projection interface, making it highly practical.

[0012] In one possible design, after sending the first data to the second device, the method further includes: sending second data to the second device after the second display screen switches from the first state to the second state; wherein the second state includes one of a landscape state and a portrait state, the second data is used to indicate a third projection interface, the third projection interface being obtained by cropping the black border area existing in the first projection interface, the third projection interface being different from the second projection interface, and the third projection interface being used by the second device to display on the second display screen in the second state. Optionally, the switching from the first state to the second state specifically includes: switching from the first state to a state different from the first state, either a landscape state or a portrait state.

[0013] In this method, after the state of the second display screen changes, when the first device shares the projection interface with the second device, it can generate a projection interface suitable for display on the second display screen after the state change and share it with the second device. Based on this method, even if the state of the second display screen changes, it can ensure that the effective content in the projection interface shared by the first device to the second device can be enlarged for display, thereby ensuring that the display effect is not affected by the state of the second display screen.

[0014] In one possible design, there are no black border areas on the top and bottom sides and / or left and right sides of the third projection interface.

[0015] This method maximizes the display of effective content in the shared screen mirroring interface, thereby improving the display effect of screen mirroring.

[0016] In one possible design, the aspect ratio of the third projection interface is the same as that of the second display screen in the second state.

[0017] The shared projection interface obtained using this method can be directly displayed on the target device's screen. Combining this method with the above approach maximizes the display of effective content within the shared projection interface, thereby improving the overall display quality of the projection sharing.

[0018] In one possible design, when the second display screen is a foldable screen, the second state further includes one of a folded state and an unfolded state. Optionally, the switch from the first state to the second state specifically includes: switching between a landscape state and a portrait state, and / or switching between a folded state and an unfolded state.

[0019] In this method, the state changes of the second display screen can be of different types. In these state change scenarios, the above method can ensure that the effective content in the projection interface shared by the first device to the second device can be enlarged for display, thus the above method has high practicality.

[0020] In one possible design, before sending the first data to the second device, the method further includes: receiving first information from the second device; wherein the first information is used to indicate the aspect ratio of the second display screen in the first state; or, the first information is used to indicate the first state and the resolution of the second display screen, and the first information is used to determine the aspect ratio of the second display screen in the first state; wherein the aspect ratio of the second display screen in the first state is used to determine the aspect ratio of the second projection interface.

[0021] In the above method, the first device can obtain the aspect ratio of the second display screen in different ways, which provides high flexibility. At the same time, it can ensure that the first device can crop the black border area in the first projection interface based on the aspect ratio of the second display screen, thereby obtaining a second projection interface that is more suitable for display on the second display screen in the first state.

[0022] In one possible design, after the second display screen switches from the first state to the second state, before sending the second data to the second device, the method further includes: receiving second information from the second device; wherein the second information is used to indicate the aspect ratio of the second display screen in the second state; or, the second information is used to indicate the second state and the resolution of the second display screen, and the second information is used to determine the aspect ratio of the second display screen in the second state; wherein the aspect ratio of the second display screen in the second state is used to determine the aspect ratio of the third projection interface.

[0023] In the above method, after the state of the second display screen changes, the first device can obtain the aspect ratio of the second display screen after the state change in different ways, which provides high flexibility. At the same time, it can ensure that the first device can crop the black border area in the first projection interface based on the aspect ratio of the second display screen after the state change, thereby obtaining a second projection interface that is more suitable for display on the second display screen after the state change, ensuring that the display effect of the shared projection interface is not affected by the state change of the second display screen.

[0024] In one possible design, generating first data for indicating a second projection interface based on a first projection interface displayed by the first device through a first display screen includes: detecting the position and size of a black border area in the first projection interface; obtaining the aspect ratio of the second display screen in the first state; determining the second projection interface based on the first projection interface, the position and size of the black border area in the first projection interface, and the aspect ratio of the second display screen in the first state; and generating the first data based on the second projection interface.

[0025] In this method, by determining the second projection interface based on the aspect ratio of the second display screen in the first state, a second projection interface that is more suitable for display on the second display screen in the first state can be obtained, which helps to improve the display effect.

[0026] In one possible design, determining the second projection interface based on the first projection interface, the position and size of the black border area in the first projection interface, and the aspect ratio of the second display screen in the first state includes: generating first cropping information based on the first projection interface, the position and size of the black border area in the first projection interface, and the aspect ratio of the second display screen in the first state; wherein the first cropping information is used to indicate the method of cropping the black border area in the first projection interface; and cropping the black border area in the first projection interface based on the first cropping information to obtain the second projection interface.

[0027] In the above method, by cropping the black border area in the first projection interface, the effective content can be enlarged and more easily viewed, thus improving the display effect and viewing efficiency.

[0028] In one possible design, the method further includes: saving the first cropping information. The included first cropping information can be used to crop the projection interface subsequently displayed on the first device, resulting in high processing efficiency.

[0029] In one possible design, after sending the first data to the second device, the method further includes: updating the first projection interface to a fourth projection interface; cropping the black border area in the fourth projection interface based on the first cropping information to obtain a fifth projection interface; and sending third data to the second device to indicate the fifth projection interface. The position and size of the black border area in the fourth projection interface are the same as the position and size of the black border area in the first projection interface.

[0030] Based on the above method, for interfaces with the same black border area, the previously used and saved cropping method can be used to process the subsequent interface, which can avoid repeatedly confirming the cropping method and thus help improve processing efficiency.

[0031] In one possible design, before generating first data for instructing a second projection interface based on a first projection interface displayed by the first device via a first display screen, the method further includes: receiving third information from the second device; wherein the third information is used to instruct the first device to process black border areas and / or to instruct the second device not to have the ability to process black border areas.

[0032] Based on the above method, when the other end of the shared screen mirroring interface does not have the ability to process black border areas, the device sharing the screen mirroring interface can process the black border areas in the screen mirroring interface, thereby ensuring the above display effect.

[0033] In one possible design, the method further includes: after displaying the first projection interface on the first display screen, receiving fourth information from a third device; wherein the fourth information is used to indicate that the first device does not process the black border area and / or to indicate that the third device has the ability to process the black border area; and sending fourth data to the third device to indicate the first projection interface.

[0034] Based on the above method, when the other end of the shared screen projection interface has the ability to process black border areas, the device sharing the screen projection interface does not need to process the black border areas in the projection interface, which helps to improve the processing efficiency of the device sharing the screen projection interface while ensuring the screen projection sharing effect.

[0035] In one possible design, the first device and the second device have a communication connection.

[0036] The above method can achieve screen sharing during a call and is highly practical.

[0037] Secondly, embodiments of this application provide a screen-sharing method applied to a second device. The method includes: receiving first data from a first device; wherein the first data is generated based on a first screen-sharing interface displayed by the first device through a first display screen; the first data is used to indicate a second screen-sharing interface, the second screen-sharing interface being obtained by cropping the black border area existing in the first screen-sharing interface, the second screen-sharing interface being used by the second device to display on a second display screen in a first state, the first state including one of a landscape state and a portrait state; and displaying the second screen-sharing interface through the second display screen in the first state based on the first data.

[0038] In this method, the projection interface displayed on the second device from the first device is larger than the projection interface displayed on the first device, making it easier to view the relevant content more clearly. Furthermore, the projection interface received by the second device from the first device can be displayed on the second display screen in its first state. Therefore, the second device can obtain a projection interface more suitable for its local display screen state, thereby further improving the display effect of projection sharing.

[0039] In one possible design, there are no black border areas on the top and bottom sides and / or left and right sides of the second projection interface.

[0040] In one possible design, the aspect ratio of the second projection interface is the same as that of the second display screen in the first state.

[0041] In one possible design, when the second display screen is a foldable screen, the first state may also include one of a folded state and an unfolded state.

[0042] In one possible design, after displaying the second projection interface on the second display screen in the first state based on the first data, the method further includes: receiving second data from the first device after the second display screen switches from the first state to the second state; wherein the second state includes one of a landscape state and a portrait state, the second data is used to indicate a third projection interface, the third projection interface being obtained by cropping the black border area existing in the first projection interface, the third projection interface being different from the second projection interface, and the third projection interface being used by the second device to display on the second display screen in the second state. Optionally, the switching from the first state to the second state specifically includes: switching from the first state to a state different from the first state, either a landscape state or a portrait state.

[0043] In this method, even if the state of the second display screen changes, the effective content in the projection interface shared by the first device to the second device can be enlarged and displayed, thereby ensuring that the display effect is not affected by the state of the second display screen.

[0044] In one possible design, there are no black border areas on the top and bottom sides and / or left and right sides of the third projection interface.

[0045] In one possible design, the aspect ratio of the third projection interface is the same as that of the second display screen in the second state.

[0046] In one possible design, when the second display screen is a foldable screen, the second state further includes one of a folded state and an unfolded state. Optionally, the switch from the first state to the second state specifically includes: switching between a landscape state and a portrait state, and / or switching between a folded state and an unfolded state.

[0047] In one possible design, before receiving the first data from the first device, the method further includes: sending first information to the first device; wherein the first information is used to indicate the aspect ratio of the second display screen in the first state; or, the first information is used to indicate the first state and the resolution of the second display screen, and the first information is used to determine the aspect ratio of the second display screen in the first state; wherein the aspect ratio of the second display screen in the first state is used to determine the aspect ratio of the second projection interface.

[0048] In this method, the second device sends first information to the first device, enabling the first device to determine the aspect ratio of the second display screen in a first state based on the first information. This allows the first device to send a projection interface more suitable for display on the second display screen in the first state to the second device. Therefore, when the second device displays the projection interface from the first device on the second display screen, it achieves a better display effect.

[0049] In one possible design, before receiving the second data from the first device, the method further includes: sending second information to the first device when the second display screen switches from the first state to the second state; wherein the second information is used to indicate the aspect ratio of the second display screen in the second state; or, the second information is used to indicate the second state and the resolution of the second display screen, and the second information is used to determine the aspect ratio of the second display screen in the second state; wherein the aspect ratio of the second display screen in the second state is used to determine the aspect ratio of the third projection interface.

[0050] In this method, after the state of the second display screen changes, the second device sends second information to the first device, enabling the first device to determine the aspect ratio of the second display screen after the state change based on the second information. This allows the first device to send a projection interface more suitable for display on the second display screen after the state change. Therefore, when the second device displays the projection interface from the first device on the second display screen, it achieves a better display effect and is unaffected by changes in the state of the second display screen.

[0051] In one possible design, before receiving the first data from the first device, the method further includes: sending third information to the first device; wherein the third information is used to instruct the first device to process the black border area and / or to instruct the second device not to have the ability to process the black border area.

[0052] Based on the above method, when the other end of the shared screen projection interface does not have the ability to process black border areas, the device sharing the screen projection interface can process the black border areas in the projection interface, thereby ensuring the above display effect.

[0053] In one possible design, the second device establishes a communication connection with the first device.

[0054] The above method can achieve screen sharing during a call and is highly practical.

[0055] Thirdly, embodiments of this application provide a screen sharing method applied to a first device. The method includes: receiving first information from a second device; wherein the first information is used to instruct the first device to process black border areas and / or to instruct the second device not to have the ability to process black border areas; sending first data to the second device; wherein the first data is used to instruct the first device to display a first screen sharing interface through a first display screen, wherein the first screen sharing interface has black border areas.

[0056] Based on the above method, when the other end of the shared screen mirroring interface has the capability to handle black border areas, the device sharing the screen mirroring interface can choose not to process the black border areas in the screen mirroring interface, leaving the black border areas to be processed by the other end. This helps to improve the processing efficiency of the device sharing the screen mirroring interface while ensuring the screen mirroring sharing effect. Furthermore, the first device sharing the screen mirroring interface, based on the black border area processing capability of the second device notified by the second device sharing the screen mirroring interface, helps the first device flexibly determine the device to handle the black border areas by combining the capabilities of both ends.

[0057] In one possible design, the first device and the second device establish a communication connection. The above method enables screen sharing during a call and is highly practical.

[0058] Fourthly, this application provides a screen sharing method applied to a second device. The method includes: sending first information to a first device; wherein the first information is used to instruct the first device to process black border areas and / or to instruct the second device not to have the ability to process black border areas; receiving first data from the first device; wherein the first data is used to instruct the first device to display a first screen sharing interface through a first display screen, wherein the first screen sharing interface has black border areas.

[0059] In this method, the second device receiving the screen sharing interface notifies the first device sharing the screen sharing interface of its own black border area processing capability, which helps the first device to flexibly determine the device end to process the black border area by combining the capabilities of both ends.

[0060] In one possible design, the method further includes: generating a second projection interface based on the first data; wherein the second projection interface is obtained by cropping the black border area existing in the first projection interface, and the second projection interface is used to display on a second display screen in a first state, the first state including one of landscape state and portrait state; and displaying the second projection interface through the second display screen in the first state.

[0061] In this method, the second device can expand the display area of ​​the effective content in the shared projection interface by cropping the black border area of ​​the first device, making it easier to view the effective content more clearly. Furthermore, the projection interface cropped by the second device can be displayed on the second display screen in the first state, thus making it more suitable for the state of the second display screen and further improving the display effect of the projection sharing.

[0062] In one possible design, there are no black border areas on the top and bottom sides and / or left and right sides of the second projection interface.

[0063] In one possible design, the aspect ratio of the second projection interface is the same as that of the second display screen in the first state.

[0064] In one possible design, when the second display screen is a foldable screen, the first state may also include one of a folded state and an unfolded state.

[0065] In one possible design, after displaying the second projection interface on the second display screen, the method further includes:

[0066] After the second display screen switches from the first state to the second state, a third projection interface is displayed on the second display screen. The second state includes either a landscape state or a portrait state. The third projection interface is obtained by cropping the black border area present in the first projection interface. The third projection interface is different from the second projection interface and is used by the second device to display on the second display screen in the second state. Optionally, switching from the first state to the second state specifically includes switching from the first state to a state different from the first state, either a landscape state or a portrait state.

[0067] In one possible design, there are no black border areas on the top and bottom sides and / or left and right sides of the third projection interface.

[0068] In one possible design, the aspect ratio of the third projection interface is the same as that of the second display screen in the second state.

[0069] In one possible design, when the second display screen is a foldable screen, the second state further includes one of a folded state and an unfolded state. Optionally, the switch from the first state to the second state specifically includes: switching between a landscape state and a portrait state, and / or switching between a folded state and an unfolded state.

[0070] In one possible design, generating the second projection interface based on the first data includes: detecting the position and size of the black border area in the first projection interface; and generating the second projection interface based on the first projection interface, the position and size of the black border area in the first projection interface, and the aspect ratio of the second display screen in the first state.

[0071] In one possible design, generating the second projection interface based on the first projection interface, the position and size of the black border area in the first projection interface, and the aspect ratio of the second display screen in the first state includes: generating first cropping information based on the first projection interface, the position and size of the black border area in the first projection interface, and the aspect ratio of the second display screen in the first state; wherein the first cropping information is used to indicate the method of cropping the black border area in the first projection interface; and cropping the black border area in the first projection interface based on the first cropping information to obtain the second projection interface.

[0072] In one possible design, the method further includes: saving the first cropping information.

[0073] In one possible design, after displaying the second projection interface on the second display screen, the method further includes: after the first projection interface is updated to a third projection interface, determining the third projection interface based on second data from the first device; wherein the third projection interface has a black border area; and based on the first cropping information, cropping the black border area in the third projection interface to obtain a fourth projection interface, and displaying the fourth projection interface.

[0074] In one possible design, the second device establishes a communication connection with the first device.

[0075] Fifthly, embodiments of this application provide a communication device, comprising: a module for executing the first aspect or any one of the methods described above; or a module for executing the second aspect or any one of the methods described above; or a module for executing the third aspect or any one of the methods described above; or a module for executing the fourth aspect or any one of the methods described above.

[0076] In a sixth aspect, embodiments of this application provide a communication device, including: at least one processor; the at least one processor is configured to cause the communication device to perform the first aspect or any one of the methods described above, or to perform the second aspect or any one of the methods described above, or to perform the third aspect or any one of the methods described above, or to perform the fourth aspect or any one of the methods described above.

[0077] In one possible design, the at least one processor is used to execute instructions stored in memory. The memory may be included in the communication device or located outside of it.

[0078] In one possible design, the communication device further includes a communication interface; the communication interface is used to receive signals from other communication devices outside the communication device and transmit them to the processor, or to send signals from the processor to other communication devices outside the communication device.

[0079] In one possible design, the communication device further includes a transceiver, with at least one processor controlling the transceiver to transmit and receive signals. The transceiver may include a receiver for receiving signals and a transmitter for transmitting signals.

[0080] The communication device in the fifth and sixth aspects can be the first device or the second device, or a component (e.g., a processor, chip, or chip system) in the first or second device. The communication device can be a device or apparatus with a chip, or a device or apparatus with integrated circuitry, or a chip, chip system, module, or control unit in the terminal device or communication device shown above, and this application does not limit the specifics.

[0081] In a seventh aspect, this application provides a computer-readable storage medium storing a computer program or instructions that, when executed on a communication device, cause the communication device to perform the first aspect or any one of the methods described above, or to perform the second aspect or any one of the methods described above, or to perform the third aspect or any one of the methods described above, or to perform the fourth aspect or any one of the methods described above.

[0082] Eighthly, this application provides a computer program product comprising a computer program or instructions that, when executed by a communication device, implement the first aspect or any one of the methods described above, or implement the second aspect or any one of the methods described above, or implement the third aspect or any one of the methods described above, or implement the fourth aspect or any one of the methods described above.

[0083] The technical effects achievable by some of the contents in the second and fourth aspects above can be referred to the description of the beneficial effects of the corresponding contents in the first aspect above, and will not be repeated here. The technical effects achievable by any of the fifth to eighth aspects above can be referred to the description of the beneficial effects of any of the first to fourth aspects above, and will not be repeated here. Attached Figure Description

[0084] Figure 1 This is a schematic diagram of a screen sharing interface.

[0085] Figure 2 This is a schematic diagram of a screen sharing interface.

[0086] Figure 3 This is a schematic diagram of the architecture of a screen sharing system provided in an embodiment of this application;

[0087] Figure 4 This application provides an example architecture diagram of a screen sharing system.

[0088] Figure 5 This application provides an example architecture diagram of a screen sharing system.

[0089] Figure 6 A schematic diagram illustrating a possible screen sharing method provided in an embodiment of this application;

[0090] Figure 7 A schematic diagram of an interface for a screen sharing scenario provided in an embodiment of this application;

[0091] Figure 8 A schematic diagram of an interface for a screen sharing scenario provided in an embodiment of this application;

[0092] Figure 9 A schematic diagram illustrating the data structure of an extended header of an RTP packet, provided in an embodiment of this application;

[0093] Figure 10 A schematic diagram of a shared screen mirroring interface provided in an embodiment of this application;

[0094] Figure 11 A schematic diagram of a shared screen mirroring interface provided in an embodiment of this application;

[0095] Figure 12 This application provides a schematic diagram of a screen sharing interface as an embodiment of the present application.

[0096] Figure 13 This application provides a schematic diagram of a screen sharing interface as an embodiment of the present application.

[0097] Figure 14 This application provides a schematic diagram of a screen sharing interface as an embodiment of the present application.

[0098] Figure 15 A schematic diagram illustrating a possible screen sharing method provided in an embodiment of this application;

[0099] Figure 16 A schematic diagram illustrating a possible screen sharing method provided in an embodiment of this application;

[0100] Figure 17 A schematic diagram illustrating a possible screen sharing method provided in an embodiment of this application;

[0101] Figure 18 A schematic diagram illustrating a possible screen sharing method provided in an embodiment of this application;

[0102] Figure 19 A schematic diagram of a communication device provided in an embodiment of this application;

[0103] Figure 20 This is a schematic diagram of the structure of a communication device provided in an embodiment of this application. Detailed Implementation

[0104] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the embodiments of this application will be further described in detail below with reference to the accompanying drawings.

[0105] In the description of the embodiments of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. It should be understood that in the embodiments of this application, "at least one" refers to one or more, and "more" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can be represented as: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be a single or multiple.

[0106] References to "one embodiment" or "some embodiments" as used in this specification mean that one or more embodiments of this specification include a particular feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0107] Currently, some devices can display the screen of a projected device on their display, and can also share the displayed screen to another device's display. Taking a set-top box as an example, it can display the screen of a mobile phone projected onto a large screen, and can also share that screen to another mobile phone for display. In one example, the interfaces displayed by each device in this scenario can be referenced... Figure 1 .like Figure 1 As shown, the interface displayed on mobile phone 1 can be Figure 1The diagram shows Interface 1. After mobile phone 1 projects Interface 1 onto the set-top box, the interface displayed on the set-top box's large screen is Interface 2. After the set-top box shares Interface 2 with mobile phone 2, the interface displayed on mobile phone 2 is Interface 3. Since the resolution of mobile phone 1's display screen differs from the resolution of the large screen corresponding to the set-top box, to ensure that the interface displayed on the set-top box's large screen remains distorted after projection, mobile phone 1 can add a black border area to Interface 1 based on the resolution of the large screen on the set-top box side, resulting in... Figure 1 The example shows Interface 2, which is then sent to a set-top box. The set-top box can directly display Interface 2 on a large screen. The black border area can be an area that does not contain valid content and is displayed as black. Similarly, when the set-top box shares Interface 2 displayed on the large screen to Mobile Phone 2, the interface displayed on Mobile Phone 2 is Interface 3 obtained by adding a black border area to Interface 2. In another example, the interface displayed on Mobile Phone 1 may also contain a black border area. That is, only a portion of the interface displayed on Mobile Phone 1 contains valid content; the areas without valid content in the interface displayed on Mobile Phone 1 are the black border areas. For example, the interface displayed on Mobile Phone 1 could be... Figure 2 Interface 4 is shown in the figure. Based on the above method, the interface displayed by the set-top box on the large screen is as follows: Figure 2 As shown in interface 5, after the set-top box shares interface 5 to mobile phone 2, the interface displayed on mobile phone 2 is... Figure 2 Interface 6 is shown in the image.

[0108] In the above method, the screen projection interface (i.e., interface 2 or interface 4) displayed on the set-top box from mobile phone 1 will have black borders. After the set-top box shares the projection interface with mobile phone 2, the interface displayed on mobile phone 2 will have even more black borders. Therefore, the display area of ​​the effective content is very small, which is not conducive to clearly viewing the effective content. Especially when there are already black borders in the interface displayed on mobile phone 1, the display area of ​​the effective content in the interface obtained after sharing the projection interface is extremely small. Therefore, the display effect of screen projection sharing in the above method is poor.

[0109] To address the above issues and improve the display effect of screen sharing, this application provides a screen sharing method and device. In this method, when sharing an interface including a black border area from one device to another, the device can crop the black border area of ​​the interface to be shared based on the state of the other device's display screen, and then share the cropped interface to the other device. This method increases the proportion of effective content in the shared interface, thus helping to clearly view the effective content when the shared interface is displayed on another device, thereby improving the display effect. Simultaneously, this method also ensures that the cropped interface, when displayed on the other device's display screen, adapts to the screen's portrait or landscape orientation, further improving the display effect.

[0110] Optionally, the screen sharing method provided in this application embodiment can be applied to a system composed of multiple devices. Figure 3 This is a schematic diagram of the system architecture applicable to the screen sharing method provided in the embodiments of this application. For example... Figure 3 As shown, the system may include a first device, a second device, and a third device. The first device and the second device can establish a wireless connection, and the first device and the third device can also establish a wireless connection. This wireless connection is established using wireless communication technology, and this application embodiment does not specifically limit the type of wireless communication technology. Optionally, the first device and the second device can establish a voice call connection.

[0111] In this system, a third device can project its screen to a first device, and the first device can display the projected interface from the third device. The first device can also share its displayed projected interface to a second device, and the second device can display the shared projected interface. Here, the third device is the projection source, and the first device is the projection receiver. The first, second, and third devices can all be terminal devices. The first and third devices can be terminal devices with projection functionality. Optionally, the first and second devices can be terminal devices with call functionality.

[0112] Optional, such as Figure 3 As shown, the system may further include a fourth device. The first device can share its displayed screen projection interface to the fourth device, and the fourth device can display the screen projection interface shared by the first device. A wireless connection can be established between the fourth device and the first device. Optionally, a voice communication connection can be established between the first device and the fourth device.

[0113] In some embodiments of this application, the terminal device can be a device that provides data connectivity to the user. Exemplary examples include portable devices such as mobile phones, tablets, set-top boxes, wearable devices with wireless communication capabilities (e.g., watches), in-vehicle terminal devices, augmented reality (AR) / virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), smart home devices (e.g., smart TVs, smart speakers), smart robots, workshop equipment, wireless terminals in self-driving vehicles, wireless terminals in remote medical surgery, wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, or wireless terminals in smart homes, and flying devices (e.g., smart robots, drones, airplanes). Wearable devices are portable devices that users can wear directly on their bodies or integrate into their clothing or accessories.

[0114] In some embodiments of this application, the terminal device may also be a portable terminal device that includes other functions. Exemplary embodiments of the portable terminal device include, but are not limited to, carrying... Alternatively, it could be a portable terminal device with another operating system. The aforementioned portable terminal device could also be other portable terminal devices, such as a laptop computer with a touch-sensitive surface (e.g., a touch panel). It should also be understood that in some other embodiments of this application, the aforementioned device may not be a portable terminal device, but rather a desktop computer with a touch-sensitive surface (e.g., a touch panel).

[0115] Terminal devices can be widely used in various scenarios, such as device-to-device (D2D), vehicle-to-everything (V2X) communication, machine-type communication (MTC), Internet of Things (IoT), virtual reality, augmented reality, industrial control, autonomous driving, telemedicine, smart grids, smart furniture, smart offices, smart wearables, smart transportation, and smart cities. Terminal devices can be deployed on land (including indoors or outdoors, handheld or vehicle-mounted), on water, or in the air on airplanes, balloons, and satellites. This application does not limit the application scenarios of the terminal devices.

[0116] Optional, when Figure 3 When any device in the illustrated system does not have its own display screen, the system may further include a display device for displaying content on that device (which can also be understood as serving as the display screen for that device). This display device may be, for example, a display screen. For instance, when the first device is a set-top box, Figure 3 The system shown may also include a display screen, such as a large screen, corresponding to the set-top box. The large screen can serve as the set-top box's display screen, and the set-top box can display content on the large screen.

[0117] It should be understood that Figure 3 The system is illustrated exemplarily for ease of understanding only and does not constitute any limitation on the systems to which the present application applies. The embodiments of this application do not limit the number of devices included in the system. Systems to which the present application applies may include more than […]. Figure 3 The more or fewer devices shown may include, for example, display devices, etc., but no specific limitations are made in the embodiments of this application.

[0118] In one example, with Figure 3 Taking the first device, second device, and third device shown in the example as a set-top box, a first mobile phone, and a second mobile phone respectively, the system applicable to the solution provided in this application embodiment can be referred to. Figure 4 .like Figure 4 As shown, the system may include a set-top box, a large screen, a first mobile phone, and a second mobile phone. The large screen can be used as the display screen for the set-top box. The set-top box and the large screen can be connected via a wired connection (e.g., via a high-definition multimedia interface (HDMI)) or a wireless connection (e.g., via wireless fidelity (WiFi)). This embodiment of the application does not limit the connection method between the set-top box and the large screen.

[0119] In one example application scenario, a user on the set-top box side and a user on the first mobile phone side can make calls between their respective screens. During the call, when the user on the set-top box side wants to share content displayed on the second mobile phone (such as pictures or videos) to the other end of the call, the user on the set-top box side can project the content displayed on the second mobile phone onto the set-top box. The set-top box can display the projected content from the second mobile phone on the larger screen, and can also share the content displayed on the larger screen to the first mobile phone based on the method provided in this application embodiment. In another example application scenario, during a call between a child and a parent using a set-top box and a first mobile phone respectively, when the child wants to share homework completed on the second mobile phone with the parent on the other end of the call, the child can project the homework content displayed on the second mobile phone onto the set-top box. The set-top box can display the homework content projected from the second mobile phone on the larger screen, and can also share the homework content displayed on the larger screen to the first mobile phone based on the method provided in this application embodiment.

[0120] In another example, with Figure 3 Taking the first device, second device, and third device shown in the embodiment as a first set-top box, a second set-top box, and a mobile phone, respectively, a system applicable to the solution provided in this application embodiment can be referred to. Figure 5 .like Figure 5 As shown, the system may include a first set-top box, a large screen corresponding to the first set-top box, a second set-top box, a large screen corresponding to the second set-top box, and a mobile phone. Each large screen can serve as the display screen for its corresponding set-top box. Each set-top box and its corresponding large screen can be connected via a wired connection (e.g., via HDMI) or a wireless connection (e.g., via WiFi). This embodiment does not limit the connection method between the set-top box and the large screen. Optionally, the first set-top box and the second set-top box may have a communication connection. The first set-top box can display screen-projected content from the mobile phone on its corresponding large screen and can share this screen-projected content to the second set-top box based on the method provided in this embodiment. The second set-top box can display the content shared by the first set-top box on its corresponding large screen.

[0121] It should be understood that Figure 4 , Figure 5 The system architectures shown are merely examples for ease of understanding and do not constitute any limitation on the systems to which the solutions in this application are applicable.

[0122] Example 1

[0123] In some embodiments of this application, in scenarios where a first device shares an interface including a black border area projected from a third device to a second device for display, the first device can crop the black border area of ​​the projected interface to be shared based on the state of the second device's display screen, and then share the cropped interface to the second device. This method can increase the proportion of effective content in the shared interface, thus resulting in better display quality. Based on this method, refer to... Figure 6 A possible screen-sharing method provided in this application embodiment may include:

[0124] S601: The first device generates first data to indicate the second projection interface based on the first projection interface displayed on the first display screen; wherein the second projection interface is obtained by cropping the black border area existing in the first projection interface.

[0125] The first display screen serves as the display screen for the first device. Optionally, the first display screen can be a display screen within the first device or a separate display screen connected to the first device. For example, when the first device is a laptop, the first display screen can be the display screen on the laptop. As another example, when the first device is a set-top box, the first display screen can be a large screen connected to the set-top box.

[0126] In some embodiments of this application, the first projection interface may originate from a third device. The third device can act as the projection source, generating the first projection interface and projecting it to the first device. The first device can act as the projection receiver, receiving and displaying the first projection interface. Optionally, steps A1 to A4 may be included before step S601:

[0127] A1: The third device displays the first interface on the third display screen.

[0128] The first interface includes first content, or the first interface includes first content and a black border area. The first content is valid content. The black border area described in this embodiment can be an area that does not contain valid content. Optionally, the black border area can be displayed in a set format. The set format can be, for example, a set color (e.g., black or white), a set background pattern, etc. The specific display format of the black border area is not specifically limited in this embodiment.

[0129] Optionally, the resolution of the first interface is the same as the resolution of the third display screen, or the aspect ratio of the first interface is the same as that of the third display screen.

[0130] Example 1: In one example, taking a mobile phone as the third device in portrait mode, the first interface displayed on the third device can be... Figure 7The first interface is shown in the figure. The first interface includes first content (i.e., valid content), which occupies the entire area of ​​the first interface.

[0131] Example 2: In one example, taking a mobile phone as the third device in portrait mode, the first interface displayed on the third device can be... Figure 8 The first interface shown is illustrated. The first interface includes first content, which occupies a portion of the first interface. The area of ​​the first interface other than the area containing the first content is a black border area (i.e.,...). Figure 8 Black border area 1 and black border area 2 in the first interface shown.

[0132] A2: In response to the received first instruction, the third device generates first projection data based on the first interface to indicate the first projection interface.

[0133] The first instruction can be used to instruct the screen to be projected onto the first device. Optionally, the first instruction can be issued by a user operation on the third device side or by the first device; this embodiment does not impose any restrictions.

[0134] In some embodiments of this application, the aspect ratio of the first projection interface is the same as that of the first display screen. The third device, in response to a first instruction, determines the aspect ratio of the first projection interface based on the acquired aspect ratio or resolution of the first display screen. Then, based on the aspect ratio of the first projection interface, a black border area is added to the first interface to obtain the first projection interface, and subsequently, first projection data is generated based on the first projection interface. The proportion of the black border area in the first projection interface is higher than or equal to the proportion of the black border area in the first interface.

[0135] A3: The third device sends the first projection data to the first device.

[0136] A4: The first device displays the first projection interface on the first display screen based on the first projection data.

[0137] Wherein, after receiving the first projection data from the third device, the first device can generate a first projection interface based on the first projection data and display the first projection interface on the first display screen. The first projection interface may include a first area containing the first content, and black border areas located on the top and bottom sides and / or the left and right sides of the first area. Optionally, the black border areas in the first projection interface may include the black border areas in the first interface and / or black border areas added by the first device.

[0138] Optionally, the first projection data may be part of the projection data stream sent by the third device to the first device in response to the first instruction. The projection data stream can be used to generate a video stream to be played. The first projection interface may be a frame of the video stream. The processing method of other frames in the video stream is similar to the processing method corresponding to the first projection interface. In this embodiment, they will not be described in detail.

[0139] Example 3: In one example, based on the scenario of Example 1 above, taking the first device as a set-top box and the first display screen as a large screen connected to the set-top box as an example, the first projection interface displayed by the first device on the first display screen can be... Figure 7 The first projection interface shown includes a first area containing first content, a black border area 1 located to the left of the first area, and a black border area 2 located to the right of the first area.

[0140] Example 4: In one example, based on the scenario of Example 2 above, taking the first device as a set-top box and the first display screen as a large screen connected to the set-top box as an example, the first projection interface displayed by the first device on the first display screen can be... Figure 8 The first screen mirroring interface shown includes a first area containing the first content and black border areas 1-4 located on the left, right, top, and bottom sides of the first area. Black border areas 1 and 2 in the first screen mirroring interface are the black border areas originally displayed on the third display screen, while black border areas 3 and 4 are black border areas added when the third device (i.e., a mobile phone) mirrors to the first device (i.e., a set-top box). Optionally, the display format of the black border areas originally displayed on the third display screen and the black border areas added by the third device can be different.

[0141] In some embodiments of this application, a call connection is established between the first device and the second device. For example, in one possible scenario, the first device and the second device can establish a call connection before the third device projects its screen to the first device. In this scenario, while the first device and the second device are connected, the first device and the third device can perform steps A1 to A4 as described above. After the first device and the third device perform steps A1 to A4, the first device can automatically perform step S601 and subsequent steps, or the first device can perform step S601 and subsequent steps in response to a received user operation. The user operation is used to instruct the sharing of the projected interface to the second device. In another possible scenario, after the third device projects its screen to the first device, the first device and the second device can establish a call connection. After the first device and the third device perform steps A1 to A4, once the first device and the second device have established a call connection, the first device can automatically perform step S601 and subsequent steps, or the first device can perform step S601 and subsequent steps in response to a received user operation. The user operation is used to instruct the sharing of the projected interface to the second device.

[0142] In some embodiments of this application, there are no black border areas on the top and bottom sides and / or left and right sides of the second projection interface. The second projection interface can be used for the second device to display on a second display screen in a first state. The first state includes at least one of a landscape state and a portrait state. When the second display screen is a foldable screen, the first state may also include one of a folded state and an unfolded state. The process by which the first device generates first data for indicating the second projection interface based on the first projection interface may include the following steps B1 to B4:

[0143] B1: The first device detects the position and size of the black border area in the first projection interface.

[0144] Specifically, the first device can detect black borders on the first projection interface to determine the position and size of each black border area. Simultaneously, the first device can also determine the position and size of the area containing the valid content (i.e., the aforementioned first content) on the first projection interface, i.e., the aforementioned first area. Based on this method, the first device can also determine the landscape / portrait state and / or aspect ratio of the third display screen based on the detected black border areas and the area containing the valid content.

[0145] For example, in Example 3 above, the first device by... Figure 7 The first projection interface shown in the diagram performs black border detection, which can determine the position and size of black border area 1 and black border area 2 added by the third device during projection, as well as the position and size of the first area. Based on the position and size of the first area, the first device can further determine the landscape and portrait states and aspect ratio of the third display screen.

[0146] For example, in Example 4 above, the first device by... Figure 8 The first projection interface shown in the diagram performs black border detection, which can determine the position and size of the original black border area 1, black border area 2, black border area 3, and black border area 4 added by the third device during projection, as well as the position and size of the first area. Based on the position and size of black border area 1, black border area 2, and the first area, the first device can determine the landscape and portrait states and aspect ratio of the third display screen.

[0147] B2: The first device acquires the aspect ratio of the second display screen in the first state.

[0148] In some embodiments of this application, before step S601, the first device can obtain the status of the second display screen from the second device. Alternatively, after establishing a connection with the first device (e.g., a call connection as described above), the second device can indicate the status of the second display screen to the first device. Specifically, before step S601, the second device can send first information to the first device after establishing a connection with the first device, or in response to a request from the first device. The first information can be used to indicate any of the following:

[0149] 1) Aspect ratio of the second display screen in the first state.

[0150] In this method, the second device can calculate the aspect ratio of the second display screen in the first state based on the first state of the second display screen and the resolution of the second display screen, and indicate this to the first device through the first information. The first device can directly obtain the aspect ratio of the second display screen in the first state based on the first information.

[0151] 2) Resolution of the first state and the second display screen.

[0152] In this method, the first information is used to determine the aspect ratio of the second display screen in the first state. The second device can directly indicate the first state of the second device and the resolution of the second display screen through the first information. The first device can calculate the aspect ratio of the second display screen in the first state based on the first state and the resolution of the second display screen. For example, when the first state is landscape mode and the resolution of the second display screen is x×y, the first device can determine that the aspect ratio of the second display screen in the first state is y / x.

[0153] Optionally, when the first state includes a folded state or an unfolded state, the resolution of the second display screen can be the resolution of the second display screen in the folded state or the unfolded state.

[0154] In some embodiments of this application, the first information may be any of the following signals or may be carried in any of the following signals:

[0155] 1) Session Description Protocol (SDP) signals.

[0156] 2) Real-time transport protocol (RTP) signal.

[0157] As an optional implementation, the extended header (or extended header field) of the RTP packet (i.e., the data packet corresponding to the RTP signal) may include information indicating the resolution of the first and second displays. For example, Figure 9 This is a schematic diagram of the data structure of an RTP packet's extended header. In one example, such as... Figure 9 As shown, the extended header of an RTP packet may include an identity document (ID) field, a length (L) field, a rotation angle (ROG) field, and a resolution field. The identity field indicates the identifier of the extended header field (this identifier can be a value negotiated via SDP signals). The length field indicates the length of the extended header minus one. The rotation angle field indicates the rotation angle of the second display screen. The state of the second display screen can be determined based on the rotation angle. The rotation angle can be one of the following values:

[0158] a. 0x00 indicates that the rotation angle is 0 degrees, which corresponds to the default direction.

[0159] b. 0x01 indicates that the rotation angle is 90 degrees and the rotation direction is clockwise.

[0160] c, 0x02, indicates that the rotation angle is 180 degrees and the rotation direction is clockwise.

[0161] d, 0x03, indicates that the rotation angle is 270 degrees and the rotation direction is clockwise.

[0162] The resolution field is used to indicate the resolution of the second display screen.

[0163] It should be noted that, Figure 9 The data structure of the RTP packet extension header shown is only an example and does not limit the data structure of the RTP packet extension header applicable to the solution provided in the embodiments of this application. The data structure of the RTP packet extension header applicable to the solution provided in the embodiments of this application may also be other structures.

[0164] 3) Real-time transport control protocol (RTCP) signals.

[0165] Optionally, the execution order of steps B1 and B2 can be arbitrary, and no specific restrictions are imposed in this embodiment.

[0166] B3: The first device determines the second projection interface based on the first projection interface, the position and size of the black border area in the first projection interface, and the aspect ratio of the second display screen in the first state.

[0167] Optionally, the aspect ratio of the second display screen in the first state can be used to determine the aspect ratio of the second projection interface.

[0168] The first device can determine the cropping method for the black border area in the first projection interface based on the aspect ratio of the second display screen in the first state, and generate first cropping information to indicate the cropping method. The cropping method is one that maximizes the aspect ratio of the interface obtained after cropping the black border area in the first projection interface to approximate the aspect ratio of the second display screen. The first cropping information indicates the cropping position and cropping ratio for the black border area in the first projection interface. The first device can crop the black border area in the first projection interface based on this cropping method, so that the aspect ratio of the cropped interface maximizes the approximate aspect ratio of the second display screen, thereby obtaining the second projection interface. Optionally, the aspect ratio of the second projection interface can be the same as that of the second display screen.

[0169] In some embodiments of this application, after the first device generates the first cropping information, it can save the first cropping information. Based on the first cropping information, it can crop the black border area of ​​the subsequent projection interface from the third device and share the resulting interface with the second device. The second device can display the interface from the first device on the second display screen in the first state. For example, based on this method, after step S602, the following step can be further included: the first device updates the first projection interface to a fourth projection interface, and based on the first cropping information, crops the black border area in the fourth projection interface to obtain a fifth projection interface. The first device generates third data based on the fifth projection interface and sends it to the second device. The second device can determine the fifth projection interface based on the third data and update the second projection interface displayed on the second display screen in the first state to the fifth projection interface.

[0170] Example 5: In one example, based on the scenario of Example 3 above, taking a mobile phone as the second device and the second display screen in portrait mode as an example, the second screen projection interface can be... Figure 10 The interface shown in diagram (a) is described above. The second projection interface can be the interface that the first device will project. Figure 7 The image shows the result after cropping all the black border areas in the first projection interface. In this scenario, the cropping method indicated by the first cropping information can be: cropping all black border areas.

[0171] Example 6: In one example, based on the scenario of Example 3 above, taking a tablet as the second device and the second display screen in portrait mode as an example, the second screen projection interface can be... Figure 10 The interface shown in diagram (b) is shown in this example. In this example, the second projection interface can be the interface that the first device projects. Figure 7 The first projection interface shown is obtained by cropping the black border areas of the first proportion from the left and right sides. That is, the first device in... Figure 7 In the first projection interface shown, after cropping the area to the left of the black border area 1 (at a first ratio) and the area to the right of the black border area 2 (at a first ratio), a second projection interface can be obtained. In this scenario, the first device can determine the first ratio based on the size of the black border area in the first projection interface, the size of the first area in the first projection interface, and the aspect ratio of the second display screen. The cropping method indicated by the first cropping information can be: cropping the left black border area at a first ratio, and cropping the right black border area at a first ratio.

[0172] Example 7: In one example, based on the scenario of Example 4 above, taking a mobile phone as the second device and the second display screen in portrait mode as an example, the second screen projection interface can be... Figure 11 The second screen mirroring interface is shown in the diagram. This second screen mirroring interface can be the interface where the first device projects the second screen. Figure 8 The image shows the first projection interface after cropping the black borders on the left and right sides. That is, the first device in... Figure 8 In the first projection interface shown, after cropping black border areas 3 and 4, a second projection interface can be obtained. In this scenario, the cropping method indicated by the first cropping information can be: cropping all black border areas on the left and right sides.

[0173] B4: The first device generates the first data based on the second projection interface.

[0174] Optionally, the first data may be a portion of the data in the shared data stream sent by the first device to the second device. The shared data stream can be used to generate a video stream to be played by the first device and shared by the first device to the second device. The second projection interface may be a frame of the video stream. The processing method of other frames in the video stream is similar to the processing method corresponding to the second projection interface, and will not be described in detail in this embodiment.

[0175] S602: The first device sends the first data to the second device.

[0176] S603: The second device displays a second projection interface on a second display screen based on the first data.

[0177] Optionally, the second display screen can be in a first state. After receiving the first data, the second device can determine the second projection interface based on the first data. When the aspect ratio of the second projection interface is the same as that of the second display screen, the second device can display the second projection interface on the second display screen in the first state. When the aspect ratio of the second projection interface is different from that of the second display screen, the second device can add black border areas to the top and bottom and / or left and right sides of the second projection interface based on the aspect ratio of the second display screen, so that the aspect ratio of the second projection interface after adding the black border areas is the same as that of the second display screen, and then display the second projection interface after adding the black border areas on the second display screen in the first state.

[0178] Optionally, the method by which the first device shares the first projection interface to other devices can be implemented with reference to the above method, and will not be described in detail in this embodiment. For example, the above method is applied to Figure 3 In the system shown, the method by which the first device shares the first projection interface to the fourth device can refer to the method described above for the first device to share the first projection interface to the second device.

[0179] Examples 1 to 7 above illustrate the method provided in this application embodiment using scenarios where the third device is in portrait mode and the second device is in portrait mode. Example 8 below further illustrates the method provided in this application embodiment using scenarios where the third device is in portrait mode and the second device is in landscape mode, to facilitate understanding of the solution provided in this application embodiment.

[0180] Example 8: In one example, considering a scenario where the first device is a set-top box, the first display is a large screen connected to the set-top box, the second device is a tablet in landscape mode, and the third device is a mobile phone in portrait mode, the first interface displayed on the third device can be... Figure 12 The first interface shown is illustrated. The first interface includes first content, which occupies the entire area of ​​the first interface. Based on the method described in steps A1-A4 above, the first projection interface generated by the third device when projecting its screen to the first device and the first projection interface displayed by the first device on the first display screen can be... Figure 12 The first projection interface shown has the same aspect ratio as the first display screen, and black borders exist on the left and right sides. Based on the methods described in steps B1 to B4 above, the first device... Figure 12 After cropping the black border area in the first projection interface shown, the resulting second projection interface can be... Figure 12 The second screen mirroring interface is shown in the image. Among them, Figure 12 The aspect ratio of the second projection interface shown can be the same as that of the display screen of the second device in landscape mode. The first device is for... Figure 12 The black border area in the first projection interface shown is cropped as follows: a second-ratio black border area is cropped from the left side of black border area 1, and a second-ratio black border area is cropped from the right side of black border area 2. The second ratio can be determined based on the position and size of each area in the first projection interface, as well as the aspect ratio of the second device's display screen. The first device will... Figure 12 After the second screen mirroring interface shown is shared to the second device in landscape mode, the second device can directly display the second screen mirroring interface on its own screen.

[0181] The following example, exemplified by Example 9, illustrates the method provided in this application embodiment in a scenario where the third device is in landscape mode and the second device is in portrait mode, to facilitate understanding of the solution provided in this application embodiment.

[0182] Example 9: In one example, taking a scenario where the first device is a set-top box, the first display screen is a large screen connected to the set-top box, the second device is a mobile phone in portrait mode, and the third device is a mobile phone in landscape mode, the first interface displayed on the third device can be... Figure 13 The first interface shown is illustrated. The first interface includes first content, which occupies a portion of the first interface. The area of ​​the first interface other than the area containing the first content is a black border area (i.e.,...). Figure 13 The black border area 1 and black border area 2 in the first interface shown. Based on the method described in steps A1 to A4 above, the first projection interface generated by the third device when projecting to the first device and the first projection interface displayed by the first device on the first display screen can be... Figure 13 The first projection interface shown has the same aspect ratio as the first display screen, and has black border areas 1 and 2 on the left and right sides, and black border areas 3 and 4 on the top and bottom sides. The top and bottom black border areas are blackboard areas added to the first interface to accommodate the aspect ratio of the first display screen when the third device projects its screen to the first device. Based on the methods described in steps B1 to B4 above, the first device... Figure 13 After cropping the black border area in the first projection interface shown, the resulting second projection interface can be... Figure 13 The second screen mirroring interface is shown in the image. The first device is designed for... Figure 13 The black border area in the first projection interface shown is cropped in the following way: black border areas 1, 2, and 3 are cropped by removing the third-ratio black border areas on the left and right sides, as well as black border areas 4 are cropped by removing the third-ratio black border areas on the left and right sides. The third ratio can be determined based on the position and size of each area in the first projection interface, and the aspect ratio of the second device's display screen. The first device cropped the black border areas by... Figure 13By cropping the black border area in the first projection interface shown above, a second projection interface with an aspect ratio closest to that of the second device's display can be obtained. The first device will... Figure 13 When the second projection interface shown is shared to a second device in landscape mode, because the aspect ratio of the second projection interface is different from that of the second device's display screen, the second device can add black borders to the top and bottom sides of the second projection interface based on its own display screen's aspect ratio, thus obtaining... Figure 13 The second interface shown has the same aspect ratio as the display screen of the second device, and the second interface is displayed.

[0183] The following example 10 illustrates the method provided in this application embodiment in the scenario where the third device is in landscape mode and the second device is in landscape mode, so as to facilitate understanding of the solution provided in this application embodiment.

[0184] Example 10: In one example, taking a scenario where the first device is a set-top box, the first display screen is a large screen connected to the set-top box, the second device is a mobile phone in landscape mode, and the third device is a mobile phone in landscape mode, the first interface displayed on the third device can be... Figure 14 The first interface shown is illustrated. The first interface includes first content, which occupies the entire area of ​​the first interface. Based on the method described in steps A1-A4 above, the first projection interface generated by the third device when projecting its screen to the first device and the first projection interface displayed by the first device on the first display screen can be... Figure 14 The first projection interface shown has the same aspect ratio as the first display screen, and black border area 1 and black border area 2 are respectively located on the top and bottom sides of the interface. Based on the method described in steps B1 to B4 above, the first device... Figure 14 After cropping the black border area in the first projection interface shown, the resulting second projection interface can be... Figure 14 The second screen mirroring interface is shown in the image. Among them, Figure 14 The aspect ratio of the second projection interface shown is the same as that of the display screen of the second device in landscape mode. The first device is for... Figure 14 The black border area in the first projection interface shown is cropped as follows: the upper part of black border area 1 (with a fourth aspect ratio) is cropped, and the lower part of black border area 2 (with a fourth aspect ratio) is cropped. The fourth aspect ratio can be determined based on the position and size of each area in the first projection interface, as well as the aspect ratio of the second device's display screen. The first device will... Figure 14 After the second screen mirroring interface shown is shared to the second device in landscape mode, the second device can directly display the second screen mirroring interface on its own screen.

[0185] In summary, in a screen-sharing scenario, before sharing the first screen-sharing interface from the third device to the second device, the first device can crop the black border area of ​​the first screen-sharing interface based on the first state of the second device's second display screen. This ensures that the aspect ratio of the cropped second screen-sharing interface is as close as possible to the aspect ratio of the second display screen, thereby maximizing the display of effective content when the cropped second screen-sharing interface is displayed on the second display screen. Therefore, the above method can obtain a second screen-sharing interface that is more suitable for display on the second display screen in the first state. Based on this, after the first device sends the second screen-sharing interface to the second device, the second device can maximize the display of effective content by displaying the second screen-sharing interface, thus improving the display effect of screen-sharing.

[0186] Example 2

[0187] In some embodiments of this application, based on the solution provided in Embodiment 1 above, after the state of the second display screen corresponding to the second device (including landscape / portrait mode and / or folded mode) changes, the first device can perform corresponding cropping processing on the black border area of ​​the interface displayed on the first display screen based on the changed state of the second display screen, so that the aspect ratio of the cropped projection interface is as close as possible to the aspect ratio of the second display screen in the changed state. Based on this method, even if the state of the second display screen changes, it can be ensured that the effective content in the projection interface shared by the first device to the second device can be maximized for display, thereby ensuring that the display effect is not affected by the state of the second display screen.

[0188] Based on this method, taking the scenario in Embodiment 1 where the first display screen displays the first projection interface and the second display screen displays the second projection interface, and the state of the second display screen changes as an example, after step S603, it may further include... Figure 15 The method described in steps S1501 to S1503 shown below:

[0189] S1501: After the second display screen switches from the first state to the second state, the first device generates second data based on the first projection interface to indicate the third projection interface; wherein, the third projection interface is obtained by cropping the black border area existing in the first projection interface, and the third projection interface is used to display on the second display screen in the second state.

[0190] The second state can include either a landscape state or a portrait state. When the second display screen is a foldable screen, the second state can also include either a folded state or an unfolded state.

[0191] In the first possible scenario, when the second display screen is not a foldable screen (i.e., the second display screen is a flat screen), the switch from the first state to the second state can be a switch between portrait and landscape modes. Specifically, the switch between portrait and landscape modes can be any of the following:

[0192] 1) The second display screen switches from landscape mode to portrait mode.

[0193] 2) The second display screen switches from portrait mode to landscape mode.

[0194] In the second possible scenario, when the second display screen is a foldable screen, the switch from the first state to the second state can be a switch between portrait and landscape modes and / or a switch between foldable modes. The switch between portrait and landscape modes can be described as described in the first possible scenario above, and the switch between foldable modes can specifically be any of the following:

[0195] 1) The second display screen switches from the folded state to the unfolded state.

[0196] 2) The second display screen switches from the unfolded state to the folded state.

[0197] In some embodiments of this application, after the second display screen switches from a first state to a second state, the second device can send second information to the first device. This second information can be used to determine the aspect ratio of the second display screen in the second state. The first device can determine the aspect ratio of the second display screen in the second state based on the first information, and then crop the black border area in the first projection interface based on this aspect ratio to obtain a third projection interface. Specifically, the method by which the first device crops the black border area in the first projection interface based on the aspect ratio of the second display screen in the second state to obtain the third projection interface can be implemented by referring to the method described in step B3 above, which involves cropping the first projection interface based on the aspect ratio of the second display screen in the first state to obtain the second projection interface; this will not be detailed here. The second information sent by the second device to the first device can be used to indicate any of the following:

[0198] 1) Aspect ratio of the second display screen in the second state.

[0199] 2) The resolution of the second state and / or the second display screen.

[0200] In the first possible scenario described above, the second information can be used to indicate the second state. In the second possible scenario, when the second display screen switches from the first state to the second state (a switch between portrait and landscape orientations), the second information can be used to indicate the second state. When the second display screen switches from the first state to the second state (a switch between folded and landscape orientations), the second information can be used to indicate both the second state and the resolution of the second display screen.

[0201] In the above method, when the second display screen switches from the first state to the second state (including switching to a folded state), this switching process causes a change in the resolution of the second display screen. Therefore, the resolution of the second display screen indicated by the second information can be the changed resolution. Based on this method, the second device can also indicate the changed resolution of the second display screen to the first device after determining that the resolution of the second display screen has changed.

[0202] S1502: The first device sends the second data to the second device.

[0203] S1503: The second device displays a third projection interface through a second display screen in a second state, based on the second data.

[0204] The implementation method of steps S1502 to S1503 can be referred to the method described in steps S602 to S603 above, and will not be described in detail here.

[0205] It should be understood that in scenarios where the state of the second display screen changes while other screen-sharing interfaces are displayed on the first and second display screens, the method for the first device to share screens with the second device is similar to the method described in steps S1501 to S1503 above. Therefore, it can be implemented by referring to the method described in steps S1501 to S1503 above, and will not be described in detail in this application embodiment.

[0206] Based on the above method, when the state of the second display screen corresponding to the second device changes, the second device can indicate the relevant information of the changed state of the second display screen (such as the second state mentioned above, the resolution of the second display screen, etc.) to the first device. The first device can then re-crop the black border area in the projection interface displayed on the first display screen based on the relevant information of the changed state of the second display screen, so that the aspect ratio of the cropped projection interface is as close as possible to the changed aspect ratio of the second display screen. This will maximize the display of effective content when the cropped projection interface is displayed on the second display screen, thereby improving the display effect of projection sharing.

[0207] The solutions provided in Embodiments 1 and 2 above can be applied to... Figure 3 , Figure 4 or Figure 5 The system shown above applies the solution provided in Embodiment 1. Figure 4 Taking the system shown as an example, a possible screen sharing method provided in this application embodiment can be referred to the following embodiment three.

[0208] Example 3

[0209] The solutions provided in Embodiments 1 and 2 above are applied to Figure 4 In the system shown, taking the scenario of a call connection between the set-top box and the first mobile phone as an example, refer to... Figure 16 The process of a possible screen-sharing method provided in this application embodiment may include:

[0210] S1601: The set-top box and the first mobile phone establish a call connection through call media negotiation.

[0211] The set-top box and the first mobile phone can establish a call relationship and a transmission channel for transmitting call data streams during the call through call media negotiation. This call data stream can be an audio data stream or a video data stream.

[0212] S1602: Data stream transmission between the set-top box and the first mobile phone.

[0213] S1603: The first mobile phone indicates the status and resolution of its display screen to the set-top box.

[0214] Optionally, the first mobile phone can transmit information such as the status and resolution of its display screen through a transmission channel established between the first mobile phone and the set-top box for transmitting call data streams.

[0215] Regarding the state of the display screen of the first mobile phone, please refer to the first state described in Embodiment 1, which will not be elaborated here.

[0216] Optionally, the implementation method of step S1603 can be referred to step B2 above, which will not be described in detail here.

[0217] Optionally, the execution order of steps S1603 and S1602 can be arbitrary, and no restriction is imposed in this embodiment.

[0218] Optionally, the set-top box can save the state and resolution of the first mobile phone screen for use in subsequent processes.

[0219] S1604: The set-top box and the second mobile phone establish a screen mirroring connection through screen mirroring negotiation.

[0220] S1605: The second mobile phone sends a screen mirroring data stream to the set-top box.

[0221] The screen mirroring data stream may include the screen mirroring interface with a black border added. Regarding this screen mirroring interface, please refer to the first screen mirroring interface described in Embodiment 1, which will not be detailed here. The set-top box can display the screen mirroring interface based on the received screen mirroring data stream.

[0222] Regarding the triggering method and specific implementation process of steps S1604 to S1605, please refer to the corresponding methods described in steps A1 to A4 above, which will not be detailed here.

[0223] S1606: The set-top box detects black borders on the large-screen display to determine the position and size of the black border area on the screen.

[0224] The implementation method of step S1606 can be referred to step B1 above, and will not be described in detail here.

[0225] S1607: The set-top box determines the aspect ratio of the first mobile phone's display screen based on the status and resolution of the first mobile phone's display screen.

[0226] Optionally, the set-top box can save the aspect ratio of the first mobile phone's screen for use in subsequent processes.

[0227] S1608: The set-top box clips the black border area of ​​the large-screen display based on the aspect ratio of the first mobile phone's screen, and generates a new screen projection data stream based on the clipped interface.

[0228] The method for cropping the black border area of ​​the large-screen display based on the aspect ratio of the first mobile phone's screen can be implemented by referring to the relevant methods in steps B1 to B4 above, and will not be described in detail here.

[0229] S1609: The set-top box sends a new screen mirroring data stream to the first mobile phone.

[0230] S1610: The first mobile phone displays the screen mirroring interface based on the received screen mirroring data stream.

[0231] Optionally, after step S1610, the following steps may also be included:

[0232] S1611: The first mobile phone detects a change in the screen orientation and / or resolution of its display.

[0233] The change in the resolution of the first mobile phone's display can also be understood as a change in the folding state of the first mobile phone's display.

[0234] S1612: The first mobile phone indicates to the set-top box the landscape / portrait state and / or resolution of the first mobile phone's display screen after the change.

[0235] S1613: The first device determines the aspect ratio of the first mobile phone's display screen after the change in screen orientation and / or resolution.

[0236] Optionally, the set-top box can save the aspect ratio of the first mobile phone's screen after the change for use in subsequent processes.

[0237] S1614: The set-top box clips the black border area in the large-screen display based on the aspect ratio of the first mobile phone's screen, and generates a new screen projection data stream based on the clipped interface.

[0238] S1615: The set-top box sends a new screen mirroring data stream to the first mobile phone.

[0239] S1616: The first mobile phone displays the screen mirroring interface based on the received screen mirroring data stream.

[0240] Optionally, steps S1613 to S1616 can be implemented by referring to steps S1607 to S1610, which will not be described in detail here.

[0241] It should be noted that the execution order of steps that are not time-related in the above embodiments can be arbitrary. For example, the execution order of steps S1603 and S1604 to S1605 can be arbitrary, and this application embodiment does not impose any restrictions on this.

[0242] Example 4

[0243] In some embodiments of this application, in a scenario where a first device shares an interface containing a black border area projected from a third device to a second device for display, the first device can determine, based on a notification from the second device, whether the second device has the capability to process the black border area, and perform subsequent processing based on this capability. The capability to process the black border area includes the ability to detect and crop the black border area.

[0244] In one possible scenario, when the second device lacks the ability to process the black border area, the first, second, and third devices can refer to the methods provided in Embodiments 1 and 2 above for processing. Based on this method, before step S601 described in Embodiment 1, the following step may be included: the second device sends third information to the first device; wherein the third information is used to instruct the first device to process the black border area and / or to instruct the second device not to have the ability to process the black border area. Optionally, this step can be performed after the first device and the second device establish a call connection.

[0245] In another possible scenario, when the second device has the capability to handle black border areas, the first device can directly share the interface containing black border areas projected from the third device to the second device. The second device can then process the black border areas in that interface before displaying it. The method by which the second device processes the black border areas in the interface can refer to the method described in Embodiment 1 for the first device to process the black border areas in the first projected interface, which will not be described in detail in the following embodiments. Based on this method, refer to... Figure 17 A possible screen-sharing method provided in this application embodiment may include:

[0246] S1701: The second device sends first information to the first device; wherein the first information is used to instruct the first device to process the black border area and / or to instruct the second device not to have the ability to process the black border area.

[0247] After the first device and the second device establish a connection, the second device can proactively send first information to the first device, or it can respond to a request from the first device by sending first information to the second device. This request can be used to request access to the second device's black border area processing capabilities. Optionally, the first device can send this request to the second device after displaying a first projection interface from the third device on a first display screen.

[0248] S1702: The first device sends first data to the second device; wherein the first data is used to instruct the first device to display a first projection interface on the first display screen, and the first projection interface has a black border area.

[0249] The first projection interface can originate from a third device. The method for the first device to display the first projection interface from the third device on the first display screen can be referred to the method described in steps A1 to A4 of the aforementioned Embodiment 1, and will not be repeated here. Regarding the first projection interface, please refer to the description in the aforementioned Embodiment 1, and will not be repeated here.

[0250] In some embodiments of this application, a call connection is established between the first device and the second device. For example, in one possible scenario, the first and second devices can establish a call connection before the third device projects its screen onto the first device. In this scenario, while the first and second devices are connected, they can execute steps A1 to A4 as described in Embodiment 1. After the first and third devices execute steps A1 to A4, they can automatically execute steps S1701 to S1702, or they can execute steps S1701 to S1702 in response to a received user operation. The user operation instructs the first device to share its screen projection interface with the second device. In another possible scenario, after the third device projects its screen onto the first device, the first and second devices can establish a call connection. After the first and third devices execute steps A1 to A4, once the call connection is established, they can automatically execute steps S1701 to S1702, or they can execute steps S1701 to S1702 in response to a received user operation. This user action is used to instruct the screen sharing interface to a second device.

[0251] Optionally, after step S1702, the following steps S1703 to S1704 may also be included:

[0252] S1703: The second device generates a second projection interface based on the first data; wherein the second projection interface is obtained by cropping the black border area existing in the first projection interface.

[0253] In some embodiments of this application, there are no black border areas on the top and bottom sides and / or left and right sides of the second projection interface. The second projection interface can be used by the second device to display on a second display screen in a first state. The first state includes at least one of a landscape state and a portrait state. When the second display screen is a foldable screen, the first state may also include one of a folded state and an unfolded state. The second device can determine the first projection interface based on first data. The method by which the second device crops the first projection interface to obtain the second projection interface may include the following steps C1 to C2:

[0254] C1: The second device detects the position and size of the black border area in the first projection interface.

[0255] Step C1 can be implemented by referring to step B1 in the aforementioned embodiment one, and will not be described in detail here.

[0256] C2: The second device generates a second projection interface based on the first projection interface, the position and size of the black border area in the first projection interface, and the aspect ratio of the second display screen in the first state.

[0257] Optionally, the aspect ratio of the second display screen in the first state can be used to determine the aspect ratio of the second projection interface.

[0258] The second device can determine the cropping method for the black border area in the first projection interface based on the aspect ratio of the second display screen in the first state, and generate first cropping information to indicate the cropping method. The cropping method is one that maximizes the aspect ratio of the interface obtained after cropping the black border area in the first projection interface to approximate the aspect ratio of the second display screen. The first cropping information indicates the cropping position and cropping ratio for the black border area in the first projection interface. The second device can crop the black border area in the first projection interface based on this cropping method, so that the aspect ratio of the cropped interface maximizes the approximate aspect ratio of the second display screen, thereby obtaining the second projection interface. Optionally, the aspect ratio of the second projection interface can be the same as that of the second display screen.

[0259] In some embodiments of this application, after the second device generates the first cropping information, it can save the first cropping information. Based on the first cropping information, it can crop the black border area of ​​the subsequent projection interface from the first device and display the resulting interface on the second display screen in the first state. For example, based on this method, after step S1704, the following steps may be included: the first device updates the first projection interface to a third projection interface and sends second data to the second device to indicate the third projection interface. The second device determines the third projection interface based on the second data. Based on the first cropping information, the second device crops the black border area present in the third projection interface to obtain a fourth projection interface and displays the fourth projection interface.

[0260] The specific process and related examples of the above method (i.e., step C2) can be found in step B3 of the aforementioned embodiment, and will not be described in detail here.

[0261] S1704: The second device displays the second projection interface through the second display screen.

[0262] The device form and state of the first device, the second device, and the third device, as well as the display effects of the first display screen and the second display screen, can be referred to in Examples 1 to 10 above, and will not be repeated here.

[0263] In some embodiments of this application, based on the method provided in Embodiment 4, after the state of the second display screen corresponding to the second device (including landscape / portrait mode and / or folded mode) changes, the second device can perform corresponding cropping processing on the black border area in the projection interface from the first device based on the changed state of the second display screen, so that the aspect ratio of the cropped projection interface is as close as possible to the aspect ratio of the second display screen in the changed state. Based on this method, even if the state of the second display screen changes, it can be ensured that the effective content in the projection interface shared by the first device to the second device can be maximized for display, thereby ensuring that the display effect is not affected by the state of the second display screen.

[0264] Based on this method, taking the scenario where the state of the second display screen changes when the first display screen displays the first projection interface and the second display screen displays the second projection interface as an example, after step S1704, the method described in steps S1705 to S170 may also be included:

[0265] S1705: After the second device switches the second display screen from the first state to the second state, it displays a third projection interface through the second display screen; wherein, the third projection interface is obtained by cropping the black border area existing in the first projection interface, and the third projection interface is used to display on the second display screen in the second state.

[0266] In this method, the third projection interface is different from the second projection interface.

[0267] Regarding the second state, and the specific circumstances under which the second display screen switches from the first state to the second state, please refer to the relevant description in step S1501 of the aforementioned embodiment two, which will not be repeated here. As for the method by which the second device crops the black border area existing in the first projection interface to obtain the third projection interface...

[0268] In some embodiments of this application, the second device can crop the black border area of ​​the first projection interface based on the aspect ratio of the second display screen in the second state to obtain the third projection interface. This method can be implemented with reference to the method described in step B3 above, where the first device crops the first projection interface based on the aspect ratio of the second display screen in the first state to obtain the second projection interface, which will not be described in detail here.

[0269] It should be understood that in scenarios where the state of the second display screen changes while other screen-sharing interfaces are displayed on the first and second display screens, the method for the first device to share screens with the second device is similar to the method described in steps S1701 to S1704 above. Therefore, it can be implemented by referring to the method described in steps S1701 to S1704 above, and will not be described in detail in this application embodiment.

[0270] The solution provided in Embodiment 4 above can be applied to Figure 3 , Figure 4 or Figure 5 The system shown above applies the solution provided in Embodiment 4. Figure 4 Taking the system shown as an example, a possible screen sharing method provided in this application embodiment can be referred to the following embodiment five.

[0271] Example 5

[0272] The solution provided in Embodiment 4 above is applied to Figure 4 In the system shown, taking the scenario of a call connection between the set-top box and the first mobile phone as an example, refer to... Figure 18 The process of a possible screen-sharing method provided in this application embodiment may include:

[0273] S1801: The set-top box and the first mobile phone establish a call connection through call media negotiation.

[0274] S1802: Data stream transmission between the set-top box and the first mobile phone.

[0275] Optionally, steps S1801 to S1802 can be implemented by referring to steps S1601 to S1602, which will not be described in detail here.

[0276] S1803: Set-top box's ability to handle the black border area of ​​the first mobile phone.

[0277] Among them, the first mobile phone's black border area processing capability may be unable to process black border areas, that is, the first mobile phone does not have the capability to process black border areas.

[0278] S1804: The set-top box and the second mobile phone establish a screen mirroring connection through screen mirroring negotiation.

[0279] S1805: The second mobile phone sends a screen mirroring data stream to the set-top box.

[0280] Optionally, steps S1804 to S1805 can be implemented by referring to steps S1604 to S1605, which will not be described in detail here.

[0281] S1806: The set-top box sends the screen mirroring data stream to the first mobile phone.

[0282] S1807: The first mobile phone performs black border detection on the interface in the screen-projected data stream to determine the position and size of the black border area in the interface.

[0283] S1808: The first mobile phone, based on the aspect ratio of its own display screen, crops the black border area of ​​the interface in the screen-projected data stream and displays the cropped interface.

[0284] The method for the first mobile phone to crop the black border area in the interface of the screen projection data stream according to the aspect ratio of its own display can be implemented by referring to the relevant methods in steps C1 to C2 above, and will not be described in detail here.

[0285] Optionally, after step S1808, the following steps may also be included:

[0286] S1809: The first mobile phone detects a change in the screen orientation and / or resolution of its display.

[0287] S1810: The first mobile phone, based on the changed aspect ratio of its own display screen, crops the black border area of ​​the interface in the screen projection data stream from the first device and displays the cropped interface.

[0288] Optionally, step S1810 can be implemented by referring to step S1808, which will not be described in detail here.

[0289] It should be noted that the execution order of steps that are not time-related in the above embodiments can be arbitrary. For example, the execution order of steps S1803 and S1804 to S1805 can be arbitrary, and this embodiment does not impose any restrictions on this.

[0290] It should be understood that the implementation processes provided in the embodiments one to five above are merely illustrative examples of the applicable method processes in the embodiments of this application. The execution order of each step in each embodiment can be adjusted according to actual needs, and other steps can be added or some steps can be removed. The execution order between steps that are not temporally related in each embodiment can be arbitrary, and this application does not impose any restrictions on this.

[0291] It should be noted that the application scenarios provided in the above embodiments are merely illustrative examples of the applicable scenarios of the embodiments of this application, and do not limit the applicable scenarios of the solutions of this application. Some methods or the same technical concepts provided in any of the above embodiments can also be applied in other embodiments or other scenarios, or can be combined with the methods provided in other embodiments. Specifically, they can be applied in combination with specific embodiments or specific scenarios, and will not be listed and described one by one in this application.

[0292] The solutions provided by the embodiments of this application have been described above. It is understood that, in order to achieve the above functions, each device may include hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should readily recognize that, in conjunction with the units and algorithm steps of the various examples described in the embodiments disclosed herein, the embodiments of this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0293] The embodiments of this application can divide the device into functional units according to the above method examples. For example, each function can be divided into a separate functional unit, or two or more functions can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0294] Based on the above embodiments and the same technical concept, this application also provides a communication device for implementing the functions of the device provided in this application. For example... Figure 19 As shown, the communication device 1900 may include a processing unit 1901 and a transceiver unit 1902. The communication device 1900 may be a device from any of the above embodiments, or it may be an apparatus applied to a device from any of the above embodiments.

[0295] In one implementation, the communication device 1900 may also include a storage unit 1903 for storing the program code and data of the communication device 1900. The storage unit 1903 may be a memory.

[0296] The processing unit 1901 can be used to control and manage the operation of the communication device 1900. The processing unit 1901 can be a processor or controller, such as a general-purpose central processing unit (CPU), a general-purpose processor, a digital signal processing unit (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computing functions, such as including one or more microprocessor combinations, a combination of a DSP and a microprocessor, etc.

[0297] The transceiver unit 1902 can be an interface circuit of the communication device 1900 for receiving signals from other devices. For example, when the communication device 1900 is implemented as a chip, the transceiver unit 1902 can be an interface circuit of the chip for sending signals to and receiving signals from other chips or devices.

[0298] The communication device 1900 can be used to implement the functions of the device provided in the embodiments of this application.

[0299] In one example, when the communication device 1900 is used to implement the function of the first device described in the above embodiments, the processing unit 1901 can be used to generate first data for instructing a second projection interface based on the first projection interface displayed by the first device through the first display screen; wherein, the second projection interface is obtained by cropping the black border area existing in the first projection interface, and the second projection interface is used for the second device to display on the second display screen in a first state, the first state including one of landscape state and portrait state. The transceiver unit 1902 can be used to send the first data to the second device.

[0300] In another example, when the communication device 1900 is used to implement the function of the second device described in the above embodiments, the transceiver unit 1902 can be used to receive first data from the first device; wherein, the first data is generated based on the first projection interface displayed by the first device through the first display screen; the first data is used to indicate the second projection interface, which is obtained by cropping the black border area existing in the first projection interface, and the second projection interface is used by the second device to display on the second display screen in a first state, the first state including one of landscape state and portrait state. The processing unit 1901 can be used to display the second projection interface through the second display screen in the first state based on the first data.

[0301] In one example, when the communication device 1900 is used to implement the function of the first device described in the above embodiments, the transceiver unit 1902 can be used to receive first information from the second device; wherein, the first information is used to instruct the first device to process the black border area and / or to instruct the second device not to have the ability to process the black border area. The transceiver unit 1902 can also be used to send first data to the second device; wherein, the first data is used to instruct the first device to display a first projection interface through a first display screen, and the first projection interface has a black border area.

[0302] In another example, when the communication device 1900 is used to implement the function of the second device described in the above embodiments, the transceiver unit 1902 can be used to send first information to the first device; wherein, the first information is used to instruct the first device to process the black border area and / or to instruct the second device not to have the ability to process the black border area. The transceiver unit 1902 can also be used to receive first data from the first device; wherein, the first data is used to instruct the first device to display a first projection interface through a first display screen, and the first projection interface has a black border area.

[0303] In one possible design, the transceiver unit 1902 may include a sending unit and a receiving unit, wherein the sending unit can be used to perform the sending operation in the above method embodiments, and the receiving unit can be used to perform the receiving operation in the above method embodiments.

[0304] The above examples illustrate some of the operational methods of the communication device 1900. It is understood that the processing unit 1901 can also be used to execute other processing-related steps or operations performed by the device in the above method embodiments, besides sending and receiving. The transceiver unit 1902 can also be used to execute other sending and / or receiving-related steps or operations performed by the device in the above method embodiments. For details, please refer to the relevant descriptions in the above method embodiments; further elaboration will not be repeated here.

[0305] It should be understood that the division of functional units in the embodiments of this application is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods. For example, the aforementioned transceiver unit 1902 can be split into a transmitting unit and a receiving unit, etc. Furthermore, the functional modules in the various embodiments of this application can be integrated into a single processor, exist as separate physical entities, or be integrated into a single module. The integrated modules can be implemented in hardware or as software functional modules.

[0306] Based on the above embodiments and the same technical concept, this application also provides a communication device, such as... Figure 20 As shown, the communication device can be Figure 19 The diagram illustrates one implementation of the hardware circuitry of a communication device. This communication device can be adapted to perform the functions of any of the devices described in the above method embodiments. For ease of explanation, Figure 20 Only the main components of the communication device are shown.

[0307] like Figure 20 As shown, the communication device 2000 may include at least one processor 2002. Optionally, the communication device 2000 may also include a communication interface 2001 and a memory 2003. The processor may also be referred to as a processing unit, processing board, processing module, processing device, etc. The processor 2002 can be used to execute instructions or programs stored in the memory 2003. When the instructions or programs stored in the memory 2003 are executed, the processor 2002 can be used to perform the operations performed by the processing unit 901 in the above embodiments, and the communication interface 2001 can be used to perform the operations performed by the transceiver unit 902 in the above embodiments.

[0308] Memory 2003 can be used to store program instructions and / or data. Memory 2003 and processor 2002 can be coupled or separated. The coupling in this embodiment is an indirect coupling or communication connection between devices, units, or modules, and can be electrical, mechanical, or other forms, used for information exchange between devices, units, or modules. Processor 2002 may operate in conjunction with memory 2003. Processor 2002 may execute program instructions stored in memory 2003. At least one of the at least one memory may be included in the processor.

[0309] In implementation, each step of the above method can be completed by integrated logic circuits in the processor's hardware or by instructions in software. The steps of the method disclosed in the embodiments of this application can be implemented by a hardware processor, or by a combination of hardware and software modules in the processor. The software modules can reside in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. This storage medium is located in memory, and the processor reads information from the memory and, in conjunction with its hardware, completes the steps of the above method. To avoid repetition, detailed descriptions are omitted here.

[0310] Optionally, the processor in this embodiment can be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method embodiment can be completed by integrated logic circuits in the processor's hardware or by software instructions. The processor can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0311] It is understood that the memory in the embodiments of this application may be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. It should be noted that the memory in the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0312] Communication interface 2001 is used to communicate with other devices via a transmission medium, thereby enabling the devices in communication device 2000 to communicate with other devices. In this embodiment, the communication interface can be a transceiver, circuit, bus, module, or other type of communication interface. In this embodiment, when the communication interface is a transceiver, the transceiver can include an independent receiver, an independent transmitter, or a transceiver integrating transceiver functions, or an interface circuit. A transceiver can also be called a transceiver unit, transceiver, transceiver device, etc. A receiver can sometimes be called a receiver module, receiving circuit, etc. A transmitter can sometimes be called a transmitter, transmitter module, transmitting circuit, etc. The processor can control the transceiver to receive or transmit signals. When the transceiver includes a receiver and a transmitter, the processor can control the receiver to perform the receiving operation in the above method embodiments, and the processor can control the transmitter to perform the transmitting operation in the above method embodiments.

[0313] Optionally, the communication device 2000 may also include a communication line 2004. The communication interface 2001, processor 2002, and memory 2003 can be interconnected via the communication line 2004. The communication line 2004 can be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. This communication line 2004 can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 20 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0314] The communication device 2000 may be a device or apparatus with a chip, or a device or apparatus with an integrated circuit, or a chip or chip system in the terminal device or communication device shown above. This application does not limit the specifics, as long as the communication device 2000 can be used to perform the operations performed by the device in the above method embodiments.

[0315] Based on the above embodiments and the same technical concept, this application also provides a computer-readable storage medium storing a computer program or instructions. When the computer program or instructions are run on a communication device, the communication device performs the method provided in the above embodiments for any device.

[0316] Based on the above embodiments and the same technical concept, this application also provides a computer program product, which includes a computer program or instructions. When the computer program or instructions are executed by a communication device, the method provided in the above embodiments for application to any device is implemented.

[0317] Based on the above embodiments and the same technical concept, this application also provides a chip system, which includes a processor for reading and executing software programs stored in a memory to implement the method provided in the above embodiments for application to any device.

[0318] Optionally, the processor can be a processing module, microprocessor, or integrated circuit integrated into the chip system.

[0319] Optionally, the chip system may also include the memory, which can be coupled to the processor via an interface.

[0320] Optionally, the chip system may also include a transceiver, which may be an input / output circuit or a communication interface. Optionally, the transceiver may include a receiver and a transmitter.

[0321] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, etc.) containing computer-usable program code.

[0322] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0323] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0324] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

Claims

1. A screen sharing method, applied to a first device, characterized in that, The method includes: Based on the first projection interface displayed by the first device through the first display screen, first data for indicating the second projection interface is generated; wherein, the second projection interface is obtained by cropping the black border area in the first projection interface, and the second projection interface is used by the second device to display on the second display screen in a first state, the first state including one of landscape state and portrait state. The first data is sent to the second device.

2. The method as described in claim 1, characterized in that, There are no black border areas on the top and bottom and / or left and right sides of the second projection interface.

3. The method as described in claim 1 or 2, characterized in that, The aspect ratio of the second projection interface is the same as that of the second display screen in the first state.

4. The method according to any one of claims 1 to 3, characterized in that, When the second display screen is a foldable screen, the first state also includes one of a folded state and an unfolded state.

5. The method according to any one of claims 1 to 4, characterized in that, After sending the first data to the second device, the method further includes: After the second display screen switches from the first state to the second state, it sends second data to the second device; wherein, the second state includes one of landscape state and portrait state, the second data is used to indicate the third projection interface, the third projection interface is obtained by cropping the black border area in the first projection interface, the third projection interface is different from the second projection interface, and the third projection interface is used by the second device to display on the second display screen in the second state.

6. The method as described in claim 5, characterized in that, There are no black border areas on the top and bottom sides and / or left and right sides of the third projection interface.

7. The method as described in claim 5 or 6, characterized in that, The aspect ratio of the third projection interface is the same as that of the second display screen in the second state.

8. The method according to any one of claims 5 to 7, characterized in that, When the second display screen is a foldable screen, the second state also includes one of a folded state and an unfolded state.

9. The method according to any one of claims 1 to 8, characterized in that, Before sending the first data to the second device, the method further includes: Receive first information from the second device; wherein, The first information is used to indicate the aspect ratio of the second display screen in the first state; or The first information is used to indicate the first state and the resolution of the second display screen, and the first information is used to determine the aspect ratio of the second display screen in the first state; The aspect ratio of the second display screen in the first state is used to determine the aspect ratio of the second projection interface.

10. The method according to any one of claims 1 to 4, characterized in that, The step of generating first data for instructing the second projection interface based on the first projection interface displayed by the first device through the first display screen includes: Detect the position and size of the black border area in the first projection interface; Obtain the aspect ratio of the second display screen in the first state; The second screen projection interface is determined based on the first projection interface, the position and size of the black border area in the first projection interface, and the aspect ratio of the second display screen in the first state. The first data is generated based on the second projection interface.

11. The method as described in claim 10, characterized in that, The step of determining the second projection interface based on the first projection interface, the position and size of the black border area in the first projection interface, and the aspect ratio of the second display screen in the first state includes: Based on the first projection interface, the position and size of the black border area in the first projection interface, and the aspect ratio of the second display screen in the first state, first cropping information is generated; wherein, the first cropping information is used to indicate the method of cropping the black border area in the first projection interface; Based on the first cropping information, the black border area in the first projection interface is cropped to obtain the second projection interface.

12. The method according to any one of claims 1 to 11, characterized in that, Before generating first data for instructing the second projection interface based on the first projection interface displayed by the first device through the first display screen, the method further includes: Receive third information from the second device; wherein the third information is used to instruct the first device to process the black border area and / or to instruct the second device not to have the ability to process the black border area.

13. The method according to any one of claims 1 to 12, characterized in that, A communication connection is established between the first device and the second device.

14. A screen sharing method, applied to a second device, characterized in that, The method includes: Receive first data from a first device; wherein the first data is generated based on a first projection interface displayed by the first device through a first display screen; the first data is used to indicate a second projection interface, the second projection interface is obtained by cropping the black border area in the first projection interface, the second projection interface is used by the second device to display on a second display screen in a first state, the first state including one of landscape state and portrait state; Based on the first data, the second projection interface is displayed on the second display screen which is in the first state.

15. The method as described in claim 14, characterized in that, There are no black border areas on the top and bottom and / or left and right sides of the second projection interface.

16. The method as described in claim 14 or 15, characterized in that, The aspect ratio of the second projection interface is the same as that of the second display screen in the first state.

17. The method according to any one of claims 14 to 16, characterized in that, When the second display screen is a foldable screen, the first state also includes one of a folded state and an unfolded state.

18. The method according to any one of claims 14 to 17, characterized in that, After displaying the second projection interface on the second display screen in the first state based on the first data, the method further includes: After the second display screen switches from the first state to the second state, it receives second data from the first device; wherein, the second state includes one of landscape state and portrait state, the second data is used to indicate a third projection interface, the third projection interface is obtained by cropping the black border area existing in the first projection interface, the third projection interface is different from the second projection interface, and the third projection interface is used by the second device to display on the second display screen in the second state.

19. The method as described in claim 18, characterized in that, There are no black border areas on the top and bottom sides and / or left and right sides of the third projection interface.

20. The method as described in claim 18 or 19, characterized in that, The aspect ratio of the third projection interface is the same as that of the second display screen in the second state.

21. The method according to any one of claims 18 to 20, characterized in that, When the second display screen is a foldable screen, the second state also includes one of a folded state and an unfolded state.

22. The method according to any one of claims 14 to 21, characterized in that, Before receiving the first data from the first device, the method further includes: Send first information to the first device; wherein, The first information is used to indicate the aspect ratio of the second display screen in the first state; or The first information is used to indicate the first state and the resolution of the second display screen, and the first information is used to determine the aspect ratio of the second display screen in the first state; The aspect ratio of the second display screen in the first state is used to determine the aspect ratio of the second projection interface.

23. The method according to any one of claims 14 to 22, characterized in that, Before receiving the first data from the first device, the method further includes: Send a third message to the first device; wherein the third message is used to instruct the first device to process the black border area and / or to instruct the second device not to have the ability to process the black border area.

24. A screen sharing method, applied to a first device, characterized in that, The method includes: Receive first information from the second device; wherein the first information is used to instruct the first device to process the black border area and / or to instruct the second device not to have the ability to process the black border area; Send first data to the second device; wherein the first data is used to instruct the first device to display a first projection interface on a first display screen, and the first projection interface has a black border area.

25. A screen sharing method, applied to a second device, characterized in that, The method includes: Send a first message to a first device; wherein the first message is used to instruct the first device to process the black border area and / or to instruct the second device not to have the ability to process the black border area; Receive first data from the first device; wherein the first data is used to indicate a first projection interface displayed by the first device through a first display screen, and the first projection interface has a black border area.

26. The method as described in claim 25, characterized in that, The method further includes: Based on the first data, a second projection interface is generated; wherein, the second projection interface is obtained by cropping the black border area in the first projection interface, and the second projection interface is used to display on the second display screen in the first state, the first state including one of landscape state and portrait state. The second projection interface is displayed on the second display screen which is in the first state.

27. A communication device, characterized in that, include: At least one processor; The at least one processor is configured to cause the communication device to perform the method as described in any one of claims 1 to 13, or the method as described in any one of claims 14 to 23, or the method as described in claim 24, or the method as described in any one of claims 25 to 26.

28. A communication device, characterized in that, include: A module or unit for performing the method as described in any one of claims 1 to 13, or a module or unit for performing the method as described in any one of claims 14 to 23, or a module or unit for performing the method as described in claim 24, or a module or unit for performing the method as described in any one of claims 25 to 26.

29. A computer-readable storage medium, characterized in that, The storage medium stores a computer program or instructions that, when executed on a communication device, cause the communication device to perform the method as described in any one of claims 1 to 13, or the method as described in any one of claims 14 to 23, or the method as described in claim 24, or the method as described in any one of claims 25 to 26.

30. A computer program product, characterized in that, The computer program product includes a computer program or instructions that, when executed on a communication device, cause the communication device to perform the method as described in any one of claims 1 to 13, or the method as described in any one of claims 14 to 23, or the method as described in claim 24, or the method as described in any one of claims 25 to 26.

Images