Multi-screen interaction method and electronic equipment
By sliding the first display screen, multi-screen interaction between the first display screen and the second display screen is achieved, solving the problems of cumbersome operation of existing methods and difficulty in adapting third-party applications, and improving the convenience and efficiency of interaction.
Patent Information
- Application Number
- CN202510116785.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2022-04-21
- Publication Date
- 2025-06-20
AI Technical Summary
The existing multi-screen interaction method is cumbersome, and users need to operate multiple times to complete the interaction, and third-party applications need to adapt to the control portal, which increases the difficulty of implementation.
By sliding the operation on the first display screen, the first electronic device shares the content of the first display screen to the second display screen of the second electronic device for display, simplifying the operation process and without the need for a third-party application to provide a control portal.
It improves the convenience and efficiency of multi-screen interaction, simplifies user operation processes, and reduces the difficulty of multi-screen interaction.
Smart Images

Figure CN120179196A_ABST
Abstract
Description
[0001] This application is a divisional application. The application number of the original application is 202210424457.X, the filing date of the original application is April 21, 2022, and the entire content of the original application is incorporated herein by reference. Technical Field
[0002] This application relates to the technical field of electronic devices, and particularly to a multi-screen interaction method and an electronic device. Background Art
[0003] Currently, more and more display screens are equipped on vehicle-mounted devices, and the demand for multi-screen interaction between multiple display screens on vehicle-mounted devices and between the display screens on the vehicle and the display screens of mobile devices is also increasing.
[0004] For the multi-screen interaction requirements within the vehicle-mounted device and between the vehicle-mounted device and the mobile device, the current multi-screen interaction method that can be adopted is as follows: The initiating end or the control end of the multi-screen interaction can provide a control entry, and the user starts the multi-screen interaction by operating on this control entry. Then, the initiating end or the control end provides the information of the selectable display screens to the user. After the user selects the display screens for multi-screen interaction, the initiating end or the control end controls to realize the sharing of the content between the selected display screens, thereby realizing multi-screen interaction.
[0005] In the above method, on the one hand, the user needs to perform multiple operations to complete the multi-screen interaction process, so the operation process is relatively cumbersome and complex. On the other hand, when the content of the multi-screen interaction is the content of a third-party application, the third-party application needs to be adapted to provide a control entry, which will also increase the difficulty of realizing multi-screen interaction. In summary, the current method of multi-screen interaction is difficult to realize multi-screen interaction conveniently and efficiently. Summary of the Invention
[0006] This application provides a multi-screen interaction method and an electronic device to improve the convenience and efficiency of multi-screen interaction.
[0007] In a first aspect, an embodiment of this application provides a multi-screen interaction method, which includes: a first electronic device displays first content on a first display screen; the first electronic device receives a first operation, and the first operation is a sliding operation on the first display screen; in response to the received first operation, the first electronic device sends the first content to a second electronic device that displays second content on a second display screen, so that the second electronic device displays the first content on the second display screen.
[0008] In this method, after the first electronic device to which the first display screen belongs receives a sliding operation on the first display screen, it can share the content displayed on the first display screen to be displayed on the second display screen of the second electronic device. Therefore, the user only needs to perform a sliding operation on the first display screen to trigger multi-screen interaction between the first display screen and the second display screen. The operation process is simple and smooth, improving the convenience and efficiency of multi-screen interaction. In addition, since the first operation that triggers multi-screen interaction is an operation on the display screen, when the content of multi-screen interaction is the content in an application, there is no need for the application to provide a control entry, and there is no need for the application to be adapted. Therefore, the difficulty of multi-screen interaction can also be reduced, thereby improving the efficiency of multi-screen interaction.
[0009] In a possible design, the included angle between the sliding direction of the first operation and the first candidate direction is less than a set first angle threshold; wherein, the first candidate direction is used to represent the direction from the position of the first display screen to the position of the second display screen.
[0010] In this method, the first angle threshold can be regarded as the allowable error angle of the direction of the sliding operation when the user selects the target display screen. When the included angle between the sliding direction of the first operation and the first candidate direction is less than the first angle threshold, it can be considered that the direction of the sliding operation performed by the user corresponds to the first candidate direction. Then, it can be determined that the display screen selected by the user through the sliding operation is the second display screen corresponding to the first candidate direction. Furthermore, it can be determined to share the content displayed on the first display screen to the second display screen for display. Based on this method, the first electronic device can quickly determine the target display screen selected by the user based on the sliding operation performed by the user, and then perform multi-screen interaction with the target display screen.
[0011] In a possible design, the first operation includes a second operation and a third operation. The second operation and the third operation are sliding operations on the first display screen. Among them, the termination contact point of the second operation on the first display screen is the starting contact point of the third operation on the first display screen. The first electronic device receiving the first operation includes: the first electronic device receiving the second operation; the first electronic device, in response to receiving the second operation, displays identification information of at least one candidate display screen on the first display screen; wherein, the at least one candidate display screen includes the second display screen; the first electronic device receives the third operation, and the third operation is used to select the identification information of the second display screen.
[0012] In this method, by dividing the first operation into two sub-operations, namely the second operation and the third operation, and displaying the identification information of the candidate display screens after the user performs the second operation, the user can select the target display screen for multi-screen interaction by performing the third operation. On the one hand, it is convenient for the user to intuitively view and select the information of the candidate display screens capable of multi-screen interaction. On the other hand, the user can still trigger multi-screen interaction through continuous sliding operations, which can expand the way for the user to trigger multi-screen interaction while ensuring the simplicity of the operation.
[0013] In a possible design, the included angle between the candidate direction corresponding to the at least one candidate display screen and the sliding direction of the second operation is less than a set second angle threshold; or, the included angle between the sliding direction of the second operation and a set first reference direction is less than the set second angle threshold; the included angle between the candidate direction corresponding to the at least one candidate display screen and the first reference direction is less than the second angle threshold; wherein, the candidate direction corresponding to any one candidate display screen is used to represent the direction from the position of the first display screen to the position of the candidate display screen.
[0014] In this method, if the included angles between the direction of the user's sliding operation and at least one candidate direction and a certain direction are both less than the second angle threshold, it can be considered that the direction of the user's sliding operation and at least one candidate direction are on the same side. Based on this method, the first electronic device can, after receiving the user's sliding operation, only display the information of the candidate display screens on the side where the direction of the sliding operation is located, which is convenient for the user to continue to select the target display screen for multi-screen interaction from them.
[0015] In a possible design, the first electronic device displays the identification information of the at least one candidate display screen on the first display screen, including: the first electronic device obtains the sorting reference information corresponding to the at least one candidate display screen, and the sorting reference information is used to indicate: the position of the display screen, or the distance between the display screen and the first display screen, or the intimacy between the electronic device to which the display screen belongs and the first electronic device; the first electronic device sorts the at least one candidate display screen according to the sorting reference information corresponding to the at least one candidate display screen; the first electronic device displays the identification information of the at least one candidate display screen on the first display screen according to the sorting of the at least one candidate display screen.
[0016] In this method, after the first electronic device sorts the at least one candidate display screen and then displays the identification information of the at least one candidate display screen according to the sorting, it is more convenient for the user to quickly select the target display screen that needs multi-screen interaction based on this sorting, thereby improving the user experience.
[0017] In a possible design, the at least one candidate display screen is in the on-screen state.
[0018] In this method, when the candidate display screen is in the on-screen state, it indicates that the candidate display screen is in the running (working) state and can display the received content. Therefore, by displaying the information of the running display screen to the user, after the user selects the display screen for multi-screen interaction from it, it can be ensured that the first electronic device can directly perform multi-screen interaction with the display screen selected by the user and successfully implement multi-screen interaction.
[0019] In a possible design, the first display screen and the second display screen are in a non-relatively static state, and the first candidate direction is a set direction.
[0020] In this method, when the first display screen and the second display screen are in a non-relatively static state, the first candidate direction is a set direction, and the first candidate direction is the candidate direction corresponding to the second display screen. Then, it can be ensured that no matter how the relative positions of the first display screen and the second display screen change, the user can trigger the multi-screen interaction between the first display screen and the second display screen by performing a sliding operation in a fixed direction (i.e., the first candidate direction), thereby ensuring the successful implementation of the multi-screen interaction between the first display screen and the second display screen.
[0021] In a possible design, the first display screen and the second display screen are in a non-relatively static state, and the candidate direction corresponding to the second display screen is a set direction.
[0022] In this method, when the first display screen and the second display screen are in a non-relatively static state, the candidate direction corresponding to the second display screen is a set direction. Then, it can be ensured that no matter how the relative positions of the first display screen and the second display screen change, the user can trigger the multi-screen interaction between the first display screen and the second display screen by performing a sliding operation in a fixed direction (i.e., the candidate direction corresponding to the second display screen), thereby ensuring the successful implementation of the multi-screen interaction between the first display screen and the second display screen.
[0023] In a possible design, the first display screen is a display screen configured in a vehicle cockpit, and the second display screen is a display screen of a mobile device.
[0024] In this method, the position of the display screen in the vehicle cockpit generally remains unchanged for a relatively long period of time, while the position of the display screen of the mobile device may change at any time. Therefore, the display screen in the vehicle cockpit and the display screen of the mobile device are generally in a non-relatively static state. Based on the above method, the multi-screen interaction between the display screen in the vehicle cockpit and the display screen of the mobile device can be realized.
[0025] In a possible design, the first display screen and the second display screen are in a relatively static state.
[0026] In this method, when the first display screen and the second display screen are in a relatively static state, the first electronic device can pre-acquire and save the direction from the first display screen to the second display screen. Subsequently, based on this direction and the user operation, it can be determined whether the display screen selected by the user for multi-screen interaction is the second display screen.
[0027] In a possible design, the first display screen and the second display screen are display screens configured in the same vehicle cockpit.
[0028] In this method, the display screens in the vehicle cockpit are generally not in a relatively static state. Therefore, the first electronic device can pre-acquire the direction relationship between the display screens in the vehicle cockpit, and then determine the display screen selected by the user for multi-screen interaction based on the user operation and the direction relationship between the display screens, realizing multi-screen interaction between different display screens in the vehicle cockpit.
[0029] In a possible design, the first electronic device and the second electronic device are the same in-vehicle device in the vehicle cockpit; or, the first electronic device and the second electronic device are different display devices belonging to the same in-vehicle device in the vehicle cockpit, or the first electronic device and the second electronic device are different in-vehicle devices in the vehicle cockpit.
[0030] In this method, the first display screen and the second display screen can be different display screens controlled by the same device, or different display screens controlled by different devices. Combining the above methods can realize multi-screen interaction in multiple scenarios.
[0031] In a possible design, the second electronic device displays the first content on the second display screen, including: the second electronic device replaces the second content displayed on the second display screen with the first content; or, the second electronic device displays a first window containing the first content and a second window containing the second content on the second display screen; wherein, the first window and the second window are located in different areas of the second display screen, or the first window covers the second window.
[0032] In this method, the second electronic device can display the content from the first electronic device in multiple ways, with relatively high flexibility.
[0033] In a possible design, the method further includes: the first electronic device obtains the second content from the second electronic device; the first electronic device displays the second content on the first display screen.
[0034] In this method, when the first electronic device shares the content displayed on the first display screen to the second display screen of the second electronic device for display, it can simultaneously obtain the content displayed on the second display screen and display it on the first display screen, so that the effect of exchanging the display content between the first display screen and the second display screen can be achieved.
[0035] In a possible design, the method further includes: the first electronic device displays third content on the first display screen; where the third content is preset content or the content displayed by the first electronic device before displaying the first content; or, the first electronic device switches the first display screen to the screen-off state.
[0036] In this method, after the first electronic device shares the content displayed on the first display screen to the second display screen of the second electronic device for display, it can adopt a variety of display control methods for display control, with relatively high flexibility.
[0037] In a second aspect, an embodiment of the present application provides a multi-screen interaction method, which includes: the first electronic device displays first content on the first display screen; the first electronic device receives a first operation, and the first operation is a sliding operation on the first display screen; the first electronic device responds to the received first operation and sends the first content to a second electronic device that displays second content on a second display screen, so that the second electronic device displays the first content on the second display screen.
[0038] In this method, after the first electronic device to which the first display screen belongs receives a sliding operation on the first display screen, it can share the content displayed on the first display screen to the second display screen of the second electronic device for display. Therefore, the user only needs to perform a sliding operation on the first display screen to trigger the multi-screen interaction between the first display screen and the second display screen, and the operation process is simple and smooth, improving the convenience and efficiency of multi-screen interaction. In addition, since the first operation that triggers multi-screen interaction is an operation on the display screen, when the content of the multi-screen interaction is the content in the application, there is no need for the application to provide a control entry, so there is no need for the application to be adapted, which can also reduce the difficulty of multi-screen interaction and thus improve the efficiency of multi-screen interaction.
[0039] In a possible design, the first operation includes a second operation and a third operation. The second operation and the third operation are sliding operations on the first display screen. Among them, the termination contact point of the second operation on the first display screen is the starting contact point of the third operation on the first display screen. The first electronic device receives the first operation, including: the first electronic device receives the second operation; in response to the received second operation, the first electronic device displays identification information of at least one candidate display screen on the first display screen; among them, the at least one candidate display screen includes the second display screen; the first electronic device receives the third operation, and the third operation is used to select the identification information of the second display screen.
[0040] In this method, by dividing the first operation into two sub-operations, namely the second operation and the third operation, and displaying the identification information of the candidate display screen after the user performs the second operation, the user can select the target display screen for multi-screen interaction by performing the third operation. On the one hand, it is convenient for the user to intuitively view and select the information of the candidate display screens that can perform multi-screen interaction. On the other hand, the user can still trigger multi-screen interaction through continuous sliding operations, ensuring the simplicity of the operation while expanding the ways for the user to trigger multi-screen interaction.
[0041] In a possible design, the first operation includes a fourth operation, a fifth operation, and a sixth operation. The fourth operation, the fifth operation, and the sixth operation are sliding operations on the first display screen. Among them, the termination contact point of the fourth operation on the first display screen is the starting contact point of the fifth operation on the first display screen, and the termination contact point of the fifth operation on the first display screen is the starting contact point of the sixth operation on the first display screen. The first electronic device receives the first operation, including: the first electronic device receives the fourth operation; in response to the received fourth operation, the first electronic device displays first identification information on the first display screen; among them, the first identification information is used to identify a first position area, and there is at least one candidate display screen in the first position area, and the at least one candidate display screen includes the second display screen; in response to the received fifth operation, the first electronic device displays the identification information of the at least one candidate display screen on the first display screen; among them, the fifth operation is used to select the first position area; the first electronic device receives the sixth operation, and the sixth operation is used to select the identification information of the second display screen.
[0042] In this method, by dividing the first operation into three sub-operations: a fourth operation, a fifth operation, and a sixth operation, and by displaying the identification information of the location area after the user performs the fourth operation, the user can select which display screen within a location area to perform multi-screen interaction with by performing the fifth operation, and then further select which display screen within that location area to perform multi-screen interaction with by performing the sixth operation. On the one hand, through the step-by-step selection method, it is convenient for the user to intuitively view and select the information of the candidate display screens capable of multi-screen interaction. On the other hand, it enables the user to still trigger multi-screen interaction through continuous sliding operations, which can expand the ways for the user to trigger multi-screen interaction while ensuring the simplicity of the operation.
[0043] In a possible design, the first display screen and the second display screen are in a non-relatively static state.
[0044] In a possible design, the first display screen is the display screen of a mobile device, and the second display screen is the display screen configured in a vehicle cockpit.
[0045] In the above method, the position of the display screen of the mobile device may change at any time, while the position of the display screen in the vehicle cockpit generally remains unchanged for a relatively long period of time. Therefore, the display screen of the mobile device and the display screen in the vehicle cockpit are generally in a non-relatively static state. In this scenario, based on the above method, the effect of sharing the content displayed on the display screen of the mobile device to the display screen in the vehicle cockpit for display can be achieved.
[0046] In a possible design, the second electronic device displays the first content on the second display screen, including: the second electronic device replaces the second content displayed on the second display screen with the first content; or, the second electronic device displays a first window containing the first content and a second window containing the second content on the second display screen; where the first window and the second window are located in different areas of the second display screen, or the first window covers the second window.
[0047] In this method, the second electronic device can display the content from the first electronic device in various ways, with relatively high flexibility.
[0048] In a possible design, the method further includes: the first electronic device obtains the second content from the second electronic device; the first electronic device displays the second content on the first display screen.
[0049] In this method, when the first electronic device shares the content displayed on the first display screen to the second display screen of the second electronic device for display, it can simultaneously obtain the content displayed on the second display screen and display it on the first display screen, so that the effect of exchanging the display content between the first display screen and the second display screen can be achieved.
[0050] In a possible design, the method further includes: the first electronic device displays third content on the first display screen; where the third content is preset content or the content displayed by the first electronic device before displaying the first content; or, the first electronic device switches the first display screen to the screen-off state.
[0051] In this method, after the first electronic device shares the content displayed on the first display screen to the second display screen of the second electronic device for display, it can adopt various display control methods for display control, with relatively high flexibility.
[0052] In a third aspect, an embodiment of the present application provides a multi-screen interaction method, and the method includes: the first electronic device displays a first window and a second window on the first display screen; where the first window contains first content and the second window contains second content; the first electronic device receives a first operation, and the first operation is a sliding operation acting on the first display screen; the first electronic device responds to the received first operation and sends target content to a second electronic device that displays third content on a second display screen, so that the second electronic device displays the target content on the second display screen; where the target content is the first content and / or the second content.
[0053] In this method, the first electronic device can display multiple contents in multiple windows on the first display screen. After receiving a sliding operation acting on the first display screen, the first electronic device can share the content displayed in one or more windows on the first display screen to the second display screen of the second electronic device for display. Therefore, the user only needs to perform a sliding operation on the first display screen to trigger the multi-screen interaction between the first display screen and the second display screen. This operation process is simple and smooth, and can selectively share the content displayed on the first display screen, improving the convenience and efficiency of multi-screen interaction and being applicable to more scenarios. In addition, since the first operation triggering the multi-screen interaction is an operation acting on the display screen, when the content of the multi-screen interaction is the content in an application, there is no need for the application to provide a control entry, so there is no need for the application to be adapted, which can also reduce the difficulty of multi-screen interaction and thus improve the efficiency of multi-screen interaction.
[0054] In a possible design, the first window and the second window are located in different areas on the first display screen. Exemplarily, the first display screen can be a non-foldable screen or a foldable screen in an unfolded state.
[0055] In this method, the first window and the second window on the first display screen can respectively occupy different display areas on the first display screen, facilitating the user to view the content. For example, the first electronic device can use a split-screen method to display the first window and the second window on the first display screen.
[0056] In a possible design, in response to the received first operation, the first electronic device sends target content to a second electronic device that displays third content on a second display screen, including: when the first electronic device determines that the starting contact point of the first operation on the first display screen is only located within the first window, sending the first content to the second electronic device; or, when the first electronic device determines that the starting contact point of the first operation on the first display screen is only located within the second window, sending the second content to the second electronic device; or, when the first electronic device determines that the starting contact point of the first operation on the first display screen is located within both the first window and the second window, sending the first content and the second content to the second electronic device.
[0057] In this method, when there are multiple windows displayed on the first display screen, the first electronic device can determine the content to be shared to the second display screen according to the position of the starting contact point of the sliding operation performed by the user on the first display screen. Specifically, when the starting contact point is located within a single window, the first electronic device shares the content within that window to the second display screen. When the starting contact point spans multiple windows, the first electronic device shares all the content displayed on the first display screen to the second display screen. Therefore, based on this method, the user can select the content for multi-screen interaction by performing the same sliding operation at different positions, with high flexibility, which can meet various needs of the user and also provide a high-quality user experience.
[0058] In a possible design, the first electronic device sends target content to a second electronic device that displays third content on a second display screen in response to the received first operation, including: when the first electronic device determines that the distance between the first window and the second display screen is greater than the distance between the second window and the second display screen, and the first operation meets a first set condition, sending the first content to the second display screen; where the first set condition includes: the angle between the sliding direction and a first candidate direction is less than a set first angle threshold; where the first candidate direction is used to represent the direction from the position of the first display screen to the position of the second display screen; and / or, the sliding speed is greater than or equal to a set first threshold, or the sliding acceleration is greater than or equal to a set second threshold, or the leaving-hand speed is greater than or equal to a set third threshold.
[0059] In this method, when the distance between the first window and the second display screen is greater than the distance between the second window and the second display screen, it can be determined that in the first display screen, the first window is the window farther from the second display screen, and the second window is the window closer to the second display screen. Then it can be considered that the second window is between the first window and the second display screen. Then, when the user selects the second display screen and the speed / acceleration / leaving-hand speed of the user's sliding operation is high, the first electronic device can determine to cross the second window and share the content in the first window to the second display screen. Therefore, the first electronic device can flexibly select whether to cross the intermediate window for multi-screen interaction based on the speed / acceleration / leaving-hand speed of the user's sliding operation, while ensuring the simplicity of the user operation and improving the multi-screen interaction efficiency.
[0060] In a possible design, the method further includes: when the target content is the first content, the first electronic device displays fourth content in the first window, where the fourth content is set content or the content that the first electronic device displayed in the first window before displaying the first content; or, the first electronic device only displays the second content in the first display screen.
[0061] In this method, after the first electronic device shares the content displayed on the first display screen to the second display screen of the second electronic device for display, various display control methods can be used for display control, with relatively high flexibility.
[0062] Fourth aspect, an embodiment of the present application provides a multi-screen interaction method, which includes: a first electronic device displays a first window, a second window, and a third window on a first display screen; wherein, the first window contains first content, the second window contains second content, and the third window contains third content; the first electronic device receives a first operation, and the first operation is a sliding operation applied to the first display screen; the first electronic device, in response to the received first operation, sends target content to a second electronic device that displays fourth content on a second display screen, so that the second electronic device displays the target content on the second display screen; wherein, the target content is: the first content, or, the second content, or, the third content, or, the first content, the second content, and the third content.
[0063] In a possible design, the first electronic device, in response to the received first operation, sending target content to a second electronic device that displays fourth content on a second display screen includes: when the first electronic device determines that the starting contact point of the first operation on the first display screen is only located within the first window, sending the first content to the second electronic device; or, when the first electronic device determines that the starting contact point of the first operation on the first display screen is only located within the second window, sending the second content to the second electronic device; or, when the first electronic device determines that the starting contact point of the first operation on the first display screen is only located within the third window, sending the third content to the second electronic device; or, when the first electronic device determines that the starting contact point of the first operation on the first display screen is located within the first window and the second window, sending the first content, the second content, and the third content to the second electronic device.
[0064] In a possible design, the first electronic device, in response to the received first operation, sending target content to a second electronic device that displays fourth content on a second display screen includes: when the first electronic device determines that the distance between the first window and the second display screen is greater than the distance between the second window and the second display screen, and the distance between the first window and the second display screen is greater than the distance between the third window and the second display screen, and the first operation meets a first set condition, sending the first content to the second electronic device; wherein, the first set condition includes: the angle between the sliding direction and a first candidate direction is less than a set first angle threshold; wherein, the first candidate direction is used to represent the direction from the position of the first display screen to the position of the second display screen; and / or, the sliding speed is greater than or equal to a set first threshold, or, the sliding acceleration is greater than or equal to a set second threshold, or, the off-hand speed is greater than or equal to a set third threshold.
[0065] In this method, the first electronic device can flexibly select whether to skip multiple intermediate windows for multi-screen interaction based on the speed / acceleration / departure speed of the user's sliding operation, while ensuring the simplicity of the user operation and improving the multi-screen interaction efficiency.
[0066] In a possible design, the method further includes: when the target content is the first content, the first electronic device displays a fifth content in the first window, where the fifth content is a set content or the content that the first electronic device displayed in the first window before displaying the first content; or, the first electronic device displays the second window and the third window in a split-screen manner on the first display screen.
[0067] In this method, after the first electronic device shares the content displayed on the first display screen to the second display screen of the second electronic device for display, various display control methods can be used for display control, with relatively high flexibility.
[0068] In a possible design, in the methods described in the above third aspect and fourth aspect, the first electronic device determines that the distance between the first window and the second display screen is greater than the distance between the second window and the second display screen, including: the first electronic device determines a first target direction corresponding to the first window; where the first target direction is used to represent the direction from the first window to the second window; when the first electronic device determines that the angle between the first target direction and the first candidate direction is less than a set second angle threshold, it is determined that the distance between the first window and the second display screen is greater than the distance between the second window and the second display screen.
[0069] In this method, the first electronic device can determine the directional relationship between the first window, the second window and the second display screen according to the directional relationship between the first display screen and the second display screen and the directional relationship between the first window and the second window, and then determine the distance between the first window, the second window and the second display screen, with relatively high accuracy.
[0070] In a possible design, in the methods described in the above third aspect and fourth aspect, the first electronic device determines that the distance between the first window and the second display screen is greater than the distance between the second window and the second display screen, including: the first electronic device determines a first target direction corresponding to the first window and a second target direction corresponding to the second window; wherein, the first target direction is used to represent the direction from the first window to the second window, and the second target direction is used to represent the direction from the second window to the first window; when the first electronic device determines that the included angle between the first target direction and the first candidate direction is less than the included angle between the second target direction and the first candidate direction, it is determined that the distance between the first window and the second display screen is greater than the distance between the second window and the second display screen.
[0071] In this method, the first electronic device can determine the directional relationship between the first window, the second window and the second display screen according to the directional relationship between the first display screen and the second display screen and the directional relationship between the first window and the second window, and then determine the distance between the first window, the second window and the second display screen, with relatively high accuracy.
[0072] In a possible design, in the methods described in the above third aspect and fourth aspect, the second electronic device displays the target content on the second display screen, including: the second electronic device replaces the third content displayed on the second display screen with the target content; or, the second electronic device displays a first window containing the target content and a second window containing the third content on the second display screen; wherein, the first window and the second window are located in different areas of the second display screen, or the first window covers the second window.
[0073] In this method, the second electronic device can display the content from the first electronic device in multiple ways, with relatively high flexibility.
[0074] In a possible design, the first window displayed on the second display screen is a window in floating window format.
[0075] In a possible design, in the methods described in the above third aspect and fourth aspect, the method further includes: when the target content is the first content, the first electronic device obtains the third content from the second electronic device; the first electronic device displays the third content in the first window.
[0076] In this method, when the first electronic device shares the content displayed on the first display screen to the second display screen of the second electronic device for display, it can simultaneously obtain the content displayed on the second display screen and display it on the first display screen, thus achieving the effect of exchanging the display content between the first display screen and the second display screen.
[0077] In a fifth aspect, an embodiment of the present application provides a multi-screen interaction method, and the method includes: the first electronic device displays first content on the first display screen; the first electronic device receives a first operation, and the first operation is a sliding operation applied to the first display screen; in response to the received first operation, the first electronic device sends the first content to a second electronic device that displays a first window including second content and a second window including third content on the second display screen, so that the second electronic device displays the first content on the second display screen.
[0078] In this method, after the first electronic device to which the first display screen belongs receives a sliding operation applied to the first display screen, it can share the content displayed on the first display screen to the second display screen of the second electronic device for display. Therefore, the user only needs to perform a sliding operation on the first display screen to trigger multi-screen interaction between the first display screen and the second display screen, and the operation process is simple and smooth, improving the convenience and efficiency of multi-screen interaction. In addition, since the first operation that triggers multi-screen interaction is an operation applied to the display screen, when the content of the multi-screen interaction is the content in the application, there is no need for the application to provide a control entry, so there is no need for the application to be adapted, thus reducing the difficulty of multi-screen interaction and further improving the efficiency of multi-screen interaction.
[0079] In a possible design, the method further includes: the first electronic device instructs the second electronic device to display the first content in a target window; where the target window is the first window or the second window.
[0080] In this method, multiple contents can be displayed in multiple windows on the second display screen of the second electronic device. When the first electronic device shares the content displayed on the first display screen to the second display screen for display, it can instruct the second electronic device to display it in the first window or the second window on the second display screen. Therefore, the first electronic device can selectively share the content displayed on the first display screen to a specific window on the second display screen while ensuring the simplicity of user operation. Therefore, while improving the convenience and efficiency of multi-screen interaction, this solution can also be applied to more scenarios, meet the diverse interaction needs of users, and further improve the user experience.
[0081] In a possible design, the first electronic device instructs the second electronic device to display the first content in a target window, including: when the first electronic device determines that the distance between the first window and the first display screen is greater than the distance between the second window and the first display screen, and the first operation meets the first set condition and / or the second set condition, instruct the second electronic device to display the first content in the first window; or, when the first electronic device determines that the distance between the first window and the first display screen is greater than the distance between the second window and the first display screen, and the first operation does not meet the second set condition, instruct the second electronic device to display the first content in the second window; wherein, the first set condition includes: the included angle between the sliding direction of the first operation and the first candidate direction is less than a set first angle threshold, and the first candidate direction is used to represent the direction from the position of the first display screen to the position of the second display screen; the second set condition includes: the sliding speed is greater than or equal to a set first threshold, or the sliding acceleration is greater than or equal to a set second threshold, or the leaving-hand speed is greater than or equal to a set third threshold.
[0082] In this method, when the distance between the first window and the first display screen is greater than the distance between the second window and the first display screen, it can be determined that on the second display screen, the first window is the window farther from the first display screen, and the second window is the window closer to the first display screen. Then it can be considered that the second window is between the first window and the first display screen. Then, when the user selects the second display screen and the speed / acceleration / leaving-hand speed of the user's sliding operation is relatively high, the first electronic device can determine to cross the second window and share the content on the first display screen to the first window on the second display screen. Therefore, the first electronic device can flexibly select whether to cross the intermediate window for multi-screen interaction based on the speed / acceleration / leaving-hand speed of the user's sliding operation, while ensuring the simplicity of the user operation and improving the multi-screen interaction efficiency.
[0083] In a possible design, the second electronic device displays the first content on the second display screen, including: the second electronic device replaces the second content displayed in the first window with the first content; or, the second electronic device replaces the third content displayed in the second window with the first content; or, the second electronic device displays a first window containing the second content, a second window containing the third content, and a third window containing the first content on the second display screen; wherein, the first window, the second window, and the third window are located in different areas of the second display screen, or the third window covers the first window and / or the second window.
[0084] In this method, the second electronic device can display the content from the first electronic device in multiple ways, with relatively high flexibility.
[0085] In a possible design, the third window displayed on the second display screen is a window in floating window format.
[0086] In a sixth aspect, an embodiment of the present application provides a multi-screen interaction method. The method includes: a first electronic device displays first content on a first display screen; the first electronic device receives a first operation, where the first operation is a sliding operation on the first display screen; in response to the received first operation, the first electronic device sends the first content to a second electronic device that displays a first window including second content, a second window including third content, and a third window including fourth content on a second display screen, so that the second electronic device displays the first content on the second display screen.
[0087] In a possible design, the method further includes: the first electronic device instructs the second electronic device to display the first content in a target window; where the target window is the first window or the second window or the third window.
[0088] In a possible design, the first electronic device instructs the second electronic device to display the first content in a target window, including: when the first electronic device determines that the distance between the first window and the first display screen is greater than the distance between the second window and the first display screen, and the distance between the first window and the first display screen is greater than the distance between the third window and the first display screen, and the first operation meets the first set condition and / or the second set condition, the first electronic device instructs the second electronic device to display the first content in the first window; or when the first electronic device determines that the distance between the first window and the first display screen is greater than the distance between the second window and the first display screen, and the distance between the second window and the first display screen is greater than the distance between the third window and the first display screen, and the first operation meets the first set condition and / or the third set condition, the first electronic device instructs the second electronic device to display the first content in the second window; or when the first electronic device determines that the distance between the first window and the first display screen is greater than the distance between the second window and the first display screen, and the distance between the second window and the first display screen is greater than the distance between the third window and the first display screen, and the first operation meets the first set condition and / or the fourth set condition, the first electronic device instructs the second electronic device to display the first content in the third window; wherein, the first set condition includes: the included angle between the sliding direction of the first operation and the first candidate direction is less than a set first angle threshold, and the first candidate direction is used to represent the direction from the position of the first display screen to the position of the second display screen; the second set condition includes: the sliding speed is greater than or equal to a set first threshold, or the sliding acceleration is greater than or equal to a set second threshold, or the off-hand speed is greater than or equal to a set third threshold; the third set condition includes: the sliding speed is less than the set first threshold and greater than or equal to a set fourth threshold, or the sliding acceleration is less than the set second threshold and greater than or equal to a set fifth threshold, or the off-hand speed is less than the set third threshold and greater than or equal to a set sixth threshold; the fourth set condition includes: the sliding speed is less than the set fourth threshold, or the sliding acceleration is less than the set fifth threshold, or the off-hand speed is less than the set sixth threshold.
[0089] In this method, the first electronic device can flexibly select whether to cross multiple intermediate windows for multi-screen interaction based on the speed / acceleration / off-hand speed of the user's sliding operation, while ensuring the simplicity of the user operation and improving the multi-screen interaction efficiency.
[0090] In a possible design, in the methods described in the fifth and sixth aspects above, the first electronic device determines that the distance between the first window and the first display screen is greater than the distance between the second window and the first display screen, including: the first electronic device determines a first target direction corresponding to the first window; wherein, the first target direction is used to represent the direction from the first window to the second window; when the first electronic device determines that the included angle between the first target direction and the first candidate direction is greater than a set first angle threshold, it determines that the distance between the first window and the first display screen is greater than the distance between the second window and the first display screen.
[0091] In this method, the first electronic device can determine the directional relationship between the first window, the second window and the first display screen based on the directional relationship between the first display screen and the second display screen and the directional relationship between the first window and the second window, and then determine the distance relationship among the first window, the second window and the first display screen, with relatively high accuracy.
[0092] In a possible design, in the methods described in the fifth and sixth aspects above, the first electronic device determines that the distance between the first window and the first display screen is greater than the distance between the second window and the first display screen, including: the first electronic device determines a first target direction corresponding to the first window; wherein, the first target direction is used to represent the direction from the first window to the second window; the first electronic device determines a second target direction corresponding to the second window according to the first target direction; wherein, the second target direction is used to represent the direction from the second window to the first window; when the first electronic device determines that the included angle between the first target direction and the first candidate direction is greater than the included angle between the second target direction and the first candidate direction, the first electronic device determines that the distance between the first window and the second display screen is greater than the distance between the second window and the second display screen.
[0093] In this method, the first electronic device can determine the directional relationship between the first window, the second window and the first display screen based on the directional relationship between the first display screen and the second display screen and the directional relationship between the first window and the second window, and then determine the distance relationship among the first window, the second window and the first display screen, with relatively high accuracy.
[0094] In a possible design, in the methods described in the fifth and sixth aspects above, the first electronic device determines the first target direction corresponding to the first window, including: the first electronic device receives first indication information sent by the second electronic device, and the first indication information is used to indicate the first target direction.
[0095] In this method, the first window and the second window are windows on the second display screen of the second electronic device. Therefore, the first electronic device can obtain the directional relationship between the first window and the second window from the second electronic device, so as to determine the distance between the first window, the second window and the first display screen accordingly.
[0096] In a seventh aspect, an embodiment of the present application provides a multi-screen interaction method, and the method includes: the first electronic device displays a first window and a second window on a first display screen; wherein, the first window contains first content, and the second window contains second content; the first electronic device receives a first operation, and the first operation is a sliding operation applied to the first display screen; the first electronic device, in response to the received first operation, sends target content to a second electronic device that displays a third window containing third content and a fourth window containing fourth content on a second display screen; wherein, the target content is the first content and / or the second content.
[0097] In this method, the first electronic device can display multiple contents in multiple windows on the first display screen, and the second electronic device can also display multiple contents in multiple windows on the second display screen. After receiving the sliding operation applied to the first display screen, the first electronic device can share the contents displayed in one or more windows on the first display screen to be displayed on the second display screen of the second electronic device. Therefore, the user only needs to perform a sliding operation on the first display screen to trigger the multi-screen interaction between the first display screen and the second display screen. This operation process is simple and smooth, and can selectively share the contents displayed on the first display screen, improving the convenience and efficiency of multi-screen interaction and being applicable to more scenarios. In addition, since the first operation triggering the multi-screen interaction is an operation on the display screen, when the content of the multi-screen interaction is the content in the application, there is no need for the application to provide a control entry, so there is no need for the application to be adapted, thus reducing the difficulty of multi-screen interaction and further improving the efficiency of multi-screen interaction.
[0098] In a possible design, the first electronic device, in response to the received first operation, sending target content to a second electronic device that displays a third window containing third content and a fourth window containing fourth content on a second display screen includes: when the first electronic device determines that the starting contact point of the first operation on the first display screen is only located within the first window, sending the first content to the second electronic device; or, when the first electronic device determines that the starting contact point of the first operation on the first display screen is only located within the second window, sending the second content to the second electronic device; or, when the first electronic device determines that the starting contact point of the first operation on the first display screen is located within both the first window and the second window, sending the first content and the second content to the second electronic device.
[0099] In this method, the user can select the content for multi-screen interaction by performing the same sliding operation at different positions, which has high flexibility, can meet various needs of the user, and also provides a high-quality user experience.
[0100] In a possible design, the method further includes: the first electronic device instructs the second electronic device to display the target content in a target window, where the target window is the third window or the fourth window.
[0101] In this method, the first electronic device can selectively share the content displayed on the first display screen to a specific window on the second display screen while ensuring the simplicity of user operations. Therefore, while improving the convenience and efficiency of multi-screen interaction, this solution can also be applied to more scenarios, meet the diverse interaction needs of users, and thus improve the user experience.
[0102] In a possible design, the first electronic device instructing the second electronic device to display the target content in a target window includes: when the first electronic device determines that the distance between the third window and the first display screen is greater than the distance between the fourth window and the first display screen, and the first operation meets the first set condition and / or the second set condition, instruct the second electronic device to display the target content in the third window; or when the first electronic device determines that the distance between the third window and the first display screen is greater than the distance between the fourth window and the first display screen, and the first operation meets the first set condition and / or the third set condition, instruct the second electronic device to display the target content in the fourth window. Wherein, the first set condition includes: the angle between the sliding direction of the first operation and the first candidate direction is less than a set first angle threshold; the first candidate direction is used to represent the direction from the position of the first display screen to the position of the second display screen; the second set condition is: the sliding speed is greater than or equal to a set first threshold, or the sliding acceleration is greater than or equal to a set second threshold, or the leaving-hand speed is greater than or equal to a set third threshold; the third set condition is: the sliding speed is less than the set first threshold and greater than or equal to a set fourth threshold, or the sliding acceleration is less than the set second threshold and greater than or equal to a set fifth threshold, or the leaving-hand speed is less than the set third threshold and greater than or equal to a set sixth threshold.
[0103] In this method, the first electronic device can delimit value ranges of different levels for the values of the speed / acceleration / hand-off speed of the user's sliding operation, and correspond the value ranges of different levels to windows at different distances from the first display screen. Then, when it is detected that the speed / acceleration / hand-off speed of the user's sliding operation belongs to the maximum value range, the first electronic device can share the content on the first display screen to a window farther from the first display screen on the second display screen. When it is detected that the speed / acceleration / hand-off speed of the user's sliding operation belongs to the second-largest value range, the first electronic device can share the content on the first display screen to a window closer to the first display screen on the second display screen, thereby achieving the effect of selectively performing cross-screen interaction.
[0104] In a possible design, the first electronic device determining that the distance between the third window and the first display screen is greater than the distance between the fourth window and the first display screen includes: the first electronic device determining a first target direction corresponding to the third window; wherein, the first target direction is used to represent the direction from the third window to the fourth window; when the first electronic device determines that the angle between the first target direction and the first candidate direction is greater than a set first angle threshold, it is determined that the distance between the third window and the first display screen is greater than the distance between the fourth window and the first display screen.
[0105] In a possible design, the first electronic device determining that the distance between the third window and the first display screen is greater than the distance between the fourth window and the first display screen includes: the first electronic device determining a first target direction corresponding to the third window; wherein, the first target direction is used to represent the direction from the third window to the fourth window; the first electronic device determining a second target direction corresponding to the fourth window according to the first target direction; wherein, the second target direction is used to represent the direction from the fourth window to the third window; when the first electronic device determines that the angle between the first target direction and the first candidate direction is greater than the angle between the second target direction and the first candidate direction, the first electronic device determines that the distance between the third window and the first display screen is greater than the distance between the fourth window and the first display screen.
[0106] In a possible design, the first electronic device determining the first target direction corresponding to the first window includes: the first electronic device receiving first indication information sent by the second electronic device, and the first indication information is used to indicate the first target direction.
[0107] In a possible design, the method further includes: when the target content is the first content, the first electronic device obtains the third content from the second electronic device; the first electronic device displays the third content in the first window.
[0108] In a possible design, the method further includes: when the target content is the first content, the first electronic device displays a fourth content in the first window, where the fourth content is a set content or the content that the first electronic device displayed in the first window before displaying the first content; or, the first electronic device only displays the second content on the first display screen.
[0109] In a possible design, the second electronic device displays the target content on the second display screen, including: the second electronic device displays a third window containing the third content, a fourth window containing the fourth content, and a fifth window containing the target content on the second display screen; where the third window, the fourth window, and the fifth window are in different areas of the second display screen, or, the fifth window covers the third window and / or the fourth window.
[0110] In a possible design, the fifth window displayed on the second display screen is a window in floating window format.
[0111] In a possible design, in the method described in the above third aspect to seventh aspect, the first display screen and the second display screen are in a relatively static state.
[0112] In this method, when the first display screen and the second display screen are in a relatively static state, the first electronic device can pre-obtain and save the direction from the first display screen to the second display screen, and then based on this direction and the user operation, it can be determined whether the display screen selected by the user for multi-screen interaction is the second display screen or a certain window on the second display screen.
[0113] In a possible design, in the method described in the above third aspect to seventh aspect, the first display screen and the second display screen are display screens configured in the same vehicle cockpit.
[0114] In this method, the display screens in the vehicle cockpit are generally not in a relatively static state. Therefore, the first electronic device can pre-obtain the direction relationship between the display screens in the vehicle cockpit, and then based on the user operation and the direction relationship between the display screens, determine the display screen selected by the user for multi-screen interaction, so as to realize multi-screen interaction between different display screens in the vehicle cockpit.
[0115] In a possible design, in the methods described in the third to seventh aspects above, the first electronic device and the second electronic device are the same in-vehicle device in the vehicle cockpit; or, the first electronic device and the second electronic device are different display devices belonging to the same in-vehicle device in the vehicle cockpit, or the first electronic device and the second electronic device are different in-vehicle devices in the vehicle cockpit.
[0116] In this method, the first display screen and the second display screen can be different display screens controlled by the same device, or different display screens controlled by different devices. Combining the above methods can achieve multi-screen interaction in multiple scenarios.
[0117] In a possible design, in the methods described in the third to seventh aspects above, the first display screen can be a non-foldable screen or a foldable screen in the unfolded state.
[0118] In this method, the first display screen can be a display screen in various forms, with high flexibility.
[0119] In a possible design, in the methods described in the third to seventh aspects above, the second display screen can be a non-foldable screen or a foldable screen in the unfolded state.
[0120] In this method, the first display screen can be a display screen in various forms, with high flexibility.
[0121] In an eighth aspect, the present application provides an electronic device, which includes a display screen, a memory, and one or more processors; wherein, the memory is used to store computer program code, and the computer program code includes computer instructions; when the computer instructions are executed by one or more processors, the electronic device is caused to execute the method described in any one of the first to seventh aspects above or any possible design of any one of the aspects.
[0122] In a ninth aspect, the present application provides a multi-screen interaction system, which includes a first electronic device and a second electronic device. Among them, the first electronic device is used to execute the method executed by the first electronic device in any one of the methods described in the first to seventh aspects above, and the second electronic device is used to execute the method executed by the second electronic device in any one of the methods described in the first to seventh aspects above.
[0123] In a tenth aspect, the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a computer, the computer is caused to execute the method described in any one of the first to seventh aspects above or any possible design of any one of the aspects.
[0124] In an eleventh aspect, the present application provides a computer program product, which includes a computer program or instructions. When the computer program or instructions run on a computer, the computer is caused to execute the method described in any one of the first to seventh aspects or any possible design of any one of these aspects.
[0125] For the beneficial effects of the fourth aspect above, please refer to the description of the beneficial effects of the third aspect above. For the beneficial effects of the sixth aspect above, please refer to the description of the beneficial effects of the fifth aspect above. For the beneficial effects of the seventh aspect above, please refer to the description of the beneficial effects of the third and fifth aspects above. For the beneficial effects of the eighth to eleventh aspects above, please refer to the description of the beneficial effects of the first to seventh aspects above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0126] Figure 1 It is a schematic diagram of the architecture of a possible system applicable to the solution provided in the embodiment of the present application;
[0127] Figure 2 It is a schematic diagram of the hardware architecture of an electronic device provided in the embodiment of the present application;
[0128] Figure 3 It is a schematic diagram of a scenario where a display screen is configured in a vehicle cockpit provided in the embodiment of the present application;
[0129] Figure 4 It is a schematic diagram of a method for determining a target display screen according to a user operation provided in the embodiment of the present application;
[0130] Figure 5 It is a schematic diagram of a hot zone display interface provided in the embodiment of the present application;
[0131] Figure 6a It is a schematic diagram of a method for determining candidate display screens according to a user operation provided in the embodiment of the present application;
[0132] Figure 6b It is a schematic diagram of a hot zone display interface provided in the embodiment of the present application;
[0133] Figure 7a It is a schematic diagram of a display interface during a multi-screen interaction process provided in the embodiment of the present application;
[0134] Figure 7b It is a schematic diagram of a display interface during a multi-screen interaction process provided in the embodiment of the present application;
[0135] Figure 8 It is a schematic diagram of a sliding operation provided in the embodiment of the present application;
[0136] Figure 9aSchematic diagram of a method for determining a target display screen according to a user operation provided by an embodiment of the present application;
[0137] Figure 9b Schematic diagram of a method for determining a target display screen according to a user operation provided by an embodiment of the present application;
[0138] Figure 10 Schematic diagram of a hot zone display interface provided by an embodiment of the present application;
[0139] Figure 11 Schematic diagram of a multi-screen interaction triggered by a sliding operation provided by an embodiment of the present application;
[0140] Figure 12 Schematic diagram of a multi-screen interaction triggered by a sliding operation provided by an embodiment of the present application;
[0141] Figure 13 Schematic diagram of a multi-screen interaction triggered by a sliding operation provided by an embodiment of the present application;
[0142] Figure 14 Schematic diagram of a multi-screen interaction triggered by a sliding operation provided by an embodiment of the present application;
[0143] Figure 15a Schematic diagram of a display interface during a multi-screen interaction provided by an embodiment of the present application;
[0144] Figure 15b Schematic diagram of a display interface during a multi-screen interaction provided by an embodiment of the present application;
[0145] Figure 16 Schematic diagram of a display interface during a multi-screen interaction provided by an embodiment of the present application;
[0146] Figure 17 Schematic diagram of a display interface during a multi-screen interaction provided by an embodiment of the present application;
[0147] Figure 18a Schematic diagram of a display interface during a multi-screen interaction provided by an embodiment of the present application;
[0148] Figure 18b Schematic diagram of a display interface during a multi-screen interaction provided by an embodiment of the present application;
[0149] Figure 19a Schematic diagram of a display interface during a multi-screen interaction provided by an embodiment of the present application;
[0150] Figure 19b Schematic diagram of a display interface during a multi-screen interaction provided by an embodiment of the present application;
[0151] Figure 20a Schematic diagram of a display interface in a multi-screen interaction process provided by an embodiment of the present application;
[0152] Figure 20b Schematic diagram of a display interface in a multi-screen interaction process provided by an embodiment of the present application;
[0153] Figure 21a Schematic diagram of a display interface in a multi-screen interaction process provided by an embodiment of the present application;
[0154] Figure 21b Schematic diagram of a display interface in a multi-screen interaction process provided by an embodiment of the present application;
[0155] Figure 22 Schematic diagram of a multi-screen interaction method provided by an embodiment of the present application;
[0156] Figure 23 Schematic diagram of a multi-screen interaction method provided by an embodiment of the present application;
[0157] Figure 24 Schematic diagram of a multi-screen interaction method provided by an embodiment of the present application;
[0158] Figure 25 Schematic diagram of a multi-screen interaction method provided by an embodiment of the present application;
[0159] Figure 26 Schematic diagram of a multi-screen interaction method provided by an embodiment of the present application;
[0160] Figure 27 Schematic diagram of a multi-screen interaction method provided by an embodiment of the present application;
[0161] Figure 28 Schematic diagram of the structure of an electronic device provided by an embodiment of the present application. Detailed implementation manners
[0162] In order to make the objectives, technical solutions, and advantages of the embodiments of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings. Among them, in the description of the embodiments of the present application, hereinafter, the terms "first" and "second" are only used for descriptive purposes and cannot be construed as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, features defined with "first" and "second" may explicitly or implicitly include one or more of such features.
[0163] For ease of understanding, illustrative descriptions of concepts related to the present application are given for reference.
[0164] An electronic device, which can be a device with a display screen. In some embodiments of the present application, the electronic device may also have functions such as wireless connection.
[0165] In some embodiments of the present application, the electronic device can be a portable device, such as a mobile phone, a tablet computer, a wearable device with wireless communication function (e.g., a watch, a bracelet, a helmet, an earphone, etc.), a vehicle-mounted terminal device, an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a smart home device (e.g., a smart TV, a smart speaker, etc.), a smart robot, a workshop device, a wireless terminal in self-driving, a wireless terminal in remote medical surgery, a wireless terminal in smart grid, a wireless terminal in transportation safety, a wireless terminal in smart city, or a wireless terminal in smart home, a flying device (e.g., a smart robot, a hot air balloon, a drone, an airplane), etc.
[0166] Among them, the wearable device is a portable device that users can directly wear on their bodies or integrate into their clothes or accessories.
[0167] In some embodiments of the present application, the electronic device can also be a portable terminal device that further includes other functions such as a personal digital assistant and / or a music player function. Exemplary embodiments of the portable terminal device include, but are not limited to, those equipped with or other operating systems. The above portable terminal device can also be other portable terminal devices, such as a laptop with a touch-sensitive surface (e.g., a touch panel), etc. It should also be understood that in some other embodiments of the present application, the above electronic device may not be a portable terminal device, but a desktop computer with a touch-sensitive surface (e.g., a touch panel).
[0168] It should be understood that in the embodiments of the present application, "at least one" means one or more, and "a plurality" means two or more. "And / or" describes the association relationship of associated objects and indicates that three relationships may exist. For example, A and / or B may represent: A exists alone, A and B exist simultaneously, and B exists alone, where A and B may be singular or plural. The character " / " generally represents an "or" relationship between the associated objects before and after. "At least one (item) of the following" or its similar expressions refer to any combination of these items, including any combination of a single item or multiple items. For example, at least one (item) of a, b, or c may represent: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c may be single or multiple.
[0169] Currently, in the scenario where multiple displays are configured in a vehicle head unit, there are requirements for multi-screen interaction (or cross-screen interaction) among multiple passengers or the same passenger. For example, a passenger may have a need to share the content displayed on one display in the vehicle head unit to other displays in the vehicle head unit for display, may also have a need to share the content displayed on the display in the vehicle head unit to the display of a mobile device for display, or share the content displayed on the display of a mobile device to the display in the vehicle head unit for display.
[0170] Among them, for the multi-screen interaction in the vehicle head unit, the following solutions are mainly adopted currently: In the display used by the user, an in-app sharing entry or a system-level sharing entry can be displayed. When the user operates on the sharing entry, it can trigger the display of a cross-screen control interface, which includes the identifiers of multiple displays. The user can long-press the identifier of one display and drag it to another display to achieve sharing the content displayed on one display to another display, and the content displayed on the two displays is the same after sharing. In some scenarios, the user can also trigger the display of the above cross-screen control interface by performing a setting operation (such as pressing the display with multiple fingers, etc.).
[0171] For the multi-screen interaction between the display in the vehicle head unit and the display of a mobile device, it can be implemented by the same method as the multi-screen interaction in the vehicle head unit. Or, when sharing the content of the display in the vehicle head unit to the display of a mobile device, it can be implemented by the same method as the multi-screen interaction in the vehicle head unit; when sharing the content of the display of a mobile device to the vehicle head unit, the mobile device can provide a corresponding control entry. After the user operates on the control entry, the mobile device displays the information of the selectable displays in the vehicle head unit. After the user selects a display, the mobile device shares the content to the display selected by the user.
[0172] In summary, in the current implementation solutions for multi-screen interaction, users need to perform multiple operations to complete the multi-screen interaction process, and cannot directly achieve multi-screen interaction in one step. Therefore, the multi-screen interaction process is not convenient enough and has low efficiency. In addition, third-party applications must adapt to the function of the sharing entry to provide a sharing entry within the application. Therefore, in order to implement multi-screen interaction, it is necessary to additionally perform adaptation processing on third-party applications, which is also not conducive to convenient and efficient multi-screen interaction. Therefore, the current method for multi-screen interaction has low convenience and poor user experience.
[0173] In view of this, the embodiments of the present application provide a multi-screen interaction method and an electronic device. This solution can perform multi-screen interaction simply and quickly, improve the convenience of multi-screen interaction, and thus improve the user experience.
[0174] Next, refer to Figure 1 , and introduce the structure of the electronic device applicable to the method provided by the embodiments of the present application.
[0175] As Figure 1 shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a USB interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a SIM card interface 195, etc.
[0176] Among them, the sensor module 180 may include a gyroscope sensor, an acceleration sensor, a proximity light sensor, a fingerprint sensor, a touch sensor, a temperature sensor, a pressure sensor, a distance sensor, a magnetic sensor, an ambient light sensor, a barometric pressure sensor, a bone conduction sensor, etc.
[0177] It can be understood that Figure 1 the electronic device 100 shown is only an example and does not constitute a limitation on the electronic device. And the electronic device may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. Figure 1 The various components shown in
[0178] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors. Among them, the controller may be the nerve center and command center of the electronic device 100. The controller may generate operation control signals according to the instruction operation code and timing signal to complete the control of fetching and executing instructions.
[0179] A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory may save the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0180] The execution of the multi-screen interaction method provided in the embodiments of the present application may be controlled by the processor 110 or other components may be called to complete it. For example, the processing program of the embodiments of the present application stored in the internal memory 121 is called, or the processing program of the embodiments of the present application stored in a third-party device is called through the external memory interface 120 to control the wireless communication module 160 to perform data communication with other devices, improving the intelligence and convenience of the electronic device 100 and enhancing the user experience. The processor 110 may include different devices. For example, when the CPU and GPU are integrated, the CPU and GPU may cooperate to execute the multi-screen interaction method provided in the embodiments of the present application. For example, some algorithms in the multi-screen interaction method are executed by the CPU and another part of the algorithms are executed by the GPU to obtain a faster processing efficiency.
[0181] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1. The display screen 194 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces (GUIs). For example, the display screen 194 can display photos, videos, web pages, or files, etc.
[0182] In the embodiments of the present application, the display screen 194 can be an integrated flexible display screen, or a spliced display screen composed of two rigid screens and a flexible screen located between the two rigid screens.
[0183] The camera 193 (front camera or rear camera, or a camera that can be used as both a front camera and a rear camera) is used to capture static images or videos. Generally, the camera 193 may include a photosensitive element such as a lens group and an image sensor. Among them, the lens group includes multiple lenses (convex lenses or concave lenses) for collecting the light signals reflected by the object to be photographed and transmitting the collected light signals to the image sensor. The image sensor generates the original image of the object to be photographed according to the light signals.
[0184] The internal memory 121 can be used to store computer-executable program code, and the executable program code includes instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store the operating system, the code of application programs (such as control functions, etc.). The data storage area can store the data created during the use of the electronic device 100.
[0185] The internal memory 121 may also store one or more computer programs corresponding to the control algorithms provided in the embodiments of the present application. The one or more computer programs are stored in the internal memory 121 described above and are configured to be executed by one or more processors 110. The one or more computer programs include instructions, and the instructions may be used to execute the respective steps in the following embodiments.
[0186] In addition, the internal memory 121 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0187] Of course, the code of the control algorithm provided in the embodiments of the present application may also be stored in an external memory. In this case, the processor 110 may run the code of the algorithm for detecting the user's gesture stored in the external memory through the external memory interface 120.
[0188] The sensor module 180 may include a gyroscope sensor, an acceleration sensor, a proximity light sensor, a fingerprint sensor, a touch sensor, etc.
[0189] The touch sensor is also called a "touch panel". The touch sensor may be disposed on the display screen 194. The touch sensor and the display screen 194 form a touch display screen, also called a "touch screen". The touch sensor is used to detect a touch operation acting thereon or nearby. The touch sensor may transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation may be provided through the display screen 194. In some other embodiments, the touch sensor may also be disposed on the surface of the electronic device 100 at a position different from that of the display screen 194.
[0190] Exemplarily, the display screen 194 of the electronic device 100 displays a main interface, and the main interface includes icons of multiple applications (such as a camera application, a sports health application, etc.). For example, the user may click on the icon of the camera application in the main interface through the touch sensor, triggering the processor 110 to start the camera application and turn on the camera 193. The display screen 194 displays the interface of the camera application, such as a viewfinder interface.
[0191] The wireless communication function of the electronic device 100 may be implemented by an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, a modulation and demodulation processor, a baseband processor, etc.
[0192] Antenna 1 and Antenna 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, Antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0193] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc. applied to the electronic device 100. The mobile communication module 150 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves through Antenna 1, filter, amplify and process the received electromagnetic waves, and then transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor and convert it into electromagnetic waves through Antenna 1 for radiation. In some embodiments, at least some functional modules of the mobile communication module 150 can be provided in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 can be provided in the same device. In the embodiments of the present application, the mobile communication module 150 can also be used for information interaction with other devices.
[0194] The modulation and demodulation processor can include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Subsequently, the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, receiver 170B, etc.), or displays an image or video through the display screen 194. In some embodiments, the modulation and demodulation processor can be an independent device. In some other embodiments, the modulation and demodulation processor can be independent of the processor 110 and be provided in the same device as the mobile communication module 150 or other functional modules.
[0195] The wireless communication module 160 may provide solutions for wireless communications applied to the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite systems (GNSSs), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 may also receive the signals to be sent from the processor 110, perform frequency modulation and amplification on them, and convert them into electromagnetic waves through the antenna 2 for radiation. In the embodiments of the present application, the wireless communication module 160 is used to establish a connection with other electronic devices for data interaction. Or the wireless communication module 160 may be used to access an access point device, send control instructions to other electronic devices, or receive data sent from other electronic devices.
[0196] In addition, the electronic device 100 may implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor, etc. For example, music playback, recording, etc. The electronic device 100 may receive inputs from the keys 190 to generate key signal inputs related to the user settings and function controls of the electronic device 100. The electronic device 100 may use the motor 191 to generate vibration prompts (such as incoming call vibration prompts). The indicator 192 in the electronic device 100 may be an indicator light, which can be used to indicate the charging state, the change in battery level, and can also be used to indicate messages, missed calls, notifications, etc. The SIM card interface 195 in the electronic device 100 is used to connect the SIM card. The SIM card can be in contact with and separated from the electronic device 100 by being inserted into or removed from the SIM card interface 195.
[0197] It should be understood that in actual applications, the electronic device 100 may include more than Figure 1More or fewer components shown are not limited in the embodiments of the present application. The illustrated electronic device 100 is merely an example, and the electronic device 100 may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and / or application specific integrated circuits.
[0198] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. In the embodiments of the present application, the Android system with a layered architecture is taken as an example to exemplarily illustrate the software structure of the electronic device.
[0199] The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. As Figure 2 shown, this software architecture can be divided into four layers, from top to bottom are the application layer, the application framework layer (framework, FWK), the Android runtime and system libraries, and the Linux kernel layer.
[0200] The application layer is the top layer of the operating system, including the native applications of the operating system, such as camera, gallery, calendar, Bluetooth, music, video, information, etc. The application involved in the embodiments of the present application is simply referred to as an application (application, APP), which is a software program capable of implementing one or more specific functions. Generally, multiple applications can be installed in the electronic device. For example, a camera application, an email application, a sports and health application, etc. The applications mentioned below can be system applications pre-installed when the electronic device leaves the factory, or third-party applications downloaded from the network or obtained from other electronic devices by the user during the use of the electronic device.
[0201] Of course, for developers, developers can write application programs and install them in this layer. In one possible implementation, the application program can be developed using the Java language and completed by calling the application programming interface (API) provided by the application framework layer. Developers can interact with the underlying layer of the operating system (such as the kernel layer, etc.) through the application framework to develop their own application programs.
[0202] The application framework layer is the API and programming framework for the application layer. The application framework layer may include some predefined functions. The application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc.
[0203] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.
[0204] The content provider is used to store and obtain data, and make this data accessible to application programs. The data may include files (such as documents, videos, images, audio), text and other information.
[0205] The view system includes visual controls, such as controls for displaying content such as text, pictures, documents, etc. The view system can be used to build application programs. The interface in the display window can be composed of one or more views. For example, a display interface including a short message notification icon may include a view for displaying text and a view for displaying pictures.
[0206] The phone manager is used to provide the communication function of the electronic device. The notification manager enables application programs to display notification information in the status bar, can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction.
[0207] The Android Runtime includes core libraries and a virtual machine. The Android Runtime is responsible for the scheduling and management of the Android system.
[0208] The core libraries of the Android system include two parts: one part is the functional functions that need to be called by the Java language, and the other part is the core libraries of the Android system. The application layer and the application framework layer run in the virtual machine. Taking Java as an example, the virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
[0209] The system libraries can include multiple functional modules. For example: the Surface Manager, the Media Library, the 3D graphics processing library (such as: OpenGL ES), the 2D graphics engine (such as: SGL), the image processing library, etc. The Surface Manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple application programs. The Media Library supports the playback and recording of multiple common audio and video formats, as well as static image files, etc. The Media Library can support multiple audio and video coding formats, such as: MPEG4, H.564, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc. The 2D graphics engine is the drawing engine for 2D drawing.
[0210] The kernel layer provides the core system services of the operating system. Services such as security, memory management, process management, network protocol stack, and driver model are all implemented based on the kernel layer. The kernel layer also serves as an abstraction layer between the hardware and software stacks. There are many driver programs related to electronic devices in this layer. The main drivers include: display driver; keyboard driver as an input device; camera driver; audio driver; Bluetooth driver; WiFi driver, etc.
[0211] It should be understood that the functional services described above are only examples. In actual applications, electronic devices can also be divided into more or fewer functional services according to other factors, or the functions of each service can be divided in other ways, or functional services may not be divided at all, but work as a whole.
[0212] The solution provided by the embodiments of this application will be introduced below.
[0213] The solution provided by the embodiments of this application can be applied to scenarios of multi-screen interaction between multiple display screens. Among them, multi-screen interaction means that both parties in the interaction can share the content displayed on the display screen to the display screen of the other party for display. The multiple display screens can be within the same spatial range. The multiple display screens can belong to the same electronic device or can belong to different electronic devices respectively.
[0214] In one example, the above-mentioned multiple display screens can be multiple display screens configured in a vehicle cockpit, and these multiple display screens can be display screens configured based on a one-chip multi-screen mechanism or a multi-chip multi-screen mechanism. In another example, the above-mentioned multiple display screens can include at least one display screen configured in the vehicle cockpit and the display screens of at least one terminal device located within the space of the vehicle cockpit. The terminal device can be an electronic device carried by a user (passenger) in the vehicle cockpit.
[0215] In the above examples, although the positions of the display screens configured in the in-vehicle infotainment system (IVI) cockpit can be adjusted, in actual scenarios, within a relatively long period of time, the relative positions between different display screens configured in the IVI cockpit are generally fixed. Therefore, in the embodiments of the present application, it can be considered that the relative positions between the display screens configured in the IVI cockpit are fixed. Each electronic device to which a display screen belongs can pre-obtain the positions of other display screens in the IVI cockpit, so as to determine the relative positions between different display screens in the IVI cockpit. When the positions of the display screens configured in the IVI cockpit change, the electronic device to which a display screen belongs can notify the electronic devices to which other display screens belong of the latest positions of the display screens, so as to ensure that the electronic devices to which each display screen belongs can accurately obtain the position distribution information of each display screen in the IVI cockpit. Due to the uncertainty of the user using the terminal device, the relative position between the display screen of the terminal device and the display screens configured in the IVI cockpit can change at any time and it is difficult to remain fixed for a long time. Therefore, in the embodiments of the present application, it can be considered that the relative position between the display screen of the terminal device and the display screens configured in the IVI cockpit can change.
[0216] In the embodiments of the present application, for multi-screen interaction between display screens with fixed relative positions, both parties to the interaction can pre-save the relative position relationship between different display screens. During the multi-screen interaction process, both parties to the interaction can present the information of different display screens to the user or determine the multi-screen interaction object indicated by the user operation according to the pre-saved relative position relationship. For multi-screen interaction between display screens with variable relative positions, both parties to the interaction can use the predefined position relationship as the position relationship between the display screens. During the multi-screen interaction process, both parties to the interaction can present the information of different display screens to the user or determine the multi-screen interaction object indicated by the user operation according to this position relationship. Among them, the user can control the multi-screen interaction process by performing a sliding operation on the display screen with a set gesture, such as selecting the object for multi-screen interaction, etc.
[0217] Next, the solution provided by the embodiments of the present application will be introduced in detail in combination with specific scenarios. For ease of description, in the following embodiments of the present application, the display screen that shares content among the two display screens for multi-screen interaction is denoted as the source display screen, the display screen that receives the content shared by the source display screen among the two display screens for multi-screen interaction is denoted as the target display screen, the content displayed on the source display screen is denoted as the source-side content, and the content displayed on the target display screen is denoted as the target content. Among them, the electronic device to which the source display screen belongs is denoted as the source device, and the electronic device to which the target display screen belongs is denoted as the target device. Any electronic device can act as a source device to perform multi-screen interaction with other electronic devices, or act as a target device to perform multi-screen interaction with other electronic devices.
[0218] Part 1: Multi-screen interaction between display screens with fixed relative positions
[0219] In the embodiments of the present application, the source device and the target device can preset an operation method for controlling multi-screen interaction, so that the user can control the multi-screen interaction process by performing corresponding operations. Among them, the operation method can be a gesture operation of swiping on the display screen with a set gesture. Exemplarily, the gesture operation can be a multi-finger (such as three-finger) swiping operation, and the user can control the multi-screen interaction process by performing a three-finger swiping operation on the display screen.
[0220] In the embodiments of the present application, for display screens with fixed relative positions, the electronic devices to which each display screen belongs can pre-determine and save the relative position relationship between the display screens. When performing multi-screen interaction, the electronic devices to which each display screen belongs can determine the target display screen selected by the user according to the operations performed by the user on the display screen, so as to share the content displayed on its own display screen to the target display screen for display. Exemplarily, the display screens with fixed relative positions can be the display screens configured in the vehicle cockpit or the display screens configured in the home environment scene, etc.
[0221] Embodiment 1: The display screens with fixed relative positions can be the display screens configured in the vehicle cockpit. For example, they can be Figure 3 the display screens 1-4 shown in, and the display screens 1-4 belong to the electronic devices 1-4 respectively. Among them, the position corresponding to the display screen 1 is the front left seat, which can be recorded as the front left screen (or the central control screen), the position corresponding to the display screen 2 is the front right seat, which can be recorded as the front right screen (or the co-pilot screen), the position corresponding to the display screen 3 is the rear left seat, which can be recorded as the rear left screen, and the position corresponding to the display screen 4 is the rear right seat, which can be recorded as the rear right screen. Then, the relative position relationship between the display screens 1 to 4 can be determined according to the relative positions between the corresponding seats. This relative position relationship can be pre-set in the electronic devices to which each display screen belongs by the user, or can be determined after the electronic devices to which each display screen belongs interact. For example, when the display screen 1 and the display screen 2 belong to different electronic devices, after the electronic device 1 to which the display screen 1 belongs establishes a communication connection with the electronic device 2 to which the display screen 2 belongs, the electronic device 1 can send its own device identifier and the corresponding seat information to the electronic device 2. Then, the electronic device 2 can determine that the display screen 1 of the electronic device 1 is located on the left side of the display screen 2, so as to establish and save the relative position relationship between its own display screen 2 and the display screen 1 of the electronic device 1. Subsequently, when it is determined according to the user operation that the user instructs to share the content in the display screen to the left display screen, the content can be shared to the display screen 1 of the electronic device 1 for display.
[0222] In the above method, when the source device determines the target display screen selected by the user according to the operation performed by the user on the source display screen, any one of the following methods 1 to 3 can be adopted.
[0223] Method 1: Determine the target display screen based on the direction angle of the user operation
[0224] In this method, the source device can determine the target display screen selected by the user according to the direction angle of the moving path of the contact point when the user performs a sliding operation on the source display screen. Specifically, when the user performs a sliding operation on the source display screen, the source device determines the sliding direction of the sliding operation, that is, the direction of the moving path of the contact point on the source display screen when the user performs the sliding operation, and compares the sliding direction with at least one candidate direction. When the angle between the sliding direction and any one of the candidate directions is less than a set first angle threshold or less than the angle between the sliding direction and other candidate directions, the electronic device determines that the target display screen is the candidate display screen corresponding to the candidate direction. Among them, at least one candidate direction corresponds one-to-one with at least one candidate display screen, and the candidate direction corresponding to any candidate display screen is the direction from the position of the source display screen to the position of the candidate display screen, and the candidate display screen is the display screen of an electronic device capable of multi-screen interaction with the source device.
[0225] Embodiment 2: In the scenario described in Example 1 above, the source device may be Electronic Device 1, at least one candidate device may be Electronic Devices 2 to 4, the source display screen is Display Screen 1, and at least one candidate display screen is respectively Display Screens 2 to 4. As Figure 4 shown, according to the relative position relationship between Display Screens 2 to 4 and Display Screen 1, the source device can determine that at least one candidate direction is respectively Candidate Directions 2 to 4, where Candidate Direction 2 is the direction from Display Screen 1 to Display Screen 2, that is, the direction to the right, Candidate Direction 3 is the direction from Display Screen 1 to Display Screen 3, and Candidate Direction 4 is the direction from Display Screen 1 to Display Screen 4. Then, when the direction pointed by the moving path of the contact point when the user operates on the source display screen is the sliding direction P, and the angle between the sliding direction P and Candidate Direction 2 is less than the set first angle threshold X1, the source device can determine that the target display screen is Display Screen 2, so that the process of sharing the content displayed on Display Screen 1 to Display Screen 2 for display can be started.
[0226] In some embodiments of the present application, the source device may allocate an angular range for candidate display screens according to the positions and quantities of the candidate display screens. When multiple candidate display screens are all within the same direction range on one side of the target display screen, the multiple candidate display screens may equally divide the angular range corresponding to this direction range, where the angular ranges corresponding to different display screens do not overlap. Then, the source device may use a value less than or equal to half of the size of the angular range corresponding to the candidate display screen as the first angular threshold corresponding to this candidate display screen. For example, when there is one candidate display screen in each of the front, back, left, and right directions of the source display screen, the angular range of the direction range corresponding to the source display screen is 360 degrees. Among the display screens in the front, back, left, and right directions of the source display screen, the angular range corresponding to each display screen is 90 degrees, and the first angular threshold is 45 degrees. When the direction of the user's sliding operation is within the angular range centered on the forward direction of the source display screen and with a size of 90 degrees, and the included angle between this sliding direction and the forward direction is less than the first angular threshold, it may be determined that the display screen in front of the source display screen is the target display screen.
[0227] In some embodiments of the present application, the candidate display screens are all in the lit screen state (i.e., the power-on state). If a display screen is in the off-screen state (i.e., the power-off state), the source device does not use this display screen as a candidate display screen. For example, in the above Example 2, if display screens 2 and 3 are in the lit screen state and display screen 4 is in the off-screen state, the source device uses display screens 2 and 3 as candidate display screens that can perform multi-screen interaction with display screen 1. Among them, the source device may obtain the status information of other display screens from the devices to which the other display screens belong, and then determine whether to use the other display screens as candidate display screens according to the status information.
[0228] Method 2: Determine the target display screen based on the hot zone selected by the user operation
[0229] In this method, the source device may display the hot zones corresponding to the candidate display screens and determine the target display screen selected by the user according to the hot zone selected by the user during the sliding operation on the source display screen. Specifically, the source device may display the hot zones corresponding to at least one candidate display screen when detecting that the user performs a sliding operation on the source display screen, so that the user can select the target display screen by continuing to slide to the hot zone. Then, the source device may determine the target display screen selected by the user according to the hot zone where the final position of the contact point of the user's sliding operation is located. Among them, the hot zone is an interactable (or clickable) area with a set size displayed on the display screen in a specific manner. In the embodiments of the present application, hot zones at different positions may be used to represent different display screens, and the user can select the display screen corresponding to the hot zone by clicking on the hot zone. Optionally, the hot zones corresponding to the candidate display screens may also include identification information of the candidate display screens, and the identification information may be information such as the position, name, and type of the candidate display screen.
[0230] Embodiment 3: Based on the scenario described in the above Example 2, the source device is Electronic Device 1. When the source device detects a sliding operation of the user, it can display on the source display screen an interface as shown in Figure 5 . The interface includes hot zones 2 to 4, and the hot zones 2 to 4 are the hot zones corresponding to the display screens 2 to 4 respectively. After the hot zones are displayed, the user continues the previous sliding operation. When the user continues to slide into hot zone 2 and stops the sliding operation, the source device can determine that the target display screen is display screen 2.
[0231] Method 3: Determine the target display screen by combining the direction of the user operation and the hot zone selected by the user
[0232] In this method, the source device can display the hot zones corresponding to the candidate display screens based on the direction of the user operation, and then determine the target display screen selected by the user according to the hot zone selected by the user during the sliding operation on the source display screen. Specifically, when the source device detects a sliding operation of the user on the source display screen, it compares the sliding direction of the sliding operation with at least one reference direction. If the sliding direction is the same as or the included angle with any reference direction is less than a set second angle threshold, the source device displays on the display screen at least one hot zone corresponding to the reference direction, so that the user can select the target display screen by continuing to slide into the hot zone. Then, the source device can determine the target display screen selected by the user according to the hot zone where the last position of the contact point of the user's sliding operation is located. Among them, the reference direction can be a set direction or the sliding direction of the user's sliding operation, and the hot zone corresponding to the reference direction is the hot zone of the display screen corresponding to the candidate direction whose included angle with the reference direction is less than the set second angle threshold. Optionally, the second angle threshold is greater than the first angle threshold.
[0233] Embodiment 4: Based on the scenario described in the above Example 2, the reference directions can be the reference directions A to D shown in Figure 6a . When the source device detects a sliding operation of the user, it compares the current sliding direction of the sliding operation with the set reference directions A to D. When it is determined that the included angle between the current sliding direction and reference direction C is less than the set second angle threshold X2, the source device can display on the source display screen an interface as shown in Figure 6b . The interface includes hot zones 3 and 4 corresponding to display screens 3 and 4. After the hot zones are displayed, the user continues the previous sliding operation. When the user continues to slide into hot zone 3 and stops the sliding operation, the source device can determine that the target display screen is display screen 3.
[0234] Based on the methods described in the above Method 1 to Method 3, the user only needs to perform a sliding operation on the source display screen once to select the target display screen and trigger the process of the source device sharing the content of the source display screen to the target display screen for display. The operation process is very simple and can be completed in one step.
[0235] In the embodiments of the present application, after the multi-screen interaction process is started, the source device may send the source content displayed on the source display screen to the target device. After receiving the source content from the source device, the target device may display the source content on the target display screen. Among them, after the multi-screen interaction (that is, after the source device sends the source content to the target device), the source device may display content on the source display screen in any of the following ways:
[0236] 1) Keep the displayed content unchanged
[0237] In this method, after the source device sends the content displayed on the source display screen to the target device, the content displayed on the source display screen remains unchanged.
[0238] Embodiment 5: As Figure 7a shown, before the multi-screen interaction, the source display screen of the source device displays a navigation interface, and the target display screen of the target device displays an album interface. Then, after the multi-screen interaction, when the source device adopts this method, the content displayed on the source display screen is as shown in Case 1 or 2 of Figure 7a , which is the same as the content displayed on the source display screen before the multi-screen interaction and has not changed.
[0239] 2) Display the setting interface
[0240] In this method, the setting interface may be the desktop interface or the previous interface of the interface displayed on the source display screen before the multi-screen interaction. After the source device sends the content displayed on the source display screen to the target device, it can jump to display the desktop interface or the previous interface of the current interface.
[0241] Embodiment 6: Based on Figure 7a the scenario shown, after the multi-screen interaction, when the source device adopts this method, the source display screen displays the desktop interface shown in Case 3 of Figure 7b . Of course, the source display screen may also display the interface displayed before the navigation interface.
[0242] 3) Turn off the screen and do not display
[0243] In this method, after the source device sends the content displayed on the source display screen to the target device, it can stop displaying the content and switch to the screen-off state.
[0244] 4) Display the target content on the target display screen
[0245] In this method, after the source device sends the source content to the target device, it can obtain the target content displayed on the target display screen from the target device and display the target content on the source display screen. Based on this method, the effect of exchanging the display content between the source display screen and the target display screen can be achieved.
[0246] Among them, when the source device displays the target content, it can replace the interface for displaying the source content with the interface for displaying the target content, or display the target content in a new window (or interface). Among them, the new window covers the interface for displaying the source content.
[0247] Embodiment 7: Based on Figure 7a the scenario shown, after multi-screen interaction, when the source device adopts this method, the source display screen displays Figure 7b the interface shown in Case 4 in Figure 7b i.e., the photo album interface; or, the source display screen displays
[0248] After multi-screen interaction, the target device can adopt any of the following methods to display the source content on the target display screen:
[0249] 1) Full-screen display method
[0250] In this method, after the target device receives the source content from the source device, it can replace the currently displayed target content with the source content.
[0251] Embodiment 8: Based on Figure 7a the scenario shown, after multi-screen interaction, when the target device adopts this method, the content displayed on the target display screen is as Figure 7a shown in Case 1 in
[0252] 2) Window display method
[0253] In this method, after the target device receives the source content from the source device, it can display the source content in a newly added window (or interface), where the newly added window covers the interface where the current content is located.
[0254] Embodiment 9: Based on Figure 7a the scenario shown, after multi-screen interaction, when the target device adopts this method, the target display screen displays as Figure 7a shown in Case 2 in
[0255] 3) Split-screen display method
[0256] In this method, after the target device receives the source content from the source device, it can split-screen display the target content and the source content. Optionally, the terminal device can adopt this method to display content under a set scenario. For example, in the case where the navigation interface is displayed on the target display screen, the target device can adopt the split-screen display method to display the target content and the source content on the target display screen.
[0257] Optionally, the source device can determine whether the sliding speed / sliding acceleration / leaving - hand speed of the user's sliding operation on the source display screen is greater than the corresponding speed threshold. If so, when sharing content, the source device can simultaneously instruct the target device to adopt the split - screen display mode and display the source - side content in the split - screen window farther from the source display screen. Otherwise, when sharing content, the source device can simultaneously instruct the target device to adopt the split - screen display mode and display the source - side content in the split - screen window closer to the source display screen. Among them, for the two split - screen windows after the target display screen is split, when the angle between the direction from the source display screen to one split - screen window and the direction from this split - screen window to the other split - screen window is less than the set angle threshold, it can be determined that this split - screen window is the split - screen window closer to the source display screen, and the other split - screen window is the split - screen window farther from the source display screen.
[0258] Embodiment 10: Based on Figure 7a the scenario shown, after multi - screen interaction, when the target device adopts this method, the target display screen is displayed as the interface shown in Case 3 of Figure 7b .
[0259] Based on the above method, the source device and the target device can flexibly select the way to display content after multi - screen interaction, thereby achieving different display effects. Among them, the source device and the target device can select the way to display content according to the type of display content, display scenario, task type, task priority, display screen position, etc., or select the display method according to the user's instruction. This application embodiment does not make specific limitations.
[0260] In some embodiments of this application, when both the source display screen and the target display screen display the source - side content after cross - screen display, the source device and the target device can synchronously perform subsequent control on the source - side content, or the source device and the target device can independently control the source - side content they display. For example, when the source - side content is a video, after multi - screen interaction, the source device and the target device can respectively control the source display screen and the target display screen to play the video synchronously. When the user operates on the video played on one of the display screens (such as adjusting the progress or closing, etc.), this display screen pauses playing the video or responds according to the user's instruction.
[0261] In the above - mentioned embodiment, the user can operate on the source display screen to control and achieve the effect of sharing the source - side content displayed on the source display screen to the target display screen for display. In some embodiments of this application, the user can also operate on the target display screen according to the method provided in the above - mentioned embodiment to control and achieve the effect of sharing the source - side content displayed on the source display screen to the target display screen for display. Among them, the source device or the target device can determine the operation control method for controlling multi - screen interaction according to the user's instruction: operating on the source display screen or operating on the target display screen.
[0262] In one scenario, when the operation control method indicated by the user is to perform an operation on the source display screen, the source device and the target device can perform multi-screen interaction in the manner provided in the above embodiments.
[0263] In another scenario, when the operation control method indicated by the user is to perform an operation on the target display screen, the method by which the target device determines the source display screen according to the user operation can refer to the method by which the source device determines the target display screen in the above embodiments. Specifically, the target device can determine the source display screen by any one of the following methods 1 to 3:
[0264] Method 1. Determine the source display screen based on the direction angle of the user operation
[0265] In this method, the target device can determine the source display screen selected by the user according to the direction angle of the movement path of the contact point when the user performs a sliding operation on the target display screen. Specifically, when the user performs a sliding operation on the target display screen, the target device determines the sliding direction of the sliding operation, that is, the direction of the movement path of the contact point on the target display screen when the user performs the sliding operation, and compares the sliding direction with at least one candidate direction. When the angle between the sliding direction and any one candidate direction is less than or equal to a set first angle threshold or less than the angle between the sliding direction and other candidate directions, the electronic device determines that the source display screen is the display screen corresponding to this candidate direction. Among them, at least one candidate direction corresponds to at least one candidate display screen one by one, and the candidate direction corresponding to any candidate display screen is the direction pointing from the position of this candidate display screen to the target display screen, and the candidate display screen is the display screen of an electronic device capable of performing multi-screen interaction with the target device.
[0266] Method 2. Determine the source display screen based on the hot zone selected by the user operation
[0267] In this method, when detecting that the user performs a sliding operation on the target display screen, the target device can display the hot zones corresponding to at least one candidate display screen, so that the user can select the source display screen from the candidate display screens by continuing to slide to the hot zone. Then, the target device can determine the source display screen selected by the user according to the hot zone where the final position of the contact point of the user's sliding operation is located.
[0268] Method 3. Determine the source display screen by combining the direction of the user operation and the hot zone selected by the user
[0269] In this method, when the target device detects a sliding operation performed by the user on the target display screen, it compares the reverse direction of the sliding direction of the sliding operation with at least one reference direction. If the reverse direction is the same as any of the reference directions or the included angle is less than a set second angle threshold, the source device displays at least one hot zone corresponding to the reference direction on the display screen, so that the user can select the source display screen by continuing to slide to the hot zone. Then, the target device can determine the source display screen selected by the user according to the hot zone where the final position of the contact point of the user's sliding operation is located. Here, the reference direction is a set direction, and the hot zone corresponding to the reference direction is the hot zone of the display screen corresponding to the candidate direction whose included angle with the reference direction is less than the set second angle threshold.
[0270] In some embodiments of the present application, when a sliding operation performed by the user on the display screen of the electronic device can trigger both the selection of the source display screen and the selection of the target display screen, the electronic device can also default to trigger the selection of the target display screen, that is, the operation performed by the user on the display screen has a higher priority for controlling the sharing of the content on the display screen to other electronic devices than the priority of obtaining the content of other display screens.
[0271] After multi-screen interaction, the ways of the target display screen and the source display screen to display content can refer to the methods of the target display screen and the source display screen to display content in the above embodiments, which will not be elaborated here. Some multi-screen interaction effects achieved based on this method can also refer to Examples 11 to 12 below.
[0272] Example 11: When the source display screen is Figure 3 the display screen 1 shown in, and the target device is Figure 3 the display screen 2 shown in, the user can perform the same sliding operation as in Example 2 above on the target display screen, that is, slide along the sliding direction P, then it can trigger the target device to obtain the source content displayed on the source display screen from the source device and display it on the target display screen, realizing the effect of controlling multi-screen interaction on the target display screen. The interfaces displayed on the source display screen and the target display screen after multi-screen interaction can be Figure 7a Case 1 to Case 2 in or Figure 7b the interfaces shown in Case 3 to Case 5 in.
[0273] Example 12: In Figure 3 the scenario shown, the display screen 1 and the display screen 2 are the display screens located in the same row in the cockpit, and the display screen 1 and the display screen 3 are the display screens located in the same column in the cockpit. Based on the method provided in the above embodiments, the user can control the multi-screen interaction between the display screen 1 and the display screen 2 by performing a sliding operation on the display screen 1 or the display screen 2, and the user can control the multi-screen interaction between the display screen 1 and the display screen 3 by performing a sliding operation on the display screen 1 or the display screen 3. For example, as Figure 8As shown in the figure, the user can control Device 1 to share the content of Display Screen 1 to Display Screen 2 of Device 2 for display by performing a three-finger right-swipe operation on Display Screen 1 or Display Screen 2; the user can control Device 2 to share the content of Display Screen 2 to Display Screen 1 of Device 1 for display by performing a three-finger left-swipe operation on Display Screen 1 or Display Screen 2. The user can control Device 1 to share the content of Display Screen 1 to Display Screen 3 of Device 3 for display by performing a three-finger down vertical swipe operation on Display Screen 1 or Display Screen 3; the user can control Device 3 to share the content of Display Screen 3 to Display Screen 1 of Device 1 for display by performing a three-finger up vertical swipe operation on Display Screen 1 or Display Screen 3. Optionally, Device 1, Device 2, and Device 3 can be the same device, or different devices, or some of them can be the same device. For example, Device 1 and Device 2 can be the same device and different from Device 3.
[0274] Based on the above method, the user can control multi-screen interaction at the source end or at the target end. Therefore, the control method is relatively flexible, which is convenient for the user to select a suitable control method according to the actual situation, and thus can improve the user experience.
[0275] Part Two: Multi-screen interaction between display screens with variable relative positions
[0276] In this part of the content, the implementation of multi-screen interaction between display screens with variable relative positions can refer to the implementation method of multi-screen interaction between display screens with fixed relative positions described in the above Part One. The following is a specific description.
[0277] In some embodiments of the present application, as an alternative implementation manner, the preset gesture operations described in the above Part One can also control the multi-screen interaction between display screens with variable relative positions, that is, the source device and the target device can use the same gesture operations to control the multi-screen interaction in the above two scenarios. For example, for the interaction between display screens with fixed relative positions and the interaction between display screens with variable relative positions, both the source device and the target device use three-finger swipe operations for control. As another alternative implementation manner, the preset gesture operations described in the above Part One are only used to control the multi-screen interaction between display screens with fixed relative positions. For the interaction between display screens with variable relative positions, the source device and the target device can pre-set other gesture operations for control. For example, for the interaction between display screens with fixed relative positions, the source device and the target device can use three-finger swipe operations for control, and for the interaction between display screens with variable relative positions, the source device and the target device can use two-finger swipe operations for control.
[0278] In the embodiments of the present application, the display screen with a fixed relative position and the display screen with a variable relative position can coexist. That is, among the multiple display screens capable of multi-screen interaction, the relative positions between some display screens can be fixed, and the relative positions between some display screens can be variable.
[0279] Embodiment 13: Based on the above Example 1, Figure 3 In the in-vehicle cockpit shown, in addition to the display screens 1 to 4, there may also be a display screen 5 of a mobile device (such as a mobile phone, a tablet, etc.) carried by the user. Then, in the space of the in-vehicle cockpit, there are both display screens with fixed relative positions and display screens with variable relative positions. Among them, the relative positions between the display screens 1 to 4 are fixed, and the relative position between the display screen 5 and other display screens can be variable. For the multi-screen interaction between any two of the display screens 1 to 4, the method described in the above first part can be referred to. For the interaction between the display screen 5 and other display screens, the method described in this second part can be referred to. The following is an illustration in combination with specific scenarios.
[0280] Scenario 1: In the environmental space where the source device is located, there are candidate display screens with a fixed relative position to the source display screen and candidate display screens with a variable relative position to the source display screen
[0281] In this scenario, the source device can determine the target display screen by any one of the methods 1 to 3 described in the above embodiments.
[0282] Among them, when the source device determines the target display screen by the method 1 or method 3 described in the above embodiments, for the candidate display screen with a variable relative position to the source display screen, the source device can use the preset position relationship as the relative position relationship between the candidate display screen and the source display screen. Then, according to the set position relationship, a fixed direction of the candidate display screen relative to the source display screen can be determined, so that the user can select the target display screen by sliding in this direction. Specifically, the source device can use the set candidate direction as the candidate direction corresponding to the candidate display screen, and the set candidate direction is different from the candidate directions corresponding to other display screens. Other processing methods can all refer to the method 1 or method 3 described in the above embodiments.
[0283] Embodiment 14: In this scenario, the source display screen can be the display screen 4 described in Example 13, and the candidate display screens are display screens 1 to 3 and display screen 5. Among them, the position of display screen 5 relative to display screen 4 can be changed. Display screens 1 to 3 are respectively located on the left front side, front side, and left side of display screen 4. Then, the device 1 can map the position of display screen 5 to the right front side of display screen 4 (or any other orientation where there is no corresponding candidate display screen, such as the right side, rear side, right rear side, etc.). Then, regardless of how the position of display screen 5 changes, the source device considers that display screen 5 is located on the right front side of display screen 4, so that the user can trigger the source device to share the content of display screen 4 to display screen 5 by swiping upwards to the right on display screen 4. For example, as Figure 9a shown, the corresponding candidate directions of display screens 1 to 3 are candidate directions 1 to 3 respectively. Then, the source device can use the set candidate direction 5 as the candidate direction corresponding to display screen 5. Then, when the source device determines the target display screen in the manner 1 described in the above embodiment, when the moving path of the contact point where the user operates on the source display screen points to the sliding direction Q, and the included angle between the sliding direction Q and the candidate direction 5 is less than the set first angle threshold X1, the source device can determine that the target display screen is display screen 5, and thus can start the process of sharing the content displayed on display screen 4 to display screen 5 for display. When the source device determines the target display screen in the manner 3 described in the above embodiment, as Figure 9b shown, when the included angle between the sliding direction of the user's sliding operation and the reference direction A is less than the set second angle threshold X2, the source device can display on the source display screen Figure 10 the interface shown. This interface includes the hot zones 1, 2, and 5 corresponding to display screens 1, 2, and 5. Then, after the hot zones are displayed, the user continues the previous sliding operation. When the user continues to slide into the hot zone 5 and stops the sliding operation, the source device can determine that the target display screen is display screen 5.
[0284] When the source device determines the target display screen in the manner 2 described in the above embodiment, the hot zones displayed by the terminal device include the hot zones corresponding to the candidate display screens with a fixed relative position to the source display screen, and the hot zones corresponding to the candidate display screens with a variable relative position to the source display screen. The display method and selection method of the hot zones can refer to the method described in the manner 2 of the above embodiment, and will not be elaborated here.
[0285] Optionally, in the above method, when there are multiple candidate display screens with variable relative positions to the source display screen in the environmental space where the source device is located, for the multiple candidate display screens, when the source device displays the hot zones of the candidate display screens, it can arrange the display positions of the hot zones of the multiple candidate display screens on the source display screen in any of the following ways:
[0286] 1) Arrange according to the orientation
[0287] In this method, the source device can determine the relative position between the candidate display screen and the source display screen according to the candidate directions corresponding to different pre-set candidate display screens, and display the hot area of the candidate display screen in the source display screen according to this relative position.
[0288] 2) Arrange according to the distance from the source display screen
[0289] In this method, the source device can respectively detect the distances between the devices to which the candidate display screens belong and the source device, and after sorting according to the determined distances, display the hot areas of the candidate display screens on the source display screen according to the sorting. Optionally, the source device can also adjust the size of the hot areas of the candidate display screens according to this sorting. For example, the source device can display the hot area of the candidate display screen with a smaller corresponding distance in the front and the hot area of the candidate display screen with a larger corresponding distance in the back. It can also enlarge the area occupied by the hot area of the candidate display screen with a smaller corresponding distance and reduce the area occupied by the hot area of the candidate display screen with a larger corresponding distance.
[0290] 3) Arrange according to the intimacy between the device to which the candidate display screen belongs and the source device
[0291] Optionally, the intimacy can be determined according to the number of times or frequency of interaction between the device to which the candidate display screen belongs and the source device within a historical time period. Specifically, the magnitude of the intimacy has a positive correlation with the number of times or frequency of interaction between the device to which the candidate display screen belongs and the source device. The intimacy can also be determined according to the interval time between the current time and the time when the device to which the candidate display screen belongs and the source device last performed multi-screen interaction, and the magnitude of this interval time has a negative correlation with the magnitude of the intimacy. Optionally, the intimacy between the device to which the candidate display screen belongs and the source device when logging in to the same user account is higher than the intimacy between the device to which the candidate display screen belongs and the source device when logging in to different user accounts. The intimacy between the device to which the candidate display screen belongs and the source device when logging in to the same or different member accounts under the same family account is higher than the intimacy between the device to which the candidate display screen belongs and the source device when logging in to different strange user accounts.
[0292] The source device can display the hot area of the candidate display screen on the source display screen according to the sorting of the intimacy. Among them, the hot area of the candidate display screen with a larger corresponding intimacy can be displayed in the front, and the hot area of the candidate display screen with a larger corresponding intimacy is displayed in the back.
[0293] In some embodiments of the present application, when there are multiple candidate displays in the environmental space where the source device is located and the relative positions of the candidate displays with respect to the source display can vary, the source device can also correspond the multiple candidate displays to the same candidate direction. Then, when the angle between the direction of the user's sliding operation and the candidate direction is less than or equal to a set first angle threshold, the source device can display the hotspots of the multiple candidate displays on the source display. Then, the user can select the hotspot of any one of the displays by continuing the sliding operation or by performing a click operation, thereby selecting the display as the target display. Among them, when the source device can display the hotspots of the multiple candidate displays on the source display, any one of the above three arrangement methods can be adopted.
[0294] In this scenario, when the target display determined by the source device is a display whose relative position with respect to the source device can vary, after multi-screen interaction, the way of displaying the content on the source display and the target display can refer to the way described in the above embodiments and will not be repeated here.
[0295] Scenario 2: There is no display in the environmental space where the source device is located whose relative position with respect to the source display remains fixed.
[0296] In this scenario, the source device can control multi-screen interaction using the same gesture operations as in Scenario 1 above.
[0297] As an alternative implementation, when the source device detects that the user performs a set gesture sliding operation on the source display, it displays the identification information (or hotspot) of the candidate displays that can perform multi-screen interaction with the source display. The user can select the identification information of any candidate display by continuing to perform the gesture sliding operation. The source device detects the final position of the contact point of the user's gesture sliding operation on the source display, and takes the candidate display corresponding to the identification information at this position as the target display. Among them, the identification information can be information such as the name, position, category, display ID, icon of the display that can uniquely identify the display.
[0298] Embodiment 15: Based on the scenario described in Example 13, the source device can be the device to which Display 5 belongs, and the candidate displays can be Displays 1 to 4. As Figure 11 shown in the schematic diagram (a) therein, the user can trigger multi-screen interaction by performing a three-finger sliding operation on Display 5. When the source device detects the three-finger sliding operation performed by the user on Display 5, the source device can display Figure 11 the interface shown in the schematic diagram (b) therein. The interface includes the identification information of Displays 1 to 4. Then, the user can continue to slide to the identification information of any one of Displays 1 to 4 and then stop the sliding operation. Then, the source device can determine the display corresponding to the identification information as the target display.
[0299] As another alternative implementation, after detecting that the user performs a gesture sliding operation set on the source display screen, the source device may display the identification information (or hot zone) of candidate display screens capable of multi-screen interaction with the source display screen. The user can select the identification information of any candidate display screen by performing a click operation, and the source device uses the candidate display screen selected by the user as the target display screen.
[0300] Example 16: Based on the scenario described in Example 15, as Figure 12 shown in the schematic diagram of (a) in, the user can trigger multi-screen interaction by performing a three-finger sliding operation on display screen 5. After the source device detects the three-finger sliding operation performed by the user on display screen 5, it can display Figure 12 the interface shown in the schematic diagram of (b) in. The interface includes the identification information of display screens 1 to 4. Then the user can perform a click operation to select the identification information of any one of the display screens 1 to 4. The source device can determine the identification information selected by the user according to the click operation of the user, and use the display screen corresponding to the identification information as the target display screen.
[0301] Optionally, in the above two implementation manners, when the candidate display screens capable of multi-screen interaction with the source display screen belong to the same type of display screen, before the source device displays the identification information of each candidate display screen, it may first display an option control for selecting the candidate display screens of this type. After the user operates on the option control to select the candidate display screens of this type, the source device then displays the identification information of each candidate display screen on the source display screen, and the user continues to operate to select the candidate display screen corresponding to the identification information.
[0302] Example 17: Based on the scenario described in Example 15, display screens 1 to 4 all belong to the display screens configured in the vehicle cockpit. As Figure 13 shown in the schematic diagram of (a) in, the user can trigger multi-screen interaction by performing a three-finger sliding operation on display screen 5. When the source device detects the three-finger sliding operation performed by the user on display screen 5, the source device can display Figure 13 the interface shown in the schematic diagram of (b) in. The interface includes an option control for selecting the vehicle. The user can continue to perform a sliding operation to select the control. Then the source device can determine to select the display screen in the vehicle as the target display screen according to the operation of the user. Then the source device can continue to display Figure 13 the interface shown in the schematic diagram of (c) in. The interface includes the identification information of display screens 1 to 4. The user can continue to slide to the identification information of any one of the display screens 1 to 4, and then stop the sliding operation. Then the source device can determine the display screen corresponding to the identification information as the target display screen. Or, after the user stops the sliding operation, the user can select the identification information by performing a click operation, and the source device determines the display screen corresponding to the identification information as the target display screen.
[0303] Example 18: Based on the scenario described in Example 15, as Figure 14 shown in the schematic diagrams (a) and (b) in [reference], the user can trigger multi-screen interaction by performing a three-finger swipe operation on the display screen 5. When the source device detects the three-finger swipe operation performed by the user on the display screen 5 (swiping from the position shown in the schematic diagram (a) in [reference] to Figure 14 the position shown in the schematic diagram (b) in [reference] and then stopping the swipe), the source device can display Figure 14 the interface shown in the schematic diagram (c) in [reference]. This interface includes an option control for selecting the in-vehicle unit. The user can select this control by performing a click operation, and then the source device can determine to select the display screen in the in-vehicle unit as the target display screen according to the user's operation. Then the source device can continue to display Figure 14 the interface shown in the schematic diagram (d) in [reference]. This interface includes the identification information of display screens 1 to 4. The user can select the identification information by means of a click operation, and the source device determines the display screen corresponding to the identification information as the target display screen.
[0304] Optionally, in the above method, the source device and the candidate device can both log in to the same user account.
[0305] In the above method, when the user selects the identification information by performing a click operation, the user can select one or more pieces of identification information, and then the content displayed on the source display screen is shared to the display screens corresponding to one or more pieces of identification information selected by the user. Among them, when the user selects multiple pieces of identification information, the source device can share the content displayed on the source display screen to the display screens corresponding to the multiple pieces of identification information selected by the user in a mirroring manner.
[0306] Part Three: Multi-screen Interaction in Split-screen Scenarios and Multi-window Scenarios
[0307] In the previous embodiments, before performing multi-screen interaction, both the source display screen of the source device and the target display screen of the target device adopted a display method of full-screen displaying a single interface. In actual applications, before performing multi-screen interaction, both the source display screen and the target display screen may adopt a split-screen or multi-window method to display content. In this scenario, the source device and the target device need to adjust the execution process of multi-screen interaction in combination with the display methods of the content on the source display screen and the target display screen. The following is an explanation in combination with specific scenarios.
[0308] Scenario One: Split-screen Display Scenario
[0309] In this scenario, the source device and the target device can use the same gesture operations as in the foregoing embodiments to control multi-screen interaction. Among them, since the source display screen and / or the target display screen adopt a split-screen mode, there are more than two windows (or interfaces) in the source display screen and the target display screen for multi-screen interaction. The source display screen and the target display screen can perform multi-screen interaction on the content displayed in one of the windows or on the content displayed on the entire display screen. To ensure the multi-screen interaction effect between the source display screen and the target display screen for one of the windows, the source device and the target device can select the window for multi-screen interaction based on the contact characteristics of the user's sliding operation, and can select whether to skip some intermediate windows for multi-screen interaction based on the speed / acceleration characteristics of the user's sliding operation, so as to realize multi-screen interaction between different windows on the display screen according to the user's operation.
[0310] In some embodiments of the present application, when the source display screen adopts a split-screen display mode, the source device can use the window where the starting contact point of the user's sliding operation is located as the window for multi-screen interaction, so as to share the content in the window to the target display screen for display during the multi-screen interaction process. When the source display screen and / or the target display screen adopt a split-screen display mode, the source device can determine whether to skip some windows and how many windows to skip for multi-screen interaction according to the speed / acceleration / leave-hand speed of the user's sliding operation. The following will be specifically described in combination with specific scenarios.
[0311] Specifically, in this scenario, the following three situations may exist:
[0312] Situation 1: Before multi-screen interaction, the source display screen uses a split-screen mode to display two windows, and the target display screen uses a full-screen display mode to display one window
[0313] In this case, when the user triggers multi-screen interaction by performing a sliding operation on the source display screen, in addition to selecting the target display screen, the user also needs to select the source window, so as to instruct the source device to share the content in the source window to the target display screen. Among them, the source window is any one of the windows displayed on the source display screen. The method for the source device to select the target display screen can refer to the method provided in the foregoing first part of the embodiments and will not be repeated here. When the source device selects the source window, it can be selected according to the starting contact point position of the user's sliding operation on the source display screen. When the starting contact point of the user's sliding operation falls inside any one of the windows on the source display screen, the source device can determine that this window is the source window.
[0314] In the embodiments of the present application, before multi-screen interaction is performed, the source device may obtain information on the number of windows and the window positions on the target display screen from the target device. During the multi-screen interaction process, after the source device determines the source window, if it is determined that the source window is a window far from the target display screen, the source device determines whether to cross a window closer to the target display screen according to the magnitude of the speed / acceleration / off-hand speed of the user's sliding operation. If so, the content in the source window is shared to the target display screen for display. Otherwise, the display positions of the source display window and another window on the source display screen may be exchanged. Among them, when the angle between the direction in which the source window points to another window on the source display screen and the direction in which the source window points to the target display screen is less than or equal to a set angle threshold, it may be determined that the source window is a window far from the target display screen. When the angle between the direction in which the source window points to another window on the source display screen and the direction in which the source window points to the target display screen is greater than the set angle threshold, it may be determined that the source window is a window closer to the target display screen.
[0315] As an alternative embodiment, when the source window is a window far from the target display screen, the source device may detect the speed of the user's sliding operation. If the detected speed is greater than or equal to a set speed threshold, it is determined to cross a window for multi-screen interaction. Then, after the source device determines the target display screen according to the user operation, the content in the source window is sent to the target device, and the target device displays the content on the target display screen. If the detected speed is less than the set speed threshold, the source device determines not to cross the window for multi-screen interaction, and the source device may exchange the display of the content in the source window and other windows.
[0316] As another alternative embodiment, when the source window is a window far from the target display screen, the source device may detect the acceleration of the user's sliding operation. If the detected acceleration is greater than or equal to a set acceleration threshold, it is determined to cross a window for multi-screen interaction. Then, after the source device determines the target display screen according to the user operation, the content in the source window is sent to the target device, and the target device displays the content on the target display screen. Otherwise, the source device determines not to cross the window for multi-screen interaction, and the source device may exchange the display of the content in the source window and other windows.
[0317] As yet another alternative embodiment, when the source window is a window far from the target display screen, the source device may detect the off-hand speed of the user's sliding operation. If the detected off-hand speed is less than or equal to a set off-hand speed threshold, it is determined to cross a window for multi-screen interaction. Then, after the source device determines the target display screen according to the user operation, the content in the source window is sent to the target device, and the target device displays the content on the target display screen. Otherwise, the source device determines not to cross the window for multi-screen interaction, and the source device may exchange the display of the content in the source window and other windows.
[0318] In some embodiments of the present application, after the source device performs multi-screen interaction with the target device for the source window in the source display screen, the method for the source device to display content in the source window of the source display screen may refer to the method for the source device to display content in the source display screen in the first part of the embodiments above. The method for the target device to display content in the target display screen may refer to the method for the target device to display content in the target display screen in the first part of the embodiments above, which will not be elaborated here. The content displayed in other windows on the source display screen of the source device except the source window may remain unchanged, the same as before the multi-screen interaction. In some embodiments of the present application, after the source window of the source device performs multi-screen interaction with the target device, the source window may no longer be displayed, and other windows except the source window may be displayed full-screen on the source display screen.
[0319] Embodiment 19: As Figure 15a shown, window 1 and window 2 are displayed on the source display screen, and a window is displayed full-screen on the target display screen, and the target direction is Figure 15a direction 1 shown. When the source device detects that the user performs a three-finger swipe operation along direction 1 in the area where window 1 is located on the source display screen, first, the target display screen can be determined according to the swipe operation performed by the user, and window 1 can be determined as the source window. Then, it is determined whether the speed of the swipe operation detected by the user during this process is greater than or equal to the set speed threshold. If so, the source device can send the source content displayed in the source window to the target device so that the target device can display the source content. Based on this, as Figure 15b shown, the source device can cross window 2 and share the content in window 1 to the target device for display. After the multi-screen interaction, the interfaces displayed on the source display screen and the target display screen can be Figure 15b any one of the interfaces in case 1 to case 3 shown. Among them, when the source device or the target device displays the content from the opposite end, it can be adapted to the size of its own display screen or the display window in the display screen and then displayed. For example, the layout method of the content on the display interface can be appropriately adjusted and then displayed on the display screen or the corresponding window.
[0320] Based on the above method, in the split-screen display scenario, the user can also control the multi-screen interaction process by performing one operation, and can achieve multi-screen interaction for different windows.
[0321] Case 2: Before the multi-screen interaction, the source display screen displays a window in full-screen mode, and the target display screen displays two windows in split-screen mode
[0322] In this case, when the user triggers multi-screen interaction by performing a sliding operation on the source display screen, in addition to selecting the target display screen, the user also needs to select the target window, so as to instruct the source device to share the content in the source display screen to the target window of the target display screen. The target window is any window displayed on the target display screen. The method for the source device to select the target display screen can refer to the method provided in the first part of the embodiments, which will not be repeated here.
[0323] In the embodiments of the present application, before multi-screen interaction, the source device can obtain information about the number and positions of windows on the target display screen from the target device, and then determine the relative position relationship between the source display screen and each window on the target display screen. During the multi-screen interaction process, when the source device selects the target window, it can determine whether to cross a screen for multi-screen interaction based on the speed / acceleration / hand-off speed of the user's sliding operation on the source display screen, and then determine the target display screen according to whether it crosses a screen for multi-screen interaction.
[0324] As an optional implementation manner, when the source device detects that the user performs a set gesture sliding operation on the source display screen, it detects the speed of the user's sliding operation. If the detected speed is less than or equal to the set speed threshold, it is determined that no other window is crossed for multi-screen interaction, and the target window is determined to be the window on the target display screen that is closer to the source display screen. Otherwise, it is determined that one window is crossed for multi-screen interaction, and the target window is determined to be the window on the target display screen that is farther from the source display screen. The distance between the window on the target display screen and the source display screen can be determined according to the position of the window on the display screen and the target direction. The target direction is the direction from the source display screen to the target display screen. The smaller the angle between the direction from one window on the target display screen to another window and the target direction, the smaller the distance between the window and the source display screen, and it can be determined that the window is the window closer to the source display screen; the larger the angle between the direction from one window on the target display screen to another window and the target direction, the larger the distance between the window and the source display screen, and it can be determined that the window is the window farther from the source display screen. The source device can judge the determined angle by setting a corresponding angle threshold. When the angle is less than the set angle threshold, it can be determined that the window is the window closer to the source display screen; otherwise, it is determined that the window is the window farther from the source display screen.
[0325] As another alternative embodiment, when the source device detects that the user performs a set gesture sliding operation on the source display screen, it detects the acceleration of the user's sliding operation. If the detected acceleration is less than or equal to the set acceleration threshold, it determines not to cross other windows for multi-screen interaction and determines the target window as the window on the target display screen that is closer to the source display screen. Otherwise, it determines to cross one window for multi-screen interaction and determines the target window as the window on the target display screen that is farther from the source display screen. The distance between the window on the target display screen and the source display screen can be determined in the manner provided by the above method and will not be repeated here.
[0326] As yet another alternative embodiment, when the source device detects that the user performs a set gesture sliding operation on the source display screen, it detects the off-hand speed of the user's sliding operation. If the detected off-hand speed is less than or equal to the set off-hand speed threshold, it determines not to cross other windows for multi-screen interaction and determines the target window as the window on the target display screen that is closer to the source display screen. Otherwise, it determines to cross one window for multi-screen interaction and determines the target window as the window on the target display screen that is farther from the source display screen. The distance between the window on the target display screen and the source display screen can be determined in the manner provided by the above method and will not be repeated here.
[0327] Embodiment 20: As Figure 16 shown, a window is full-screen displayed in the source display screen, and window 1 and window 2 are displayed in the target display screen. The target direction is Figure 16 the direction 1 described above. When the source device detects that the user performs a three-finger sliding operation along direction 1 on the source display screen, it can first determine the target display screen according to the sliding operation performed by the user, and then determine whether the detected off-hand speed of the user's sliding operation is less than or equal to the set off-hand speed threshold. If so, it takes window 1 as the target window. Otherwise, it takes window 2 as the target window. After determining the target window, the source device can send the source content displayed in the source display screen to the target device so that the target device can display the source content. When the source device determines window 2 as the target window, as Figure 16 shown, the source device can cross window 1 in the target display screen and share the content in the source display screen to window 2 in the target display screen for display. After multi-screen interaction, the interfaces displayed on the source display screen and the target display screen can be Figure 16 the interface of case 1 or case 2 shown above.
[0328] In the above method, after the source device determines the target window on the target display screen, when sharing the content of the source display screen to the target device, it simultaneously indicates the target window to the target device so that the target device can display the content from the source device in the target window.
[0329] Case 3: Before multi-screen interaction, the source display screen and the target display screen display more than three windows in total
[0330] In this case, the situation of the source display screen and the target display screen displaying windows can be: the source display screen uses a split-screen method to display multiple windows, and the target display screen uses a split-screen display method to display multiple windows; or, the source display screen uses a split-screen method to display more than two windows, and the target display screen displays a single window full-screen; or, the source display screen displays a single window full-screen, and the target display screen uses a split-screen method to display more than two windows.
[0331] In this case, when there are multiple windows displayed on the source display screen, the source device needs to select a source window from them according to the user operation. When there are multiple windows displayed on the target display screen, the source device needs to select a target window from them according to the user operation, so as to share the content in the source window to the target window on the target display screen according to the user operation. Among them, the source window can be any window displayed on the source display screen, and the target window can be any window displayed on the target display screen. Among them, the method for the source device to select the target display screen can refer to the method provided in the first part of the embodiments above, and will not be repeated here. When the source device selects the source window, it can refer to the method for selecting the source window described in the above Case 1, and will not be elaborated here.
[0332] In some embodiments of the present application, when performing multi-screen interaction, the target device can notify the source device of the number and distribution information of the windows in the target display screen. The source device can, according to this information, agree with the target device to use any window in the target display screen as the default target window. When the user performs a sliding operation in the area of the source window on the source display screen to trigger multi-screen interaction, the source device sends the content of the source window to the target device, and the target device displays the content from the source device in the default target window.
[0333] Embodiment 21: As Figure 17 shown, window 1 and window 2 are displayed on the source display screen, window 3 and window 4 are displayed on the target display screen, and window 4 is the default target window. Then when the source device detects that the user performs a three-finger sliding operation in the area of window 1 on the source display screen, the source device can first determine the target display screen according to the sliding operation performed by the user and determine that window 1 is the source window. Then the source device sends the source content displayed in window 1 to the target device, and the target device displays it in window 4 after receiving the source content. Based on this, the source device can bypass window 2 in the source display screen and window 3 in the target display screen, and share the content in window 1 to window 4 on the target display screen for display, achieving the effect of interacting across multiple display screens. After multi-screen interaction, the interfaces displayed on the source display screen and the target display screen can be Figure 17 the interfaces in Case 1 or Case 2 shown above.
[0334] In some embodiments of the present application, the source device can also select a target window according to the speed / acceleration / speed when the user's hand leaves the source display screen during a sliding operation on the source display screen.
[0335] As an alternative implementation, when the source device determines that the speed of the user's sliding operation is greater than or equal to a set threshold, it can determine to cross all intermediate windows for multi-screen interaction, that is, interact with the window farthest from the source window in the source display screen, and then the target window can be determined as the window farthest from the source window. When the source device determines that the speed of the user's sliding operation is less than the set threshold, it can determine to exchange the display positions of different windows in the source display screen, or it can determine to cross one window for multi-screen interaction, and then the target window can be determined as the window closest to the source window.
[0336] Embodiment 22: As Figure 18a shown, window 1, window 2, and window 3 are displayed on the source display screen, and window 4 is displayed on the target display screen. When the source window is window 1, as an alternative, when the source device determines that the speed of the user's sliding operation is greater than or equal to the set threshold, it can determine to directly cross the screen to the window on the target display screen, and then determine that the target display screen is display screen 4. After multi-screen interaction, the content displayed on the source display screen and the target display screen is as Figure 18b shown. In addition, when the source device determines that the speed of the user's sliding operation is less than the set threshold, it can determine to exchange the display positions of window 1 and other windows.
[0337] As another alternative implementation, the source device can set a threshold range for the speed / acceleration / speed when the user's hand leaves the source display screen according to the number of windows that can be crossed, where each threshold range corresponds to the number of windows that can be crossed. When receiving the user's sliding operation, the source device can determine the number of windows crossed during multi-screen interaction according to the threshold range to which the different values of the speed / acceleration / speed when the user's hand leaves the source display screen belong, and then determine the target window. Among them, the value of the speed / acceleration / speed when the user's hand leaves the source display screen has a positive correlation with the number of windows crossed during multi-screen interaction. The greater the value of the speed / acceleration / speed when the user's hand leaves the source display screen, the more windows are crossed.
[0338] In some embodiments of the present application, when the source device performs a cross-screen operation across multiple windows, the multiple windows crossed can belong to the same display screen or different display screens.
[0339] In some embodiments of the present application, in a split-screen display scenario, the user can also operate on the target display screen according to the method provided in the above embodiments to control and achieve the effect of sharing the source content in the source window of the source display screen to the target window of the target display screen for display. Among them, when the target device determines the source display screen according to the operation of the user on the target display screen, it can refer to the method provided in the first part of the above embodiments. When the target device determines the source window in the source display screen and the target window in the target display screen according to the operation of the user on the target display screen, it can use the window corresponding to the area where the contact point of the user's sliding operation is located on the display screen as the target window, and select the source window according to the speed / acceleration of the user's sliding operation on the target display screen. For specific reference, please refer to the method in the above embodiments, which will not be elaborated here.
[0340] Embodiment 23: Based on this method, as Figure 19a shown, window 1 and window 2 are displayed on the target display screen, and a window is displayed full screen on the source display screen. When the target device detects that the user performs a three-finger sliding operation on the target display screen, it determines the source display screen selected by the user and the target window selected by the user according to this operation. When the target window is window 1, the target device can obtain the content displayed on the source display screen from the source device and display it in window 1, achieving the effect of pulling and displaying the content of the source display screen across one window (window 2). After multi-screen interaction, the interfaces displayed on the target display screen and the source display screen can be Figure 19a any one of the interfaces in case 1 to case 2 shown in Figure 19b or any one of the interfaces in case 3 to case 5 shown in
[0341] Scenario 2: Multi-window display scenario
[0342] In this scenario, there are multiple windows in the source display screen of the source device. When the starting contact point of the user's sliding operation on the source display screen straddles multiple windows, the source device can directly share all the content displayed on the source display screen to the target display screen. When the starting contact point of the user's sliding operation on the source display screen is within one window, the source device can only share the content displayed in this window to the target display screen. Among them, the display areas of the multiple windows on the source display screen can be different from each other. For example, it can be the split-screen display method in Scenario 1 above. There may also be overlapping areas in the display areas of the multiple windows on the display screen, that is, the multiple windows are stacked and displayed. Among them, any window may cover other windows or be covered by other windows.
[0343] Embodiment 24: As Figure 20aAs shown in [figure], window 1 and window 2 are displayed in a split-screen manner on the source display screen, and a window is displayed full-screen on the target display screen. When the source device detects that the user performs a three-finger swipe operation on the source display screen and the starting contact points of the operation span multiple windows, the source device shares all the content on the source display screen to the target display screen. After multi-screen interaction, the interfaces displayed on the source display screen and the target display screen can be Figure 20b any one of the interfaces in Case 1 to Case 3 in [figure].
[0344] Embodiment 25: As Figure 21a shown in [figure], window 1 and window 2 are displayed in a stacked manner on the source display screen, and a window is displayed full-screen on the target display screen. When the source device detects that the user performs a three-finger swipe operation on the source display screen and the starting contact points of the operation span multiple windows, the source device shares all the content on the source display screen to the target display screen. After multi-screen interaction, the interfaces displayed on the source display screen and the target display screen can be Figure 21b any one of the interfaces in Case 1 to Case 3 in [figure].
[0345] Based on the above method, when the starting contact point window of the user's swipe operation is detected, it can be considered that the user has no need for multi-screen interaction for the content of a single window. Then the source device shares the content of the entire source display screen to the target display screen for display, which can blur the concept of windows in this scenario and better conform to the user's intention to control multi-screen interaction.
[0346] It should be noted that each example provided in the above embodiments is only an illustrative example of the effects that the solutions provided in the embodiments of the present application can achieve, and does not cover all the effects that the solutions of the present application can achieve, nor does it limit the effects achieved by the solutions of the present application. The content provided in the above examples can also be recombined or combined for use to achieve more diverse multi-screen interaction results.
[0347] Based on the above embodiments and the same concept, the embodiments of the present application also provide a multi-screen interaction method, as Figure 22 shown in [figure], the method includes:
[0348] S2201: The first electronic device displays the first content on the first display screen.
[0349] S2202: The first electronic device receives a first operation, and the first operation is a swipe operation applied to the first display screen.
[0350] S2203: In response to the received first operation, the first electronic device sends the first content to the second electronic device that displays the second content on the second display screen, so that the second electronic device displays the first content on the second display screen.
[0351] In a possible example, the first electronic device may be the source device described in the first part of the above embodiments, the second electronic device may be the target device described in the first part of the above embodiments, the first display screen may be the source display screen described in the first part of the above embodiments, the second display screen may be the target display screen described in the first part of the above embodiments, and the first operation may be the three-finger swipe operation described in the above embodiments. Then, for the method of multi-screen interaction between the first display screen and the second display screen by the first electronic device and the second electronic device, reference may be made to the method described in the first part of the above embodiments, which will not be elaborated here.
[0352] For example, before and after the multi-screen interaction between the first electronic device and the second electronic device, the display content of the first display screen and the second display screen may be presented in the manner shown in Figure 7a 、 Figure 7b shown therein.
[0353] In another possible example, the first electronic device may be the source device described in Scenario 1 of the second part of the above embodiments, the second electronic device may be the target device described in Scenario 1 of the second part of the above embodiments, the first display screen may be the source display screen described in Scenario 1 of the second part of the above embodiments, the second display screen may be the target display screen described in Scenario 1 of the second part of the above embodiments, and the first operation may be the three-finger swipe operation described in the above embodiments. Then, for the method of multi-screen interaction between the first display screen and the second display screen by the first electronic device and the second electronic device, reference may be made to the method described in Scenario 1 of the second part of the above embodiments, which will not be elaborated here.
[0354] In yet another possible example, the first electronic device may be the source device described in Scenario 2 of the second part of the above embodiments, the second electronic device may be the target device described in Scenario 2 of the second part of the above embodiments, the first display screen may be the source display screen described in Scenario 2 of the second part of the above embodiments, the second display screen may be the target display screen described in Scenario 2 of the second part of the above embodiments, and the first operation may be the three-finger swipe operation described in the above embodiments. Then, for the method of multi-screen interaction between the first display screen and the second display screen by the first electronic device and the second electronic device, reference may be made to the method described in Scenario 2 of the second part of the above embodiments, which will not be elaborated here.
[0355] Exemplarily, the first operation may be an operation performed in the operation manner shown in Figure 11 or Figure 13 shown therein.
[0356] Based on the above embodiments and the same concept, an embodiment of the present application further provides a multi-screen interaction method, as shown in Figure 23 shown therein, the method includes:
[0357] S2301: The first electronic device displays a first window and a second window on the first display screen; wherein, the first window contains first content, and the second window contains second content.
[0358] S2302: The first electronic device receives a first operation, and the first operation is a sliding operation applied to the first display screen.
[0359] S2303: In response to the received first operation, the first electronic device sends target content to a second electronic device that displays third content on a second display screen, so that the second electronic device displays the target content on the second display screen; wherein, the target content is the first content and / or the second content.
[0360] Exemplarily, the first electronic device may be the source device described in Case 1 of Scenario 1 in the third part of the above embodiments, the second electronic device may be the target device described in Case 1 of Scenario 1 in the third part of the above embodiments, the first display screen may be the source display screen described in Case 1 of Scenario 1 in the third part of the above embodiments, the second display screen may be the target display screen described in Case 1 of Scenario 1 in the third part of the above embodiments, and the first operation may be the three-finger sliding operation described in the above embodiments. Then, for the method of multi-screen interaction between the first electronic device and the second electronic device on the first display screen and the second display screen, reference may be made to the method described in Case 1 of Scenario 1 in the third part of the above embodiments, which will not be elaborated here.
[0361] For example, before and after the multi-screen interaction between the first electronic device and the second electronic device, the display modes of the first display screen and the second display screen may adopt the Figure 15a 、 Figure 15b modes shown.
[0362] Based on the above embodiments and the same concept, an embodiment of the present application further provides a multi-screen interaction method, as shown in Figure 24 , and this method includes:
[0363] S2401: The first electronic device displays a first window, a second window, and a third window on the first display screen; wherein, the first window contains first content, the second window contains second content, and the third window contains third content.
[0364] S2402: The first electronic device receives a first operation, and the first operation is a sliding operation applied to the first display screen.
[0365] S2403: In response to the received first operation, the first electronic device sends target content to a second electronic device that is displaying fourth content on a second display screen, so that the second electronic device displays the target content on the second display screen; wherein, the target content is: the first content, or the second content, or the third content, or the first content, the second content, and the third content.
[0366] Exemplarily, the first electronic device may be the source device described in case 3 of scenario 1 in the above-mentioned third part of the embodiments, the second electronic device may be the target device described in case 3 of scenario 1 in the above-mentioned third part of the embodiments, the first display screen may be the source display screen described in case 3 of scenario 1 in the above-mentioned third part of the embodiments, the second display screen may be the target display screen described in case 3 of scenario 1 in the above-mentioned third part of the embodiments, and the first operation may be the three-finger swipe operation described in the above embodiments. Then, for the method of multi-screen interaction between the first electronic device and the second electronic device between the first display screen and the second display screen, reference may be made to the relevant method described in case 3 of scenario 1 in the above-mentioned third part of the embodiments, which will not be elaborated here.
[0367] For example, before and after the first electronic device and the second electronic device perform multi-screen interaction, the ways of displaying content on the first display screen and the second display screen may adopt Figure 18a , Figure 18b the ways shown in.
[0368] Based on the above embodiments and the same concept, an embodiment of the present application also provides a multi-screen interaction method, as shown in Figure 25 , and this method includes:
[0369] S2501: The first electronic device displays first content on a first display screen.
[0370] S2502: The first electronic device receives a first operation, and the first operation is a swipe operation applied to the first display screen.
[0371] S2503: In response to the received first operation, the first electronic device sends the first content to a second electronic device that is displaying a first window containing second content and a second window containing third content on a second display screen, so that the second electronic device displays the first content on the second display screen.
[0372] Exemplarily, the first electronic device may be the source device described in Case 2 of Scenario 1 in the above-mentioned third part of the embodiments, the second electronic device may be the target device described in Case 2 of Scenario 1 in the above-mentioned third part of the embodiments, the first display screen may be the source display screen described in Case 2 of Scenario 1 in the above-mentioned third part of the embodiments, the second display screen may be the target display screen described in Case 2 of Scenario 1 in the above-mentioned third part of the embodiments, and the first operation may be the three-finger swipe operation described in the above-mentioned embodiments. Then, for the method of multi-screen interaction between the first electronic device and the second electronic device on the first display screen and the second display screen, reference may be made to the method described in Case 2 of Scenario 1 in the above-mentioned third part of the embodiments, which will not be elaborated here.
[0373] For example, before and after the multi-screen interaction between the first electronic device and the second electronic device, the display content of the first display screen and the second display screen may adopt the Figure 16 way shown.
[0374] Based on the above embodiments and the same concept, the embodiments of the present application further provide a multi-screen interaction method, as shown in Figure 26 below, the method includes:
[0375] S2601: The first electronic device displays the first content on the first display screen.
[0376] S2602: The first electronic device receives a first operation, and the first operation is a swipe operation applied to the first display screen.
[0377] S2603: In response to the received first operation, the first electronic device sends the first content to the second electronic device that displays a first window containing the second content, a second window containing the third content, and a third window containing the fourth content on the second display screen, so that the second electronic device displays the first content on the second display screen.
[0378] Exemplarily, the first electronic device may be the source device described in Case 3 of Scenario 1 in the above-mentioned third part of the embodiments, the second electronic device may be the target device described in Case 3 of Scenario 1 in the above-mentioned third part of the embodiments, the first display screen may be the source display screen described in Case 3 of Scenario 1 in the above-mentioned third part of the embodiments, the second display screen may be the target display screen described in Case 3 of Scenario 1 in the above-mentioned third part of the embodiments, and the first operation may be the three-finger swipe operation described in the above-mentioned embodiments. Then, for the method of multi-screen interaction between the first electronic device and the second electronic device on the first display screen and the second display screen, reference may be made to the relevant method described in Case 3 of Scenario 1 in the above-mentioned third part of the embodiments, which will not be elaborated here.
[0379] Based on the above embodiments and the same concept, the embodiments of the present application further provide a multi-screen interaction method, as shown inFigure 27 As shown in, the method includes:
[0380] S2701: The first electronic device displays a first window and a second window on a first display screen; wherein, the first window contains first content, and the second window contains second content.
[0381] S2702: The first electronic device receives a first operation, and the first operation is a sliding operation applied to the first display screen.
[0382] S2703: In response to the received first operation, the first electronic device sends target content to a second electronic device that displays a third window containing third content and a fourth window containing fourth content on a second display screen, so that the second electronic device displays the target content on the second display screen; wherein, the target content is the first content and / or the second content.
[0383] Exemplarily, the first electronic device may be the source device described in Case 3 of Scenario 1 in the third part of the above embodiments, the second electronic device may be the target device described in Case 3 of Scenario 1 in the third part of the above embodiments, the first display screen may be the source display screen described in Case 3 of Scenario 1 in the third part of the above embodiments, the second display screen may be the target display screen described in Case 3 of Scenario 1 in the third part of the above embodiments, and the first operation may be the three-finger sliding operation described in the above embodiments. Then, for the method of multi-screen interaction between the first electronic device and the second electronic device between the first display screen and the second display screen, reference may be made to the relevant method described in Case 3 of Scenario 1 in the third part of the above embodiments, which will not be elaborated here.
[0384] Exemplarily, before and after the first electronic device and the second electronic device perform multi-screen interaction, the manner of displaying content on the first display screen and the second display screen may adopt Figure 17 the manner shown in.
[0385] Based on the above embodiments and the same concept, an embodiment of the present application further provides an electronic device, which is used to implement the method implemented by the first electronic device or the second electronic device in the multi-screen interaction method provided by the embodiment of the present application. As Figure 28 shown in, the electronic device 2800 may include: a display screen 2801, a memory 2802, one or more processors 2803, and one or more computer programs (not shown in the figure). The above components may be coupled through one or more communication buses 2804.
[0386] Among them, the display screen 2801 is used to display relevant user interfaces such as application interfaces.
[0387] One or more computer programs (codes) are stored in the memory 2802, and the one or more computer programs include computer instructions; the one or more processors 2803 call the computer instructions stored in the memory 2802, so that the electronic device 2800 executes the multi-screen interaction method provided by the embodiments of the present application.
[0388] In a specific implementation, the memory 2802 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more disk storage devices, flash memory devices or other non-volatile solid-state storage devices. The memory 2802 may store an operating system (hereinafter referred to as the system), such as ANDROID, IOS, WINDOWS, or an embedded operating system such as LINUX. The memory 2802 may be used to store the implementation program of the embodiments of the present application. The memory 2802 may also store a network communication program, which may be used to communicate with one or more additional devices, one or more user devices, and one or more network devices.
[0389] The one or more processors 2803 may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the present application solution.
[0390] It should be noted that Figure 28 This is only one implementation manner of the electronic device 2800 provided by the embodiments of the present application. In practical applications, the electronic device 2800 may further include more or fewer components, which are not limited herein.
[0391] Based on the above embodiments and the same concept, the embodiments of the present application further provide a multi-screen interaction system, which includes a first electronic device and a second electronic device. The method executed by the first electronic device in the system may refer to the method executed by the source device described in the above embodiments, and the method executed by the second electronic device in the system may refer to the method executed by the target device described in the above embodiments, which will not be elaborated herein.
[0392] Based on the above embodiments and the same concept, the embodiments of the present application further provide a computer-readable storage medium, which stores a computer program. When the computer program runs on a computer, the computer is enabled to execute the method provided by the above embodiments.
[0393] Based on the above embodiments and the same inventive concept, an embodiment of the present application further provides a computer program product, which includes a computer program or instructions. When the computer program or instructions run on a computer, the computer is caused to execute the method provided in the above embodiments.
[0394] In the method provided by the embodiment of the present application, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions according to the embodiments of the present invention are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user device, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from a website, a computer, a server, or a data center to another website, a computer, a server, or a data center by wire (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wirelessly (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or a data center that includes one or more integrated available media. The available medium can be a magnetic medium (such as a floppy disk, a hard disk, a magnetic tape), an optical medium (such as a digital video disc (DVD)), or a semiconductor medium (such as an SSD), etc.
[0395] Obviously, those skilled in the art can make various modifications and variations to the present application without departing from the scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application also intends to include these modifications and variations.
Claims
1. A multi-screen interaction method, characterized in that, Applied to a first electronic device, the method includes: Displaying first content on a first display screen; Receiving a first operation, where the first operation is a sliding operation applied to the first display screen; In response to the first operation, sending the first content to a second electronic device that displays second content on a second display screen, so that the second electronic device displays the first content on the second display screen.
2. The method according to claim 1, characterized in that, The included angle between the sliding direction of the first operation and a first candidate direction is less than a set first angle threshold; wherein, the first candidate direction is used to represent the direction pointing from the position of the first display screen to the position of the second display screen.
3. The method according to claim 1, characterized in that, The first operation includes a second operation and a third operation, where the second operation and the third operation are sliding operations applied to the first display screen, and the termination contact point of the second operation on the first display screen is the starting contact point of the third operation on the first display screen. Receiving the first operation includes: Receiving the second operation; In response to the received second operation, displaying identification information of at least one candidate display screen on the first display screen; wherein, the at least one candidate display screen includes the second display screen; Receiving the third operation, where the third operation is used to select the identification information of the second display screen.
4. The method according to claim 3, characterized in that, The included angle between the candidate direction corresponding to the at least one candidate display screen and the sliding direction of the second operation is less than a set second angle threshold; or The included angle between the sliding direction of the second operation and a set first reference direction is less than a set second angle threshold; the included angle between the candidate direction corresponding to the at least one candidate display screen and the first reference direction is less than the second angle threshold; Wherein, the candidate direction corresponding to any one candidate display screen is used to represent the direction pointing from the position of the first display screen to the position of the candidate display screen.
5. The method according to claim 3 or 4, characterized in that, The first electronic device displaying the identification information of at least one candidate display screen on the first display screen includes: Obtaining sorting reference information corresponding to the at least one candidate display screen, where the sorting reference information is used to indicate: the position of the display screen, or the distance between the display screen and the first display screen, or the intimacy between the electronic device to which the display screen belongs and the first electronic device; Sorting the at least one candidate display screen according to the sorting reference information corresponding to the at least one candidate display screen; Displaying the identification information of the at least one candidate display screen on the first display screen according to the sorting of the at least one candidate display screen.
6. The method according to any one of claims 3 to 5, characterized in that, The at least one candidate display screen is in a lit state.
7. The method according to claim 2, characterized in that, The first display screen and the second display screen are in a non-relatively static state, and the first candidate direction is a set direction.
8. The method according to any one of claims 4 to 6, characterized in that, The first display screen and the second display screen are in a non-relatively static state, and the candidate direction corresponding to the second display screen is a set direction.
9. The method according to claim 1, characterized in that, The first display screen is a display screen configured in a vehicle cockpit, and the second display screen is a display screen of a mobile device.
10. The method according to any one of claims 1 to 6, characterized in that, The first display screen and the second display screen are in a relatively static state.
11. The method according to any one of claims 1 to 6, characterized in that, The first display screen and the second display screen are display screens configured in the same vehicle cockpit.
12. The method according to any one of claims 1 to 11, characterized in that, The second electronic device displays the first content on the second display screen, including: The second electronic device replaces the second content displayed on the second display screen with the first content; or The second electronic device displays a first window including the first content and a second window including the second content on the second display screen; wherein, the first window and the second window are located in different areas of the second display screen, or, the first window covers the second window.
13. The method according to any one of claims 1 to 12, characterized in that, The method further includes: Obtaining the second content from the second electronic device; Displaying the second content on the first display screen.
14. The method according to any one of claims 1 to 12, characterized in that, The method further includes: Displaying third content on the first display screen; wherein, the third content is preset content or the content displayed by the first electronic device before displaying the first content; or Switching the first display screen to a screen-off state.
15. The method according to claim 1, characterized in that, The first operation includes a second operation and a third operation, and the second operation and the third operation are sliding operations on the first display screen, wherein, the termination contact point of the second operation on the first display screen is the starting contact point of the third operation on the first display screen; The first electronic device receives a first operation, including: The first electronic device receives the second operation; In response to receiving the second operation, the first electronic device displays identification information of at least one candidate display screen on the first display screen; wherein, the at least one candidate display screen includes the second display screen; The first electronic device receives the third operation, and the third operation is used to select the identification information of the second display screen.
16. The method according to claim 1, characterized in that, The first operation includes a fourth operation, a fifth operation and a sixth operation, and the fourth operation, the fifth operation and the sixth operation are sliding operations on the first display screen, wherein, the termination contact point of the fourth operation on the first display screen is the starting contact point of the fifth operation on the first display screen, and the termination contact point of the fifth operation on the first display screen is the starting contact point of the sixth operation on the first display screen; The first electronic device receives a first operation, including: The first electronic device receives the fourth operation; In response to receiving the fourth operation, the first electronic device displays first identification information on the first display screen; wherein, the first identification information is used to identify a first position area, and there is at least one candidate display screen in the first position area, and the at least one candidate display screen includes the second display screen; In response to receiving the fifth operation, the first electronic device displays the identification information of the at least one candidate display screen on the first display screen; wherein, the fifth operation is used to select the first position area; The first electronic device receives the sixth operation, and the sixth operation is used to select the identification information of the second display screen.
17. The method according to claim 1, characterized in that, The first display screen is a display screen of a mobile device, and the second display screen is a display screen configured in a vehicle cockpit.
18. A multi-screen interaction method, characterized in that, The method includes: The first electronic device displays a first window and a second window on a first display screen; wherein, the first window contains first content, and the second window contains second content; The first electronic device receives a first operation, and the first operation is a sliding operation applied to the first display screen; In response to the received first operation, the first electronic device sends target content to a second electronic device that displays third content on a second display screen, so that the second electronic device displays the target content on the second display screen; wherein, the target content is the first content and / or the second content.
19. The method according to claim 18, characterized in that, In response to the received first operation, the first electronic device sending target content to a second electronic device that displays third content on a second display screen includes: When the starting contact point of the first operation on the first display screen is only located within the first window, sending the first content to the second electronic device; or When the starting contact point of the first operation on the first display screen is only located within the second window, sending the second content to the second electronic device; or When the starting contact point of the first operation on the first display screen is located within both the first window and the second window, sending the first content and the second content to the second electronic device.
20. The method according to claim 18 or 19, characterized in that, In response to the received first operation, the first electronic device sending target content to a second electronic device that displays third content on a second display screen includes: When it is determined that the distance between the first window and the second display screen is greater than the distance between the second window and the second display screen, and the first operation meets a first set condition, sending the first content to the second display screen; wherein, the first set condition includes: The angle between the sliding direction and a first candidate direction is less than a set first angle threshold; wherein, the first candidate direction is used to represent the direction from the position of the first display screen to the position of the second display screen; and / or The sliding speed is greater than or equal to a set first threshold, or the sliding acceleration is greater than or equal to a set second threshold, or the leaving-hand speed is greater than or equal to a set third threshold.
21. The method according to claim 20, characterized in that, The first electronic device determining that the distance between the first window and the second display screen is greater than the distance between the second window and the second display screen includes: The first electronic device determines a first target direction corresponding to the first window; wherein, the first target direction is used to represent the direction from the first window to the second window; When the angle between the first target direction and the first candidate direction is less than a set second angle threshold, it is determined that the distance between the first window and the second display screen is greater than the distance between the second window and the second display screen.
22. The method according to claim 20, wherein The first electronic device determining that the distance between the first window and the second display screen is greater than the distance between the second window and the second display screen includes: The first electronic device determines a first target direction corresponding to the first window and a second target direction corresponding to the second window; wherein, the first target direction is used to represent the direction from the first window to the second window, and the second target direction is used to represent the direction from the second window to the first window; When the included angle between the first target direction and the first candidate direction is less than the included angle between the second target direction and the first candidate direction, it is determined that the distance between the first window and the second display screen is greater than the distance between the second window and the second display screen.
23. The method according to any one of claims 18 to 22, wherein The second electronic device displays the target content on the second display screen, including: The second electronic device replaces the third content displayed on the second display screen with the target content; or The second electronic device displays a first window containing the target content and a second window containing the third content on the second display screen; wherein, the first window and the second window are in different areas of the second display screen, or the first window covers the second window.
24. The method according to any one of claims 18 to 23, wherein The method further includes: When the target content is the first content, the first electronic device obtains the third content from the second electronic device; The first electronic device displays the third content in the first window.
25. The method according to any one of claims 18 to 23, wherein The method further includes: When the target content is the first content, the first electronic device displays a fourth content in the first window, where the fourth content is a set content or the content that the first electronic device displayed in the first window before displaying the first content; or The first electronic device only displays the second content on the first display screen.
26. The method according to any one of claims 18 to 25, wherein The first display screen and the second display screen are in a relatively static state.
27. The method according to any one of claims 18 to 26, wherein The first display screen and the second display screen are display screens configured in the same vehicle cockpit.
28. A multi-screen interaction method, wherein The method includes: A first electronic device displays a first window, a second window, and a third window on a first display screen; wherein, the first window contains a first content, the second window contains a second content, and the third window contains a third content; The first electronic device receives a first operation, and the first operation is a sliding operation applied to the first display screen; In response to the received first operation, the first electronic device sends a target content to a second electronic device that displays a fourth content on a second display screen, so that the second electronic device displays the target content on the second display screen; wherein, the target content is: the first content, or the second content, or the third content, or the first content, the second content, and the third content.
29. The method according to claim 28, wherein In response to the received first operation, the first electronic device sends the target content to a second electronic device that displays a fourth content on a second display screen, including: When the starting contact point of the first operation on the first display screen is only located within the first window, send the first content to the second electronic device; or When the starting contact of the first operation on the first display screen is only located within the second window, send the second content to the second electronic device; or When the starting contact of the first operation on the first display screen is only located within the third window, send the third content to the second electronic device; or When the starting contact of the first operation on the first display screen is located within the first window and the second window, send the first content, the second content, and the third content to the second electronic device.
30. The method according to claim 28 or 29, wherein The first electronic device sends target content to a second electronic device that displays a fourth content on a second display screen in response to the received first operation, including: When it is determined that the distance between the first window and the second display screen is greater than the distance between the second window and the second display screen, and the distance between the first window and the second display screen is greater than the distance between the third window and the second display screen, and the first operation meets the first set condition, send the first content to the second electronic device; wherein, the first set condition includes: The included angle between the sliding direction and the first candidate direction is less than a set first angle threshold; wherein, the first candidate direction is used to represent the direction from the position of the first display screen to the position of the second display screen; and / or The sliding speed is greater than or equal to a set first threshold, or the sliding acceleration is greater than or equal to a set second threshold, or the off-hand speed is greater than or equal to a set third threshold.
31. The method according to any one of claims 28 to 30, wherein The method further includes: When the target content is the first content, the first electronic device displays a fifth content in the first window, where the fifth content is a set content or the content that the first electronic device displayed in the first window before displaying the first content; or The first electronic device displays the second window and the third window in split screen on the first display screen.
32. A multi-screen interaction method, characterized in that, The method includes: A first electronic device displays a first content on a first display screen; The first electronic device receives a first operation, and the first operation is a sliding operation applied to the first display screen; The first electronic device sends the first content to a second electronic device that displays a first window containing a second content and a second window containing a third content on a second display screen in response to the received first operation, so that the second electronic device displays the first content on the second display screen.
33. The method according to claim 32, characterized in that, The method further includes: The first electronic device instructs the second electronic device to display the first content in a target window; wherein, the target window is the first window or the second window.
34. The method according to claim 33, characterized in that, The first electronic device instructing the second electronic device to display the first content in a target window includes: When the distance between the first window and the first display screen is greater than the distance between the second window and the first display screen, and the first operation meets the first set condition and / or the second set condition, instruct the second electronic device to display the first content in the first window; or When the distance between the first window and the first display screen is greater than the distance between the second window and the first display screen, and the first operation does not meet the second set condition, instruct the second electronic device to display the first content in the second window; Among them, the first set condition includes: the included angle between the sliding direction of the first operation and the first candidate direction is less than the set first angle threshold, and the first candidate direction is used to represent the direction from the position of the first display screen to the position of the second display screen; The second set condition includes: the sliding speed is greater than or equal to the set first threshold, or the sliding acceleration is greater than or equal to the set second threshold, or the leaving-hand speed is greater than or equal to the set third threshold.
35. The method according to claim 34, characterized in that, The first electronic device determines that the distance between the first window and the first display screen is greater than the distance between the second window and the first display screen, including: The first electronic device determines the first target direction corresponding to the first window; among them, the first target direction is used to represent the direction from the first window to the second window; When the included angle between the first target direction and the first candidate direction is greater than the set first angle threshold, it is determined that the distance between the first window and the first display screen is greater than the distance between the second window and the first display screen.
36. The method according to claim 34, characterized in that, The first electronic device determines that the distance between the first window and the first display screen is greater than the distance between the second window and the first display screen, including: The first electronic device determines the first target direction corresponding to the first window; among them, the first target direction is used to represent the direction from the first window to the second window; The first electronic device determines the second target direction corresponding to the second window according to the first target direction; among them, the second target direction is used to represent the direction from the second window to the first window; When the included angle between the first target direction and the first candidate direction is greater than the included angle between the second target direction and the first candidate direction, the first electronic device determines that the distance between the first window and the first display screen is greater than the distance between the second window and the first display screen.
37. The method according to claim 35 or 36, characterized in that, The first electronic device determines the first target direction corresponding to the first window, including: The first electronic device receives the first indication information sent by the second electronic device, and the first indication information is used to indicate the first target direction.
38. The method according to claim 32, characterized in that, The second electronic device displays the first content on the second display screen, including: The second electronic device replaces the second content displayed in the first window with the first content; or The second electronic device replaces the third content displayed in the second window with the first content; or The second electronic device displays a first window containing the second content, a second window containing the third content, and a third window containing the first content on the second display screen; wherein, the first window, the second window, and the third window are located in different areas of the second display screen, or, the third window covers the first window and / or the second window.
39. A multi-screen interaction method, characterized in that, The method includes: A first electronic device displays first content on a first display screen; The first electronic device receives a first operation, and the first operation is a sliding operation applied to the first display screen; In response to the received first operation, the first electronic device sends the first content to a second electronic device that displays a first window containing second content, a second window containing third content, and a third window containing fourth content on a second display screen, so that the second electronic device displays the first content on the second display screen.
40. The method according to claim 39, characterized in that, The method further includes: The first electronic device instructs the second electronic device to display the first content in a target window; wherein, the target window is the first window or the second window or the third window.
41. The method according to claim 40, wherein, The first electronic device instructing the second electronic device to display the first content in a target window includes: When the distance between the first window and the first display screen is greater than the distance between the second window and the first display screen, and the distance between the first window and the first display screen is greater than the distance between the third window and the first display screen, and the first operation satisfies a first set condition and / or a second set condition, the first electronic device instructs the second electronic device to display the first content in the first window; or When the distance between the first window and the first display screen is greater than the distance between the second window and the first display screen, and the distance between the second window and the first display screen is greater than the distance between the third window and the first display screen, and the first operation satisfies a first set condition and / or a third set condition, the first electronic device instructs the second electronic device to display the first content in the second window; or When the distance between the first window and the first display screen is greater than the distance between the second window and the first display screen, and the distance between the second window and the first display screen is greater than the distance between the third window and the first display screen, and the first operation satisfies a first set condition and / or a fourth set condition, the first electronic device instructs the second electronic device to display the first content in the third window; Wherein, the first set condition includes: the included angle between the sliding direction of the first operation and a first candidate direction is less than a set first angle threshold, and the first candidate direction is used to represent the direction from the position of the first display screen to the position of the second display screen; The second set condition includes: the sliding speed is greater than or equal to a set first threshold, or the sliding acceleration is greater than or equal to a set second threshold, or the leaving - hand speed is greater than or equal to a set third threshold; The third set condition includes: the sliding speed is less than a set first threshold and greater than or equal to a set fourth threshold, or the sliding acceleration is less than a set second threshold and greater than or equal to a set fifth threshold, or the leaving - hand speed is less than a set third threshold and greater than or equal to a set sixth threshold; The fourth set condition includes: the sliding speed is less than the set fourth threshold, or the sliding acceleration is less than the set fifth threshold, or the leaving - hand speed is less than the set sixth threshold.
42. A multi-screen interaction method, wherein, The method includes: The first electronic device displays a first window and a second window on a first display screen; wherein, the first window contains first content and the second window contains second content; The first electronic device receives a first operation, and the first operation is a sliding operation applied to the first display screen; In response to the received first operation, the first electronic device sends target content to a second electronic device that displays a third window containing third content and a fourth window containing fourth content on a second display screen, so that the second electronic device displays the target content on the second display screen; wherein, the target content is the first content and / or the second content.
43. The method according to claim 42, wherein, In response to the received first operation, the first electronic device sending the target content to the second electronic device that displays a third window containing third content and a fourth window containing fourth content on a second display screen includes: When the starting contact point of the first operation on the first display screen is only located within the first window, sending the first content to the second electronic device; or When the starting contact point of the first operation on the first display screen is only located within the second window, sending the second content to the second electronic device; or When the starting contact point of the first operation on the first display screen is located within both the first window and the second window, sending the first content and the second content to the second electronic device.
44. The method according to claim 42 or 43, wherein, The method further includes: The first electronic device instructs the second electronic device to display the target content in a target window; wherein, the target window is the third window or the fourth window.
45. The method according to claim 42 or 43, wherein, The first electronic device instructing the second electronic device to display the target content in a target window includes: When the distance between the third window and the first display screen is greater than the distance between the fourth window and the first display screen, and the first operation meets the first set condition and / or the second set condition, instructing the second electronic device to display the target content in the third window; or When the distance between the third window and the first display screen is greater than the distance between the fourth window and the first display screen, and the first operation meets the first set condition and / or the third set condition, instructing the second electronic device to display the target content in the fourth window; Wherein, the first set condition includes: the included angle between the sliding direction of the first operation and a first candidate direction is less than a set first angle threshold; wherein, the first candidate direction is used to represent the direction from the position of the first display screen to the position of the second display screen; The second set condition is: the sliding speed is greater than or equal to a set first threshold, or the sliding acceleration is greater than or equal to a set second threshold, or the leaving - hand speed is greater than or equal to a set third threshold; The third set condition is: the sliding speed is less than the set first threshold and greater than or equal to a set fourth threshold, or the sliding acceleration is less than the set second threshold and greater than or equal to a set fifth threshold, or the leaving - hand speed is less than the set third threshold and greater than or equal to a set sixth threshold.
46. An electronic device, wherein, The electronic device includes a display screen, a memory, and one or more processors; Wherein, the memory is used to store computer program code, and the computer program code includes computer instructions; when the computer instructions are executed by the one or more processors, the electronic device is caused to execute the method according to any one of claims 1 to 17, or execute the method according to any one of claims 18 to 27, or execute the method according to any one of claims 28 to 31, or execute the method according to any one of claims 32 to 38, or execute the method according to any one of claims 39 to 41, or execute the method according to any one of claims 42 to 45, or execute the method according to any one of claims 47 to 50.
47. A computer-readable storage medium, wherein, The computer - readable storage medium stores a computer program, and when the computer program runs on the electronic device, the electronic device is caused to execute The method according to any one of claims 1 to 17, or implementing the method according to any one of claims 18 to 27, or implementing the method according to any one of claims 28 to 31, or implementing the method according to any one of claims 32 to 38, or implementing the method according to any one of claims 39 to 41, or implementing the method according to any one of claims 42 to 45, or implementing the method according to any one of claims 47 to 50.
Citation Information
Patent Citations
In-vehicle touch screen flying interaction method
CN109992193A
Application sharing method, first electronic device and computer readable storage medium
CN110990172A
Device, Method, and Graphical User Interface for Manipulating Windows in Split Screen Mode
US20170357437A1
Unified desktop triad control user interface for an application launcher
US20220004350A1
Object dragging method and device
WO2021212922A1