Control method and electronic equipment

Abstract

The invention provides a control method and electronic equipment, and the method can provide efficient intelligent interface display which meets the requirements and habits of a user for the user in a multi-task scene. According to the method and the device, when the electronic equipment such as the vehicle-mounted terminal receives the operation of the user for interface circulation, the specific intention of the operation is analyzed to determine whether the operation is cross-screen circulation or same-screen circulation, so that a better intelligent interface display service is provided for the user. For example, when it is determined that the intention is cross-screen circulation, the interface circulated from the original screen can be displayed on the target screen in a proper display type after circulation according to the actual display condition before circulation of the first interface and / or the interface display condition on the second screen. According to the method, the current focused task of the target screen is not interrupted, the task interface transferred from the original screen is displayed with a striking display effect, and more humanized interface transfer experience is provided for a user.

Description

Control method and electronic equipment

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to the Chinese patent application filed with the China Patent Office on July 29, 2022, with application number 202210911043.X and application name “A vehicle-mounted interface flow method and vehicle-mounted terminal”, the entire contents of which are incorporated by reference into this application; this application claims priority to the Chinese patent application filed with the China Patent Office on July 30, 2022, with application number 202210912601.4 and application name “A audio control method and electronic device”, the entire contents of which are incorporated by reference into this application; this application claims priority to the Chinese patent application filed with the China Patent Office on December 29, 2022, with application number 202211716573.5 and application name “A control method and electronic device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0003] The present application relates to the technical field of vehicle-mounted equipment, and in particular to a control method and electronic equipment. Background Art

[0004] With the rapid development of intelligent automobile technology, in order to provide users with a more personalized and humanized user experience, more and more display screens are configured in vehicles. For example, the display screens configured in the vehicle include not only the central control display screen (hereinafter referred to as the "central control screen"), but also the co-pilot display screen (hereinafter referred to as the "co-pilot screen") and display screens set in other positions, such as the left rear seat display screen (hereinafter referred to as the "left rear screen" or "rear left screen") and the right rear seat display screen (hereinafter referred to as the "right rear screen" or "rear right screen"). Passengers can watch videos or play games on the display screens at their seats while riding in the vehicle. In addition, the driver and passengers, or passengers themselves, can also interact through the display screens, such as interface flow, collaborative operations, etc.

[0005] The interaction between the in-vehicle display screens supported by existing intelligent in-vehicle terminals (hereinafter referred to as "in-vehicle terminals") is usually the cross-screen flow of the entire screen. For example, as shown in Figure 1, the in-vehicle terminal can transfer the video playback window displayed in full screen on the first screen (such as the main driver's screen) to the second screen (such as the co-driver's screen) according to the user's operation of indicating the interface flow (the operation of sliding the video playback window on the first screen toward the second screen with a finger as shown in Figure 1). However, in actual use, the in-vehicle display screen usually displays multiple task interfaces that are performed in parallel. For example, the video call interface is often displayed on the in-vehicle display screen together with the navigation interface, music interface, etc. For this case, how to transfer the interface and provide users with intelligent display that meets user needs and habits is a problem that needs to be studied.

[0006] Summary of the Invention

[0007] The present application provides a control method and an electronic device, which can provide users with an efficient and intelligent interface display that meets user needs and habits in a multi-tasking scenario.

[0008] In the first aspect, an embodiment of the present application provides a control method, which can be applied to the interface flow process of an electronic device such as a vehicle-mounted terminal, wherein the vehicle-mounted terminal includes multiple display screens (such as a first screen (or called a first display screen) and a second screen (or called a second display screen)); the method includes: when receiving a first operation for flowing a first interface on a first screen, the vehicle-mounted terminal flows the first interface according to the intention of the first operation; wherein the above-mentioned flow includes same-screen flow and cross-screen flow; when performing cross-screen flow of the first interface, after completing the flow of the first interface, the display type of the first interface on the second screen is related to the task information before the flow of the first interface and / or the screen task information of the second screen.

[0009] The task information before the first interface is switched is used to indicate the display type and / or classification information of the first interface before the first interface is switched. The classification information is used to indicate whether the first interface is the preset focused application interface of the first screen. The screen task information of the second screen is used to indicate the display type and / or classification information of the task interface on the second screen before the first interface is switched. The classification information is used to indicate whether the interface is the preset focused application interface of the screen.

[0010] According to the solution provided by the first aspect above, when the vehicle-mounted terminal receives an operation from the user for interface transfer, it determines whether it is cross-screen transfer or same-screen transfer by analyzing the specific intention of the operation, so as to provide users with better intelligent interface display services. For example, when it is determined that the intention of the first operation is cross-screen transfer, the vehicle-mounted terminal can display the task interface transferred from the original screen on the target screen with a suitable display type after the interface transfer, based on the actual display situation before the first interface transfer and / or the interface display situation on the second screen. Through this method, the task interface transferred from the original screen can be displayed with the most eye-catching display effect possible without interrupting the task currently focused on by the user of the target screen, thereby reducing the user's subsequent operations and providing the user with a more humane interface transfer experience.

[0011] In one possible design, the display type includes any one of the following: an application window, a floating window, a floating icon, a floating ball, a picture-in-picture, a card, a control, or a notification. The solution provided in this application can be applied to the flow of first interfaces of various display types, and does not limit the display type of the interface on the second screen before the flow. Regardless of the scenario, the solution provided in this application can be used to display the task interface transferred from the original screen with the most eye-catching display effect without affecting the current task focused on by the user on the target screen. It has high applicability and strong practicality.

[0012] In one possible design, the above-mentioned first operation is an operation of sliding one or more fingers on the first interface at a sliding speed greater than a preset threshold and then leaving, and the first operation is used to transfer the first interface across screens. It can be understood that the one-finger or multi-finger sliding operation conforms to the operating habits of most users and is convenient for users to remember and operate. Therefore, by performing specific interface flow intention recognition according to different sliding speeds (or sliding accelerations), such as cross-screen flow intention and same-screen flow intention recognition, while facilitating user memory and operation, it can also improve the interaction performance between the vehicle terminal and the user, thereby improving the user experience.

[0013] In one possible design, the above-mentioned vehicle-mounted terminal transfers the first interface according to the intention of the first operation, including: the vehicle-mounted terminal determines the second screen as the target screen for cross-screen transfer according to the sliding direction of the first operation and the positional relationship between the first screen and the multiple display screens; wherein the sliding direction points to the second screen; the vehicle-mounted terminal transfers the first interface to the second screen across the screen. For the case where the vehicle-mounted terminal includes multiple display screens (such as the first screen and the second screen), the vehicle-mounted terminal must know the relative positional relationship of the multiple display screens. Similarly, for the case where multiple display screens (such as the first screen and the second screen) belong to different vehicle-mounted terminals, the vehicle-mounted terminal to which the first screen belongs can know the relative positional relationship of the multiple display screens. For example, the specific positions of multiple display screens are stored in the vehicle-mounted terminal. Based on this, in an embodiment of the present application, the vehicle-mounted terminal can determine the target screen for cross-screen transfer of the first interface based on the sliding direction of the user's finger and the relative positional relationship of the multiple display screens.

[0014] In one possible design, the display type of the first interface after the transfer is the same as the display type of the first interface before the transfer. For example, if the first interface is displayed in full screen before the transfer, the first interface can be kept in full screen after the interface transfer to ensure the eye-catching display of the first interface. For another example, if the first interface is displayed as a floating window before the transfer, the floating window can be kept after the interface transfer without affecting the interface on the target screen. Based on this, the same interface display experience can be maintained before and after the interface transfer.

[0015] In one possible design, the first interface is displayed full-screen on the first screen before the transition; after the transition, the first interface is displayed full-screen on the second screen. This allows the same eye-catching interface experience to be maintained before and after the transition.

[0016] In one possible design, the display type of the first interface after the transfer is related to the classification information of the first interface before the transfer; wherein, before the transfer, the first interface is the preset focused application interface of the first screen; after the transfer of the first interface is completed, the display type of the first interface on the second screen is full-screen display. It can be understood that the fact that the first interface is the preset focused application interface of the first screen before the transfer indicates that the interface has a high degree of user attention or is of high importance and needs to be prioritized for display. Based on this, displaying the first interface in full screen after the transfer can ensure the eye-catching display of the first interface and facilitate user operation.

[0017] In one possible design, the display type of the first interface after the transfer is also related to the screen task information of the second screen; wherein, before the first interface is transferred, the task interface is not displayed on the second screen, the task interface is not displayed in full screen, or the preset focus application interface of the second screen is not displayed. It can be understood that the fact that the task interface is not displayed on the second screen before the transfer, the task interface is not displayed in full screen, or the preset focus application interface of the second screen is not displayed indicates that the second screen is not performing a task that is of high user attention or importance. Based on this, displaying the first interface in full screen after the transfer can ensure the eye-catching display of the first interface and facilitate user operation.

[0018] In one possible design, the display type of the first interface after the transfer is related to the screen task information of the second screen; wherein, before the transfer of the first interface, the task interface is not displayed on the second screen, the task interface is not displayed in full screen, or the preset focus application interface of the second screen is not displayed; after the transfer of the first interface is completed, the display type of the first interface is full screen. It can be understood that the fact that the task interface is not displayed on the second screen before the transfer, the task interface is not displayed in full screen, or the preset focus application interface of the second screen is not displayed indicates that the second screen is not performing a task that is of high user attention or importance. Based on this, displaying the first interface in full screen after the transfer can ensure the eye-catching display of the first interface and facilitate user operation.

[0019] In one possible design, the display type of the first interface after the transfer is related to the screen task information of the second screen; wherein, before the first interface transfers, the second screen displays a task interface in full screen or displays a preset focus application interface of the second screen; after the transfer of the first interface is completed, the first interface and other task interfaces on the second screen are displayed in split screen. It can be understood that the full screen display of the task interface or the preset focus application interface of the second screen on the second screen before the transfer indicates that the second screen is performing a task that is of high user attention or importance. Based on this, the first interface is displayed in split screen after the transfer to avoid interrupting the task interface that the user is focusing on on the second screen, providing the user with a more user-friendly transfer experience.

[0020] In one possible design, the display type of the first interface after the transfer is related to the screen task information of the second screen and the task information of the first interface before the transfer; wherein, before the first interface transfers, the display type of the first interface is full-screen display or the first interface is the preset focus application interface of the first screen; the task interface is displayed in full screen on the second screen or the preset focus application interface of the second screen is displayed; after the transfer of the first interface is completed, the first interface and other task interfaces on the second screen are displayed in split screen. It can be understood that before the transfer, the full-screen display of the first interface or the first interface is the preset focus application interface of the first screen indicates that the interface has a high degree of user attention or is of high importance. In addition, the full-screen display of the task interface or the preset focus application interface of the second screen on the second screen indicates that the second screen is performing a task that has a high degree of user attention or is of high importance. Based on this, the split-screen display of the first interface after the transfer can ensure the eye-catching display of the first interface while avoiding interrupting the task interface that the user is focusing on on the second screen, providing the user with a more humane transfer experience.

[0021] In one possible design, the display type of the first interface after the transfer is related to the screen task information of the second screen; wherein, before the first interface transfers, the second screen displays the task interface in full screen or displays the preset focus application interface of the second screen; after the transfer of the first interface is completed, the display type of the first interface is split screen display, floating window, floating icon, floating ball, picture-in-picture, card, or control. It can be understood that the full screen display of the task interface or the preset focus application interface of the second screen on the second screen before the transfer indicates that the second screen is performing a task that is of high user attention or importance. Based on this, displaying the first interface in a non-full screen form (such as a floating window or picture-in-picture form) after the transfer can avoid interrupting the task interface that the user is focusing on on the second screen, thereby providing the user with a more user-friendly transfer experience.

[0022] In one possible design, the display type of the first interface after the transition is the same as the display type of the first interface before the transition. For example, the first interface is displayed as a floating window on the first screen before the transition, and after the transition, the first interface can be displayed as a floating window on the second screen.

[0023] In one possible design, after the first interface is completed, a floating window, floating icon, floating ball, application icon, or card corresponding to the first interface is displayed on the first screen. This allows the user on the first screen to continue viewing or operating the first interface, while preventing the first interface from interfering with other focused tasks on the first screen.

[0024] In one possible design, when the aforementioned transition is a same-screen transition, the first operation is a sliding movement of one or more fingers on the first interface at a speed less than or equal to a preset threshold for a certain distance, followed by a release. This first operation is used to transition to the first interface on the same screen. By conforming to the operating habits of most users and facilitating user memory and operation to trigger same-screen transition, the interaction between the in-vehicle terminal and the user can be improved while facilitating user memory and operation, thereby enhancing the user experience.

[0025] In one possible design, the vehicle terminal transfers the first interface based on the intent of the first operation, including: the vehicle terminal transfers the first interface to a target location on the same screen; wherein the target location is the termination location of the first operation on the first screen; or the target location is calculated by the vehicle terminal based on the first operation; or the target location is a preset location on the edge of the first screen. Based on this, the first interface can be pinned to a certain position on the screen, and the same-screen transfer function can be implemented to meet the diverse needs of users.

[0026] In one possible design, before the first interface is switched, the first screen displays the first and second interfaces in a split screen. The first operation is a user sliding one or more fingers on the first interface at a speed less than or equal to a preset threshold toward the second interface for a distance and then releasing the fingers. After the first interface is switched, the in-vehicle terminal swaps the positions of the first and second interfaces. This allows for quick and easy swapping of the split interface positions.

[0027] In one possible design, after the first interface is transferred to the second screen across screens, the above method further includes: upon receiving an operation for transferring the first interface to the first screen across screens, the vehicle terminal transfers the first interface back to the first screen across screens; wherein, after transferring the first interface back to the first screen across screens, the display type of the first interface is related to the task information when the first interface is displayed on the second screen and / or the screen task information of the first screen when the vehicle terminal receives the first operation. This application supports arbitrary transfer of interfaces between multiple screens, including reverse transfer.

[0028] In one possible design, the vehicle-mounted terminal further includes a third screen. After the first interface is transferred to the second screen across screens, the method further includes: upon receiving an operation for transferring the first interface to the third screen across screens, the vehicle-mounted terminal transfers the first interface to the third screen across screens; wherein, after transferring the first interface to the third screen across screens, the display type of the first interface is related to the task information when the first interface is displayed on the second screen and / or the screen task information of the third screen when the vehicle-mounted terminal receives the first operation. This application supports arbitrary transfer of interfaces between multiple screens, including relay transfer.

[0029] In one possible design, when a user performs a first operation to switch to the first interface on the first screen, one or more first task interfaces are displayed on the first screen, and the one or more first task interfaces include the first interface. The solution provided in this application is applicable to multi-tasking scenarios.

[0030] In one possible design, the first screen is any one of the following vehicle screens: the driver's screen, the passenger's screen, the left rear screen, or the right rear screen. As an example, the solution provided in this application is applicable to the interface flow on any of the following screens in a vehicle: the driver's screen, the passenger's screen, the left rear screen, or the right rear screen.

[0031] In one possible design, the second screen is any one of the following vehicle screens: the driver's screen, the passenger screen, the left rear screen, or the right rear screen; and the second screen is different from the first screen. As an example, the solution provided in this application is applicable to transferring the interface flow to any screen in the vehicle.

[0032] In a second aspect, an embodiment of the present application provides a control method, which can provide an immersive viewing experience for users by collaboratively displaying a screen through multiple display screens. The method can be applied to an electronic device including a first display screen, a second display screen, and a third display screen, wherein the second display screen and the third display screen are respectively located on both sides of the first display screen; the method may include: when displaying the first interface on the first display screen, displaying the second interface on the second display screen, and displaying the third interface on the third display screen; wherein the second interface is an interface obtained by performing a first effect processing on a portion of the interface of the first interface close to the second display screen side; the third interface is an interface obtained by performing the first effect processing on a portion of the interface of the first interface close to the third display screen side; the first effect processing is any one of the following: Gaussian blur processing, solid color gradient processing, particle motion effect processing.

[0033] In this method, when an electronic device with multiple display screens displays a first interface on a first display screen, by displaying a special effects interface corresponding to a portion of the first interface close to the second display screen on a second display screen, and displaying a special effects interface corresponding to a portion of the first interface close to the third display screen on a third display screen, the second display screen and the third display screen can be controlled to simultaneously display different special effects interfaces related to the first interface, thereby collaboratively presenting an interface through multiple display screens, providing richer display effects and enhancing the user's immersive viewing experience.

[0034] In a possible design, the sizes of the second interface and the third interface may be the same or different.

[0035] In this method, the size relationship between the second interface and the third interface can be flexibly set, which helps to improve the flexibility of interface display.

[0036] In one possible design, the method also includes: when receiving a first operation for flowing the first interface on the first display screen, flowing the first interface according to the intention of the first operation; the flow includes same-screen flow and cross-screen flow; after receiving the first operation for flowing the first interface on the first display screen, the method also includes: when it is determined that the flow is a cross-screen flow, the second interface is not displayed on the second display screen, and the third interface is not displayed on the third display screen.

[0037] In this method, when the first interface displayed on the first display screen flows across screens, the electronic device can stop displaying the special effects interface related to the first interface on the display screens on both sides of the first display screen, and can turn off the special effects in time to avoid unnecessary power consumption.

[0038] In one possible design, the first electronic device includes a first OS and a second OS; wherein the first OS is used to control the first display screen, and the second OS is used to control the second display screen; displaying the second interface on the second display screen includes: determining a fourth interface through the first OS; wherein the fourth interface is: the first interface, or a portion of the first interface close to the second display screen, or an interface obtained by performing part or all of the first effect processing on the portion of the first interface close to the second display screen; storing the fourth interface in a first memory through the first OS; obtaining the fourth interface from the first memory through the second OS; determining the second interface based on the fourth interface through the second OS; and displaying the second interface on the second display screen through the second OS.

[0039] In this method, different display screens can be controlled by different operating systems. When displaying the special effects interface corresponding to the first interface, the process of generating the special effects interface can be completed by the OS belonging to any display screen, or it can be completed by different OSes together. Therefore, this method is highly flexible and can flexibly select the OS that performs the special effects interface generation process based on the processing power or processing pressure of different OSes, thereby improving processing efficiency. In addition, different OSes can share memory, so each OS can read data from the shared memory and store processed data in the shared memory, thereby providing higher access efficiency and saving data storage space.

[0040] In one possible design, determining the second interface according to the fourth interface by the second OS includes: when the fourth interface is the first interface, the second OS determines the portion of the first interface close to the second display screen according to the fourth interface, and performs the first effect processing on the portion of the first interface close to the second display screen to obtain the second interface; or, when the fourth interface is the portion of the first interface close to the second display screen, the second OS performs the first effect processing on the fourth interface to obtain the second interface; or, when the fourth interface is the interface obtained by performing part of the first effect processing on the portion of the first interface close to the second display screen, the second OS performs the remaining part of the first effect processing on the fourth interface to obtain the second interface; or, when the fourth interface is the interface obtained by performing all of the first effect processing on the portion of the first interface close to the second display screen, the second OS uses the fourth interface as the second interface.

[0041] In this method, if the interface obtained by the second OS from the first OS is the original interface without special effects processing, the second OS can perform complete special effects processing on the interface. If the interface obtained by the second OS from the first OS is an interface that has been partially processed with special effects, the second OS can perform the remaining special effects processing on the interface. If the interface obtained by the second OS from the first OS is an interface that has been fully processed with special effects, the second OS can directly use the interface. Therefore, the second OS can perform corresponding subsequent processing according to the processing progress of the first OS, which is highly flexible. When the processing pressure of the first OS is high, the second OS can take on part or all of the special effects processing tasks, which can improve processing efficiency.

[0042] In one possible design, the first display screen, the second display screen, and the third display screen belong to the same OS.

[0043] In this method, the first display screen, the second display screen, and the third display screen belong to the same OS, so the OS can directly and quickly control the three display screens, thereby improving the control efficiency to a certain extent.

[0044] In a third aspect, an embodiment of the present application provides a control method that can collaboratively display a single screen on multiple displays to provide an immersive viewing experience for users. The method can be applied to an electronic device comprising a first display, a second display, and a third display, wherein the second display and the third display are respectively located on either side of the first display; the method may include: when displaying a first interface on the first display, displaying a second interface on the second display, and displaying the second interface on the third display; wherein the second interface is an interface obtained by performing particle motion effect processing on the first interface.

[0045] In this method, when an electronic device with multiple display screens displays a first interface on a first display screen, by displaying a special effects interface corresponding to the first interface on a second display screen and a third display screen, one interface can be collaboratively presented through multiple display screens, thereby providing richer display effects and enhancing the user's immersive viewing experience.

[0046] In one possible design, the method also includes: when receiving a first operation for flowing the first interface on the first display screen, flowing the first interface according to the intention of the first operation; the flow includes same-screen flow and cross-screen flow; after receiving the first operation for flowing the first interface on the first display screen, the method also includes: when the flow is cross-screen flow, the second interface is not displayed on the second display screen, and the second interface is not displayed on the third display screen.

[0047] In this method, when the first interface displayed on the first display screen is transferred across screens, the special effect interfaces related to the first interface can be stopped from being displayed on other display screens, and the special effects can be turned off in time to avoid unnecessary power consumption.

[0048] In one possible design, the first electronic device includes a first OS and a second OS; wherein the first OS is used to control the first display screen, and the second OS is used to control the second display screen; displaying the second interface on the second display screen includes: determining a third interface through the first OS; wherein the third interface is: the first interface, or an interface obtained after performing part or all of the particle motion effect processing on the first interface; storing the third interface in a first memory through the first OS; obtaining the third interface from the first memory through the second OS; determining the second interface based on the third interface through the second OS; and displaying the second interface on the second display screen through the second OS.

[0049] In this method, different display screens can be controlled by different operating systems. When displaying the special effects interface corresponding to the first interface, the process of generating the special effects interface can be completed by the OS belonging to any display screen, or it can be completed by different OSes together. Therefore, this method is highly flexible and can flexibly select the OS that performs the special effects interface generation process based on the processing power or processing pressure of different OSes, thereby improving processing efficiency. In addition, different OSes can share memory, so each OS can read data from the shared memory and store processed data in the shared memory, thereby providing higher access efficiency and saving data storage space.

[0050] In one possible design, the first display screen, the second display screen, and the third display screen belong to the same OS.

[0051] In this method, the first display screen, the second display screen, and the third display screen belong to the same OS, so the OS can directly and quickly control the three display screens, thereby improving the control efficiency to a certain extent.

[0052] Fourthly, an embodiment of the present application provides a control method that can provide an immersive viewing experience for users by simultaneously displaying a content interface and a special effects interface corresponding to the content interface on a single display screen. The method can be applied to an electronic device including a first display screen, and the method may include: displaying a first interface in a first area on the first display screen, and displaying a second interface in a second area on the first display screen; wherein the second area is an area on the first display screen other than the first area; and the second interface is an interface obtained by performing particle motion effect processing on the first interface.

[0053] In this method, when the electronic device displays the first interface on the first display screen, it can display the content interface and the special effects interface simultaneously on the same display screen by displaying the special effects interface corresponding to the first interface in the display area outside the first interface on the first display screen, thereby providing a richer display effect and enhancing the user's immersive viewing experience.

[0054] In one possible design, the method also includes: when receiving a first operation for flowing the first interface on the first display screen, flowing the first interface according to the intention of the first operation; the flow includes same-screen flow and cross-screen flow; after receiving the first operation for flowing the first interface on the first display screen, the method also includes: when the flow is cross-screen flow, the second interface is not displayed on the first display screen.

[0055] In this method, when the first interface displayed on the first display screen is transferred across screens, the first display screen can stop displaying the special effects interface related to the first interface, and the special effects can be turned off in time to avoid unnecessary power consumption.

[0056] In a fifth aspect, an embodiment of the present application provides a control method that can collaboratively display a single screen through multiple displays to provide an immersive viewing experience for a user. The method can be applied to a first electronic device including a first display and a second display; the method may include: displaying a first interface on the first display and displaying a second interface on the second display; sending a third interface to a second electronic device so that the second electronic device displays the third interface on the third display; or sending a fourth interface to the second electronic device so that the second electronic device generates the third interface based on the fourth interface and then displays the third interface on the third display; wherein the second electronic device includes the third display, and the second and third displays are located on both sides of the first display; the second interface is an interface obtained by performing a first effect processing on a portion of the first interface near the second display; the third interface is an interface obtained by performing the first effect processing on a portion of the first interface near the third display; the fourth interface is: a portion of the first interface near the third display, or an interface obtained by performing part or all of the first effect processing on a portion of the first interface near the third display; the first effect processing is any one of the following: Gaussian blur processing, solid color gradient processing, and particle motion effect processing.

[0057] In this method, when the first electronic device displays the first interface on the first display screen, it can control its own second display screen to display the special effects interface corresponding to the first interface. At the same time, the first electronic device sends the first interface or the first interface that has been partially or completely processed with special effects to the second electronic device, so that the second electronic device can determine the special effects interface corresponding to the first interface, and then display the special effects interface corresponding to the first interface on the third display screen of the second electronic device. Therefore, this method can support the first electronic device and the second electronic device to collaboratively achieve the effect of displaying the first interface on the first display screen and displaying the special effects interface related to the first interface on the second and third display screens, thereby providing richer display effects and enhancing the user's immersive viewing experience.

[0058] In a possible design, the sizes of the second interface and the third interface may be the same or different.

[0059] In this method, the size relationship between the second interface and the third interface can be flexibly set, which helps to improve the flexibility of interface display.

[0060] In a sixth aspect, an embodiment of the present application provides a control method that can collaboratively display a screen through multiple displays to provide an immersive viewing experience for a user. The method can be applied to a first electronic device including a first display screen; the method may include: when displaying a first interface on the first display screen, sending a second interface and a third interface to a second electronic device, so that the second electronic device displays the second interface and the third interface on the second display screen and the third display screen, respectively; or, when displaying the first interface on the first display screen, sending the first interface to a second electronic device, so that the second electronic device generates the second interface and the third interface based on the first interface and displays the second interface and the third interface on the second display screen and the third display screen, respectively; wherein the second electronic device includes the second display screen and the third display screen, and the second display screen and the third display screen are respectively located on both sides of the first display screen; the second interface is an interface obtained by performing a first effect processing on a portion of the first interface close to the second display screen; the third interface is an interface obtained by performing the first effect processing on a portion of the first interface close to the third display screen; the first effect processing is any one of the following: Gaussian blur processing, solid color gradient processing, and particle motion effect processing.

[0061] In this method, when a first electronic device displays a first interface on a first display screen, by sending the first interface or the first interface that has been partially or fully processed with special effects to a second electronic device, the second electronic device can determine the special effects interface corresponding to the first interface, and then display the special effects interface corresponding to the first interface on the second and third displays of the second electronic device. Therefore, this method can support the first electronic device and the second electronic device to collaboratively achieve the effect of displaying the first interface on the first display screen and displaying the special effects interface related to the first interface on the second and third displays, thereby providing richer display effects and enhancing the user's immersive viewing experience.

[0062] In a possible design, the sizes of the second interface and the third interface may be the same or different.

[0063] In this method, the size relationship between the second interface and the third interface can be flexibly set, which helps to improve the flexibility of interface display.

[0064] In the seventh aspect, an embodiment of the present application provides a control method, which can provide users with an immersive viewing experience by collaboratively displaying a picture through multiple display screens. The method can be applied to a first electronic device including a first display screen; the method may include: when displaying a first interface on the first display screen, sending a second interface to a second electronic device, so that the second electronic device displays the second interface on the second display screen, or, sending a third interface to a second electronic device, so that the second electronic device displays the second interface on the second display screen after generating the second interface according to the third interface; when displaying the first interface on the first display screen, sending a fourth interface to a third electronic device, so that the third electronic device displays the fourth interface on the third display screen, or, sending a fifth interface to a third electronic device, so that the third electronic device displays the fourth interface on the third display screen after generating the fourth interface according to the fifth interface; wherein, the second electronic device includes the second display screen, the third electronic device includes the third display screen, and the second display screen and the third display screen are connected. The display screens are located on both sides of the first display screen; the second interface is an interface obtained by performing the first effect processing on the part of the interface of the first interface close to the second display screen; the third interface is: the part of the interface of the first interface close to the second display screen, or the part of the interface of the first interface close to the second display screen is subjected to part or all of the processing of the first effect processing; the fourth interface is the interface obtained by performing the first effect processing on the part of the interface of the first interface close to the third display screen; the fifth interface is: the part of the interface of the first interface close to the third display screen, or the part of the interface of the first interface close to the third display screen is subjected to part or all of the processing of the first effect processing; the first effect processing is any one of the following: Gaussian blur processing, solid color gradient processing, particle motion effect processing.

[0065] In this method, when the first electronic device displays the first interface on the first display screen, by sending the first interface or the first interface that has been partially or completely processed with special effects to the second electronic device and the third electronic device respectively, the second electronic device and the third electronic device can determine the special effects interface corresponding to the first interface, and then display the special effects interface corresponding to the first interface on their own displays. Therefore, this method can support the first electronic device, the second electronic device, and the third electronic device to collaboratively achieve the effect of displaying the first interface on the first display screen and displaying the special effects interface related to the first interface on the second and third displays, thereby providing richer display effects and enhancing the user's immersive viewing experience.

[0066] In a possible design, the sizes of the second interface and the third interface may be the same or different.

[0067] In this method, the size relationship between the second interface and the third interface can be flexibly set, which helps to improve the flexibility of interface display.

[0068] In a possible design, in the method described in any one of the second to seventh aspects above, the method also includes: when the first interface is displayed on the first display screen, adjusting the control parameters of the air-conditioning equipment in the space where the first display screen is located according to the volume of the audio corresponding to the first interface; wherein the control parameters are positively correlated with the volume, and the control parameters include at least one of the following: air volume at the air outlet, wind speed at the air outlet, and air outlet time.

[0069] In this method, the electronic device can determine the control parameters of the air-conditioning device based on the displayed interface, and control the air-conditioning according to the determined control parameters. Therefore, it can provide some auxiliary immersive experience with the help of the air-conditioning when displaying the content interface, thereby further providing richer and more diverse immersive services, thereby improving the user's immersive experience.

[0070] In a possible design, in the method described in any one of the second to seventh aspects above, the method also includes: when displaying the first interface on the first display screen, determining the target temperature corresponding to the picture scene of the first interface based on the correspondence between the preset picture scene and the temperature; and adjusting the temperature of the air-conditioning equipment in the space where the first display screen is located to the target temperature.

[0071] In this method, the electronic device can determine the temperature parameters of the air-conditioning device based on the displayed interface, and adjust the temperature of the air-conditioning device according to the determined temperature parameters, so that the temperature felt by the user corresponds to the interface content seen by the user, thereby improving the user's immersive experience.

[0072] In a possible design, in the method described in any one of the second to seventh aspects above, the method further includes: when displaying the first interface on the first display screen, determining a first target color based on at least one color existing in the first interface; wherein the first target color is any color of the at least one color, or the first target color is the average color of some or all of the colors of the at least one color; and adjusting the light color and / or brightness of the first lighting device in the space where the first display screen is located according to the first target color.

[0073] In this method, the electronic device can determine the color, brightness and other control parameters of the lighting device based on the displayed interface, and control the lighting device according to the determined control parameters. Therefore, it can provide some auxiliary immersive experience with the help of the lighting device when displaying the content interface, thereby further providing richer and more diverse immersive services, thereby improving the user's immersive experience.

[0074] In an eighth aspect, an embodiment of the present application provides a control method, which can improve the flexibility and practicality of controlling an audio output device to play audio in a multi-audio output device scenario. The method can be applied to a first electronic device, and the method may include: when a first content is displayed on a first display screen, using a first audio output device to play a first audio corresponding to the first content; wherein the first display screen is any one of a plurality of display screens located in a first spatial area; in response to a received first operation, the first display screen displays the first content, and, in response to a second display screen, displays the first content; wherein the second display screen is included in the plurality of display screens; in response to the first operation, the first audio output device does not play the first audio, and uses a second audio output device to play the first audio; or, continues to use the first audio output device to play the first audio; or, uses an audio output device of a set type located in the first spatial area to play the first audio. ; wherein the first audio output device is associated with a first sound zone, and the second audio output device is associated with a second sound zone; the first sound zone is a candidate sound zone associated with the first display screen among multiple candidate sound zones, and the second sound zone is a candidate sound zone associated with the second display screen among the multiple candidate sound zones; among the multiple candidate sound zones, each candidate sound zone is associated with one or more audio output devices within the first spatial area; and / or, the first audio output device includes at least one audio output device of the same type, and the second audio output device includes at least one audio output device of the same type; wherein the type includes at least one of the following: a state type for indicating the dynamic or static state of the audio output device; a location type for indicating the location range of the audio output device; a device type of the audio output device. wherein the interface where the first content is located is the first interface.

[0075] In this method, in a scenario where there are multiple display screens and multiple audio output devices in a spatial area, when the electronic device displays content on the display screen and plays the corresponding audio, it can select a sound zone associated with the display screen from multiple sound zones and use the audio output device associated with the sound zone to play the audio. When the content on one display screen is transferred to another display screen for display, the electronic device can also flexibly select the audio output device used to play the audio after the transfer. Based on this method, the control device can use the sound zones to partition the display screens and audio output devices in the spatial area, and with the sound zones as a reference, flexibly select the audio output device for playing the audio corresponding to the content on each display screen, without the need for manual intervention, so the control efficiency is relatively high. It can also adapt to audio control needs in more and more common scenarios, and has high versatility and practicality.

[0076] In one possible design, if the first audio is media audio or call audio; or the service providing the first audio is a media service or a call service; in response to the first operation, the first audio output device does not play the first audio, and uses the second audio output device to play the first audio.

[0077] In this method, when users watch media / call content, they have a high demand for listening to the corresponding audio. Therefore, when the electronic device determines that the content transferred from the first display screen to the second display screen is media / call content, or determines that the audio corresponding to the content is media / call audio, or determines that the service providing audio is a media / call service, it can switch the audio output device that plays the audio of the content, which can achieve the effect of media / call audio following the flow of the picture, thereby improving the user's experience of listening to audio.

[0078] In one possible design, if the first audio is any one of the following audios: navigation sound, notification sound, system sound, alarm sound; or, the service providing the first audio is any one of the following services: navigation service, notification service, system service, alarm service; or, the display type corresponding to the first content is any one of the following: floating window, picture-in-picture, control, card; in response to the first operation, continue to use the first audio output device to play the first audio.

[0079] In this method, navigation sounds, notification sounds, system sounds, and warning sounds are generally listened to primarily by users in the driver's seat of the vehicle. Therefore, when the content corresponding to these sounds flows, it is more in line with the actual needs of users if these sounds do not follow the flow. Therefore, in this method, when the content corresponding to these sounds flows, these sounds do not follow the flow, which can be more suitable for audio control scenarios in the vehicle and ensure a high listening experience for users during the control process. When users view floating windows, picture-in-picture, controls, and cards, the demand for listening to the corresponding audio is relatively low, and the flow time of these contents may be relatively short. Therefore, when these contents flow, the corresponding audio does not follow the flow, which can reduce the complexity of audio control and have less impact on the user experience.

[0080] In one possible design, if the first audio is a call-type audio, in response to the first operation, the first audio is played using all audio output devices of a set type located in the first spatial area.

[0081] In this method, when the electronic device determines that the audio corresponding to the content transferred from the first display screen to the second display screen is call-type audio, the audio playback mode is switched to playing using an audio output device of a type set in the spatial area. For example, the audio playback mode is switched to playing using all or part of the audio output devices of a type set in the spatial area. For example, when the video call interface is transferred from the central control screen to the co-driver screen, it can be switched to playing the call audio using all the speakers in the car, which can ensure that all users in the spatial area can hear the call audio, thereby meeting the needs of users in the spatial area to participate in calls and improving the user experience. For another example, when the video call interface is transferred from the central control screen to the co-driver screen, it can be switched to playing the call audio using the front speakers (driver's seat speaker and co-driver's seat speaker) to meet the call experience of the front row users.

[0082] In one possible design, the method also includes: in response to a first voice instruction of a first user, playing a third audio using an audio output device associated with the first sound zone; wherein the spatial area where the first user is located is the spatial area associated with the first sound zone; and in response to a second voice instruction of a second user, playing a fourth audio using an audio output device associated with the second sound zone; wherein the spatial area where the second user is located is the spatial area associated with the second sound zone.

[0083] In this method, when the electronic device determines that the position of the user who issued the voice instruction has changed (for example, the user at a different position in the car issues the voice instruction), the audio output device can be switched to play the audio in response to the user's instruction, thereby ensuring the continuity and smoothness of the user's listening to the response audio, thereby improving the user experience.

[0084] In one possible design, in response to a received first operation, the first display screen does not display the first content, and before the second display screen displays the first content, the method further includes: displaying the second content on the second display screen, and playing the second audio corresponding to the second content using a third audio output device; wherein the third audio output device is associated with the second sound zone; displaying the first content on the second display screen includes: displaying the first content and the second content in split screen on the second display screen; or, displaying the first content in a first window on the second display screen; wherein the first window is superimposed on the window where the second content is located, and the size of the first window is smaller than the size of the window where the second content is located; in response to the received first operation, the first display screen does not display the first content, and after the second display screen displays the first content, the method further includes: continuing to play the second audio using the third audio output device.

[0085] In this method, before the content on the first display screen is transferred to the second display screen, the second display screen can display the content and play the corresponding audio. After the content on the first display screen is transferred to the second display screen, the second display screen can display the transferred content in a split screen or in a window. The content originally displayed on the second display screen is still partially or completely visible, and the electronic device can continue to play the audio corresponding to the content, which can avoid the mismatch between the picture and the audio and ensure the user's visual and auditory consistency.

[0086] In one possible design, in response to a received first operation, the first display screen does not display the first content, and before the second display screen displays the first content, the method further includes: displaying second content on the second display screen and playing second audio corresponding to the second content using a third audio output device; wherein the third audio output device is associated with the second sound zone; displaying the first content on the second display screen includes: displaying the first content on the second display screen and not displaying the second content; in response to a received first operation, the first display screen does not display the first content, and after the second display screen displays the first content, the method further includes: the third audio output device does not play the second audio.

[0087] In this method, before the content on the first display screen is transferred to the second display screen, the second display screen can display the content and play the corresponding audio. After the content on the first display screen is transferred to the second display screen, the second display screen displays the transferred content in full screen. The content originally displayed on the second display screen is invisible to the user, and the electronic device stops playing the audio corresponding to the content. This can avoid the mismatch between the picture and the audio, and ensure the consistency of the user's vision and hearing.

[0088] In one possible design, after the third audio output device stops playing the second audio, the method further includes: in response to receiving a second operation, not displaying the first content on the second display screen, and displaying the second content on the second display screen; and continuing to play the second audio using the third audio output device.

[0089] In this method, when the transferred content is no longer displayed on the second display screen, the electronic device can use the audio output device that played the audio corresponding to the content on the second display screen before the content was transferred to continue playing the audio corresponding to the content originally displayed on the second display screen, thereby continuing the service before the content was transferred, improving the continuity of content display and audio playback on the second display screen, and thus improving the user experience.

[0090] In one possible design, after the third audio output device stops playing the second audio, the method further includes: in response to receiving a third operation, displaying the first content on the first display screen, not displaying the first content on the second display screen, and displaying the second content on the second display screen; continuing to play the first audio using the first audio output device, and continuing to play the second audio using the third audio output device.

[0091] In this method, after the content on the first display screen is transferred to the second display screen for display, when the content from the first display screen displayed on the second display screen exits display, the electronic device can switch back to the audio playback mode before the content is transferred, thereby continuing the service before the content is transferred, improving the continuity of content display and audio playback on the second display screen, and thereby improving the user experience.

[0092] In one possible design, in response to a received first operation, the first display screen does not display the first content, and after the second display screen displays the first content, the method further includes: when the display area of ​​the first content on the second display screen is a partial area of ​​the second display screen, in response to a received fourth operation, the first content is displayed in full screen on the second display screen; and only the first audio is played using the audio output device associated with the second sound zone, and the audio output device associated with the first sound zone does not play the first audio.

[0093] In this method, after the content on the first display is transferred to the second display and displayed in a non-full-screen manner, the electronic device may not switch the audio playback mode. When the non-full-screen content on the second display becomes full-screen, the electronic device may switch the audio playback mode and only play the audio corresponding to the content. Based on this method, audio control can adapt to changes in the scene, improving the flexibility of audio control and user experience.

[0094] In one possible design, before using the first audio output device to play the first audio corresponding to the first content, the method further includes: determining the first audio output device; wherein, determining the first audio output device includes: determining the first sound zone based on the first display screen; selecting the audio output device with the highest priority among the at least one audio output device as the first audio output device. In this method, when the electronic device displays content on the display screen, it can use the audio output device with the highest priority in the sound zone associated with the display screen to play the corresponding audio. Based on this method, the electronic device can flexibly select the audio output device that plays the audio corresponding to the content on different display screens, and no manual intervention is required, so the control efficiency is high.

[0095] In one possible design, selecting the audio output device with the highest priority among the at least one audio output device as the first audio output device includes: obtaining a priority ranking of at least one audio output device associated with the first sound zone; and selecting the audio output device with the highest priority among the at least one audio output device as the first audio output device based on the priority ranking of the at least one audio output device.

[0096] In one possible design, determining the first sound zone based on the first display screen includes: selecting a candidate sound zone associated with the first display screen from the multiple candidate sound zones as the first sound zone based on a set association relationship between the display screen and the candidate sound zones; or determining the first sound zone based on a received sound zone selection operation; wherein the sound zone selection operation is used to select a candidate sound zone from the multiple candidate sound zones as the first sound zone.

[0097] In this method, the electronic device can select the sound zone associated with the display screen based on the association relationship between the pre-configured display screen and the candidate sound zones, or it can select the sound zone associated with the display screen based on user instructions. On the one hand, it can reduce manual intervention and improve efficiency, and on the other hand, it also allows manual intervention and has high flexibility.

[0098] In one possible design, obtaining the priority ranking of at least one audio output device associated with the first sound zone includes: selecting target priority information corresponding to the audio type of the first audio from multiple priority information based on the set correspondence between the audio type and the priority information; wherein each priority information in the multiple priority information is used to indicate a priority ranking of the at least one audio output device associated with the first sound zone, and different priority information corresponds to different audio types; and determining the priority ranking of the at least one audio output device based on the target priority information.

[0099] In this method, for at least one audio output device associated with the same audio zone, the priority order of the at least one audio output device is different when playing different types of audio. Therefore, the electronic device can select a more appropriate audio output device for audio playback based on the audio type to be played, thereby improving the user's listening experience and providing greater flexibility in audio control.

[0100] In one possible design, before the first audio output device does not play the first audio and uses the second audio output device to play the first audio, the method further includes:

[0101] Determine the second audio output device; wherein, determining the second audio output device includes: determining the second sound zone according to the second display screen; and selecting the audio output device with the highest priority from at least one audio output device associated with the second sound zone as the second audio output device.

[0102] In one possible design, selecting the audio output device with the highest priority among the at least one audio output device associated with the second sound zone as the second audio output device includes: obtaining a priority ranking of the at least one audio output device associated with the second sound zone; and selecting the audio output device with the highest priority among the at least one audio output device associated with the second sound zone as the second audio output device based on the priority ranking of the at least one audio output device associated with the second sound zone.

[0103] In a possible design, the first spatial area is a spatial area within a vehicle cabin, and any audio output device includes at least one of the following: a vehicle speaker, a headrest speaker, and a Bluetooth headset.

[0104] Ninthly, an embodiment of the present application provides a control method, which can improve the flexibility and practicality of controlling audio output devices to play audio in a multi-audio output device scenario. The method can be applied to a first electronic device, and the method may include: when a first content is displayed on a first display screen, using a first audio output device to play a first audio corresponding to the first content; wherein the first display screen is any one of a plurality of display screens located in a first spatial area; in response to a received first operation, the first content is displayed on the first display screen, and the first content is displayed on the second display screen; or, in response to a received second operation, a first sub-content is displayed on the first display screen, and a second sub-content is displayed on the second display screen; wherein the first content includes the first sub-content and the second sub-content; using a second audio output device and a third audio output device to play the first audio; or using an audio output device of a set type located in the first spatial area to play the first audio; wherein the second display screen is included in the plurality of display screens, and the first audio output The device is associated with a first sound zone, the second audio output device is associated with the first sound zone, and the third audio output device is associated with a second sound zone; the first sound zone is a candidate sound zone associated with the first display screen among multiple candidate sound zones, and the second sound zone is a candidate sound zone associated with the second display screen among the multiple candidate sound zones; among the multiple candidate sound zones, each candidate sound zone is associated with one or more audio output devices within the first spatial area; and / or the first audio output device includes at least one audio output device of the same type, the second audio output device includes at least one audio output device of the same type, and the third audio output device includes at least one audio output device of the same type; wherein the type includes at least one of the following: a state type for indicating the dynamic or static state of the audio output device; a location type for indicating the location range of the audio output device; and a device type of the audio output device. The interface where the first content is located is the first interface.

[0105] In this method, in a scenario where there are multiple display screens and multiple audio output devices in a spatial area, when the electronic device displays content on the display screen and plays the corresponding audio, it can select a sound zone associated with the display screen from multiple sound zones and use the audio output device associated with the sound zone to play the audio. When the content on a display screen is copied or partially transferred to another display screen for display, the electronic device can also flexibly select the audio output device used to play the audio after the transfer. Based on this method, the control device can use the sound zones to partition the display screens and audio output devices in the spatial area, and with the sound zones as a reference, flexibly select the audio output device for playing the audio corresponding to the content on each display screen, without the need for manual intervention, so the control efficiency is relatively high. It can also adapt to audio control needs in more and more common scenarios, and has high versatility and practicality.

[0106] In one possible design, the second audio output device is the same as the first audio output device; and / or the second audio output device is of the same type as the third audio output device.

[0107] In this method, when content on one display screen is partially transferred to another display screen for display, the electronic device can continue to play the audio corresponding to the content using the audio output device used before the transfer, while simultaneously playing the audio corresponding to the content using the audio output device corresponding to the transferred display screen, thereby ensuring the listening experience of users corresponding to different display screens. Alternatively, the electronic device can switch to a new audio output device of the same type for playback, facilitating unified audio playback effects and unified management.

[0108] In one possible design, in response to a received first operation, the first content is displayed on the first display screen, and after the first content is displayed on the second display screen, the method further includes: in response to a received third operation, the first display screen does not display the first content, and continues to display the first content on the second display screen; plays the first audio only using the audio output device associated with the second sound zone, and the audio output device associated with the first sound zone does not play the first audio; or, in response to a received fourth operation, continues to display the first content on the first display screen, and does not display the first content on the second display screen; plays the first audio using the audio output device associated with the first sound zone, and does not play the first audio.

[0109] In this method, when content is being duplicated, both displays display the same content, and the audio output devices associated with both displays play the audio corresponding to that content. When one display no longer displays the content, the electronic device can disable the audio output device associated with that display and continue to display the content and play the corresponding audio using the other display. This method can meet the needs of users of each display and improve the user experience.

[0110] In one possible design, in response to a received second operation, the first sub-content is displayed on the first display screen, and after the second sub-content is displayed on the second display screen, the method further includes: in response to a received fifth operation, the second display screen does not display the second sub-content, and the first content is displayed on the first display screen; the first audio is played using the audio output device associated with the first sound zone, and the audio output device associated with the second sound zone does not play the first audio; or, in response to a received sixth operation, the first sub-content is not displayed on the first display screen, and the first content is displayed on the second display screen; the first audio is played using the audio output device associated with the second sound zone, and the audio output device associated with the first sound zone does not play the first audio.

[0111] In this method, in a scenario where content is displayed in a spliced ​​manner, two display screens display the same content, and the audio output devices associated with both display screens play the audio corresponding to the content. When one display screen no longer displays the content, the electronic device can turn off the audio output device associated with that display screen, and use the other display screen to display the complete content while continuing to play the corresponding audio using the audio output device associated with that display screen. This method can meet the needs of the users corresponding to each display screen and improve the user experience.

[0112] In one possible design, before using a first audio output device to play the first audio corresponding to the first content, the method also includes: determining the first audio output device; wherein, determining the first audio output device includes: determining the first sound zone based on the first display screen; and selecting the audio output device with the highest priority among the at least one audio output device as the first audio output device.

[0113] In one possible design, selecting the audio output device with the highest priority among the at least one audio output device as the first audio output device includes: obtaining a priority ranking of at least one audio output device associated with the first sound zone; and selecting the audio output device with the highest priority among the at least one audio output device as the first audio output device based on the priority ranking of the at least one audio output device.

[0114] In one possible design, determining the first sound zone based on the first display screen includes: selecting a candidate sound zone associated with the first display screen from the multiple candidate sound zones as the first sound zone based on a set association relationship between the display screen and the candidate sound zones; or determining the first sound zone based on a received sound zone selection operation; wherein the sound zone selection operation is used to select a candidate sound zone from the multiple candidate sound zones as the first sound zone.

[0115] In one possible design, obtaining the priority ranking of at least one audio output device associated with the first sound zone includes: selecting target priority information corresponding to the audio type of the first audio from multiple priority information based on the set correspondence between the audio type and the priority information; wherein each priority information in the multiple priority information is used to indicate a priority ranking of the at least one audio output device associated with the first sound zone, and different priority information corresponds to different audio types; and determining the priority ranking of the at least one audio output device based on the target priority information.

[0116] In one possible design, before playing the first audio using the second audio output device and the third audio output device, the method further includes: determining the second audio output device; and determining the third audio output device; wherein determining the third audio output device includes: determining the second sound zone based on the second display screen; obtaining a priority ranking of at least one audio output device associated with the second sound zone; and selecting, based on the priority ranking of the at least one audio output device associated with the second sound zone, an audio output device with the highest priority among the at least one audio output device associated with the second sound zone as the third audio output device.

[0117] In a possible design, the first spatial area is a spatial area within a vehicle cabin, and any audio output device includes at least one of the following: a vehicle speaker, a headrest speaker, and a Bluetooth headset.

[0118] In the tenth aspect, the present application provides an electronic device comprising a display screen, a memory and one or more processors; wherein the memory is used to store computer program code, and the computer program code comprises computer instructions; when the computer instructions are executed by one or more processors, the electronic device executes the method described in any one of the above-mentioned first to ninth aspects or any possible design of any one of the above-mentioned first to ninth aspects.

[0119] In the eleventh aspect, the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is run on a computer, the computer executes the method described in any one of the above-mentioned aspects from the first to the ninth aspect or any possible design of any one of the above-mentioned aspects from the first to the ninth aspect.

[0120] In the twelfth aspect, the present application provides a computer program product, which includes a computer program or instructions. When the computer program or instructions are run on a computer, the computer executes the method described in any one of the above-mentioned aspects from the first to the ninth aspect or any possible design of any one of the above-mentioned aspects from the first to the ninth aspect.

[0121] In a thirteenth aspect, the present application provides a chip system, comprising a processor and a memory, wherein the memory stores instructions; when the instructions are executed by the processor, the method of any possible implementation of any one of aspects 1 to 9 is implemented. The chip system may be composed of a chip, or may include a chip and other discrete components.

[0122] For the beneficial effects of the tenth to thirteenth aspects mentioned above, please refer to the description of the beneficial effects of the corresponding contents in the first to ninth aspects mentioned above, and no further details will be given here. BRIEF DESCRIPTION OF THE DRAWINGS

[0123] FIG1 is a schematic diagram of a full-screen cross-screen flow process provided by an embodiment of the present application;

[0124] FIG2 is a schematic diagram of a plurality of task interfaces provided in an embodiment of the present application displayed in a split-screen format;

[0125] FIG3 is a schematic diagram of a task interface provided in an embodiment of the present application displayed in full screen form;

[0126] FIG4 is a schematic diagram of a task interface provided by an embodiment of the present application displayed in the form of a floating window;

[0127] FIG5 is a schematic diagram of a task interface provided by an embodiment of the present application displayed in the form of a floating icon;

[0128] FIG6 is a schematic diagram of a task interface provided by an embodiment of the present application displayed in a picture-in-picture format;

[0129] FIG7 is a schematic diagram of a task interface provided in an embodiment of the present application displayed in the form of a card;

[0130] FIG8 is a schematic diagram of two task interfaces provided in an embodiment of the present application displayed in the form of notifications;

[0131] FIG9A is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0132] FIG9B is a schematic diagram of the distribution of display screens of an in-vehicle terminal provided in an embodiment of the present application;

[0133] FIG9C is a schematic diagram of the software structure of an electronic device provided in an embodiment of the present application;

[0134] FIG10 is a flow chart of a vehicle interface transfer method provided by an embodiment of the present application;

[0135] FIG11 is a schematic diagram of a process of displaying multiple task interfaces on a display screen provided by an embodiment of the present application;

[0136] FIG12 is a schematic diagram of another process of displaying multiple task interfaces on a display screen according to an embodiment of the present application;

[0137] FIG13 is a schematic diagram of a gesture for representing an interface flow intention provided by an embodiment of the present application;

[0138] FIG14A is a schematic diagram of a process of obtaining information related to a sliding event by a vehicle-mounted terminal according to an embodiment of the present application;

[0139] FIG14B is a schematic diagram showing a corresponding relationship between a sliding direction and a target screen according to an embodiment of the present application;

[0140] FIG14C is a schematic diagram of a scenario for representing the intention of interface flow provided by an embodiment of the present application;

[0141] FIG14D is a schematic diagram of another scenario for representing the intention of interface flow provided by an embodiment of the present application;

[0142] FIG15 is a first schematic diagram of cross-screen flow provided by an embodiment of the present application;

[0143] FIG16 is a second schematic diagram of cross-screen flow provided by an embodiment of the present application;

[0144] FIG17 is a third schematic diagram of cross-screen flow provided by an embodiment of the present application;

[0145] FIG18 is a fourth schematic diagram of cross-screen flow provided by an embodiment of the present application;

[0146] FIG19 is a fifth schematic diagram of cross-screen flow provided by an embodiment of the present application;

[0147] FIG20 is a sixth schematic diagram of cross-screen flow provided by an embodiment of the present application;

[0148] FIG21 is a seventh schematic diagram of cross-screen flow provided by an embodiment of the present application;

[0149] FIG22 is a schematic diagram eight of cross-screen flow provided by an embodiment of the present application;

[0150] FIG23 is a ninth schematic diagram of cross-screen transfer provided by an embodiment of the present application;

[0151] FIG24 is a schematic diagram of cross-screen flow provided in an embodiment of the present application;

[0152] FIG25 is a schematic diagram 11 of cross-screen flow provided by an embodiment of the present application;

[0153] FIG26 is a schematic diagram 12 of cross-screen flow provided in an embodiment of the present application;

[0154] FIG27 is a thirteenth schematic diagram of cross-screen flow provided in an embodiment of the present application;

[0155] FIG28A is a schematic diagram 15 of cross-screen flow provided in an embodiment of the present application;

[0156] FIG28B is a sixteenth schematic diagram of cross-screen flow provided in an embodiment of the present application;

[0157] FIG29 is a schematic diagram seventeen of cross-screen flow provided in an embodiment of the present application;

[0158] FIG30 is a schematic diagram eighteen of cross-screen flow provided in an embodiment of the present application;

[0159] FIG31 is a nineteenth schematic diagram of cross-screen flow provided in an embodiment of the present application;

[0160] FIG32 is a schematic diagram 20 of cross-screen flow provided in an embodiment of the present application;

[0161] FIG33 is a schematic diagram 21 of cross-screen flow provided by an embodiment of the present application;

[0162] FIG34 is a first diagram of same-screen streaming provided by an embodiment of the present application;

[0163] FIG35 is a second schematic diagram of same-screen flow provided by an embodiment of the present application;

[0164] FIG36 is a third diagram of same-screen streaming provided by an embodiment of the present application;

[0165] FIG37 is a first schematic diagram of reverse flow provided in an embodiment of the present application;

[0166] FIG38 is a second schematic diagram of reverse flow provided in an embodiment of the present application;

[0167] FIG39 is a schematic diagram 22 of cross-screen flow provided by an embodiment of the present application;

[0168] FIG40 is a schematic diagram of touch areas when different users perform touch operations according to an embodiment of the present application;

[0169] FIG41 is a schematic diagram of an application scenario of a multi-screen collaborative display method provided in an embodiment of the present application;

[0170] FIG42 is a schematic diagram of the architecture of a control system provided in an embodiment of the present application;

[0171] FIG43 is a schematic diagram of a multi-screen collaborative display method provided in an embodiment of the present application;

[0172] FIG44 is a schematic diagram of the architecture of a control system provided in an embodiment of the present application;

[0173] FIG45 is a schematic diagram of a multi-screen collaborative display method provided in an embodiment of the present application;

[0174] FIG46 is a schematic diagram of the architecture of a control system provided in an embodiment of the present application;

[0175] FIG47 is a schematic diagram of a multi-screen collaborative display method provided in an embodiment of the present application;

[0176] FIG48 is a schematic diagram of a Gaussian blur processing method provided in an embodiment of the present application;

[0177] FIG49 is a schematic diagram of an interface for Gaussian blur processing provided in an embodiment of the present application;

[0178] FIG50 is a schematic diagram of a method for pure color gradient processing provided in an embodiment of the present application;

[0179] FIG51 is a schematic diagram of an interface with a pure color gradient process provided by an embodiment of the present application;

[0180] FIG52 is a schematic diagram of a method for processing particle motion effects provided by an embodiment of the present application;

[0181] FIG53 is a schematic diagram of an interface for particle motion effect processing provided by an embodiment of the present application;

[0182] FIG54 is a schematic diagram of an interface for particle motion effect processing provided by an embodiment of the present application;

[0183] FIG55 is a schematic diagram of an interface for particle motion effect processing provided by an embodiment of the present application;

[0184] FIG56 is a schematic diagram of the architecture of a control system provided in an embodiment of the present application;

[0185] FIG57 is a schematic diagram of a sound zone division in a vehicle cabin according to an embodiment of the present application;

[0186] FIG58 is a schematic diagram of the functional hierarchy architecture of a control device provided in an embodiment of the present application;

[0187] FIG59 is a flow chart of an audio control method provided in an embodiment of the present application;

[0188] FIG60 is a schematic diagram of an audio playback method provided in an embodiment of the present application;

[0189] FIG61 is a schematic diagram of factors affecting audio control provided by an embodiment of the present application;

[0190] FIG62 is a schematic diagram of an audio control scenario and control method provided in an embodiment of the present application;

[0191] FIG63 is a schematic diagram of an audio control scenario and control method provided in an embodiment of the present application;

[0192] FIG64A is a schematic diagram of an audio control scenario and control method provided in an embodiment of the present application;

[0193] FIG64B is a schematic diagram of an audio control scenario and control method provided in an embodiment of the present application;

[0194] FIG65 is a schematic diagram of an audio control scenario and control method provided in an embodiment of the present application;

[0195] FIG66 is a schematic diagram of an audio control scenario and control method provided in an embodiment of the present application;

[0196] FIG67 is a schematic diagram of an audio control scenario and control method provided in an embodiment of the present application;

[0197] FIG68 is a schematic diagram of an audio control scenario and control method provided in an embodiment of the present application;

[0198] FIG69 is a schematic diagram of an audio control scenario and control method provided in an embodiment of the present application;

[0199] FIG70 is a schematic diagram of an audio control scenario and control method provided in an embodiment of the present application;

[0200] FIG71 is a flow chart of an audio control method provided in an embodiment of the present application;

[0201] FIG72A is a schematic diagram of an audio control scenario and control method provided in an embodiment of the present application;

[0202] FIG72B is a schematic diagram of an audio control scenario and control method provided in an embodiment of the present application;

[0203] FIG73 is a schematic diagram of a flow chart of an audio control method provided in an embodiment of the present application;

[0204] FIG74A is a schematic diagram of an audio control scenario and control method provided in an embodiment of the present application;

[0205] FIG74B is a schematic diagram of an audio control scenario and control method provided in an embodiment of the present application;

[0206] FIG74C is a schematic diagram of an audio control scenario and control method provided in an embodiment of the present application;

[0207] FIG75A is a schematic diagram of an audio control scenario and control method provided in an embodiment of the present application;

[0208] FIG75B is a schematic diagram of an audio control scenario and control method provided in an embodiment of the present application;

[0209] FIG76 is a schematic diagram of an audio control method provided in an embodiment of the present application;

[0210] FIG77 is a schematic diagram of an audio control method provided in an embodiment of the present application;

[0211] Figure 78 is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0212] In order to make the purpose, technical solutions and advantages of the embodiments of the present application more clear, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings. In the description of the embodiments of the present application, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features.

[0213] It should be understood that in the embodiments of the present application, "at least one" refers to one or more, and "more" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can represent: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c can be single or multiple.

[0214] Vehicles are increasingly equipped with display screens, and users are increasingly demanding cross-screen interactions (e.g., cross-screen transitions, collaborative operations, etc.) across different displays. Currently, however, interactions between in-vehicle displays typically involve full-screen transitions, which struggles to meet users' diverse interaction needs. Therefore, how to efficiently transition between interfaces and provide users with intelligent displays that meet their needs and preferences is a challenge that requires research.

[0215] In addition, as the number of display screens in vehicles increases, immersive technology based on multiple screens is also developing. Currently, immersive technology based on multiple screens mainly includes two forms: multiple screens copying and displaying the same screen or multiple screens splicing and displaying the same screen. Among them, multi-screen splicing is widely used to create an immersive experience. For example, after the passengers get on the bus, multiple screens can be spliced ​​to display the startup animation; while the vehicle is driving, multiple screens can be spliced ​​to display the navigation interface; when playing a video, multiple screens can be spliced ​​to display the video interface, etc. These methods of splicing display screens have high requirements for display content, and generally they are display contents of customized sizes by specific manufacturers. Therefore, they can only be used in specific scenarios (such as pre-set scenarios such as start-up effects, nap mode, maps and music rhythm effects), and the immersive experience they can provide is limited, resulting in low practicality.

[0216] In addition to display devices, vehicles are increasingly equipped with audio output devices (such as speakers). Taking the vehicle cockpit as an example, current audio output devices include in-cabin speakers, headrest speakers, and Bluetooth headsets. Users in different locations within the vehicle cockpit may have different audio listening needs, necessitating flexible selection of audio output devices based on their needs. Furthermore, displays at different locations may display different content, corresponding to different audio playback requirements. Therefore, the audio output devices used for different displays also require corresponding adjustments. For in-cabin audio control, the current approach primarily involves allowing users to manually select a desired audio playback mode from a variety of preset audio playback modes. Once the user selects a mode, the audio output devices within the vehicle cockpit play audio according to the selected mode. Different audio playback modes correspond to different audio output devices or methods. These audio control solutions require manual intervention, and the user's selectable audio playback modes are limited, requiring control to be performed according to a fixed, pre-set pattern. This results in a relatively rigid audio playback control process, resulting in limited flexibility and practicality.

[0217] In view of the above problems, an embodiment of the present application provides a control method for controlling the content display mode and audio playback mode in a multi-screen scenario, thereby improving the flexibility and practicality of the control.

[0218] The methods provided in the embodiments of the present application include interface flow methods in multi-screen scenarios, multi-screen collaborative display methods, audio control methods and other methods. Among them, the interface flow method can be used to realize the cross-screen flow of the display interface between different display screens. In some embodiments, the method can also realize the same-screen cross-region (or cross-position) flow of the display interface on the same display screen. The multi-screen collaborative display method is used to achieve the effect of collaborative display of multiple display screens, thereby providing users with an immersive viewing experience. The audio control method is used to control the way of playing the audio corresponding to the display screen, and is also used to realize audio flow between different display screens.

[0219] To facilitate understanding, the following first briefly introduces some names or terms that may appear in the embodiments of this application:

[0220] (1) Split-screen display

[0221] In the embodiment of the present application, the "split screen display" refers to dividing the display screen into multiple areas, each area displaying an application window of a task interface. At the same time, application windows of multiple task interfaces can be displayed in multiple areas of the display screen respectively.

[0222] For example, please refer to Figure 2, which shows a schematic diagram of a split-screen display of multiple task interfaces provided by an embodiment of the present application. Interface A and interface B shown in Figure 2 are displayed in split-screen form on display screen 100. Interface A and interface B can be task interfaces of the same application or task interfaces of different applications.

[0223] (2) Full screen display

[0224] In the embodiment of the present application, "full screen display" refers to: displaying an application window of a task interface in full screen on a display screen. Among them, displaying a task interface in full screen on a display screen means displaying this task interface in all display areas available for display on the display screen.

[0225] It should be noted that, in the embodiment of the present application, the full-screen display of a task interface on the display screen does not mean that the display screen will not display other interface elements at the same time. For example, while the display screen displays the above-mentioned task interface in full screen, it can also display a status bar. Among them, the status bar can display information such as the network identifier of the vehicle terminal (such as the wireless fidelity (WI-FI) network identifier, etc.) and the remaining power identifier. Of course, when the display screen displays the above-mentioned task interface in full screen, it can not only display the above-mentioned status bar, but may also display other interface elements, which will not be described in detail in the embodiment of the present application.

[0226] For example, please refer to Figure 3, which shows a schematic diagram of a task interface provided by an embodiment of the present application displayed in full screen format.

[0227] (3) Application Window

[0228] The "application window" in the embodiments of this application refers to the basic unit of a graphical user interface (GUI) that an application uses to access data. The application can be an application integrated into the device's operating system (such as Bluetooth, a gallery, etc.) or a user-installed application (such as a map application, music application, video application, email application, shopping application, etc.), and this embodiment of the application does not limit this.

[0229] In an embodiment of the present application, the application window is such as a video application window, a navigation application window, a music application window, etc.

[0230] Exemplarily, application windows include full-screen application windows and split-screen application windows. For example, referring to FIG2 , interface A and interface B shown in FIG2 are window application interfaces, and the windows containing interface A and interface B are displayed in split-screen on display screen 100. For another example, referring to FIG3 , interface C shown in FIG3 is a window application interface, and the window containing interface C is displayed in full-screen on display screen 100.

[0231] (4) Floating window

[0232] In the embodiments of this application, the "floating window" refers to a movable window that is displayed floating on a display screen. For example, the floating window can be displayed floating above the application window displayed on the display screen, and any user operations on the lower layer (such as operations on the application window) will not affect the display of the floating window (including display position, display type, etc.).

[0233] For example, please refer to Figure 4, which shows a schematic diagram of a task interface provided by an embodiment of the present application displayed in the form of a floating window. In Figure 4, the window application interface E is displayed full screen on the display screen 100, and the interface D is displayed in a floating window 401. The floating window 401 is displayed floatingly above the window application interface E. User operations in the lower layer (such as operations on the interface E) will not affect the display of the floating window.

[0234] (5) Floating Icon

[0235] In the embodiments of the present application, the "floating icon" refers to a movable icon that is displayed floating on a display screen. For example, the floating icon can be displayed floating above the application window displayed on the display screen, and any user operation on the application window will not affect the display of the floating icon (including display position, display type, etc.).

[0236] For example, please refer to Figure 5, which shows a schematic diagram of a task interface provided by an embodiment of the present application displayed in the form of a floating icon. Among them, the window application interface E shown in Figure 5 is displayed in full screen on the display screen 100, and the icon 501 is displayed in a floating manner on the upper layer of the window application interface E. The user's operation on the lower layer (such as the operation on the interface E) will not affect the display of the icon 501. Icon 501 can correspond to the task interface D. For example, the vehicle terminal can respond to the user's access operation to the icon 501 and display the task interface corresponding to the icon 501 (i.e., the interface D shown in Figure 4).

[0237] (6) Picture-in-picture (PiP)

[0238] The "picture-in-picture" described in the embodiment of the present application refers to a video screen (referred to as the "sub-screen") being independently presented in an overlaid form on another interface (such as another video screen (referred to as the "main screen")), where the sub-screen can always be superimposed on the main screen, and any operation of the user on the main screen will not affect the display of the sub-screen (including display position, display type, etc.).

[0239] For example, please refer to Figure 6, which shows a schematic diagram of a task interface provided by an embodiment of the present application displayed in picture-in-picture format. In particular, the video application interface 601 shown in Figure 6 is displayed full screen on the display screen 100, and the video screen 602 is superimposed and displayed on the video application interface 601. User operations on the video application interface 601 will not affect the display of the sub-screen.

[0240] (7) Cards

[0241] The "card" described in the embodiment of the present application is also called a "service card", which means that some important interface information or operation entrances are placed in front of the card to achieve the purpose of direct service.

[0242] As a possible form, the cards can be displayed independently on the display.

[0243] As another possible form, cards can be embedded in other applications and displayed as part of their interface, and support functions such as pulling up pages.

[0244] For example, please refer to Figure 7, which shows a schematic diagram of a task interface provided by an embodiment of the present application displayed in card format. The display screen 100 shown in Figure 7 displays a navigation card interface 701, a weather card interface 702, and a music card interface 703. For example, in response to a user accessing a card, the in-vehicle terminal can display the corresponding detailed information interface (i.e., the task interface) for the card.

[0245] (8) Notification

[0246] The "notification" in the embodiment of the present application refers to the notification information about the application, the received message, etc. that pops up on the display screen. For example, in the embodiment of the present application, the notification is as follows: Message notifications, incoming call notifications, etc.

[0247] For example, please refer to FIG8, which shows a schematic diagram of two task interfaces provided by an embodiment of the present application displayed in the form of notifications. Among them, the interface C shown in FIG8 (a) and FIG8 (b) is displayed on the display screen 100. When the message is received, the vehicle terminal displays the following (a) in FIG8 Optionally, the vehicle terminal can respond to the user's response to the notification. Message access operation, showing the Alternatively, upon receiving a new video call request, the vehicle terminal displays a notification of a pending video call as shown in (b) of FIG8 . Optionally, the vehicle terminal may display a detailed information interface of the video call (i.e., a task interface) in response to the user answering the notified video call. Alternatively, the vehicle terminal may hang up the video call in response to the user rejecting the notified video call.

[0248] (9) Vehicle-mounted terminal

[0249] The vehicle-mounted terminal described in the embodiments of the present application is a terminal device set on a vehicle. For example, the vehicle-mounted terminal can be integrated into the vehicle. Optionally, the vehicle-mounted terminal can also be independent of the vehicle and installed on the vehicle.

[0250] In the embodiments of this application, the term "vehicle" does not specifically refer to a specific type of transportation. Alternatively, the vehicle can be a ground-based transportation vehicle, such as a car, bus, subway, high-speed rail, etc. Alternatively, the vehicle can be a water-based transportation vehicle, such as a boat, hovercraft, submarine, etc. Alternatively, the vehicle can be an air-based transportation vehicle, such as an airplane, helicopter, etc.

[0251] (10) Electronic equipment

[0252] The electronic device may be a device with a display function. Alternatively, the electronic device may be a device with one or more display screens.

[0253] In some embodiments of the present application, the electronic device may be a vehicle-mounted terminal.

[0254] In other embodiments of the present application, the electronic device may be a portable device, such as a mobile phone, a tablet computer, a wearable device with wireless communication capabilities (e.g., a watch, a bracelet, a helmet, a headset, etc.), an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), etc. The electronic device may also be a smart home device (e.g., a smart TV, a smart speaker, etc.), a smart car, a smart robot, workshop equipment, a wireless terminal in self-driving, a wireless terminal in remote medical surgery, a wireless terminal in a smart grid, a wireless terminal in transportation safety, a wireless terminal in a smart city, a wireless terminal in a smart home, or an aerial device (e.g., a smart robot, a hot air balloon, a drone, an airplane), etc.

[0255] In some embodiments of the present application, the electronic device may also be a portable terminal device that also includes other functions such as a personal digital assistant and / or a music player. Or a portable terminal device with other operating systems. The portable terminal device may also be other portable terminal devices, such as a laptop computer with a touch-sensitive surface (e.g., a touch panel). It should also be understood that in some other embodiments of the present application, the electronic device may not be a portable terminal device, but a desktop computer with a touch-sensitive surface (e.g., a touch panel).

[0256] The following is an exemplary introduction to the structure of the device to which the method provided in the embodiments of the present application is applicable.

[0257] As an example, please refer to Figure 9A, which shows a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. Optionally, the electronic device can be a vehicle-mounted terminal.

[0258] As shown in FIG9A , electronic device 900 may include a processor 910, an external memory interface 920, an internal memory 921, a universal serial bus (USB) interface 930, a charging management module 940, a power management module 941, a battery 942, antenna 1, antenna 2, a mobile communication module 950, a wireless communication module 960, an audio module 970, a speaker 970A, a receiver 970B, a microphone 970C, an earphone interface 970D, a sensor module 980, a button 990, a motor 991, an indicator 992, a camera 993, a display 994, and a SIM card interface 995. The sensor module 980 may include a gyroscope sensor, an acceleration sensor, a proximity light sensor, a fingerprint sensor, a touch sensor, a temperature sensor, a pressure sensor, a distance sensor, a magnetic sensor, an ambient light sensor, an air pressure sensor, a bone conduction sensor, and the like.

[0259] It is understood that the electronic device 900 shown in FIG9A is merely an example and does not limit the electronic device, and the electronic device may have more or fewer components than shown in the figure, may combine two or more components, or may have a different component configuration. The various components shown in FIG9A may be implemented in hardware, including one or more signal processing and / or application-specific integrated circuits, software, or a combination of hardware and software.

[0260] The processor 910 may include one or more processing units. For example, the processor 910 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.

[0261] The controller can be the nerve center and command center of electronic device 900. Based on instruction opcodes and timing signals, the controller generates operational control signals to control instruction fetching and execution. A digital signal processor processes digital signals, not only digital image signals, but also other digital signals. For example, when an electronic device selects a frequency, the digital signal processor performs a Fourier transform on the frequency energy. A video codec compresses or decompresses digital video. An electronic device can support one or more video codecs. This allows the device to play or record videos in a variety of encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4. The NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and can also continuously self-learn. The NPU can enable intelligent cognitive applications in electronic devices, such as image recognition, face recognition, speech recognition, and text comprehension.

[0262] Processor 910 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 910 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 910. If processor 910 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 910 latency, and thus improves system efficiency.

[0263] The execution of the control method provided in the embodiment of the present application can be controlled by the processor 910 or completed by calling other components, such as calling the processing program of the embodiment of the present application stored in the internal memory 921, or calling the processing program of the embodiment of the present application stored in a third-party device through the external memory interface 920, to control the wireless communication module 960 to communicate data with other devices, thereby improving the intelligence and convenience of the electronic device 900 and enhancing the user experience. The processor 910 can include different devices. For example, when a CPU and a GPU are integrated, the CPU and the GPU can cooperate to execute the control method provided in the embodiment of the present application. For example, part of the algorithm in the control method is executed by the CPU, and another part of the algorithm is executed by the GPU to obtain faster processing efficiency.

[0264] In some embodiments, the processor 910 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO), a subscriber identity module interface, and / or a universal serial bus interface.

[0265] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 910 may include multiple I2C bus interfaces. The processor 910 can be coupled to the touch sensor, microphone, camera 993, etc. through different I2C bus interfaces.

[0266] For example, in an embodiment of the present application, the processor 910 can be coupled to a touch sensor via an I2C interface, so that the processor 910 and the touch sensor communicate via the I2C bus interface, thereby realizing the touch function of the electronic device. Alternatively, the processor 910 can be coupled to a camera 993 via an I2C interface, so that the processor 910 and the camera 993 communicate via the I2C bus interface, thereby realizing the image acquisition function of the electronic device.

[0267] In some embodiments of the present application, the processor 910 can obtain touch operations such as clicking, long pressing, preset gesture operations or dragging operations performed by the user on the display screen detected by the touch sensor through the I2C bus interface, thereby determining the specific intention corresponding to the touch operation, and then responding to the touch operation, such as cross-screen interface flow, same-screen interface flow, audio flow, etc.

[0268] Further optionally, when the touch sensor detects a user touch operation on the display screen, the processor 910 may obtain image information captured by the camera 993 via the I2C bus interface, thereby identifying the user who input the touch operation and enabling the corresponding interface flow based on the user's identity. For example, upon receiving an operation to launch an application on the main driver's screen and identifying the user as a passenger based on the image information captured by the camera 993, the electronic device may directly respond to the application launch operation by displaying the application interface on the passenger's screen.

[0269] The I2S interface can be used for audio communication. In some embodiments, the processor 910 can include multiple I2S buses. The processor 910 can be coupled to the audio module 970 via the I2S bus to enable communication between the processor 910 and the audio module 970. In some embodiments, the audio module 970 can transmit audio signals to the wireless communication module 960 via the I2S interface, enabling the function of answering calls through a Bluetooth headset.

[0270] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 970 and the wireless communication module 960 can be coupled via a PCM bus interface. In some embodiments, the audio module 970 can also transmit audio signals to the wireless communication module 960 via the PCM interface, enabling the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0271] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 910 and the wireless communication module 960. For example, the processor 910 communicates with the Bluetooth module in the wireless communication module 960 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 970 can transmit audio signals to the wireless communication module 960 via the UART interface, enabling the function of playing music through Bluetooth headphones.

[0272] The MIPI interface can be used to connect the processor 910 to peripheral devices such as the display 994 and the camera 993. MIPI interfaces include the camera serial interface (CSI) and the display serial interface (DSI). In some embodiments, the processor 910 and the camera 993 communicate via the CSI interface to implement the image acquisition function of the electronic device. The processor 910 and the display 994 communicate via the DSI interface to implement the display function of the electronic device.

[0273] The GPIO interface can be configured via software. It can be configured as either a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 910 to the camera 993, display 994, wireless communication module 960, audio module 970, sensor module 980, and the like. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, and the like.

[0274] USB interface 930 is an interface that complies with USB standards and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. USB interface 930 can be used to transfer data between an electronic device and peripheral devices (such as a mobile phone or speaker). It can also be used to connect headphones to play audio. This interface can also be used to connect other electronic devices, such as gaming devices.

[0275] It should be understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is only for illustrative purposes and does not constitute a structural limitation on the electronic device. In other embodiments of the present application, the electronic device may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0276] The display screen 994 is used to display images, videos, etc. The display screen 994 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 900 may include one or N display screens 994, where N is a positive integer greater than 1. The display screen 994 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces (GUIs). For example, the display screen 994 can display photos, videos, web pages, or files.

[0277] In the embodiment of the present application, the display screen 994 can be an integrated flexible display screen, or a spliced ​​display screen consisting of two rigid screens and a flexible screen located between the two rigid screens.

[0278] In the embodiment of the present application, the electronic device may include multiple display screens 994. For example, as shown in FIG9B , for an electronic device in a car, such as an onboard terminal, the onboard terminal may include a main driver's screen, a passenger driver's screen, a left rear screen, and a right rear screen. For another example, for an electronic device in a bus, such as an onboard terminal, the onboard terminal may include a main driver's screen and one or more display screens located within the bus compartment.

[0279] Electronic devices implement display functions through a graphics processing unit (GPU), display screen 994, and an application processor. A GPU is a microprocessor for image processing that connects display screen 994 and the application processor. The GPU performs data and geometry calculations for graphics rendering. Processor 910 may include one or more GPUs that execute program instructions to generate or modify display information.

[0280] In an embodiment of the present application, the GPU may be used for interface rendering. Display screen 994 may be used to display interfaces. For example, the interfaces may include, but are not limited to, application interfaces (such as browser interfaces, office application interfaces, email interfaces, news application interfaces, map application interfaces, social application interfaces, etc.), floating windows, floating icons, floating balls, picture-in-picture, cards, notifications, mini-program interfaces, and other interfaces.

[0281] The camera 993 (a front camera or a rear camera, or one camera can be used as both a front camera and a rear camera) is used to capture still images or videos. Generally, the camera 993 may include a photosensitive element such as a lens group and an image sensor, wherein the lens group includes a plurality of lenses (convex lenses or concave lenses) for collecting light signals reflected by the object to be photographed and transmitting the collected light signals to the image sensor. The image sensor generates an original image of the object to be photographed based on the light signal. Exemplarily, the object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard three primary colors (red, green, blue, RGB), YUV or other format.

[0282] In this embodiment of the present application, the electronic device may include one or more cameras 993.

[0283] The electronic device can implement image acquisition functions (such as taking photos or shooting) through an image signal processor (ISP), a camera 993, a video codec, a GPU, a display 994, and an application processor. In this application, the camera 993 can be an optical zoom lens, etc., and this application does not limit this.

[0284] The ISP processes data fed back by the camera 993. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within the camera 993.

[0285] The external memory interface 920 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 910 via the external memory interface 920 to implement data storage functions. For example, files such as audio, video, and images can be stored on the external memory card.

[0286] The internal memory 921 can be used to store computer executable program code, which includes instructions. The processor 910 executes various functional applications and data processing of the electronic device 900 by running the instructions stored in the internal memory 921. The internal memory 921 may include a program storage area and a data storage area. Among them, the program storage area can store the code of the operating system, at least one application required for a function, etc. The data storage area can store data (such as task cards, etc.) created during the use of the electronic device 900.

[0287] The internal memory 921 may also store one or more computer programs corresponding to the algorithms of the control methods provided in the embodiments of the present application. The one or more computer programs are stored in the internal memory 921 and configured to be executed by the one or more processors 910. The one or more computer programs include instructions, which can be used to perform the various steps in the following embodiments.

[0288] In addition, the internal memory 921 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0289] Of course, the code of the algorithm of the control method provided in the embodiment of the present application can also be stored in an external memory. In this case, the processor 910 can run the code of the algorithm of the control method stored in the external memory through the external memory interface 920.

[0290] Touch sensor, also known as "touch panel". The touch sensor can be set on the display screen 994, and the touch sensor and the display screen 994 form a touch display screen, also known as a "touch screen". The touch sensor is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation (including information such as touch position, touch force, contact area and touch duration) to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 994. In other embodiments, the touch sensor can also be set on the surface of the electronic device 900, which is different from the position of the display screen 994.

[0291] In an embodiment of the present application, the touch operation detected by the touch sensor can be an operation performed by a user through a finger on or near the touch screen, or an operation performed by a user using a touch-assistive tool such as a stylus, a touch pen, or a touch ball on or near the touch screen. This application does not limit this.

[0292] The wireless communication function of the electronic device 900 can be implemented through antenna 1, antenna 2, mobile communication module 950, wireless communication module 960, modem processor and baseband processor.

[0293] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 900 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0294] The mobile communication module 950 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 900. The mobile communication module 950 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 950 can receive electromagnetic waves from the antenna 1, filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 950 can also amplify the signal modulated by the modulation and demodulation processor and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 950 can be set in the processor 910. In some embodiments, at least some of the functional modules of the mobile communication module 950 can be set in the same device as at least some of the modules of the processor 910. In an embodiment of the present application, the mobile communication module 950 can also be used to exchange information with other devices.

[0295] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 970A, the receiver 970B, etc.) or displays an image or video through the display screen 994. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 910 and be set in the same device as the mobile communication module 950 or other functional modules.

[0296] The wireless communication module 960 can provide wireless communication solutions applied to the electronic device 900, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. The wireless communication module 960 can be one or more devices integrating at least one communication processing module. The wireless communication module 960 receives electromagnetic waves via antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 910. The wireless communication module 960 can also receive signals to be transmitted from the processor 910, frequency modulate them, amplify them, and convert them into electromagnetic waves for radiation through antenna 2. In the embodiment of the present application, the wireless communication module 960 is used to establish connections with other electronic devices and exchange data. Alternatively, the wireless communication module 960 can be used to access an access point device, send control instructions to other electronic devices, or receive data sent from other electronic devices.

[0297] In addition, the electronic device 900 can implement audio functions such as music playback and recording through the audio module 970, speaker 970A, receiver 970B, microphone 970C, headphone jack 970D, and application processor.

[0298] The audio module 970 is used to convert digital audio information into analog signal output, and is also used to convert analog audio input into digital audio signals. The audio module 970 can also be used to encode and decode audio signals. In some embodiments, the audio module 970 can be provided in the processor 910, or some functional modules of the audio module 970 can be provided in the processor 910.

[0299] The speaker 970A, also called a "speaker," is used to convert audio electrical signals into sound signals. The electronic device can allow a user to listen to audio or make hands-free calls through the speaker 970A.

[0300] The receiver 970B, also called the "earpiece", is used to convert audio electrical signals into sound signals.

[0301] Microphone 970C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 970C to input the sound signal into the microphone 970C. In the present application, the electronic device can be provided with at least two microphones 970C, such as a local microphone or a wireless microphone. In other embodiments, the electronic device can be provided with three, four or more microphones 970C to realize functions such as collecting sound signals and noise reduction. In an embodiment of the present application, the electronic device can collect sound signals in the real world through the microphone 970C.

[0302] The electronic device 900 can receive input from the key 990 and generate key signal input related to the user settings and function control of the electronic device 900. The electronic device 900 can use the motor 991 to generate a vibration prompt (such as an incoming call vibration prompt). The indicator 992 in the electronic device 900 can be an indicator light, which can be used to indicate the charging status, power changes, and can also be used to indicate messages, missed calls, notifications, etc. The SIM card interface 995 in the electronic device 900 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 900 by inserting it into the SIM card interface 995 or pulling it out from the SIM card interface 995.

[0303] The power management module 940 is used to provide power to the processor 910 , the internal memory 921 , the display screen 994 , the camera 993 , the wireless communication module 963 , and the like.

[0304] It should be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device. In practical applications, the electronic device 900 may include more or fewer components than those shown in FIG9A , and the embodiment of the present application is not limited thereto. The illustrated electronic device 900 is only an example, and the electronic device 900 may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.

[0305] The software system of the electronic device 900 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present application, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device.

[0306] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. As shown in Figure 9C, this software architecture can be divided into four layers: the application layer, the application framework (FWK), the runtime and system libraries, and the Linux kernel layer.

[0307] The application layer is the top layer of the operating system, including native applications of the operating system, such as camera, gallery, calendar, Bluetooth, music, video, information, etc. The application involved in the embodiment of the present application is referred to as application, which is a software program that can realize one or more specific functions. Generally, multiple applications can be installed in an electronic device. For example, a camera application, an email application, a smart home control application, etc. The application mentioned below can be a system application that is installed on the electronic device when it leaves the factory, or it can be a third-party application that the user downloads from the Internet or obtains from other electronic devices while using the electronic device.

[0308] Developers can, of course, write applications and install them into this layer. In one possible implementation, applications can be developed using the Java language by calling the Application Programming Interface (API) provided by the application framework layer. Developers can use the application framework to interact with the underlying layers of the operating system (e.g., the kernel layer) and develop their own applications.

[0309] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions. The application framework layer may include a window manager, content provider, view system, telephony manager, resource manager, notification manager, etc.

[0310] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0311] Content providers are used to store and retrieve data and make it accessible to applications. The data may include files (such as documents, videos, images, audio), text, and other information.

[0312] The view system includes visual controls, such as those that display text, images, and documents. The view system is used to build applications. The interface within a display window can be composed of one or more views. For example, the interface for a text notification icon might include a view that displays text and a view that displays an image.

[0313] The phone manager provides communication functionality for electronic devices. The notification manager enables applications to display notifications in the status bar, which can be used to convey informational messages and automatically disappear after a short period of time without user interaction.

[0314] The runtime includes the core library and the virtual machine. The runtime is responsible for scheduling and management of the Android system.

[0315] The system's core library consists of two parts: one containing the Java language's callable functions and the other the system's core library. The application layer and application framework layer run in a virtual machine. For example, in Java, the virtual machine executes Java files from the application and framework layers as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0316] The system library can include multiple functional modules. For example: surface manager, media library, 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), image processing library, etc. The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.564, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing. The 2D graphics engine is a drawing engine for 2D drawing.

[0317] The kernel layer provides core operating system services, such as security, memory management, process management, network protocol stacks, and driver models. These services are all implemented within the kernel layer. The kernel layer also serves as an abstraction layer between the hardware and software stacks. This layer contains many drivers related to electronic devices, including: display drivers; keyboard drivers for input devices; Flash drivers for memory-based devices; camera drivers; audio drivers; Bluetooth drivers; and Wi-Fi drivers.

[0318] It should be understood that the functional services described above are only examples. In actual applications, electronic devices can also be divided into more or fewer functional services according to other factors, or the functions of each service can be divided in other ways, or the functional services can be not divided but work as a whole.

[0319] The following introduces the interface flow method, multi-screen collaborative display method and audio control method provided in the embodiments of the present application respectively.

[0320] Part 1: Interface Flow Method

[0321] The interface transfer method provided in the embodiment of the present application can realize the cross-screen transfer of the task interface on the first screen to the second screen for display. For example, the task interface can be understood as the interface corresponding to the application running on the vehicle terminal.

[0322] In some embodiments, a multitasking interface may be displayed on the first screen. Based on an embodiment of the present application, a method for transferring an interface may be provided to transfer one of the multitasking interfaces displayed on the first screen to the second screen for display, or to transfer multiple (e.g., two) of the multitasking interfaces displayed on the first screen to the second screen for display simultaneously.

[0323] In other embodiments, a task interface may be displayed on the first screen. Based on the embodiment of the present application, an interface transfer method is provided to transfer the task interface displayed on the first screen to the second screen for display.

[0324] Optionally, in other embodiments of the present application, an interface transfer method is provided based on the embodiments of the present application to realize the transfer of the task interface on the first screen from the first position to the second position of the first screen for display.

[0325] Furthermore, after the task interface on the first screen is transferred across the screen to the second screen for display, based on an interface transfer method provided in an embodiment of the present application, the task interface transferred to the second screen can also be transferred back to the first screen for display, or the task interface transferred to the second screen can be transferred to the third screen for display.

[0326] Alternatively, after the task interface on the first screen is transferred from the first position to the second position of the first screen for display on the same screen, based on an interface transfer method provided in an embodiment of the present application, the task interface transferred to the second position of the first screen can also be transferred across screens to the second screen for display, or the task interface transferred to the second position of the first screen can be transferred to the third position of the first screen for display on the same screen. The third position can be the same as the first position or different from the first position, which is not limited in the embodiment of the present application.

[0327] In particular, based on an interface transition method provided in an embodiment of the present application, when performing interface transition, the vehicle-mounted terminal can determine the display type on the target screen (e.g., the second screen) after the interface transition based on the task information of the target screen before the interface transition. The task information of the target screen before the interface transition may include the display type and / or classification information of the task interface displayed on the target screen before the interface transition.

[0328] Optionally, based on an interface flow method provided in an embodiment of the present application, when performing interface flow, the vehicle-mounted terminal can determine the display type of the interface on the target screen after the flow based on the task information of the first interface when it was displayed on the original screen (such as the first screen) before the interface flow. The task information of the first interface when it was displayed on the original screen (such as the first screen) before the interface flow includes the display type and / or classification information of the first interface when it was displayed on the original screen (such as the first screen) before the interface flow.

[0329] Optionally, an interface flow method is provided based on an embodiment of the present application. When the vehicle-mounted terminal performs interface flow, it can also determine the display type on the target screen after the interface flow based on the task information when the first interface is displayed on the original screen (such as the first screen) before the interface flow and / or the task information of the target screen (such as the second screen).

[0330] The display type of the task interface is used to characterize the presentation of the task interface. For example, the display type of the task interface may include, but is not limited to, any of the following: full screen display, split screen display, floating window, floating icon, floating ball, picture-in-picture, service card, control, or notification.

[0331] The classification information corresponding to the task interface is used to characterize whether the task interface is a preset focus application interface. Among them, the preset focus application interface is the interface of an application with a relatively high priority set by the user. It can be understood that in the in-vehicle scenario, there are some applications that are of high user attention or importance, and their display needs to be prioritized, so users can make preset focus application settings according to their specific needs. For the preset focus application interface, when displaying the interface, including the display before and after the interface flow, the in-vehicle terminal will give priority to ensuring its eye-catching display (such as full-screen display) to avoid interference from other interfaces on the interface and facilitate user viewing and / or operation.

[0332] For example, the preset focus applications may be map applications, navigation applications, or other applications related to driving safety, or applications frequently used by users, such as video applications, social applications, and entertainment applications (such as game applications, music applications, office applications, etc.). The embodiments of the present application do not specifically limit the preset focus applications.

[0333] In the embodiments of the present application, different preset focus applications may correspond to different display screens of the vehicle terminal. For example, for the main driver's screen, the corresponding preset focus application may be a map application, navigation application, or other application related to driving safety; for the passenger screen, left rear screen, or right rear screen, the corresponding preset focus application may be a video application, social application, entertainment application (such as game application, music application, office application, etc.), and other applications that the user frequently uses on the corresponding display screen.

[0334] It should be noted that the embodiment of the present application does not limit the specific display type of the task interface on the original screen and the target screen before the interface flow is performed.

[0335] As a possible structure, the original screen and the target screen described in the embodiment of the present application can belong to a vehicle-mounted terminal, and the original screen and the target screen can share the processor, memory and other modules of the vehicle-mounted terminal. In other words, the vehicle-mounted terminal can include multiple display screens, and each of the multiple display screens can work independently, for example: each can play audio and video, operate entertainment games, etc. A communication connection is established between the multiple display screens. For example, the multiple display screens can communicate with each other through a communication bus interface. For another example, the multiple display screens can communicate with each other through an in-vehicle local area network.

[0336] As another possible structure, the original screen and the target screen described in the embodiment of the present application may belong to different vehicle-mounted terminals, and a communication connection is established between the vehicle-mounted terminals. The cross-screen flow of the task interface described in the embodiment of the present application is actually a cross-device interface flow. For example, the vehicle-mounted terminals communicate through a communication bus interface or through an in-vehicle local area network.

[0337] It should be noted that in the embodiments of the present application, a screen or a display may also be referred to as a display screen. For example, the first screen may also be referred to as a first display screen; the original screen may also be referred to as an original display screen; and the target screen may also be referred to as a target display screen.

[0338] The following will specifically introduce an interface flow method provided in an embodiment of the present application, taking a vehicle terminal including multiple display screens (such as a first screen, a second screen, and a third screen) as an example of a specific embodiment.

[0339] In some embodiments, assuming that a task interface (referred to as the first task interface) is displayed on the original screen (such as the first screen), an interface flow method provided in an embodiment of the present application can realize the cross-screen flow of one or more task interfaces to the target screen (such as the second screen or the third screen) for display.

[0340] Please refer to Figure 10, which shows a flow chart of the interface transfer method provided by an embodiment of the present application. As shown in Figure 10, an interface transfer method provided by an embodiment of the present application may include S1001-S1002:

[0341] S1001: The vehicle-mounted terminal displays one or more first task interfaces through the first screen.

[0342] In some embodiments, the vehicle-mounted terminal displays a first task interface through the first screen.

[0343] In other embodiments, the vehicle-mounted terminal displays multiple first task interfaces through the first screen.

[0344] In this embodiment of the present application, one or more first task interfaces may be displayed on the first screen of the vehicle-mounted terminal in any display type.

[0345] If the vehicle terminal has a first task interface displayed through the first screen, the first task interface can be displayed in full screen on the first screen (as shown in Figure 3), or it can be displayed on the first screen desktop, notification center, control center and other pages in the form of a floating window, floating icon, floating ball, picture-in-picture, card, control or notification.

[0346] If the vehicle terminal displays multiple first task interfaces on the first screen, in some examples, each of the multiple first task interfaces may not be displayed full-screen on the first screen. For example, as shown in FIG2 , interfaces A and B are displayed split-screen on display screen 100. For another example, as shown in FIG7 , navigation card interface 701, weather interface 702, and song card interface 703 are displayed non-full-screen on display screen 100.

[0347] In other examples, one of the multiple first task interfaces can be displayed in full screen on the first screen, and the other interfaces are displayed on the first screen in the form of floating windows, floating icons, floating balls, picture-in-pictures, cards, controls, or notifications. For example, as shown in Figure 4, interface E is displayed in full screen on the display screen 100, and interface D is displayed on the display screen 100 in the form of a floating window. For another example, as shown in Figure 5, interface E is displayed in full screen on the display screen 100, and task interface D is displayed on the display screen 100 in the form of a floating icon. For another example, as shown in Figure 6, the video application interface 601 is displayed in full screen on the display screen 100, and the video screen 602 is displayed on the display screen 100 in the form of a picture-in-picture. For another example, as shown in Figure 7, interface 701 is displayed in full screen on the display screen 100, and the sports health card, memo card, and express inquiry card are displayed on the display screen 100 in the form of cards. For another example, as shown in (a) in Figure 8, interface C is displayed in full screen on the display screen 100, The notification message is displayed on the display screen 100. For another example, as shown in FIG8(b), the interface C is displayed in full screen on the display screen 100, and the notification of the video call to be answered is displayed on the display screen 100.

[0348] In an embodiment of the present application, the vehicle terminal can display multiple first task interfaces on the first screen in response to the user's operation of opening multiple first task interfaces. For example, as shown in Figure 11, when the vehicle terminal displays interface 1101 in full screen through display screen 100 (such as display screen 100 can be the first screen), in response to the user's operation of opening application 1, the vehicle terminal displays interface 1103 corresponding to application 1 on display screen 100. Among them, as shown in Figure 11, interface 1103 can be displayed on the upper layer of interface 1101 in the form of a floating window or picture-in-picture; interface 1103 and interface 1101 can also be displayed on display screen 100 in a split-screen display form.

[0349] Optionally, if the application to which the interface 1101 shown in FIG11 belongs is the preset focus application corresponding to the display screen 100, when the vehicle terminal displays the interface 1101 in full screen through the display screen 100, in response to the user's operation of opening application 1 (the user clicks the application 1 icon as shown in FIG11), the vehicle terminal can always keep the interface 1101 in full screen display and display the interface 1103 corresponding to application 1 in the form of a floating window or a picture-in-picture. Based on this, it can be ensured that the interface with relatively high attention and / or relatively high importance can be displayed prominently, avoiding interference from other interfaces on the interface, and making it convenient for users to view and operate.

[0350] Alternatively, if the application to which the interface 1101 shown in FIG11 belongs is the preset focus application corresponding to the display screen 100, when the vehicle terminal displays the interface 1101 in full screen through the display screen 100, in response to the user's operation of opening application 1, assuming that application 1 is a non-preset focus application, the vehicle terminal can display the interface 1103 corresponding to application 1 and interface 1101 on the display screen 100 in a split-screen format according to a preset ratio. For example, when displayed in split screen, the ratio of the interfaces corresponding to the preset focus application and the non-preset focus application can be 1:2 or 2:1.

[0351] Or optionally, if the application to which the interface 1101 shown in Figure 11 belongs is the preset focus application corresponding to the display screen 100, when the vehicle terminal displays the interface 1101 in full screen through the display screen 100, in response to the user's operation of opening application 1, assuming that application 1 is the preset focus application, the vehicle terminal can display the interface 1103 and interface 1101 corresponding to application 1 on the display screen 100 in a split-screen format with an interface ratio of 1:1.

[0352] Optionally, as shown in Figure 12, when the vehicle terminal displays interface 1101 in full screen through the display screen 100 shown in Figure 11, in response to the user opening application 1, if the vehicle terminal displays interface 1103 corresponding to application 1 in the form of a floating window or a picture-in-picture, the vehicle terminal can also perform interface adaptive layout adjustment (such as adaptive position adjustment) on the full-screen displayed interface 1101 to avoid interface 1103 blocking interface 1101.

[0353] As an example, if interface 1103 blocks the focus area (or focus area) on interface 1101, the vehicle terminal can adaptively adjust the position of the focus area (or focus area) of interface 1101 according to the area blocked by interface 1103 on interface 1101, so that the focus area (or focus area) of interface 1101 is not blocked by interface 1103. Among them, the focus area (or focus area) of interface 1101 can be determined by the vehicle terminal according to one or more of the following: the function of the information displayed on interface 1101, the application function corresponding to interface 1101, the type corresponding to multiple layers (Layer) on interface 1101, the user's custom settings, etc., which are not limited in the embodiments of this application. For example, when interface 1101 is the interface of a navigation application, the focus area of ​​interface 1101 can be the area where the current navigation route is displayed. Optionally, the vehicle terminal can also display multiple first task interfaces corresponding to the task combination on the first screen in response to the user's operation of opening the task combination. Alternatively, the vehicle-mounted terminal may also go through other processes until multiple first task interfaces are displayed on the first screen, which is not limited in this embodiment of the present application.

[0354] It should be noted that Figures 11 and 12 only use application icons (such as the icon of application 1 and the icon of application 2) that are always displayed (such as floating display in the figure) on the display screen 100 as an example. In some embodiments, the application icons can also be displayed on the display screen by the vehicle terminal in response to other operations such as the user accessing the display screen desktop or accessing the recently used application icons. This application does not make specific limitations. Further, optionally, after the vehicle terminal responds to the user's operation of opening application 1 and displays the interface 1103 corresponding to application 1, the application icons can also no longer be displayed on the display screen.

[0355] S1002: The vehicle terminal receives a first operation of a user on a first interface. The first interface is one of one or more first task interfaces. The first operation is used to switch to the first interface.

[0356] The first operation is a user's flow operation on the first interface of one or more first task interfaces displayed on the first screen. The first operation may include but is not limited to a preset sliding operation, a preset touch operation, a voice operation, a preset body movement, etc., which is not limited in this application.

[0357] For example, preset sliding operations include the operation of sliding one finger quickly on the first interface and then leaving the interface, the operation of sliding one finger slowly for a distance on the first interface and then leaving the interface, the operation of sliding multiple fingers (such as two fingers, three fingers, etc.) quickly on the first interface and then leaving the interface, and the operation of sliding multiple fingers (such as two fingers, three fingers, etc.) slowly for a distance on the first interface and then leaving the interface. Preset touch operations include long press operations (such as the press duration meets the time threshold t), double-click operations, multi-point click operations (such as two-point click operations, three-point click operations, etc.), multi-finger pinch operations (such as two-finger pinch operations, three-finger pinch operations, etc.), multi-finger expand operations (such as two-finger expand operations, three-finger expand operations, etc.). Preset body movements include preset air gesture operations, preset facial expressions, etc.

[0358] In an embodiment of the present application, the first operation received by the vehicle terminal can be used to transfer the first interface across screens, or can be used to transfer the first interface on the same screen.

[0359] Among them, the user intentions corresponding to different preset sliding operations, preset touch operations, voice operations, preset body movements and other operations can be pre-set and associated by the user, or pre-defined by the system.

[0360] For example, if the user sets the preset operation of quickly sliding two fingers on the first interface and then leaving to be associated with cross-screen flow, then when the vehicle terminal receives the user's operation of quickly sliding two fingers on the first interface and then leaving, it can be determined that the user's intention is to flow the first interface across screens. For another example, if the user sets the preset operation of slowly sliding two fingers on the first interface for a distance and then leaving to be associated with same-screen flow, then when the vehicle terminal receives the user's operation of slowly sliding two fingers on the first interface for a distance and then leaving, it can be determined that the user's intention is to flow the first interface on the same screen.

[0361] Optionally, in order to facilitate user operations and provide users with a more efficient interface flow experience, in some embodiments, the vehicle-mounted terminal can associate the interface flow intention with a sliding operation of one or more fingers at different speeds (or accelerations). For example, cross-screen flow can be associated with an operation of leaving after a quick swipe of one or more fingers; same-screen flow can be associated with an operation of leaving after a slow swipe of one or more fingers for a distance. Alternatively, cross-screen flow can be associated with an operation of leaving after a slow swipe of one or more fingers for a distance, and same-screen flow can be associated with an operation of leaving after a quick swipe of one or more fingers. This application does not make specific restrictions.

[0362] Among them, in the embodiment of the present application, fast and slow are relative concepts. For example, if the sliding speed (or sliding acceleration) is greater than a preset threshold, the vehicle-mounted terminal may consider the sliding to be a fast sliding; if the sliding speed (or sliding acceleration) is less than or equal to the preset threshold, the vehicle-mounted terminal may consider the sliding to be a slow sliding. Alternatively, if the sliding speed (or sliding acceleration) is greater than or equal to the preset threshold, the vehicle-mounted terminal may consider the sliding to be a fast sliding; if the sliding speed (or sliding acceleration) is less than the preset threshold, the vehicle-mounted terminal may consider the sliding to be a slow sliding.

[0363] For example, please refer to Figure 13, which shows an example of a gesture for characterizing the intention of interface flow provided by an embodiment of the present application. Among them, the gesture a shown in Figure 13 is an operation of leaving after a quick slide of two fingers. When the user inputs gesture a to the display screen, it specifically includes the following process: two fingers contact the display screen (a1 shown in Figure 13) → leave the display screen after a quick slide (as shown in 13 a2). The gesture b shown in Figure 13 is an operation of leaving after a slow slide of two fingers for a distance. When the user inputs gesture b to the display screen, it specifically includes the following process: two fingers contact the display screen (b1 shown in Figure 13) → slow slide distance L (as shown in 13 b2) → two fingers leave the display screen (as shown in Figure 13 b3). In addition, when cross-screen flow is associated with the operation of leaving after a quick slide of one or more fingers, and the same-screen flow is associated with the operation of leaving after a slow slide of one or more fingers for a distance, optionally, the slow sliding distance L can be the distance that the first interface moves on the first screen.

[0364] It is understandable that one-finger or multi-finger swiping is in line with the operating habits of most users and is easy for users to remember and operate. Therefore, by identifying specific interface flow intentions based on different sliding speeds (or sliding accelerations), such as cross-screen flow intentions and same-screen flow intentions, it can not only facilitate user memory and operation, but also improve the interaction performance between the in-vehicle terminal and the user, thereby enhancing the user experience.

[0365] In an embodiment of the present application, as an example, the vehicle terminal can determine the sliding speed of the user's finger on the display screen based on a received MotionEvent (such as MotionEvent.ACTION_MOVE (hereinafter referred to as "ACTION_MOVE event")). The sliding speed of the user's finger on the display screen can be represented by the number of pixels that the user's finger slides on the display screen per unit time (such as 1 second).

[0366] It can be understood that MotionEvent is a time series related to user touch. The operation of the user's finger on the display screen represents a touch event (such as a sliding operation). For a multi-finger sliding operation, a MotionEvent.ACTION_DOWN event (hereinafter referred to as the "ACTION_DOWN event") is generated when the user's first finger touches the display screen; an ACTION_POINTER_DOWN event is generated when the second finger and subsequent fingers or multiple fingers touch the display screen; an ACTION_MOVE event is generated during the multi-finger sliding process; an ACTION_POINTER_UP event is generated when a non-last finger leaves the display screen; and a MotionEvent.ACTION_UP event (hereinafter referred to as the "ACTION_UP event") is generated when the last finger leaves the display screen.

[0367] Among them, the ACTION_DOWN event indicates the start of a multi-finger sliding operation, that is, when the vehicle terminal detects that a contact point on the display screen is pressed, the ACTION_DOWN event is triggered.

[0368] The ACTION_MOVE event is triggered by the user pressing and sliding the screen with multiple fingers. That is, when the in-vehicle terminal detects that multiple touch points on the display are pressed and moved, the ACTION_MOVE event is triggered.

[0369] The ACTION_UP event indicates the end of the multi-finger sliding operation. That is, when the vehicle terminal detects that no contact point on the display screen is pressed by the user, the ACTION_UP event is triggered.

[0370] Based on the above touch event mechanism, as a possible implementation method, the vehicle terminal can determine, based on the method shown in Figure 14A, whether the first user operation on the first interface is used to transfer the first interface to the second screen across screens or to transfer the first interface to the second screen within the same screen. In particular, the first user operation on the first interface in S1002 shown in Figure 10 can correspond to the ACTION_DOWN+ACTION_POINTER_DOWN+ACTION_MOVE+ACTION_POINTER_UP+ACTION_UP events shown in Figure 14A.

[0371] As shown in S1401 in FIG. 14A , the in-vehicle terminal may determine and store the initial positions of the user's multiple fingers on the display screen based on the received ACTION_DOWN event and ACTION_POINTER_DOWN event.

[0372] For example, upon receiving an ACTION_DOWN event, the vehicle-mounted terminal may determine and store the finger index of the first finger that the user touched the display screen and the initial position coordinates of the finger on the display screen (referred to as initial coordinates). For example, the vehicle-mounted terminal may determine the initial position of the user's finger on the display screen based on the finger index, store the finger index in an ArrayList, and store the coordinates of the initial position (i.e., initial coordinates) in a HashMap according to the finger index.

[0373] Similarly, when receiving the ACTION_POINTER_DOWN event, the vehicle terminal can determine and store the finger index of the other one or more fingers of the user touching the display screen and the initial coordinates of the fingers on the display screen. For example, the vehicle terminal can determine the initial positions of the other one or more fingers of the user on the display screen based on the other one or more finger indexes, store the finger indexes in an ArrayList, and store the initial coordinates in a HashMap according to the finger indexes.

[0374] As shown in S1402 in FIG. 14A , the vehicle-mounted terminal may calculate the sliding speed according to the received ACTION_MOVE event, and mark whether the sliding speed is greater than a preset threshold.

[0375] For example, upon receiving an ACTION_MOVE event, the vehicle-mounted terminal calculates the average sliding speed of one or more fingers in real time. For example, the average sliding speed of one or more fingers may include the speed of one or more fingers along the x-axis and the speed of one or more fingers along the y-axis. The vehicle-mounted terminal may determine whether the sliding speed is greater than the corresponding preset threshold by comparing the speed of one or more fingers along the x-axis and the speed of one or more fingers along the y-axis with preset thresholds, and further mark whether it is greater than the preset threshold.

[0376] Optionally, during a one-finger or multi-finger sliding process, ACTION_MOVE events may be generated multiple times, so the flag indicating whether the value is greater than a preset threshold may also be refreshed multiple times.

[0377] Furthermore, as shown in S1403 in FIG. 14A , upon receiving the ACTION_UP event, the vehicle-mounted terminal determines whether to transfer across screens or transfer on the same screen according to the sliding speed mark.

[0378] For example, if the sliding speed of the user's finger on the display screen is greater than (or greater than or equal to) a preset threshold, the vehicle terminal may consider the sliding to be a fast sliding; if the sliding speed of the user's finger on the display screen is less than or equal to (or less than) the preset threshold, the vehicle terminal may consider the sliding to be a slow sliding.

[0379] It should be noted that only when the speed in the sliding direction is greater than the preset threshold can cross-screen sliding be truly achieved. For example, to judge the sliding speed in the right and left directions, it is necessary to judge whether the speed along the x-axis is greater than the preset threshold; to judge the sliding speed in the front and rear directions, it is necessary to judge whether the speed along the y-axis is greater than the preset threshold. Optionally, for other directions, the speed along the x-axis or y-axis can be used to judge whether it is greater than the preset threshold.

[0380] Based on the above mechanism, the vehicle terminal can determine whether the user's interface flow intention is cross-screen flow or same-screen flow.

[0381] 14A , if the sliding speed mark is the first mark, then the cross-screen flow branch described in S1404 - 1 and S1405 - 1 is executed, wherein the first mark is used to indicate that the sliding speed is greater than a preset threshold.

[0382] S1404-1: The vehicle terminal determines the sliding direction of the user's multiple fingers on the display screen according to the received ACTION_POINTER_UP event and ACTION_UP event.

[0383] For example, when receiving the ACTION_POINTER_UP event, the vehicle terminal can store its end position coordinates (abbreviated as end coordinates) in a HashMap according to the finger index of the corresponding finger. Similarly, when receiving the ACTION_UP event, the vehicle terminal can store the end coordinates of the last finger that left the display screen in a HashMap according to the finger index.

[0384] For example, the vehicle terminal can calculate the sliding direction of each finger based on the initial coordinates (such as (startPointX, startPointY)) and the end coordinates (such as (endPointX, endPointY)) of the multiple fingers stored in the HashMap. For example, the sliding direction can be calculated based on the following calculation formula 1:

[0385] Calculation formula 1: Math.atan2((endPointY-startPointY),(endPointX-startPointX))*(180 / Math.PI).

[0386] As an example, for a multi-finger sliding operation, when calculating the sliding speed, the vehicle-mounted terminal can calculate the sliding speed of each finger, and calculate the average sliding speed of the sliding speeds of multiple fingers to obtain the final sliding speed as the sliding speed of the first operation, or the sliding speed of any one of the fingers can be selected as the sliding speed of the first operation, which is not limited in the embodiments of the present application. Similarly, when determining the sliding direction of the first operation, the vehicle-mounted terminal can also first determine the sliding direction of each finger, and then use the consistent direction of the sliding of multiple fingers as the sliding direction of the first operation, or the sliding direction of any one of the fingers can be selected as the sliding direction of the first operation, which is not limited in the embodiments of the present application. And, when determining the sliding distance of the first operation, the sliding distance of each finger can be determined first, and the average value can be calculated as the sliding distance of the first operation, or the sliding distance of any one of the fingers can be selected as the sliding distance of the first operation, which is not limited in the embodiments of the present application.

[0387] S1405-1: The vehicle terminal determines the target screen for cross-screen flow based on the sliding direction of the user's finger on the display screen.

[0388] As a possible implementation, the vehicle terminal can determine which screen is the target screen based on the sliding direction when the user quickly slides one or more fingers on the first interface and the positional relationship between the original screen and the multiple display screens. The target screen can be the display screen pointed to by the sliding direction.

[0389] Alternatively, as shown in Figure 14A, if the sliding speed mark is the second mark, the vehicle terminal executes the same-screen flow branch described in S1404-2 and S1405-2, wherein the second mark is used to indicate that the sliding speed is less than or equal to a preset threshold.

[0390] S1404-2: The vehicle terminal determines the sliding distance and sliding direction of the user's multiple fingers on the display screen based on the received ACTION_POINTER_UP event and ACTION_UP event.

[0391] For example, the vehicle terminal can calculate the sliding distance and sliding direction of each finger based on the initial coordinates (such as (startPointX, startPointY)) and the ending coordinates (such as (endPointX, endPointY)) of the multiple fingers stored in the HashMap. For example, the sliding direction can be calculated based on the above calculation formula 1, and the sliding distance can be calculated based on the following calculation formula 2:

[0392] Calculation 2:

[0393] S1405-2: The vehicle terminal determines the target position of the same-screen flow according to the sliding distance and sliding direction of the user's finger on the display screen.

[0394] Optionally, for same-screen scrolling, the vehicle terminal can also determine whether the sliding distance of the finger on the display screen is greater than a preset threshold after calculating the sliding distance. If the sliding distance is greater than the preset threshold, the vehicle terminal executes S1405-2. If the sliding distance is less than or equal to the preset threshold, the vehicle terminal can maintain the interface display in its original position.

[0395] Optionally, in an embodiment of the present application, when a user swipes one or more fingers on the first interface, the first interface can follow the movement of the user's fingers. For example, when a user swipes one or more fingers on the first interface, the in-vehicle terminal can call a Rect object representing the window position in the terminal system (such as mWindowDragBounds) to achieve the effect that the first interface follows the movement of the user's fingers.

[0396] Among them, the sliding direction when the user slides one or more fingers on the first interface can be represented by the angle between the sliding trajectory of the user's finger and the positive direction of the horizontal axis of the preset coordinate system. Exemplarily, the user's finger coordinates are the coordinates of the user's finger in the preset coordinate system. The preset coordinate system is such as the xOy coordinate system, wherein the origin O of the xOy coordinate system can be the upper left corner of the first screen, the x-axis can be the upper edge of the first screen, wherein the right direction is the +x-axis direction (that is, the positive direction of the horizontal axis is to the right), and the y-axis can be the left edge of the first screen, wherein the downward direction is the +y-axis direction (that is, the positive direction of the vertical axis is upward). The embodiment of the present application does not limit the specific setting of the preset coordinate system xOy.

[0397] For example, if the angle is within the range of [-22.5°, 22.5°) shown in Figure 14B, and the preset sliding direction [-22.5°, 22.5°) corresponds to the screen to the right of the original screen, the vehicle terminal determines the screen to the right of the original screen, i.e., the target screen, based on the positional relationship between the original screen and the multiple display screens. For example, if the original screen is the main driver's screen, the target screen can be determined to be the passenger driver's screen. If the original screen is the left rear screen, the target screen can be determined to be the right rear screen.

[0398] For another example, if the angle is within the range of [-67.5°, -22.5°) shown in Figure 14B, and the preset sliding direction [-67.5°, -22.5°) corresponds to the screen located to the right front of the original screen, the vehicle terminal determines the screen located to the right front of the original screen based on the positional relationship between the original screen and the multiple display screens, i.e., the target screen. For example, if the original screen is the left rear screen, the target screen can be determined to be the passenger screen.

[0399] For another example, if the angle is within the range of [-112.5°, -67.5°) shown in Figure 14B, assuming that the preset sliding direction [-112.5°, -67.5°) corresponds to the screen directly in front of the original screen, the vehicle terminal determines the screen directly in front of the original screen based on the positional relationship between the original screen and the multiple display screens, i.e., the target screen. For example, if the original screen is the left rear screen, the target screen can be determined to be the main driver's screen. If the original screen is the right rear screen, the target screen can be determined to be the passenger driver's screen.

[0400] For another example, if the angle is within the range of [-157.5°, -112.5°) shown in Figure 14B, assuming that the preset sliding direction [-157.5°, -112.5°) corresponds to the screen located to the left and front of the original screen, the vehicle terminal determines the screen located to the left and front of the original screen based on the positional relationship between the original screen and the multiple display screens, i.e., the target screen. For example, if the original screen is the right rear screen, it can be determined that the target screen is the main driving screen.

[0401] For another example, if the angle is within the range of [157.5°, -157.5°) shown in Figure 14B, assuming that the preset sliding direction [157.5°, -157.5°) corresponds to the screen located to the left of the original screen, the vehicle terminal determines the screen located to the left of the original screen, i.e., the target screen, based on the positional relationship between the original screen and the multiple display screens. For example, if the original screen is the passenger screen, the target screen can be determined to be the main driver screen. If the original screen is the right rear screen, the target screen can be determined to be the left rear screen.

[0402] For another example, if the angle is within the range of [112.5°, 157.5°) shown in Figure 14B, and the preset sliding direction [112.5°, 157.5°) corresponds to the screen located to the left and rear of the original screen, the vehicle terminal determines the screen located to the left and rear of the original screen based on the positional relationship between the original screen and the multiple display screens, i.e., the target screen. For example, if the original screen is the passenger screen, the target screen can be determined to be the left rear screen.

[0403] For another example, if the angle is within the range of [67.5°, 112.5°) shown in Figure 14B, assuming that the preset sliding direction [67.5°, 112.5°) corresponds to the screen directly behind the original screen, the vehicle terminal determines the screen directly behind the original screen based on the positional relationship between the original screen and the multiple display screens, i.e., the target screen. For example, if the original screen is the main driver's screen, the target screen can be determined to be the left rear screen. If the original screen is the passenger driver's screen, the target screen can be determined to be the right rear screen.

[0404] For example, if the angle is within the range of [22.5°, 67.5°) shown in Figure 14B, assuming that the pre-set sliding direction [22.5°, 67.5°) corresponds to the screen located to the right rear of the original screen, the vehicle terminal determines the screen located to the right rear of the original screen, that is, the target screen, based on the positional relationship between the original screen and multiple display screens.

[0405] Exemplarily, if the original screen is the main driving screen, it can be determined that the target screen is the right rear screen. It should be noted that the correspondence between the sliding direction and the target screen shown in FIG14B is only an example, and the embodiments of the present application do not make specific limitations. For example, if the angle is within the range of [67.5°, 112.5°) shown in FIG14B, assuming that the pre-set sliding direction [67.5°, 112.5°) corresponds to all screens located behind the original screen, the vehicle-mounted terminal determines all screens located behind the original screen, i.e., the target screen, based on the positional relationship between the original screen and the multiple display screens. Exemplarily, if the original screen is the main driving screen, it can be determined that the target screens are the left rear screen and the right rear screen.

[0406] In some other embodiments, the vehicle terminal can also determine whether the user's interface flow intention is cross-screen flow or same-screen flow based on other mechanisms. For example, when receiving the user's first operation on the first interface, the vehicle terminal can determine whether the user's interface flow intention is cross-screen flow or same-screen flow, as well as the position of the first interface after the flow based on the position of the first interface before the flow and the positional relationship between the display screens. For example, as shown in Figure 14C, display screen 2 is located on the right side of display screen 1. Taking display screen 1 as the first screen, if the position of the first interface before the flow is close to the right side of display screen 1, and the first operation is to slide the first interface to the right, then the vehicle terminal can determine that the user's interface flow intention is cross-screen flow, such as flowing the first interface from display screen 1 to display screen 2. As shown in Figure 14D, if the position of the first interface before the flow is close to the right side of display screen 1, and the first operation is to slide the first interface to the left, then the vehicle terminal can determine that the user's interface flow intention is same-screen flow, such as flowing the first interface from the right side of display screen 1 to the left side of display screen 1. For another example, if the position of the first interface before the flow is close to the left side of the display screen 1, and the first operation is to slide the first interface to the right, the vehicle terminal can determine that the user's interface flow intention is to flow on the same screen, such as flowing the first interface from the left side of the display screen 1 to the right side of the display screen 1.

[0407] Similarly, display screen 2 is located on the right side of display screen 1. Taking display screen 2 as the first screen as an example, if the position of the first interface before the flow is close to the left side of display screen 2, and the first operation is to slide the first interface to the left, then the vehicle terminal can determine that the user's interface flow intention is cross-screen flow, such as flowing the first interface from display screen 2 to display screen 1; if the position of the first interface before the flow is close to the left side of display screen 2, and the first operation is to slide the first interface to the right, then the vehicle terminal can determine that the user's interface flow intention is same-screen flow, such as flowing the first interface from the left side of display screen 2 to the right side of display screen 2.

[0408] For example, as shown in FIG10 , if the first operation is used to transfer the first interface across screens, the vehicle terminal executes S1003-1 and S1004-1; if the first operation is used to transfer the first interface to the same screen, the vehicle terminal executes S1003-2 and S1004-2:

[0409] S1003-1: The vehicle-mounted terminal determines that the target screen is the second screen.

[0410] In some embodiments of the present application, the vehicle-mounted terminal may determine the target screen based on the received first operation for transferring the first interface across screens.

[0411] For example, if the first operation for transferring the first interface across screens is a user's quick swipe with one or more fingers followed by a swipe away, in some embodiments, the vehicle-mounted terminal can determine the target screen based on the direction of the user's swipe. The specific method and process for determining the target screen can be found in the detailed description above and will not be repeated here.

[0412] It can be understood that in the case where the vehicle-mounted terminal includes multiple display screens (such as the first screen and the second screen), the vehicle-mounted terminal must know the relative position relationship of the multiple display screens. Similarly, in the case where multiple display screens (such as the first screen and the second screen) belong to different vehicle-mounted terminals, the vehicle-mounted terminal to which the first screen belongs can know the relative position relationship of the multiple display screens. For example, the specific positions of multiple display screens are saved in the vehicle-mounted terminal. Based on this, in an embodiment of the present application, the vehicle-mounted terminal can determine the target screen when the first interface is transferred across screens based on the sliding direction of the user's finger and the relative position relationship of the multiple display screens.

[0413] As an example, for the case where multiple display screens (such as the first screen and the second screen) belong to different vehicle-mounted terminals, the vehicle-mounted terminal to which the first screen belongs can obtain the relative position relationship of the multiple display screens based on automatic positioning technology. For example, the automatic positioning technology is such as ultrasonic positioning technology. The vehicle-mounted terminal to which the first screen belongs can be based on ultrasonic positioning technology, emitting ultrasonic signals through a speaker arranged therein, and receiving echo signals of ultrasonic signals from other vehicle-mounted terminals through a microphone arranged therein. Furthermore, the vehicle-mounted terminal to which the first screen belongs can be based on triangulation positioning technology, according to the transmission path of the emitted signal, the transmission path of the received signal, combined with the relative position relationship of the speaker and the microphone, to determine the specific positions of the multiple vehicle-mounted terminals in the vehicle, and then determine the relative position relationship of the multiple vehicle-mounted terminals, that is, the relative position relationship of the multiple display screens.

[0414] Alternatively, if multiple display screens (e.g., a first screen and a second screen) belong to different vehicle-mounted terminals, the vehicle-mounted terminal to which the first screen belongs can also determine the specific positions of the multiple vehicle-mounted terminals in the vehicle based on relevant configuration information such as vehicle-mounted system configuration information or through other methods, and then determine the relative positional relationship of the multiple vehicle-mounted terminals, that is, the relative positional relationship of the multiple display screens. The embodiments of this application do not specifically limit the specific methods and processes.

[0415] In some embodiments of the present application, based on the method provided in the embodiments of the present application, a one-to-one interface flow can be achieved.

[0416] For example, the method provided in the embodiments of the present application can realize the cross-screen flow of any interface on any screen to any other screen. For example, for a car, the cross-screen flow of the interface can be realized from the main driver's screen to the passenger driver's screen, the main driver's screen to the left rear screen, the main driver's screen to the right rear screen, the passenger driver's screen to the main driver's screen, the passenger driver's screen to the left rear screen, the passenger driver's screen to the right rear screen, the left rear screen to the main driver's screen, the left rear screen to the passenger driver's screen, the left rear screen to the right rear screen, the right rear screen to the main driver's screen, the right rear screen to the passenger driver's screen, and the right rear screen to the left rear screen.

[0417] Please refer to Figures 15 to 17. Figures 15 to 17 take the vehicle terminal including display screen 1, display screen 2, display screen 3 and display screen 4 as an example, and show schematic diagrams of several sliding operations for switching across different display screens provided in the embodiments of the present application.

[0418] For example, if display screen 1 (i.e., the first screen) receives the user's two-finger quick right swipe (i.e., the swiping direction is toward display screen 2) on the first interface and then leaves the screen, as shown in Figure 15, the vehicle terminal can determine that the target screen is display screen 2 located to the right of display screen 1 based on the swiping direction of the operation and the relative positional relationship of display screens 1, 2, 3, and 4. In other words, the intention of the above operation is to transfer the first interface from display screen 1 to display screen 2 across the screen.

[0419] For another example, if display screen 1 (i.e., the first screen) receives operation 5 as shown in Figure 16, in which the user quickly slides down with two fingers on the first interface (i.e., the sliding direction is toward display screen 3) and then leaves, then as shown in Figure 16, the vehicle terminal can determine that the target screen is display screen 3 located behind display screen 1 based on the sliding direction of the operation and the relative position relationship of display screens 1, 2, 3, and 4. In other words, the intention of the above operation is to transfer the first interface from display screen 1 to display screen 3 across screens.

[0420] For another example, if display screen 1 (i.e., the first screen) receives the user's two-finger swipe in the lower-right direction (i.e., the swiping direction is toward display screen 4) on the first interface and then leaves the screen, as shown in Figure 17, the vehicle terminal can determine that the target screen is display screen 4, which is located to the right rear of display screen 1, based on the swiping direction of the operation and the relative positions of display screens 1, 2, 3, and 4, as shown in Figure 17. In other words, the intention of the above operation is to transfer the first interface from display screen 1 to display screen 4 across the screen.

[0421] In other embodiments of the present application, based on the method provided in the embodiments of the present application, one-to-many interface flow can be achieved.

[0422] For example, the method provided in the embodiments of this application can implement cross-screen flow of any interface on any screen to multiple other screens. For example, in a car, cross-screen flow of the interface can be implemented from the main driver's screen to the rear screens (including the left and right rear screens), and from the rear screens (such as the left or right rear screens) to the front screens (including the main driver's screen and the passenger screen).

[0423] For example, as shown in Figure 18, assuming that the vehicle terminal includes display screen 1, display screen 2, display screen 3, and display screen 4, if display screen 1 (i.e., the first screen) receives the operation of the user quickly sliding down with two fingers on the first interface (i.e., the sliding direction points to the back row) and then leaving, the vehicle terminal can determine that the target screen is the display screen located in the back row of display screen 1 (including display screen 3 and display screen 4) based on the sliding direction of the operation and the relative position relationship of display screen 1, display screen 2, display screen 3, and display screen 4. That is, the intention of the above operation is to transfer the first interface from display screen 1 to the back row display screens (including display screen 3 and display screen 4) across the screen.

[0424] It should be noted that the sliding operation for cross-screen transfer shown in Figures 15-18 is only an example of a directional cross-screen transfer operation. The method provided in the embodiments of the present application can also be applied to non-directional cross-screen transfer. For example, the terminal device can also respond to the user's second operation on the first interface and transfer the first interface to all other screens of the vehicle terminal.

[0425] In addition, Figures 15-18 are merely examples of interfaces before and after a cross-screen transition, and this application does not limit the specific displays during the cross-screen interface transition process. For example, after receiving a sliding operation for cross-screen transition, the vehicle-mounted terminal may also display prompt information on the original screen and / or the target screen, respectively, to indicate that a cross-screen transition is about to take place and that a cross-screen transition interface is about to be received, or to confirm that a cross-screen transition is about to take place and that a cross-screen transition interface is about to be received, to prevent incorrect interface transitions caused by user misoperation. Alternatively, for example, during the transition of the first interface from the original screen to the target screen, the first interface may also display an animation effect in which the interface displayed on the original screen becomes smaller and then transitions to the target screen. Alternatively, for example, if the aspect ratio of the original screen and the target screen are different, the vehicle-mounted terminal may also adjust the display ratio of the first interface on the target screen after the interface transition, displaying the first interface at a ratio that matches the aspect ratio of the target screen. Alternatively, for example, if the dimensions of the original screen and the target screen are different, the vehicle-mounted terminal may also display the first interface at a size that matches the dimensions of the target screen after the interface transition.

[0426] S1004-1: The vehicle terminal displays the first interface in a first display type through the second screen. The first display type is related to the task information before the first interface is transferred and / or the screen task information of the second screen.

[0427] Among them, the task information before the first interface flows is used to characterize the display type and / or classification information of the first interface when it is displayed on the first screen before the interface flows. The display type of the first interface when it is displayed on the first screen is used to characterize the form of expression of the first interface when it is displayed on the first screen. Exemplarily, the display type of the first interface before the flow may include but is not limited to any one of the following: full-screen display, split-screen display, floating window, floating icon, floating ball, picture-in-picture, card, control or notification, etc. The classification information of the first interface when it is displayed on the first screen is used to characterize whether the first interface is a preset focus application interface.

[0428] The screen task information of the second screen is used to characterize the display type and / or classification information of the task interface on the second screen before the interface is transferred. The display type of the task interface on the second screen is used to characterize the presentation form of the task interface on the second screen. For example, the display type of the task interface on the second screen may include but is not limited to any one of the following: full screen display, split screen display, floating window, floating icon, floating ball, picture-in-picture, card, control or notification, etc. The classification information of the task interface on the second screen is used to characterize whether the task interface on the second screen is a preset focus application interface.

[0429] In some embodiments, no task interface is displayed on the second screen of the vehicle terminal. For example, the second screen of the vehicle terminal displays a display desktop, a notification center, a control center, etc. Optionally, when a system page (e.g., a settings page) is displayed on the second screen of the vehicle terminal, it can also be considered that no task interface is displayed on the second screen of the vehicle terminal.

[0430] In other embodiments, a task interface (such as a second task interface) is displayed on the second screen of the vehicle-mounted terminal.

[0431] In other embodiments, multiple task interfaces (such as multiple second task interfaces) are displayed on the second screen of the vehicle-mounted terminal.

[0432] In this embodiment of the present application, one or more second task interfaces can be displayed on the second screen of the vehicle terminal in any display type.

[0433] If a second task interface is displayed on the second screen of the vehicle terminal, the second task interface can be displayed in full screen on the second screen (as shown in Figure 3), or it can be displayed on the desktop, notification center, control center and other pages of the second screen in the form of a floating window, floating icon, floating ball, picture-in-picture, card, control or notification.

[0434] If multiple second task interfaces are displayed on the second screen of the vehicle terminal, in some examples, the multiple second task interfaces can be displayed in split screen on the second screen, as shown in Figure 2. In other examples, one of the multiple second task interfaces can be displayed full screen on the second screen, and the other interfaces can be displayed on the second screen in the form of floating windows, floating icons, floating balls, picture-in-pictures, cards, controls, or notifications, as shown in Figures 4, 5, 6, (a) of Figure 8, or (b) of Figure 8.

[0435] Similarly, if multiple second task interfaces are displayed on the second screen of the vehicle terminal, the multiple task interfaces may be displayed on the second screen in response to the user opening the multiple second task interfaces; or the multiple task interfaces may be displayed on the second screen in response to the user opening the task combination. The embodiments of the present application do not limit the specific process of the vehicle terminal displaying multiple second task interfaces through the second screen.

[0436] It can be understood that the second screen is the target screen, and when the first interface flows from the first screen to the second screen, in order to provide an intelligent display that can meet the needs and habits of the user, the display type of the first interface on the second screen may be affected by the task interface being displayed on the second screen. For example, if the vehicle-mounted terminal does not consider the task interface on the second screen, but directly displays the first interface in full screen on the second screen, it may forcibly interrupt the task interface that the user is concentrating on on the second screen, affecting the user experience. For another example, if the vehicle-mounted terminal does not consider the task interface on the second screen, but directly displays the first interface in non-full screen on the second screen, if the task interface is not originally displayed on the second screen, the user may need to manually adjust the non-full screen display of the first interface to full screen display, affecting the user experience.

[0437] In addition, the user transfers the first interface on the first screen to the second screen usually because he wants to use the first interface as the focused task of the second screen. Therefore, in order to provide an intelligent display that can meet the needs and habits of users, the display type of the first interface on the second screen may also be affected by the display type or classification information of the first interface when it is displayed on the first screen. For example, if the vehicle-mounted terminal does not consider the information that the first interface was previously displayed in full screen on the first screen or as a focused task interface, and directly displays the first interface in non-full screen on the second screen, if the task interface is not originally displayed on the second screen, the user may need to manually adjust the non-full screen display of the first interface to full screen display, affecting the user experience.

[0438] Therefore, in an embodiment of the present application, when the interface is transferred across screens, the vehicle-mounted terminal determines the specific display type of the first interface on the second screen after the transfer by obtaining the task information of the first interface before the transfer and / or the screen task information of the second screen, so as to display the first interface on the second screen with a more reasonable display effect after the interface transfer, thereby improving the user experience.

[0439] The following will introduce the specific display effects of the vehicle terminal displaying the first interface transferred from the first screen on the second screen, divided into cases (A) to (C), with specific examples:

[0440] Case (A): The display effect of the first interface transferred from the first screen displayed on the second screen by the vehicle terminal is related to the screen task information of the second screen before the transfer.

[0441] In some embodiments, the vehicle terminal displays the first interface in full screen form through the second screen (ie, the first display type is full screen display), and the first display type is determined by the vehicle terminal according to the screen task information of the second screen.

[0442] For example, the screen task information of the second screen indicates that no task interface is displayed on the second screen. The vehicle terminal can decide to display the first interface in full screen on the second screen after the flow according to the screen task information of the second screen.

[0443] For example, the second screen may display the desktop, notification center, control center, or system interface (such as a settings page), etc.

[0444] The second screen is located on the right side of the first screen, as shown in Figure 19. In response to the user's operation of quickly sliding two fingers away from the first interface on the first screen, the vehicle terminal transfers the first interface on the first screen to the second screen. After the transfer, the vehicle terminal displays the first interface in full screen through the second screen.

[0445] Among them, the example shown in Figure 19 only takes the first interface being displayed in full screen on the first screen before the flow as an example. In the case where the first interface is displayed on the first screen in the form of split screen display, floating window, floating icon, floating ball, picture-in-picture, card or notification before the flow, if the task interface is not displayed on the second screen, the vehicle-mounted terminal can also decide to display the first interface in full screen on the second screen after the flow based on the screen task information of the second screen.

[0446] For example, Figures 20-24 take the second screen as an example and show the interface flow examples of several vehicle-mounted terminals provided by the embodiments of the present application in response to the user's two-finger quick swipe and then leaving operation on the first interface on the first screen. Among them, Figure 20 shows an example in which interface A (i.e., the first interface) is displayed on the first screen in split screen with interface B before the flow, and the vehicle-mounted terminal decides to display interface A (i.e., the first interface) in full screen on the second screen after the flow according to the screen task information of the second screen. Figure 21 shows an example in which interface D (i.e., the first interface) is displayed on the first screen together with interface E in the form of a floating window before the flow, and the vehicle-mounted terminal decides to display interface D (i.e., the first interface) in full screen on the second screen after the flow according to the screen task information of the second screen. Figure 22 shows an example in which the icon of interface D (i.e., the first interface) is displayed on the first screen together with interface E in the form of a floating icon before the flow, and the vehicle-mounted terminal decides to display interface D (i.e., the first interface) in full screen on the second screen after the flow according to the screen task information of the second screen. Figure 23 shows an example where a memo card (i.e., the first interface) is displayed as a card on the first screen before being transferred, and the vehicle terminal decides, based on the screen task information on the second screen, to display the memo interface (i.e., the first interface) in full screen on the second screen after being transferred. Figure 24 shows an example where a video call to be answered (i.e., the first interface) is displayed together with interface C on the first screen as a notification before being transferred, and the vehicle terminal decides, based on the screen task information on the second screen, to display the video call to be answered (i.e., the first interface) in full screen on the second screen after being transferred.

[0447] Or, for example, the screen task information of the second screen indicates that the task interface on the second screen is displayed in non-full-screen form before the flow. For example, the display type of the task interface on the second screen is any one of the following: split-screen window, floating window, floating icon, floating ball, card, control or notification. The vehicle-mounted terminal can decide to display the first interface in full screen through the second screen after the flow based on the screen task information of the second screen.

[0448] For example, Figures 25-26 take the second screen being located on the right side of the first screen as an example, and show examples of interface flow of two types of vehicle-mounted terminals provided by the embodiments of the present application in response to the user's two-finger quick swipe and then leaving the first interface on the first screen. Among them, Figure 25 shows an example in which, when interface A (i.e., the first interface) is displayed on the first screen as a split screen with interface B before the flow, and the second screen displays interface B in the form of a floating window, the vehicle-mounted terminal decides to display interface A (i.e., the first interface) in full screen on the second screen after the flow based on the screen task information of the second screen. Figure 26 shows an example in which, when interface A (i.e., the first interface) is displayed on the first screen as a split screen with interface B before the flow, and the second screen displays the new interface in the form of a notification. In the case of a message, the vehicle terminal decides to display interface A (ie, the first interface) in full screen on the second screen after the flow according to the screen task information of the second screen.

[0449] Figures 25 and 26 only use the first interface as an example of being displayed on the first screen in a split-screen manner with other interfaces before the first interface is switched. For examples of interface switching when the first interface is displayed in other display types before the first interface is switched, please refer to the examples above or below. Also, for examples of interface switching when the task interface on the second screen is displayed in other non-full-screen formats (such as picture-in-picture, floating icons, split-screen windows, cards, floating balls, etc.), please refer to the examples above or below, and we will not list them one by one here.

[0450] Alternatively, for example, the screen task information of the second screen indicates that the task interface on the second screen before the transfer does not include the preset focus application interface, and the vehicle terminal can decide to display the first interface in full screen on the second screen after the transfer based on the screen task information of the second screen. For example, assuming that interface B shown in Figure 27 is not the preset focus application interface, the vehicle terminal decides to display interface E (i.e., the first interface) in full screen on the second screen after the transfer based on the screen task information of the second screen.

[0451] It can be understood that in an embodiment of the present application, when no task interface is displayed on the second screen, or no task interface is displayed in full screen, or no preset focused application interface is displayed, the vehicle-mounted terminal can directly display the first interface in full screen through the second screen after the interface flows, so as to ensure that the first interface can be displayed prominently without the need for manual adjustment by the user, avoid interference from other interfaces on the interface, and facilitate the user to view the first interface and / or operate on the first interface through the second screen, providing the user with a more efficient and user-friendly interface flow experience.

[0452] In other embodiments, the vehicle-mounted terminal displays the first interface transferred from the first screen through the second screen in a non-full-screen format (such as the first display type is split-screen display, floating window, floating icon, floating ball, picture-in-picture, card or notification, etc.), and the first display type is determined by the vehicle-mounted terminal based on the screen task information of the second screen.

[0453] For example, the screen task information of the second screen indicates that the second screen includes a full-screen task interface. The vehicle terminal decides the display type of the first interface after the flow based on the screen task information of the second screen, such as split-screen display, floating window or picture-in-picture.

[0454] For example, Figures 28A-28B take the second screen as an example and show the interface flow examples of two vehicle-mounted terminals provided by the embodiment of the present application in response to the user's two-finger quick swipe and then leave operation on the first interface on the first screen. Among them, Figure 28A shows that when interface A (i.e., the first interface) is displayed on the first screen in split screen with interface B before the flow, and the second screen displays interface C in full screen, the vehicle-mounted terminal decides to display interface A (i.e., the first interface) and interface C in split screen (i.e., non-full screen) through the second screen according to the screen task information of the second screen after the flow. Figure 28B shows that when the first interface (i.e., interface A) is displayed on the first screen in split screen with interface B before the flow, and the second screen displays interface C in full screen, the vehicle-mounted terminal decides to display interface A (i.e., the first interface) in the form of a floating window or picture-in-picture through the second screen after the flow together with the full-screen interface C according to the screen task information of the second screen.

[0455] Among them, Figures 28A-28B only take the first interface as an example of being displayed on the first screen in a split screen with other interfaces before the flow. For examples of interface flow in which the first interface is displayed in other display types (such as full-screen display, floating window, etc.) before the flow, please refer to the examples above or below, and they will not be listed here one by one.

[0456] Or, for example, the screen task information of the second screen indicates that a preset focus application interface is displayed on the second screen, and the vehicle terminal decides the display type of the first interface after the flow is transferred based on the screen task information of the second screen, such as split-screen display, floating window or picture-in-picture.

[0457] For example, interface C shown in Figures 28A-28B can be a preset focused application interface. The vehicle terminal decides based on the screen task information of the second screen to display interface A (i.e., the first interface) and interface C in a split-screen manner on the second screen after the flow (as shown in Figure 28A), or the vehicle terminal decides based on the screen task information of the second screen to display interface A (i.e., the first interface) in the form of a floating window or picture-in-picture on interface C displayed in full screen on the second screen after the flow (as shown in Figure 28B).

[0458] Among them, for the situation where the first interface and the preset focused application interface on the second screen are split-screen and displayed on the second screen after the flow, the interface ratio of the preset focused application interface on the first interface and the second screen can be 1:1 as shown in Figure 27, or it can be 1:2, or it can be 2:1, depending on the specific settings, and the embodiments of this application are not limited.

[0459] It can be understood that in an embodiment of the present application, when there is a full-screen task interface displayed on the second screen, or a preset focus application interface is displayed, the vehicle-mounted terminal can display the first interface in the form of split-screen display, floating window or picture-in-picture through the second screen after the interface flows, so as to avoid interrupting the task interface that the user is focusing on on the second screen, and provide the user with a more user-friendly interface flow experience.

[0460] Case (B): The display effect of the first interface transferred from the first screen displayed on the second screen by the vehicle-mounted terminal is related to the task information before the first interface is transferred.

[0461] In some embodiments, after the interface flows, the vehicle terminal displays the first interface in full screen through the second screen (ie, the first display type is full screen display), and the first display type is determined by the vehicle terminal based on the task information when the first interface is displayed on the first screen before the flow.

[0462] For example, the vehicle-mounted terminal may display the first interface on the second screen using the same display type as when the first interface is displayed on the first screen. For example, if the display type of the first interface on the first screen is full screen display, the vehicle-mounted terminal may display the first interface in full screen on the second screen after the decision flow is transferred.

[0463] As shown in Figure 27, when interface E (i.e., the first interface) is displayed in full screen on the first screen and interface D is displayed on interface E (i.e., the first interface) in the form of a floating window or picture-in-picture, in response to the user's two-finger quick swipe and then release of interface E (i.e., the first interface) on the first screen, the vehicle-mounted terminal determines the display type of interface E (i.e., the first interface) when it is displayed on the first screen and displays interface E (i.e., the first interface) in full screen on the second screen after the flow. Among them, after the flow shown in Figure 27, interface B originally displayed in full screen on the second screen is blocked or replaced by interface E (i.e., the first interface) displayed in full screen, and interface D originally displayed on the first screen can continue to maintain the original display type.

[0464] It is understandable that the need for interface flow is usually based on communication between people in the car, so we can assume that the interface flow is to transfer the focused task on the first screen to the second screen as the focused task on the second screen. Based on this, in order to provide users with a more efficient and user-friendly interface flow experience, the in-vehicle device can display the first interface that was displayed in full screen on the first screen before the flow on the second screen after the interface flow, so as to ensure that the first interface can be displayed prominently without the need for manual adjustment by the user, avoid interference from other interfaces on the interface, and facilitate users to view the first interface and / or operate on the first interface through the second screen.

[0465] For example, the first interface is displayed on the first screen as a preset focused application interface. After the decision flow is transferred, the vehicle terminal can display the first interface in full screen on the second screen. Based on this, it can ensure that the interface with high user attention or high importance is displayed prominently, avoiding interference from other interfaces on this interface, and making it easier for users to view and / or operate.

[0466] In other embodiments, the vehicle terminal displays the first interface in a non-full-screen format (i.e., the first display type is split-screen display, floating window, picture-in-picture, etc.) through the second screen, and the first display type is determined by the vehicle terminal based on the task information when the first interface is displayed on the first screen before it flows.

[0467] For example, the vehicle-mounted terminal may display the first interface on the second screen using the same display type as that used when the first interface was displayed on the first screen before the first interface was transferred. For example, as shown in FIG29 , when interface D (i.e., the first interface) is displayed on the first screen together with interface E displayed in full screen in the form of a floating window, in response to the user's two-finger quick swipe and then release operation on interface D (i.e., the first interface) on the first screen, the vehicle-mounted terminal determines that interface D (i.e., the first interface) is displayed on the second screen in the form of a floating window after the transfer based on the display type of interface D (i.e., the first interface) when it was displayed on the first screen before the transfer.

[0468] Similarly, if the first interface is displayed in picture-in-picture format on the first screen before the transfer, the vehicle terminal may also decide to display the first interface in picture-in-picture format on the second screen after the transfer (see FIG. 29 ).

[0469] Case (C): The display effect of the first interface transferred from the first screen displayed on the second screen by the vehicle terminal is related to both the task information before the transfer of the first interface and the screen task information of the second screen before the transfer.

[0470] In some embodiments, the vehicle-mounted terminal can analyze the screen task information of the second screen. If the screen task information of the second screen indicates that the second screen includes a full-screen task interface or a preset focus application interface is displayed on the second screen, the vehicle-mounted terminal can decide to display the first interface in a non-full-screen format after the flow.

[0471] Furthermore, after the vehicle terminal decides to display the first interface in non-full screen form after the flow according to the screen task information of the second screen, the vehicle terminal can determine the specific display type (i.e., the first display type) of the first interface on the second screen after the flow.

[0472] For example, assuming that the first interface is displayed in split screen on the first screen before it flows, the vehicle terminal can determine that the first interface is displayed in split screen on the second screen after it flows. Assuming that the first interface is displayed in full screen on the first screen before it flows, the vehicle terminal can determine that the first interface is displayed in split screen, floating window, or picture-in-picture on the second screen after it flows. For another example, assuming that the first interface flows and is displayed in the form of a floating window on the first screen, the vehicle terminal can determine that the first interface is displayed through a floating window on the second screen after it flows. For another example, assuming that the first interface flows and is displayed in the form of a picture-in-picture on the first screen, the vehicle terminal can determine that the first interface is displayed through a picture-in-picture on the second screen after it flows.

[0473] Exemplarily, as shown in FIG28A , when the first interface (i.e., interface A) is displayed split-screen with interface B on the first screen before the flow, and interface C is displayed full-screen on the second screen, the vehicle-mounted terminal decides to display interface A (i.e., the first interface) and interface C split-screen on the second screen after the flow.

[0474] As shown in Figure 31, when the first interface (i.e., interface A) is displayed in the form of a floating window on interface B displayed in full screen on the first screen before the flow, and the second screen displays interface C and interface D in a split screen, the vehicle terminal can decide to display interface A (i.e., the first interface) in the form of a floating window on interface C and interface D displayed in a split screen on the second screen after the flow.

[0475] In other embodiments, if the screen task information of the second screen indicates that the second screen does not include a full-screen task interface and there is no preset focus application interface on the second screen, the vehicle terminal can further analyze the task information before the first interface is transferred. If the task information before the first interface is transferred indicates that the first interface is displayed in full screen when displayed on the first screen before the transfer and / or the first interface is a preset focus application interface, the vehicle terminal can decide to display the first interface in full screen on the second screen after the transfer (that is, the first display type is full screen display).

[0476] For example, as shown in Figure 30, in the case where the first screen is split-screen displaying interface A (i.e., the first interface) and interface B, and the second screen is split-screen displaying interface C and interface D, assuming that interface C and interface D are not preset focus application interfaces, and interface A is the preset focus application interface, in response to the user's two-finger quick swipe and then release operation on interface A (i.e., the first interface) on the first screen, the in-vehicle terminal can decide to display the first interface in full screen on the second screen after the flow. Among them, after the flow shown in Figure 30, the originally split-screen display of interface C and interface D on the second screen is blocked or replaced by the full-screen display of the first interface.

[0477] Similarly, if the screen task information of the second screen indicates that the second screen does not include a full-screen task interface, and there is no preset focus application interface on the second screen, if the first interface is a preset focus application and the first interface is displayed as a floating window, floating icon, floating ball, picture-in-picture, card, control, or notification on the first screen, the vehicle terminal can also make a decision to display the first interface in full screen on the second screen after the flow is transferred. For details, please refer to the examples above or below, and will not be listed here one by one.

[0478] It should be noted that Figures 20, 25-26, 28A-28B, and 30 are merely examples of the situation where, after Interface A (i.e., the first interface) is transferred from the first screen to the second screen, the first screen displays Interface B, which was displayed in split screen with Interface A (i.e., the first interface) on the first screen before the transfer, in full screen. In other embodiments of the present application, after the first interface is transferred from the first screen to the second screen, the first screen may also maintain the display type and position of the remaining other interfaces as before the transfer.

[0479] Optionally, in some embodiments, the vehicle terminal may also determine the display type of the first interface after the transition based on user settings or system settings. Alternatively, the vehicle terminal may also determine the specific display type of the first interface after the transition based on other relevant factors, which is not specifically limited in the embodiments of the present application.

[0480] In addition, it should be noted that the embodiment of the present application does not limit the specific location of the first interface when it is displayed on the second screen in a non-full screen format such as a floating window or picture-in-picture after the interface is transferred. It depends on the specific device settings or interface layout.

[0481] Also, it should be noted that the above embodiment of the present application only takes the example of the first screen no longer displaying the first interface related information after the first interface is transferred from the first screen to the second screen. In other embodiments of the present application, after the first interface is transferred from the first screen to the second screen, the first screen may also display a small interface such as an application icon or a floating icon corresponding to the first interface. Based on this, it is convenient for the original screen user to still view the first interface or operate the first interface, and it can avoid the first interface interfering with other focused tasks on the first screen.

[0482] For example, as shown in FIG32, when the first screen displays interface E (i.e., the first interface) in full screen and interface D is displayed on interface E (i.e., the first interface) in the form of a floating window, in response to the user's two-finger quick sliding operation on interface E (i.e., the first interface) on the first screen and then leaving, the vehicle terminal decides to display interface E (i.e., the first interface) in full screen on the second screen after the flow according to the display type of interface E (i.e., the first interface) when it was displayed on the first screen before the flow. Among them, after the flow shown in FIG32, the first screen may display an icon (such as an application icon or a floating icon) corresponding to interface E (i.e., the first interface).

[0483] Alternatively, for the case where the first interface is displayed in full screen or split screen on the first screen before the flow, after the first interface flows from the first screen to the second screen, the first screen can also display the first interface in the form of a floating window, picture-in-picture or card that occupies a small display area. Based on this, it is convenient for the original screen user to still view the first interface or operate the first interface, and the interference of the first interface with other focused tasks on the first screen can be avoided. For example, as shown in Figure 32, after interface E flows from the first screen to the second screen, when the user clicks the icon (or floating window, picture-in-picture or card, etc.) corresponding to interface E on the first screen, interface E can flow from the second screen back to the first screen.

[0484] For example, as shown in Figure 33, when the first screen is split to display interface A (i.e., the first interface) and interface B, and the second screen is split to display interface C and interface D, assuming that interface C and interface D are not preset focus application interfaces, and interface A is the preset focus application interface, in response to the user's operation of quickly sliding two fingers on interface A (i.e., the first interface) on the first screen and then leaving, the vehicle-mounted terminal can decide to display the first interface in full screen through the second screen after the flow is transferred.

[0485] Or optionally, if interface C and / or interface D are preset focused application interfaces, after interface A (i.e., the first interface) shown in Figure 33 flows from the first screen to the second screen, the second screen can display the first interface in the form of a floating window.

[0486] After the flow shown in FIG33 , interface A (i.e., the first interface) is displayed on the first screen. The first interface is displayed on the first screen in the form of a floating window, a picture-in-picture, or a card. It should also be noted that the above embodiment of the present application only uses the first screen including multiple task interfaces as an example. The method provided in the embodiment of the present application is also applicable to the case where the first screen includes a single interface.

[0487] Also, it should be noted that the above-mentioned embodiment of the present application only takes the cross-screen transfer of a task interface (i.e., the first interface) as an example. The method provided by the embodiment of the present application can also support the one-time cross-screen transfer of multiple task interfaces. For example, if the user's multi-finger quick swipe and leave operation acts on the display area where multiple task interfaces are located on the first screen, the on-board terminal will transfer the multiple task interfaces to the second screen across the screen at the same time. It can be understood that based on an interface transfer method provided by an embodiment of the present application, the user can trigger the cross-screen transfer of the task interface from the original screen to the target screen through a cross-screen transfer operation that conforms to the user's operating habits and is easy to remember and operate, so as to meet the diverse needs of users, such as transferring to other passengers for use or assisting other passengers in performing related operations.

[0488] For example, based on an interface flow method provided in an embodiment of the present application, the vehicle-mounted terminal can respond to the driver's operation of transferring the navigation interface (i.e., the first interface) across screens, and display the above-mentioned navigation interface (i.e., the first interface) through the co-pilot screen or other display screens, so that passengers in the corresponding positions can assist the driver in performing navigation-related operations, such as adding waypoints, modifying destinations, etc., eliminating safety hazards when the driver performs navigation-related operations, ensuring vehicle driving safety, and improving user experience.

[0489] For example, based on an interface flow method provided in an embodiment of the present application, the vehicle-mounted terminal can respond to the driver's operation of transferring the music interface (i.e., the first interface) across screens, and display the above-mentioned music interface (i.e., the first interface) through the co-pilot screen or other display screens, so that passengers in the corresponding positions can assist the driver in performing music-related operations, such as music search, music switching, etc., eliminating safety hazards when the driver performs music-related operations, ensuring vehicle driving safety, and improving user experience.

[0490] For example, based on an interface flow method provided in an embodiment of the present application, the vehicle-mounted terminal can respond to the driver's operation of transferring the video call to be answered (i.e., the first interface) across screens, and display the video call interface to be answered (i.e., the first interface) through the co-pilot screen or other display screens, so that passengers in the corresponding position can replace or assist the driver in answering the video call, allowing the driver to focus on driving the vehicle, ensuring vehicle driving safety, and improving user experience.

[0491] For another example, based on an interface transfer method provided in an embodiment of the present application, the vehicle-mounted terminal can, in response to the driver, transfer the cartoon playback interface (i.e., the first interface) to the display screen (e.g., the right rear screen or the left rear screen) where the child is located in the vehicle, making it easier for the child to watch the cartoon. Based on this, it can not only solve the problem of children being unable to play cartoons independently due to not knowing how to search for cartoons, play cartoons, and other related operations, but also enable adults to monitor the activities of children through the display screen, thereby improving the user experience.

[0492] Furthermore, based on an interface transfer method provided in an embodiment of the present application, the vehicle terminal can also analyze the target screen task information and / or the task information of the interface to be transferred, so as to display the task interface transferred from the original screen on the target screen with an appropriate display type after the interface transfer. Through this method, the task interface transferred from the original screen can be displayed as prominently as possible without affecting the task currently focused on by the user on the target screen, thereby reducing the user's subsequent operations and providing the user with a more efficient and user-friendly interface transfer experience.

[0493] For example, if the user is focusing on a task on the target screen, the vehicle terminal can display the task interface transferred from the original screen on the target screen in a split-screen display format, a floating window format, or a picture-in-picture format that does not block the user's focused task.

[0494] For example, if there is no user focused task on the target screen, the vehicle terminal can display the task interface transferred from the original screen in a striking full-screen display format, reducing the user's manual operation of placing the task interface.

[0495] In addition, during the cross-screen flow of the task interface, the task interface can be animated to improve the user's visual experience. For example, when a full-screen task is transferred from the original screen (such as the central control screen) to the target screen (such as the co-pilot screen), when the central control screen and the co-pilot screen are the same width, the user can obtain a more coherent visual effect. However, when the central control screen and the co-pilot screen are different widths, the task interface is displayed in different sizes on the central control screen and the co-pilot screen, which affects the user's visual experience. Therefore, in an embodiment of the present application, the task interface can be animated after it is transferred to the target screen. In one possible implementation, the task interface can be adaptively laid out after the full-screen or split-screen task interface is transferred to the target screen, that is, the task interface is processed according to the size of the target screen so that its display effect adapts to the size of the target screen. In this way, the task interface can be quickly transferred to the target screen by first translating and then scaling the task interface. In another possible implementation, during the flow of the full-screen or split-screen task interface to the target screen, for example, during the process of the task interface crossing the original screen and the target screen, the task interface can be deformed while transferring. In this way, visual continuity can be improved by scaling and translating the task interface simultaneously.

[0496] The above embodiment describes the case of cross-screen flow. As shown in FIG10 , for the case of same-screen flow, that is, if the first operation received by the vehicle terminal in S1002 is used to flow the first interface on the same screen, the vehicle terminal executes the following S1003-2 and S1004-2:

[0497] S1003-2: The vehicle-mounted terminal determines the target location.

[0498] In an embodiment of the present application, the vehicle-mounted terminal can determine the target location based on the received first operation for transferring the first interface to the same screen.

[0499] For example, in the case where the first operation for transferring the first interface to the same screen is a user slowly sliding one or more fingers a certain distance and then releasing the finger, in some embodiments, the vehicle terminal can determine the target location based on the sliding distance of the user's finger. The specific method and process for determining the target location can be found in the detailed description above and will not be repeated here.

[0500] S1004-2: The vehicle-mounted terminal displays the first interface at the target location in a second display type according to the screen task information of the first screen. The second display type is related to the screen task information of the first screen.

[0501] The screen task information of the first screen is used to represent the display type and / or classification information of the task interface on the first screen before the interface is switched. The screen task information of the first screen includes the task information before the first interface is switched.

[0502] In some embodiments, assuming that the first interface is displayed full screen on the first screen before being transferred, the vehicle-mounted terminal can determine that the second display type is a preset display type, such as a floating window, a floating icon, a floating ball, a picture-in-picture, or a card. The specific display type depends on the settings of the vehicle-mounted device (including factory settings or manual settings, etc.). The specific size of the floating window, floating icon, floating ball, picture-in-picture, or card also depends on the settings of the vehicle-mounted device (including factory settings or manual settings, etc.).

[0503] Exemplarily, as shown in FIG34 , when the first interface is displayed in full screen on the first screen before being transferred, in response to the user's operation of slowly sliding two fingers on the first interface for a distance (such as distance L) and then leaving, the vehicle terminal determines that the operation is intended to transfer the first interface to the target position on the same screen. Exemplarily, the target position can be the position where the user's two fingers leave the first screen; or, the target position can also be a preset position, such as the edge of the screen. Taking into account that the first interface is currently displayed in full screen, the vehicle terminal decides the display type of the first interface at the target position after the transfer according to the preset display type, such as a floating window or picture-in-picture as shown in FIG34 .

[0504] In other embodiments, assuming that the first interface is not displayed in full screen at the original position of the first screen before the transfer, and no other task interface is displayed at the target position, the vehicle terminal can determine that the second display type is the display type of the first interface before the transfer. In other words, assuming that the first interface is not displayed in full screen at the original position of the first screen before the transfer, the vehicle terminal can maintain the original display type and move the first interface from the original position to the target position.

[0505] For example, as shown in FIG35 , when the first interface is displayed in the form of a floating window at position A (i.e., the original position) on the first screen, in response to the user's operation of slowly sliding two fingers on the first interface for a distance (e.g., distance L) and then leaving, the vehicle terminal can keep the original floating window of the first interface unchanged and move the floating window (i.e., the first interface) from position A (i.e., the original position) to position B (i.e., the target position) where the user's two fingers leave the first screen. Alternatively, the vehicle terminal can keep the original floating window of the first interface unchanged and move the floating window (i.e., the first interface) from position A (i.e., the original position) to a preset position, such as the edge of the display screen (i.e., the target position).

[0506] Regarding the situation where the first interface is displayed in the original position of the first screen in the form of picture-in-picture, floating icon, card, etc. before the flow, the vehicle terminal can also keep the original display type of the first interface unchanged and move the first interface from the original position to the target position. They are not listed one by one here.

[0507] In other embodiments, assuming that the first interface is displayed on the first screen in a split-screen with other interfaces (such as the second interface) before the flow, and the target position is the task interface (i.e., the second interface) displayed in a split-screen with the first interface, the vehicle-mounted terminal can decide to swap the positions of the first interface and the second interface (i.e., the position of the second interface before the flow is the target position of the first interface).

[0508] For example, as shown in FIG36 , when the first interface and the second interface are displayed in split screen on the first screen, in response to the user's operation of slowly sliding two fingers on the first interface to the display area where the second interface is located and then leaving, the vehicle-mounted terminal can keep the original split screen window of the first interface unchanged and swap the positions of the first interface and the second interface.

[0509] It can be understood that based on an interface flow method provided in an embodiment of the present application, users can trigger the same-screen flow of the task interface from one position on the screen (i.e., the original position) to another position (i.e., the target position) through a same-screen flow operation that conforms to the user's operating habits and is easy to remember and operate, so as to meet the diverse needs of users, such as pinning the full-screen interface to a certain position on the screen, or moving the position of the task interface, or swapping the task interface displayed on the split screen, etc.

[0510] Optionally, based on an interface flow method provided in an embodiment of the present application, the vehicle terminal may also support reverse flow of the first interface that has flowed from the first screen to the second screen.

[0511] For example, as shown in FIG37 , after the vehicle terminal transfers the first interface (interface A shown in FIG37 ) from the first screen to the second screen across screens, the vehicle terminal can reversely transfer the first interface that has been transferred from the first screen to the second screen back to the first screen based on the user's operation of transferring the first interface from the second screen to the first screen across screens. The display type of the first interface after the reverse transfer shown in FIG37 is only an example and is not limited in the embodiments of the present application and depends on the specific circumstances.

[0512] For example, during the reverse flow process, the vehicle terminal can determine that the target screen is the first screen based on the user's first operation on the first interface on the second screen (such as an operation of quickly sliding or sliding away with one or more fingers), and further determine the display type of the first interface on the first screen after the flow based on the screen task information of the first screen at the current moment and / or the task information of the first interface, and further display the first interface through the first screen with the above-determined display type to achieve the reverse flow of the first interface to the first screen. In the reverse flow process, the second screen is the original screen, and the first screen is the target screen. Regarding the specific process of the reverse flow, you can refer to the specific process of the cross-screen flow of the first interface from the first screen to the second screen.

[0513] Or, exemplarily, as shown in FIG38, after the vehicle terminal transfers the first interface (interface E as shown in FIG38) from the first screen to the second screen across screens, the vehicle terminal can reversely transfer the first interface that has been transferred from the first screen to the second screen back to the first screen according to the operation of reversely transferring the first interface triggered by the user on the first screen (the operation of the user clicking the icon corresponding to interface E on the first screen as shown in FIG38). Among them, the display type of the first interface after the reverse flow shown in FIG38 is only an example, and is not limited in the embodiments of the present application, depending on the specific circumstances. For example, the first screen can be the main driver's screen, and the second screen can be the co-driver's screen or the rear screen, so that the user can control the reverse flow of the first interface through the main driver's screen. Among them, the operation of triggering the reverse flow of the first interface on the first screen can also be the operation of clicking the floating window, floating ball, card, etc. corresponding to interface E.

[0514] Or, optionally, based on an interface flow method provided in an embodiment of the present application, after the vehicle terminal flows the first interface from the first screen to the second screen across the screen, the vehicle terminal can also support the same-screen flow of the first interface on the second screen. For example, the vehicle terminal can flow the first interface that flows from the first screen to the second screen from the original position to the target position based on the user's same-screen flow operation. Regarding the same-screen flow of the first interface on the second screen, reference can be made to the specific process of the same-screen flow of the first interface on the first screen in the above embodiment, which will not be repeated here.

[0515] Alternatively, optionally, based on an interface transfer method provided in an embodiment of the present application, after the vehicle terminal transfers the first interface from the first screen to the second screen across screens, the vehicle terminal may also support the first interface to be transferred across screens again to other display screens (such as the third screen). Regarding the cross-screen transfer of the first interface from the second screen to the third screen, reference may be made to the specific process of the cross-screen transfer of the first interface from the first screen to the second screen in the above embodiment, which will not be repeated here.

[0516] It should be noted that in the above-mentioned embodiment of the present application, the vehicle-mounted terminal transfers the first interface displayed on the original screen (such as the first screen) to the target screen (such as the second screen) across the screen according to the user's cross-screen transfer operation. In some embodiments, the vehicle-mounted terminal can also transfer the first interface to the target screen (such as the second screen) according to the user's cross-screen transfer operation when the process corresponding to the first interface has been started but has not yet been displayed. Among them, the user's cross-screen transfer operation is such as the operation of a passenger at the target screen position opening the first interface on the first screen.

[0517] For example, as shown in FIG39 , assuming that the first interface is the homepage of application A, in response to detecting that the user has opened application A on the first screen and determining that the user is a passenger at the second screen position, the vehicle terminal starts application A, draws the homepage interface of application A (i.e., the first interface) and displays the first interface through the second screen. Optionally, as shown in FIG39 , after the vehicle terminal displays the first interface through the second screen, the icon of application A may continue to be displayed on the first screen. Alternatively, after the vehicle terminal displays the first interface through the second screen, the first screen may also display the first interface in the form of a small interface such as a floating window or a floating icon to avoid interference with other focused tasks on the first screen. This is not limited in the embodiments of the present application.

[0518] Alternatively, for example, assuming that the first interface is the next-level interface of a certain interface (such as the third interface), in response to detecting the user's operation of accessing the first interface on the third interface, and determining that the user is a passenger at the second screen position, the vehicle-mounted terminal draws the first interface and displays the first interface through the second screen. Optionally, after the vehicle-mounted terminal displays the first interface through the second screen, the third interface may continue to be displayed on the first screen. Alternatively, after the vehicle-mounted terminal displays the first interface through the second screen, the first screen may no longer display the third interface, which is not limited in the embodiments of the present application.

[0519] Alternatively, assuming that the first interface is the detailed information interface corresponding to a card (i.e., the first interface), and the application corresponding to the card is not currently running, in response to detecting that the user clicks on the card on the first screen, and determining that the user is a passenger at the second screen position, the vehicle terminal starts the application corresponding to the card, draws the detailed information interface of the card (i.e., the first interface), and displays the first interface through the second screen. Optionally, after the vehicle terminal displays the first interface through the second screen, the first screen can also display the first interface in the form of a small interface such as a floating window, a floating icon, or a floating ball to avoid interference with other focused tasks on the first screen, which is not limited in the embodiments of the present application.

[0520] As a possible implementation method, the vehicle-mounted terminal can collect image information in the viewfinder through the camera when receiving the cross-screen flow operation. It can be understood that the viewfinder of the camera usually includes the image of the user who inputs the cross-screen flow operation. Furthermore, the vehicle-mounted terminal can identify the identity of the user who triggered the cross-screen flow operation based on the user image information collected by the camera. Regarding the specific method and process of determining the user identity based on the user image information, reference can be made to conventional technology and will not be repeated here.

[0521] As another possible implementation, upon receiving a cross-screen transfer operation, the vehicle-mounted terminal can draw a touch image corresponding to the cross-screen transfer operation based on information such as the touch position, touch force, and contact area on the first screen. The touch image corresponding to the cross-screen transfer operation is used to represent the contact area between the user's finger and the screen. Furthermore, the vehicle-mounted terminal can determine the identity of the user who triggered the cross-screen transfer operation based on the touch image.

[0522] Taking the first screen as the main driver's screen as an example, it can be understood that, as shown in Figure 40, if the user identity that triggers the cross-screen flow operation is the passenger in the main driver's seat, the contact area between the user's finger and the screen corresponding to the cross-screen flow operation is shown in (a) of Figure 40; if the user identity that triggers the cross-screen flow operation is the passenger in the co-pilot seat, the contact area between the user's finger and the screen corresponding to the cross-screen flow operation is shown in (b) of Figure 40. Among them, it can be seen from the contact area shown in (a) of Figure 40 and the contact area shown in (b) of Figure 40 that the direction of the user's fingertips is towards the upper right and upper left respectively. Based on this, the vehicle terminal can determine the direction of the user's fingertips by analyzing the contact area between the user's finger and the screen, and then determine the user identity that triggered the cross-screen flow operation according to the direction of the user's fingertips.

[0523] Alternatively, the vehicle-mounted terminal may also determine the identity of the user who triggers the cross-screen transfer operation through other methods, which are not specifically limited in the embodiments of the present application.

[0524] It can be understood that based on an interface flow method provided in an embodiment of the present application, the vehicle-mounted terminal can not only trigger the cross-screen flow of the task interface from the original screen to the target screen according to the user's cross-screen flow operation, but also trigger the task interface from one position on the screen (i.e., the original position) to another position (i.e., the target position) according to the user's same-screen flow operation. The same-screen flow can meet the diverse needs of users, such as transferring to other passengers for use or assisting other passengers in performing related operations, or pinning the full-screen interface to a certain position on the screen or moving the position of the task interface.

[0525] Furthermore, based on an interface transfer method provided in an embodiment of the present application, the vehicle terminal can also analyze the target screen task information and / or the task information of the interface to be transferred, so as to display the task interface transferred from the original screen on the target screen with an appropriate display type after the interface transfer. Through this method, the task interface transferred from the original screen can be displayed as prominently as possible without affecting the task currently focused on by the user on the target screen, thereby reducing the user's subsequent operations and providing the user with a more efficient and user-friendly interface transfer experience.

[0526] Part 2: Multi-screen collaborative display method

[0527] The multi-screen collaborative display method provided in the embodiment of the present application can provide users with an immersive viewing experience by collaboratively displaying a picture on multiple display screens. Among them, the content displayed on different display screens or the way of displaying content are different. Based on the multi-screen collaborative display method provided in the embodiment of the present application, when one display screen displays a content interface, other display screens can display content based on the content on the display screen, so that multiple display screens collaboratively present a picture, thereby setting off the atmosphere and providing a better display effect.

[0528] Figure 41 is a schematic diagram of an application scenario of a multi-screen collaborative display method provided by an embodiment of the present application. In the multi-screen collaborative display method provided by an embodiment of the present application, among multiple display screens, a first interface can be displayed on the first display screen, and the second display screen and the third display screen can display content according to the first interface. As shown in Figure 41, in terms of the display screen control mode, the control mechanism of the first display screen, the second display screen and the third display screen can be any of the following: single-core single operating system (OS) control mechanism, single-core multi-OS control mechanism, multi-core multi-OS control mechanism. In terms of display effect, the first interface displayed on the first display screen can be any interface, and the second display screen and the third display screen can display the interface after rendering the first interface, wherein the rendering effect can be any of the following: Gaussian blur, solid color gradient, particle motion effect. Optionally, in the multi-screen collaborative display method provided by an embodiment of the present application, when multiple screens collaboratively display a picture, the peripheral elements of the multiple display screens, such as other devices in the space where the multiple display screens are located, can also be controlled according to the displayed picture to assist in realizing immersive picture display through other devices. For example, as shown in Figure 41, the peripheral elements of the multiple display screens may include atmosphere lights, seats, air conditioners, etc.

[0529] The multi-screen collaborative display method provided in the embodiment of the present application can be applied in a vehicle cockpit scenario, and the first display screen, the second display screen, and the third display screen can be display screens configured in the cockpit. Optionally, the first display screen, the second display screen, and the third display screen can be display screens belonging to the same vehicle-mounted terminal, and the control mechanism of the first display screen, the second display screen, and the third display screen is a one-core multi-screen mechanism (including the above-mentioned single-core single-OS mechanism and single-core multi-OS mechanism); the first display screen, the second display screen, and the third display screen can also be display screens belonging to different vehicle-mounted terminals, and the control mechanism of the first display screen, the second display screen, and the third display screen is a multi-core multi-screen mechanism (including the above-mentioned multi-core multi-OS mechanism).

[0530] In some embodiments of the present application, the second and third displays can be spatially located on either side of the first display. For example, the second and third displays can be located on the left and right sides of the first display, respectively. Of course, the relative positions of the first, second, and third displays can also be in other positions, and the embodiments of the present application do not require the first, second, and third displays to be distributed in the manner described above.

[0531] In some embodiments of the present application, the first display screen may be any of the displays described in the first part of the preceding text (i.e., the content of the interface flow method section) or the third part of the following text (i.e., the content of the audio control method section), and the second display screen and the third display screen may be displays located on both sides of any of the displays. In some embodiments of the present application, when the user turns on the immersive display mode, the multi-screen collaborative display method provided in the embodiments of the present application may be used to display content.

[0532] The following describes the multi-screen collaborative display method provided by the embodiment of the present application in conjunction with specific application scenarios. Hereinafter, the second display screen and the third display screen are respectively located on the left and right sides of the first display screen as an example for explanation. The implementation methods in other relative position scenarios can refer to the implementation methods in this scenario, and will not be described in detail in the embodiments of the present application.

[0533] 1. Single-chip, single-OS control multiple screen scenarios

[0534] In this scenario, the first display screen, the second display screen, and the third display screen belong to the same electronic device (for example, the same vehicle-mounted terminal), and the electronic device is only configured with one OS, and the control mechanism of the first display screen, the second display screen, and the third display screen is a single-chip single-OS control mechanism.

[0535] For example, Figure 42 is a schematic diagram of the architecture of a control system provided in an embodiment of the present application. This control system can be deployed in a single-chip, single-OS electronic device. As shown in Figure 42, the control system may include a display management module, an effects processing module, a first display, a second display, and a third display.

[0536] The display screen management module is used to control and manage the first display screen, the second display screen, and the third display screen. The effect processing module is used to perform effect processing on the first interface displayed on the first display screen, so that the display screen management module can display the first interface after effect processing on the second display screen and the third display screen.

[0537] Optionally, the control system may further include a first application. The first application may be used to draw a first interface and control the first display screen to display the first interface via the display screen management module. The first application is an application installed in the electronic device and running on the first display screen; the first interface may be any interface within the first application.

[0538] Optionally, when the electronic device to which the control system belongs is implemented using the software architecture shown in FIG9C , the display screen management module and the effect processing module in the control system can be deployed in the application framework layer shown in FIG9C .

[0539] It should be understood that the functional modules in the control system described above are only examples. In actual applications, electronic equipment can also be divided into more or fewer functional modules according to other factors, or the functions of each module can be divided in other ways, or the functional modules can be not divided but work as a whole.

[0540] 43 , taking the control system applied to the above-mentioned single-chip single-OS scenario as an example, a multi-screen collaborative display method provided in an embodiment of the present application may include:

[0541] S4301: After drawing a screen to be displayed according to the content to be displayed, the first application in the electronic device sends the drawn screen data to a display screen management module in the electronic device.

[0542] The first application may draw the picture to be displayed in each refresh cycle of the first display screen.

[0543] S4302: The display screen management module synthesizes the screen data to obtain a first interface to be displayed.

[0544] S4303: The display screen management module sends the content of the first interface to the effect processing module in the electronic device.

[0545] S4304: The effect processing module renders the content of the first interface to obtain the second interface and the third interface.

[0546] The rendering process may be any of the following: Gaussian blur processing, pure color gradient processing, particle dynamic effect processing. The specific processing process can be referred to the relevant introduction in the following embodiment, which will not be described in detail here.

[0547] S4305: The effect processing module sends the content of the second interface and the content of the third interface to the display screen management module.

[0548] S4306: After receiving the content of the second interface and the content of the third interface, the display screen management module displays the first interface on the first display screen, displays the second interface on the second display screen, and displays the third interface on the third display screen.

[0549] Based on the above method, when an electronic device with multiple display screens displays a first interface on a first display screen, it can control the second display screen and the third display screen to display special effects interfaces related to the first interface, thereby providing richer display effects and enhancing the user's immersive viewing experience.

[0550] 2. Single-chip multi-OS control multi-screen scenario

[0551] In this scenario, the first display screen, the second display screen, and the third display screen belong to the same electronic device (for example, the same vehicle-mounted terminal), and multiple OSs are configured in the electronic device. The control mechanism of the first display screen, the second display screen, and the third display screen is a single-core multi-OS control mechanism.

[0552] For example, Figure 44 is a schematic diagram of the architecture of a control system provided in an embodiment of the present application. The control system can be deployed in a single-chip, multi-OS electronic device. As shown in Figure 42, the control system includes at least a first OS and a second OS. The first OS includes a first display management module, a first effect processing module, and a first display screen, and the second OS may include a second display management module, a second effect processing module, and a second display screen.

[0553] As an optional implementation, as shown in Case 1 in Figure 42 , the third display screen can belong to the first OS. In this scenario, the first OS is used to control the first and third displays. The specific control method can refer to the control method of the OS in the control system shown in Figure 42 , and will not be described in detail here.

[0554] As another optional implementation, as shown in Case 2 in Figure 42, the third display screen can belong to the second OS. In this scenario, the second OS is used to control the second and third displays. The specific control method can refer to the control method of the OS in the control system shown in Figure 42, and will not be detailed here.

[0555] As another optional implementation, as shown in Case 3 in Figure 42, the third display screen may belong to a third OS. In this case, the control system also includes a third OS, which includes a third display screen management module, a third effect processing module, and a third display screen.

[0556] In each of the above-mentioned methods, each display screen management module in the control system is used to control and manage the corresponding display screen. Each effect processing module is used to perform effect processing on the first interface displayed on the first display screen, so that the display screen management module in the corresponding OS can display the first interface after effect processing on the corresponding display screen.

[0557] Optionally, the first OS may further include a first application. The first application may be used to draw a first interface and control the first display screen to display the first interface through the first display screen management module. The first interface may be any interface in the first application.

[0558] In the above-mentioned single-core multi-OS scenario, multiple OSes in the control system (the first OS and the second OS, or the first OS, the second OS and the third OS) can share memory. The functional modules in each OS can read data from the shared memory, and can also store processed data in the shared memory. Therefore, it can provide higher access efficiency and save data storage space of the control system.

[0559] It should be understood that the functional modules in the control system described above are only examples. In actual applications, electronic equipment can also be divided into more or fewer functional modules according to other factors, or the functions of each module can be divided in other ways, or the functional modules can be not divided but work as a whole.

[0560] 45 , taking the control system applied to the above-mentioned single-core multi-OS scenario as an example, a multi-screen collaborative display method provided in an embodiment of the present application may include:

[0561] S4501: After drawing a screen to be displayed according to the content to be displayed, the first application in the first OS of the electronic device sends the drawn screen data to the first display screen management module in the first OS.

[0562] The first application may draw the picture to be displayed in each refresh cycle of the first display screen.

[0563] S4502: The first display screen management module synthesizes the screen data to obtain a first interface to be displayed.

[0564] S4503: The first display screen management module determines the target content based on the content of the first interface, and stores the target content in the shared memory of the first OS and the second OS of the electronic device; wherein the target content is the content of the first interface or the content obtained after the first effect processing module performs partial or full rendering processing on the content of the first interface.

[0565] The rendering process may be any of the following: Gaussian blur processing, pure color gradient processing, particle dynamic effect processing. The specific processing process can be referred to the relevant introduction in the following embodiment, which will not be described in detail here.

[0566] In some embodiments of the present application, after the first display screen management module obtains the first interface, it can directly use the content of the first interface as the target content and store it in the shared memory; or, after the first display screen management module obtains the first interface, it can perform a partial rendering process (i.e., a partial process of a complete rendering process) on the content of the first interface through the first effect processing module, and use the obtained content as the target content and store it in the shared memory; or, after the first display screen management module obtains the first interface, it can perform the entire rendering process (i.e., a complete rendering process) on the content of the first interface through the first effect processing module, and use the obtained content as the target content and store it in the shared memory.

[0567] The method by which the first display screen management module determines the target content can be dynamically adjusted based on the performance of the first and second OSes. For example, when the utilization rate of the central processing unit (CPU) or graphics processing unit (GPU) allocated to the first OS exceeds a set value, the first display screen management module can directly use the content of the first interface as the target content, or can use the content obtained by the first effect processing module after partially rendering the content of the first interface as the target content. In this method, when the processing pressure of the CPU or GPU of the first OS is high, the first OS does not render the content of the first interface or only renders it partially, leaving the remaining rendering work to the second OS, thereby avoiding or reducing the pressure on the CPU or GPU of the first OS and improving overall processing efficiency. For another example, when it is determined that the utilization rate of the central processing unit (CPU) or graphics processing unit (GPU) allocated to the second OS is higher than a set value, the first OS can use the content obtained by partially or fully rendering the content of the first interface as the target content. In this way, when the processing pressure of the CPU or GPU of the second OS is relatively high, the first OS performs partial or full rendering processing on the content of the first interface, so that the first OS shares part of the rendering processing work, which can reduce or avoid the pressure of the rendering processing process on the CPU or GPU of the second OS, thereby improving the overall processing efficiency.

[0568] S4504: The first display screen management module displays the first interface on the first display screen.

[0569] S4505: The second display screen management module in the second OS of the electronic device obtains the target content from the shared memory.

[0570] S4506: The second display screen management module determines whether the target content is content that has been fully rendered. If so, execute step S4507; otherwise, execute step S4508.

[0571] S4507: The second display screen management module synthesizes the target content to obtain a second interface, and then executes step S4509.

[0572] S4508: The second display screen management module renders the target content through the second effect processing module to obtain a second interface, and then executes step S4509.

[0573] When the target content is not rendered, the second effect processing module can perform a complete rendering process on the target content to obtain the second interface. When the target content is partially rendered, the second effect processing module can perform the remaining rendering process on the target content to obtain the second interface.

[0574] S4509: The second display screen management module displays the second interface on the second display screen.

[0575] The above process shows a method in which the first OS and the second OS in the electronic device display interfaces on the first display and the second display, respectively. For the third display, there are the following three situations:

[0576] 1) When the third display screen belongs to the first OS, the method for the first OS to display an interface on the third display screen may be: after obtaining the first interface, the first display screen management module sends the content of the first interface to the first effect processing module; the first effect processing module renders the content of the first interface to obtain the third interface; the first effect processing module sends the content of the third interface to the first display screen management module; and the first display screen management module displays the third interface based on the received content.

[0577] 2) When the third display screen belongs to the second OS, the method for the second OS to display the interface on the third display screen can refer to the method for the second OS to display the second interface on the second display screen described in steps S4505 to S4509 in the above process, which will not be repeated here.

[0578] 3) When the third display screen belongs to the third OS, the method for the third OS to display the interface on the third display screen can refer to the method for the second OS to display the second interface on the second display screen described in steps S4505 to S4509 in the above process, which will not be repeated here.

[0579] Based on the above method, multiple OSs in an electronic device can collaborate to achieve the effect of displaying the first interface on the first display screen and displaying special effect interfaces related to the first interface on the second display screen and the third display screen, thereby providing richer display effects and enhancing the user's immersive viewing experience.

[0580] 3. Multi-core and multi-OS control multi-screen scenario

[0581] In this scenario, the first display screen, the second display screen, and the third display screen belong to different electronic devices (for example, different vehicle-mounted terminals), and one or more OSs can be configured in each electronic device. Each OS can include one or more display screens. The control mechanism of the first display screen, the second display screen, and the third display screen is a multi-core multi-OS control mechanism.

[0582] For example, Figure 46 is a schematic diagram of the architecture of a control system provided in an embodiment of the present application. The control system can be deployed in multiple electronic devices. Taking the first display screen and the second display screen in the control system as an example, which are deployed in different electronic devices and belong to different OS, as shown in Figure 46, the control system includes at least a first electronic device and a second electronic device, wherein the first electronic device includes at least a first OS, and the second electronic device includes at least a second OS. The first OS includes a first display screen management module, a first effect processing module, and a first display screen, and the second OS includes a second display screen management module, a second effect processing module, and a second display screen.

[0583] Optionally, the first electronic device may include only the first OS, or may include more OSs. The same applies to the second electronic device.

[0584] As an optional implementation, the third display screen (not shown in FIG46 ) can belong to the first OS or the second OS. In this scenario, the specific control method of the first OS or the second OS controlling multiple display screens can be referred to the control method of the OS in the control system shown in FIG42 , and will not be described in detail here.

[0585] As another optional embodiment, the third display screen may belong to a third OS, which includes a third display screen management module, a third effect processing module, and a third display screen. In one possible scenario, the third OS may belong to the first electronic device or the second electronic device. In another possible scenario, the third OS may belong to the third electronic device, in which case the control system also includes a third electronic device. The manner in which multiple OSs in the first electronic device, the second electronic device, or the third electronic device control the display screens can refer to the OS control method in the control system shown in FIG44 , and will not be described in detail here.

[0586] In each of the above-mentioned methods, each display screen management module in the control system is used to control and manage the corresponding display screen. Each effect processing module is used to perform effect processing on the first interface displayed on the first display screen, so that the display screen management module in the corresponding OS can display the first interface after effect processing on the corresponding display screen.

[0587] Optionally, the first OS may further include a first application. The first application may be used to draw a first interface and control the first display screen to display the first interface through the first display screen management module. The first interface may be any interface in the first application.

[0588] In the multi-core, multi-OS scenario described above, multiple OSs belonging to the same electronic device in the control system can share memory. Different electronic devices (or OSs of different electronic devices) cannot share memory, but can send and receive data via network streams.

[0589] It should be understood that the functional modules in the control system described above are only examples. In actual applications, electronic equipment can also be divided into more or fewer functional modules according to other factors, or the functions of each module can be divided in other ways, or the functional modules can be not divided but work as a whole.

[0590] 47 , taking the control system applied to the multi-core multi-OS scenario as an example, a multi-screen collaborative display method provided in an embodiment of the present application may include:

[0591] S4701: After drawing a screen to be displayed according to the content to be displayed, the first application in the first OS of the first electronic device sends the drawn screen data to the first display screen management module in the first OS.

[0592] The first application may draw the picture to be displayed in each refresh cycle of the first display screen.

[0593] S4702: The first display screen management module synthesizes the screen data to obtain a first interface to be displayed.

[0594] S4703: The first display screen management module determines the target content based on the content of the first interface and sends the target content to the second electronic device; wherein the target content is the content of the first interface or the content obtained after the first effect processing module partially or fully renders the content of the first interface.

[0595] Among them, regarding the methods of rendering processing, target content, and the method of determining target content, reference can be made to the relevant description of step S4503 in the aforementioned embodiment, and will not be repeated here.

[0596] S4704: The second display screen management module in the second OS of the second electronic device determines whether the target content received by the second electronic device is content that has been fully rendered. If so, execute step S4705; otherwise, execute step S4706.

[0597] S4705: The second display screen management module synthesizes the target content to obtain a second interface, and then executes step S4707.

[0598] S4706: The second display screen management module renders the target content through the second effect processing module to obtain a second interface, and then executes step S4707.

[0599] When the target content is not rendered, the second effect processing module can perform a complete rendering process on the target content to obtain the second interface. When the target content is partially rendered, the second effect processing module can perform the remaining rendering process on the target content to obtain the second interface.

[0600] S4707: The second effect processing module displays the second interface on the second display screen.

[0601] The above process shows a method in which the first OS of the first electronic device and the second OS of the second electronic device display interfaces on the first display and the second display, respectively. For the third display, there are the following five situations:

[0602] 1) When the third display screen belongs to the first OS, the method for the first OS to display an interface on the third display screen may be: after obtaining the first interface, the first display screen management module sends the content of the first interface to the first effect processing module; the first effect processing module renders the content of the first interface to obtain the third interface; the first effect processing module sends the content of the third interface to the first display screen management module; and the first display screen management module displays the third interface based on the received content.

[0603] 2) When the third display screen belongs to the second OS, the method for the second OS to display the interface on the third display screen can refer to the method for the second OS to display the second interface on the second display screen described in steps S4704 to S4707 in the above process, which will not be repeated here.

[0604] 3) When the third display screen belongs to the third OS and the third OS belongs to the first electronic device, the method for the third OS to display the interface on the third display screen can refer to the method for the first OS to display the third interface on the third display screen described in case 1) in the above process, and will not be repeated here.

[0605] 4) When the third display belongs to the third OS and the third OS belongs to the second electronic device, the method for the third OS to display the interface on the third display can refer to the method for the second OS to display the second interface on the second display described in steps S4704 to 4707 in the above process, which will not be repeated here.

[0606] 5) When the third display screen belongs to the third OS and the third OS belongs to the third electronic device, the method for the third OS to display the interface on the third display screen can refer to the method described in steps S4703 to S4707 in the above process, which will not be repeated here.

[0607] Based on the above method, multiple OSs in multiple electronic devices can collaborate to achieve the effect of displaying the first interface on the first display screen and displaying special effect interfaces related to the first interface on the second display screen and the third display screen, thereby providing richer display effects and enhancing the user's immersive viewing experience.

[0608] The rendering processing method described in the above embodiment is introduced below with reference to specific examples.

[0609] 1. Gaussian blur processing

[0610] 48 , taking the control system provided in the above embodiment as an example, a Gaussian blur processing method provided in an embodiment of the present application may include:

[0611] S4801: The effect processing module determines the first interface according to the content of the first interface from the display screen management module.

[0612] The effect processing module and the display screen management module may be the effect processing module and the display screen management module in any OS described in the above embodiments, respectively.

[0613] S4802: The effect processing module copies the interface of the set size close to the target display screen in the first interface to obtain a first target interface; wherein the target display screen is any display screen in the OS where the effect processing module is located.

[0614] Optionally, the target display screen may be the second display screen or the third display screen described in the above embodiment.

[0615] In some embodiments of the present application, the display screen management module can pre-acquire the positional relationship between the target display screen and other display screens. The effect processing module can determine the positional relationship between the target display screen and the first display screen based on the positional relationship acquired by the display screen management module, and then determine the position of the first target interface intercepted from the first interface based on the positional relationship. For example, when the target display screen is located on the left side of the first display screen, the effect processing module can crop and copy the interface of the set size on the left side of the first interface as the first target interface. For another example, when the target display screen is located on the right side of the first display screen, the effect processing module can crop and copy the interface of the set size on the right side of the first interface as the first target interface.

[0616] For example, as shown in the schematic diagram (a) in Figure 49, in a scenario where the second display screen and the third display screen are located on the left and right sides of the first display screen, respectively, the first interface may be the first interface displayed on the first display screen shown in the schematic diagram (a) in Figure 49. Taking the setting size as one-third of the size of the first interface as an example, when the target display screen is the second display screen, the first target interface may be interface 1 shown in the schematic dia...

Claims

1. A control method, applied to a first electronic device, characterized in that: The first electronic device includes a first display screen and a second display screen, and the method includes: Displaying a first interface on the first display screen; Upon receiving a first operation for transferring a first interface on the first display screen, transferring the first interface according to the intention of the first operation; the transfer includes same-screen transfer and cross-screen transfer; When the flow is a cross-screen flow, after completing the flow of the first interface, the display type of the first interface on the second display screen is related to the task information before the flow of the first interface and / or the screen task information of the second display screen; the task information before the flow of the first interface is used to characterize the display type and / or classification information of the first interface before the flow of the first interface; the screen task information of the second display screen is used to characterize the display type and / or classification information of the task interface on the second display screen before the flow of the first interface, and the classification information is used to characterize whether the interface is the preset focused application interface of the screen.

2. The method according to claim 1, wherein The display type includes any one of the following: application window, floating window, floating icon, floating ball, picture-in-picture, card, control or notification.

3. The method according to claim 1 or 2, wherein: The cross-screen flow includes: Displaying a first sub-content on the first display screen, and displaying a second sub-content on the second display screen; wherein the first interface includes a first content, and the first content includes the first sub-content and the second sub-content; or The first display screen does not display the first interface, and the second display screen displays the first interface; or The first interface is displayed on the first display screen, and the first interface is displayed on the second display screen.

4. The method according to claim 3, wherein The first operation is an operation of sliding one or more fingers on the first interface at a sliding speed greater than a preset threshold and then leaving the interface. The first operation is used to transfer the first interface across screens.

5. The method according to claim 4, wherein When the transition is a cross-screen transition, the transition of the first interface according to the intention of the first operation includes: Determining the second display screen as a target screen for cross-screen transfer based on a sliding direction of the first operation and a positional relationship between the first display screen and the plurality of display screens; wherein the sliding direction points to the second display screen; Transfer the first interface across screens to the second display screen.

6. The method according to any one of claims 3 to 5, characterized in that: The display type of the first interface after the transition is the same as the display type of the first interface before the transition.

7. The method according to claim 6, wherein Before the transfer, the display type of the first interface on the first display screen is full-screen display; after the transfer of the first interface is completed, the display type of the first interface on the second display screen is full-screen display.

8. The method according to any one of claims 3 to 5, characterized in that: The display type of the first interface after the transition is related to the classification information of the first interface before the transition; Among them, the first interface is a preset focused application interface of the first display screen before the flow; after the flow of the first interface is completed, the display type of the first interface on the second display screen is full-screen display.

9. The method according to claim 7 or 8, wherein The display type of the first interface after the transfer is also related to the screen task information of the second display screen; Before the first interface is switched, the task interface is not displayed on the second display screen, the task interface is not displayed in full screen, or the preset focus application interface of the second display screen is not displayed.

10. The method according to any one of claims 3 to 5, characterized in that: The display type of the first interface after the transition is related to the screen task information of the second display screen; Among them, before the first interface is transferred, the task interface is not displayed on the second display screen, the task interface is not displayed in full screen, or the preset focus application interface of the second display screen is not displayed; after the transfer of the first interface is completed, the display type of the first interface is full screen display.

11. The method according to any one of claims 3 to 5, characterized in that: The display type of the first interface after the transition is related to the screen task information of the second display screen; Among them, before the first interface flows, the second display screen displays a task interface in full screen or displays the preset focus application interface of the second display screen; after the flow of the first interface is completed, the first interface and other task interfaces on the second display screen are displayed in split screen.

12. The method according to claim 11, wherein The display type of the first interface after the transfer is also related to the task information of the first interface before the transfer; Among them, before the first interface is transferred, the display type of the first interface is full-screen display or the first interface is a preset focused application interface of the first display screen.

13. The method according to any one of claims 3 to 5, characterized in that: The display type of the first interface after the transition is related to the screen task information of the second display screen; Among them, before the first interface flows, the second display screen displays a task interface in full screen or displays the preset focus application interface of the second display screen; after the flow of the first interface is completed, the display type of the first interface is split-screen display, floating window, floating icon, floating ball, picture-in-picture, card, or control.

14. The method according to claim 13, wherein The display type of the first interface after the transition is the same as the display type of the first interface before the transition.

15. The method according to any one of claims 3 to 14, wherein: The method further comprises: When a first interface is displayed on the first display screen, a first audio corresponding to the first interface is played by a first audio output device; The method further comprises: In response to the first operation, the first display screen does not display the first interface, and the second display screen displays the first interface; In response to the first operation, the first audio output device stops playing the first audio and plays the first audio using a second audio output device; or continues playing the first audio using the first audio output device; or plays the first audio using an audio output device of a specified type located in a first spatial area where the first display screen is located; The first audio output device is associated with a first sound zone, and the second audio output device is associated with a second sound zone; the first sound zone is a candidate sound zone associated with the first display screen among multiple candidate sound zones, and the second sound zone is a candidate sound zone associated with the second display screen among the multiple candidate sound zones; among the multiple candidate sound zones, each candidate sound zone is associated with one or more audio output devices within the first spatial area; and / or, the first audio output device includes at least one audio output device of the same type, and the second audio output device includes at least one audio output device of the same type; wherein the type includes at least one of the following: a state type for indicating the dynamic or static state of the audio output device; a location type for indicating the location range of the audio output device; a device type of the audio output device.

16. The method according to claim 15, wherein If the first audio is media audio or call audio; or the service providing the first audio is a media service or a call service; in response to the first operation, the first audio output device does not play the first audio, and uses the second audio output device to play the first audio.

17. The method according to claim 15 or 16, wherein: If the first audio is any one of the following audios: navigation sound, notification sound, system sound, alarm sound; or, the service providing the first audio is any one of the following services: navigation service, notification service, system service, alarm service; or, the display type corresponding to the first interface is any one of the following: floating window, picture-in-picture, control, card; in response to the first operation, continue to use the first audio output device to play the first audio.

18. The method according to any one of claims 15 to 17, wherein: If the first audio is a call-type audio, in response to the first operation, the first audio is played using all audio output devices of a set type located in the first spatial area.

19. The method according to claim 15, wherein The method further comprises: In response to a first voice instruction from a first user, playing a third audio using an audio output device associated with the first audio zone; wherein the spatial area where the first user is located is the spatial area associated with the first audio zone; In response to a second voice instruction of a second user, a fourth audio is played using the audio output device associated with the second sound zone; wherein the spatial area where the second user is located is the spatial area associated with the second sound zone.

20. The method according to any one of claims 15 to 19, wherein: When the first display screen does not display the first interface, and before the second display screen displays the first interface, the method further includes: Displaying a second interface on the second display screen and playing a second audio corresponding to the second interface using a third audio output device; wherein the third audio output device is associated with the second sound zone; The displaying the first interface on the second display screen includes: The first interface is displayed on the second display screen, and the second interface is not displayed; In response to the received first operation, the first display screen does not display the first interface, and after the second display screen displays the first interface, the method further includes: The third audio output device does not play the second audio.

21. The method according to claim 20, wherein After the third audio output device stops playing the second audio, the method further includes: In response to the received second operation, the second display screen does not display the first interface, and displays the second interface on the second display screen; Continue to play the second audio using the third audio output device.

22. The method according to claim 20, wherein After the third audio output device stops playing the second audio, the method further includes: In response to the received third operation, the first interface is displayed on the first display screen, the first interface is not displayed on the second display screen, and the second interface is displayed on the second display screen; Continue to play the first audio using the first audio output device, and continue to play the second audio using the third audio output device.

23. The method according to any one of claims 15 to 22, wherein: After the first display screen does not display the first interface, and after the second display screen displays the first interface, the method further includes: When the display area of ​​the first interface on the second display screen is a partial area of ​​the second display screen, in response to receiving a fourth operation, displaying the first interface in full screen on the second display screen; The first audio is played by the audio output device associated with the second audio zone, and the first audio is not played by the audio output device associated with the first audio zone.

24. The method according to any one of claims 15 to 23, wherein: Before playing the first audio corresponding to the first interface using the first audio output device, the method further includes: determining the first audio output device; The step of determining the first audio output device includes: determining the first sound range according to the first display screen; An audio output device with the highest priority among the at least one audio output device is selected as the first audio output device.

25. The method according to claim 24, characterized in that Selecting an audio output device with the highest priority from the at least one audio output device as the first audio output device includes: Obtaining a priority ranking of at least one audio output device associated with the first audio zone; According to the priority ranking of the at least one audio output device, an audio output device with the highest priority is selected from the at least one audio output device as the first audio output device.

26. The method of claim 24, wherein: The determining the first sound range according to the first display screen includes: According to the set association relationship between the display screen and the candidate sound zones, selecting the candidate sound zone associated with the first display screen from the multiple candidate sound zones as the first sound zone; or The first sound zone is determined according to a received sound zone selection operation; wherein the sound zone selection operation is used to select a candidate sound zone from the multiple candidate sound zones as the first sound zone.

27. The method according to any one of claims 15 to 26, wherein: Before the first audio output device stops playing the first audio and uses the second audio output device to play the first audio, the method further includes: determining the second audio output device; The step of determining the second audio output device includes: determining the second sound range according to the second display screen; Obtaining a priority ranking of at least one audio output device associated with the second audio zone; According to the priority ranking of the at least one audio output device associated with the second sound zone, an audio output device with the highest priority is selected from the at least one audio output device associated with the second sound zone as the second audio output device.

28. The method according to any one of claims 3, 8 to 27, wherein: When the first display screen does not display the first interface, and before the second display screen displays the first interface, the method further includes: Displaying a second interface on the second display screen and using a third audio output device to play a second audio corresponding to the second interface; wherein the third audio output device is associated with a second sound zone, and the second sound zone is a candidate sound zone associated with the second display screen among multiple candidate sound zones; and each candidate sound zone among the multiple candidate sound zones is associated with one or more audio output devices in the first spatial area where the first display screen is located; The displaying the first interface on the second display screen includes: Displaying the first interface and the second interface on the second display screen in split screen; or Displaying the first interface in a first window on the second display screen; wherein the first window is superimposed on the window where the second interface is located, and a size of the first window is smaller than a size of the window where the second interface is located; In response to the received first operation, the first display screen does not display the first interface, and after the second display screen displays the first interface, the method further includes: Continue to play the second audio using the third audio output device.

29. The method according to any one of claims 3 to 14, wherein: The method further comprises: When the first interface is displayed on the first display screen, playing the first audio corresponding to the first content by using the first audio output device; The method further comprises: In response to the first operation, displaying a first sub-content on the first display screen, and displaying a second sub-content on the second display screen; or displaying the first interface on the first display screen, and displaying the first interface on the second display screen; In response to the first operation, playing the first audio using a second audio output device and a third audio output device; or playing the first audio using an audio output device of a specified type located in a first spatial area where the first display screen is located; The first audio output device is associated with a first sound zone, the second audio output device is associated with the first sound zone, and the third audio output device is associated with a second sound zone; the first sound zone is a candidate sound zone associated with the first display screen among multiple candidate sound zones, and the second sound zone is a candidate sound zone associated with the second display screen among the multiple candidate sound zones; among the multiple candidate sound zones, each candidate sound zone is associated with one or more audio output devices within the first spatial area; and / or the first audio output device includes at least one audio output device of the same type, the second audio output device includes at least one audio output device of the same type, and the third audio output device includes at least one audio output device of the same type; wherein the type includes at least one of the following: a state type for indicating the dynamic or static state of the audio output device; a location type for indicating the location range of the audio output device; and a device type of the audio output device.

30. The method of claim 29, wherein: The second audio output device is the same as the first audio output device; and / or The second audio output device and the third audio output device are of the same type.

31. The method according to claim 29 or 30, wherein After the first display screen displays the first interface, and after the second display screen displays the first interface, the method further includes: In response to the received second operation, the first display screen does not display the first interface, and the first interface continues to be displayed on the second display screen; the first audio is played using the audio output device associated with the second audio zone, and the audio output device associated with the first audio zone does not play the first audio; or In response to the received third operation, the first interface continues to be displayed on the first display screen, and the first interface is not displayed on the second display screen; the first audio is played using the audio output device associated with the first sound zone, and the first audio is not played by the audio output device associated with the second sound zone.

32. The method according to claim 29 or 30, wherein: After the first sub-content is displayed on the first display screen and the second sub-content is displayed on the second display screen, the method further includes: In response to the received fourth operation, the second display screen does not display the second sub-content, and the first interface is displayed on the first display screen; the first audio is played using the audio output device associated with the first audio zone, and the audio output device associated with the second audio zone does not play the first audio; or In response to the received sixth operation, the first display screen does not display the first sub-content, and the first interface is displayed on the second display screen; the first audio is played using the audio output device associated with the second sound zone, and the audio output device associated with the first sound zone does not play the first audio.

33. The method according to any one of claims 29 to 32, wherein: Before playing the first audio corresponding to the first interface using the first audio output device, the method further includes: determining the first audio output device; The step of determining the first audio output device includes: determining the first sound range according to the first display screen; An audio output device with the highest priority among the at least one audio output device is selected as the first audio output device.

34. The method of claim 33, wherein: Selecting an audio output device with the highest priority from the at least one audio output device as the first audio output device includes: Obtaining a priority ranking of at least one audio output device associated with the first audio zone; According to the priority ranking of the at least one audio output device, an audio output device with the highest priority is selected from the at least one audio output device as the first audio output device.

35. The method of claim 33, wherein: The determining the first sound range according to the first display screen includes: According to the set association relationship between the display screen and the candidate sound zones, selecting the candidate sound zone associated with the first display screen from the multiple candidate sound zones as the first sound zone; or The first sound zone is determined according to a received sound zone selection operation; wherein the sound zone selection operation is used to select a candidate sound zone from the multiple candidate sound zones as the first sound zone.

36. The method according to any one of claims 29 to 35, wherein: Before playing the first audio using the second audio output device and the third audio output device, the method further includes: determining the second audio output device; and determining the third audio output device; Wherein, determining the third audio output device includes: determining the second sound range according to the second display screen; Obtaining a priority ranking of at least one audio output device associated with the second audio zone; According to the priority ranking of the at least one audio output device associated with the second sound zone, an audio output device with the highest priority among the at least one audio output device associated with the second sound zone is selected as the third audio output device.

37. The method according to any one of claims 15 to 36, wherein: The first spatial area is a spatial area within the vehicle cabin, and any audio output device includes at least one of the following: a vehicle speaker, a headrest speaker, and a Bluetooth headset.

38. The method according to any one of claims 3 to 37, wherein: After the flow of the first interface is completed, a floating window, a floating icon, a floating ball, an application icon or a card corresponding to the first interface is displayed on the first display screen.

39. The method of claim 38, wherein After completing the transfer of the first interface, the method further includes: Upon receiving an operation in which a user clicks on a floating window, floating icon, floating ball, application icon, or card corresponding to the first interface displayed on the first display screen, switching the first interface back to the first display screen across screens; Among them, after the first interface is transferred back to the first display screen across the screen, the display type of the first interface is related to the task information when the first interface is displayed on the second display screen and / or the screen task information of the first display screen when the first operation is received.

40. The method according to any one of claims 3 to 39, wherein: After the first display screen does not display the first interface, and after the second display screen displays the first interface, the method further includes: Upon receiving an operation for transferring the first interface to the first display screen across screens, transferring the first interface back to the first display screen across screens; Among them, after the first interface is transferred back to the first display screen across the screen, the display type of the first interface is related to the task information when the first interface is displayed on the second display screen and / or the screen task information of the first display screen when the first operation is received.

41. The method according to any one of claims 3 to 40, wherein: The first electronic device further includes a third display screen. After transferring the first interface to the second display screen across screens, the method further includes: When receiving an operation for transferring the first interface to a third display screen across screens, transferring the first interface to the third display screen across screens; Among them, after the first interface is transferred across the screen to the third display screen, the display type of the first interface is related to the task information when the first interface is displayed on the second display screen and / or the screen task information of the third display screen when the first operation is received.

42. The method according to any one of claims 1 to 41, wherein: When a first operation of the user to switch to the first interface on the first display screen is received, one or more first task interfaces are displayed on the first display screen, and the one or more first task interfaces include the first interface.

43. The method according to any one of claims 1 to 42, wherein: The first display screen is any one of the following screens of the vehicle: main driver's screen, co-driver's screen, left rear screen, right rear screen; the second display screen is any one of the following screens of the vehicle: main driver's screen, co-driver's screen, left rear screen, right rear screen; and the second display screen is different from the first display screen.

44. The method according to any one of claims 1 to 43, wherein: The first electronic device further includes a fourth display screen and a fifth display screen; wherein the fourth display screen and the fifth display screen are respectively located on both sides of the first display screen; The method further comprises: When the first interface is displayed on the first display screen, the third interface is displayed on the fourth display screen, and the fourth interface is displayed on the fifth display screen; Among them, the third interface is the interface obtained after the first effect processing is performed on the part of the interface in the first interface close to the fourth display screen; the fourth interface is the interface obtained after the first effect processing is performed on the part of the interface in the first interface close to the fifth display screen; the first effect processing is any one of the following: Gaussian blur processing, pure color gradient processing, particle motion effect processing.

45. The method of claim 44, wherein: After receiving a first operation for switching the first interface on the first display screen, the method further includes: When the transfer is a cross-screen transfer, the third interface is not displayed on the fourth display screen, and the fourth interface is not displayed on the fifth display screen.

46. ​​The method according to claim 44 or 45, wherein The first electronic device includes a first OS and a second OS; wherein the first OS is used to control the first display screen, and the second OS is used to control the fourth display screen; The displaying of the third interface on the fourth display screen includes: determining a fifth interface through the first OS; wherein the fifth interface is: the first interface, or a portion of the first interface close to the fourth display screen, or an interface obtained by performing part or all of the first effect processing on the portion of the first interface close to the fourth display screen; storing the fifth interface in the first memory through the first OS; acquiring the fifth interface from the first memory through the second OS; determining, by the second OS, the third interface according to the fifth interface; The third interface is displayed on the fourth display screen through the second OS.

47. The method of claim 46, wherein The determining the third interface according to the fifth interface by the second OS includes: When the fifth interface is the first interface, the second OS determines, based on the fifth interface, a portion of the first interface close to the fourth display screen, and performs the first effect processing on the portion of the first interface close to the fourth display screen to obtain the third interface; or When the fifth interface is a portion of the first interface close to the fourth display screen, the second OS performs the first effect processing on the fifth interface to obtain the third interface; or When the fifth interface is an interface obtained by performing a portion of the first effect processing on a portion of the first interface close to the fourth display screen, the second OS performs the remaining portion of the first effect processing on the fifth interface to obtain the third interface; or When the fifth interface is an interface obtained by performing all the processing steps of the first effect processing on a portion of the first interface close to the fourth display screen, the second OS uses the fifth interface as the third interface.

48. The method according to any one of claims 1 to 43, wherein: The first electronic device further includes a fourth display screen and a fifth display screen; wherein the fourth display screen and the fifth display screen are respectively located on both sides of the first display screen; The method further comprises: When the first interface is displayed on the first display screen, the third interface is displayed on the fourth display screen, and the third interface is displayed on the fifth display screen; wherein, the third interface is an interface obtained by performing particle motion effect processing on the first interface.

49. The method of claim 48, wherein After receiving a first operation for switching the first interface on the first display screen, the method further includes: When the transfer is a cross-screen transfer, the third interface is not displayed on the fourth display screen, and the third interface is not displayed on the fifth display screen.

50. The method according to claim 48 or 49, wherein The first electronic device includes a first OS and a second OS; wherein the first OS is used to control the first display screen, and the second OS is used to control the fourth display screen; The displaying of the third interface on the fourth display screen includes: Determining a fourth interface through the first OS; wherein the fourth interface is: the first interface, or an interface obtained by performing part or all of the particle motion effect processing on the first interface; storing the fourth interface in the first memory through the first OS; acquiring the fourth interface from the first memory through the second OS; determining the third interface according to the fourth interface by the second OS; The third interface is displayed on the fourth display screen through the second OS.

51. The method according to any one of claims 44 to 45, 48 to 49, wherein: The first display screen, the fourth display screen, and the fifth display screen belong to the same OS.

52. The method according to any one of claims 1 to 6, 8, 10 to 12, wherein: The displaying of the first interface on the first display screen includes: Displaying the first interface in a first area on the first display screen; The method further comprises: When the first interface is displayed on the first display screen, a third interface is displayed in the second area on the first display screen; The second area is an area on the first display screen other than the first area; and the third interface is an interface obtained by performing particle motion effect processing on the first interface.

53. The method of claim 52, wherein: After receiving a first operation for switching the first interface on the first display screen, the method further includes: When the flow is a cross-screen flow, the third interface is not displayed on the first display screen.

54. The method according to any one of claims 1 to 43, wherein: The first electronic device further includes a fourth display screen; and before receiving a first operation for switching the first interface on the first display screen, the method further includes: When the first interface is displayed on the first display screen, a third interface is displayed on the fourth display screen; Sending the fourth interface to the second electronic device so that the second electronic device displays the fourth interface on a fifth display screen; or sending the fifth interface to the second electronic device so that the second electronic device generates a fourth interface based on the fifth interface and displays the fourth interface on a fifth display screen; Among them, the second electronic device includes the fifth display screen, and the fourth display screen and the fifth display screen are respectively located on both sides of the first display screen; the third interface is an interface obtained by performing the first effect processing on the part of the interface of the first interface close to the fourth display screen; the fourth interface is an interface obtained by performing the first effect processing on the part of the interface of the first interface close to the fifth display screen; the fifth interface is: the part of the interface of the first interface close to the fifth display screen, or the part of the interface of the first interface close to the fifth display screen is subjected to part or all of the processing of the first effect processing; the first effect processing is any one of the following: Gaussian blur processing, solid color gradient processing, particle motion effect processing.

55. The method according to any one of claims 1 to 43, wherein: The method further comprises: When the first interface is displayed on the first display screen, the third interface and the fourth interface are sent to the second electronic device, so that the second electronic device displays the third interface and the fourth interface on the fourth display screen and the fifth display screen, respectively; or, when the first interface is displayed on the first display screen, the first interface is sent to the second electronic device, so that the second electronic device generates the third interface and the fourth interface according to the first interface, and then displays the third interface and the fourth interface on the fourth display screen and the fifth display screen, respectively; Among them, the second electronic device includes the fourth display screen and the fifth display screen, and the fourth display screen and the fifth display screen are respectively located on both sides of the first display screen; the third interface is an interface obtained by performing the first effect processing on the part of the interface of the first interface close to the fourth display screen; the fourth interface is an interface obtained by performing the first effect processing on the part of the interface of the first interface close to the fifth display screen; the first effect processing is any one of the following: Gaussian blur processing, pure color gradient processing, and particle motion effect processing.

56. The method according to any one of claims 1 to 43, wherein: The method further comprises: When the first interface is displayed on the first display screen, the third interface is sent to the second electronic device so that the second electronic device displays the third interface on the fourth display screen, or the fourth interface is sent to the second electronic device so that the second electronic device generates the third interface according to the fourth interface and then displays the third interface on the fourth display screen; When the first interface is displayed on the first display screen, the fifth interface is sent to the third electronic device so that the third electronic device displays the fifth interface on the fifth display screen, or the sixth interface is sent to the third electronic device so that the third electronic device generates the fifth interface according to the sixth interface and then displays the fifth interface on the fifth display screen; Among them, the second electronic device includes the fourth display screen, and the third electronic device includes the fifth display screen, and the fourth display screen and the fifth display screen are respectively located on both sides of the first display screen; the third interface is an interface obtained after the first effect processing is performed on the part of the interface of the first interface close to the fourth display screen; the fourth interface is: the part of the interface of the first interface close to the fourth display screen, or the interface obtained after the part of the interface of the first interface close to the fourth display screen is processed in part or all of the first effect processing; the fifth interface is the interface obtained after the first effect processing is performed on the part of the interface of the first interface close to the fifth display screen; the sixth interface is: the part of the interface of the first interface close to the fifth display screen, or the interface obtained after the part of the interface of the first interface close to the fifth display screen is processed in part or all of the first effect processing; the first effect processing is any one of the following: Gaussian blur processing, solid color gradient processing, particle motion effect processing.

57. The method of claim 1 or 2, wherein: When the transfer is a same-screen transfer, the first operation is an operation of sliding one or more fingers on the first interface at a sliding speed less than or equal to the preset threshold for a distance and then leaving. The first operation is used to transfer the first interface on the same screen.

58. The method of claim 57, wherein: Performing a flow of the first interface according to the intention of the first operation includes: Transferring the first interface to the target location on the same screen; The target position is the termination position of the first operation on the first display screen; or, the target position is calculated according to the first operation; or, the target position is a preset position of the edge of the first display screen.

59. The method of claim 58, wherein Before the first interface is switched, the first display screen displays the first interface and the second interface in a split screen; the first operation is an operation in which the user slides one or more fingers on the first interface at a sliding speed less than or equal to the preset threshold for a distance in the direction of the second interface and then leaves; After the flow of the first interface is completed, the positions of the first interface and the second interface are swapped.

60. An electronic device, characterized in that: The electronic device includes a display, a memory, and one or more processors; The memory is used to store computer program code, which includes computer instructions; when the computer instructions are executed by the one or more processors, the electronic device executes the method according to any one of claims 1 to 59.

61. A chip system, characterized in that The chip system includes a processing circuit and a storage medium, wherein the storage medium stores instructions; when the instructions are executed by the processing circuit, the processing circuit executes the method according to any one of claims 1 to 59.

62. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is run on a computer, the computer is caused to execute the method according to any one of claims 1 to 59.

63. A computer program product, characterized in that The computer program product includes a computer program or instructions, and when the computer program or instructions are run on a computer, the computer is caused to execute the method according to any one of claims 1 to 59.

Images