A control method and electronic device

Abstract

This application provides a control method and electronic device. This method can provide users with an efficient and intelligent interface display that meets their needs and habits in multi-tasking scenarios. In this application, when an electronic device, such as an in-vehicle terminal, receives a user's operation for interface transition, it analyzes the specific intent of the operation to determine whether it is a cross-screen transition or a same-screen transition, thus providing the user with a better intelligent interface display service. For example, if the intent is determined to be a cross-screen transition, the interface transitioning from the original screen can be displayed on the target screen with an appropriate display type after the transition, based on the actual display situation before the first interface transition and / or the interface display situation on the second screen. This method can balance not interrupting the target screen's current focused task and displaying the task interface transitioning from the original screen with a prominent display effect, providing users with a more user-friendly interface transition experience.

Description

[0001] Cross-references to related applications

[0002] This application claims priority to Chinese Patent Application No. 202210911043.X, filed on July 29, 2022, entitled "A Method for Transferring Vehicle Interfaces and a Vehicle Terminal", the entire contents of which are incorporated herein by reference; and Chinese Patent Application No. 202210912601.4, filed on July 30, 2022, entitled "An Audio Control Method and an Electronic Device", filed on July 30, 2022, also incorporated herein by reference. Technical Field

[0003] This application relates to the field of vehicle-mounted equipment technology, and more particularly to a control method and electronic device. Background Technology

[0004] With the rapid development of intelligent vehicle technology, more and more displays are being installed in vehicles to provide users with a more personalized and human-centered experience. For example, vehicle displays include not only the central control display (hereinafter referred to as "central control screen"), but also the passenger-side display (hereinafter referred to as "passenger-side screen") and displays located in other positions, such as the left rear seat display (hereinafter referred to as "left rear screen" or "rear left screen") and the right rear seat display (hereinafter referred to as "right rear screen" or "rear right screen"). Passengers can watch videos or play games on the displays at their seats. Furthermore, drivers and passengers, or passengers themselves, can interact through the displays, such as switching between interfaces and performing collaborative operations.

[0005] Existing intelligent in-vehicle terminals (hereinafter referred to as "in-vehicle terminals") typically support full-screen cross-screen interaction between in-vehicle displays. For example, Figure 1 As shown, the vehicle-mounted terminal can perform operations based on the user-instructed interface (such as...). Figure 1 The gesture shown (sliding a finger from the first screen to the second screen) transitions the full-screen video playback window from the first screen (e.g., the driver's screen) to the second screen (e.g., the passenger's screen). However, in actual use, in-vehicle displays often show multiple concurrent task interfaces. For example, video call interfaces are often displayed alongside navigation and music interfaces. Therefore, how to handle interface transitions in this situation and provide intelligent displays that meet user needs and habits is a problem that requires further research. Summary of the Invention

[0006] This application provides a control method and electronic device that can provide users with an efficient and intelligent interface display that meets user needs and habits in multi-tasking scenarios.

[0007] In a first aspect, embodiments of this application provide a control method that can be applied to the interface transition process of an electronic device, such as an in-vehicle terminal, wherein the in-vehicle terminal includes multiple displays (such as a first screen (or first display screen) and a second screen (or second display screen)); the method includes: upon receiving a first operation for transitioning a first interface on the first screen, the in-vehicle terminal transitions the first interface according to the intent of the first operation; wherein the transition includes same-screen transition and cross-screen transition; when performing cross-screen transition of the first interface, after the transition of the first interface is completed, the display type of the first interface on the second screen is related to the task information before the transition of the first interface and / or the screen task information of the second screen.

[0008] The task information before the first interface transition is used to characterize the display type and / or classification information of the first interface before the transition. The classification information is used to characterize whether the first interface is the preset focused application interface of the first screen. The screen task information of the second screen is used to characterize the display type and / or classification information of the task interface on the second screen before the transition of the first interface. The classification information is used to characterize whether the interface is the preset focused application interface of the screen.

[0009] The solution provided in the first aspect above involves the in-vehicle terminal, upon receiving a user's operation for interface transition, analyzing the specific intent of the operation to determine whether it is a cross-screen transition or a same-screen transition, thus providing the user with a better intelligent interface display service. For example, if the intent of the first operation is determined to be a cross-screen transition, the in-vehicle terminal can, based on the actual display situation before the first interface transition and / or the interface display situation on the second screen, display the task interface transitioning from the original screen on the target screen with an appropriate display type after the interface transition. This method allows the task interface transitioning from the original screen to be displayed with the most prominent display effect possible without interrupting the user's current task on the target screen, thereby reducing subsequent user operations and providing a more user-friendly interface transition experience.

[0010] In one possible design, the aforementioned display types include any of the following: application window, floating window, floating icon, floating ball, picture-in-picture, card, control, or notification. The solution provided in this application is applicable to the transition of various display types of the first interface, and is not limited to the display type of the interface on the second screen before the transition. Regardless of the scenario, the solution provided in this application can be used to display the task interface transitioning from the original screen with the most prominent display effect without affecting the user's current focus on the target screen. It has high applicability and strong practicality.

[0011] In one possible design, the aforementioned first operation is a swipe of one or more fingers on the first interface at a speed exceeding a preset threshold, followed by a swipe away. This first operation is used for cross-screen navigation of the first interface. It is understood that one-finger or multi-finger swipes align with the operating habits of most users, making them easy to remember and use. Therefore, by recognizing specific interface navigation intentions based on different swipe speeds (or swipe accelerations), such as cross-screen navigation intentions and same-screen navigation intentions, it not only facilitates user memorization and operation but also improves the interaction performance between the in-vehicle terminal and the user, thereby enhancing the user experience.

[0012] In one possible design, the aforementioned vehicle-mounted terminal performs a first interface transition according to the intent of the first operation, including: the vehicle-mounted terminal determines the second screen as the target screen for cross-screen transition based on the sliding direction of the first operation and the positional relationship between the first screen and multiple displays; wherein the sliding direction points to the second screen; the vehicle-mounted terminal then transitions the first interface to the second screen. When the vehicle-mounted terminal includes multiple displays (e.g., the first screen and the second screen), the vehicle-mounted terminal necessarily knows the relative positional relationship of the multiple displays. Similarly, when multiple displays (e.g., the first screen and the second screen) belong to different vehicle-mounted terminals, the vehicle-mounted terminal to which the first screen belongs can know the relative positional relationship of the multiple displays. For example, the vehicle-mounted terminal stores the specific positions of the multiple displays. Based on this, in this embodiment, the vehicle-mounted terminal can determine the target screen for cross-screen transition of the first interface based on the sliding direction of the user's finger and the relative positional relationship of the multiple displays.

[0013] In one possible design, the display type of the first interface after the transition is the same as the display type of the first interface before the transition. For example, if the first interface is displayed in full screen before the transition, it can remain in full screen after the transition, ensuring its prominent display. Similarly, if the first interface is displayed as a floating window before the transition, it can remain displayed as a floating window after the transition, without affecting the interface on the target screen. Based on this, the same interface display experience can be maintained before and after the transition.

[0014] In one possible design, the first interface is displayed in full-screen mode on the first screen before the transition; after the transition is complete, the first interface is displayed in full-screen mode on the second screen. This maintains the same striking interface display experience before and after the transition.

[0015] In one possible design, the display type of the first interface after the transition is related to the category information of the first interface before the transition; specifically, the first interface before the transition is the preset focused application interface of the first screen; after the transition of the first interface is completed, the first interface is displayed in full screen on the second screen. It can be understood that the fact that the first interface is the preset focused application interface of the first screen before the transition indicates that this interface receives high user attention or is of high importance, requiring priority in its display. Based on this, displaying the first interface in full screen after the transition ensures its prominent display and facilitates user operation.

[0016] In one possible design, the display type after the transition from the first interface is also related to the screen task information of the second screen. Specifically, before the transition from the first interface, the second screen does not display a task interface, does not display the task interface in full screen, or does not display the preset focused application interface of the second screen. It can be understood that the absence of a task interface, full-screen display of the task interface, or the preset focused application interface of the second screen before the transition indicates that the second screen is not performing a task that receives high user attention or is of high importance. Based on this, displaying the first interface in full screen after the transition ensures that the first interface is prominently displayed and facilitates user operation.

[0017] In one possible design, the display type after the transition from the first interface is related to the screen task information of the second screen. Specifically, before the transition from the first interface, the second screen does not display a task interface, is not displayed in full screen, or does not display the preset focused application interface. After the transition from the first interface, the first interface is displayed in full screen. It can be understood that the absence of a task interface, full screen, or preset focused application interface on the second screen before the transition indicates that the second screen is not performing a task that receives high user attention or is of high importance. Therefore, displaying the first interface in full screen after the transition ensures its prominent display and facilitates user operation.

[0018] In one possible design, the display type after the transition from the first interface is related to the screen task information of the second screen. Before the transition from the first interface, the second screen displays either a full-screen task interface or a preset focused application interface. After the transition from the first interface, the first interface and other task interfaces on the second screen are displayed in a split-screen manner. It can be understood that the full-screen display of a task interface or a preset focused application interface on the second screen before the transition indicates that the second screen is performing a task that is of high user attention or importance. Based on this, the first interface is displayed in a split-screen manner after the transition to avoid interrupting the user's focused task interface on the second screen, providing a more user-friendly transition experience.

[0019] In one possible design, the display type after the transition of the first interface is related to the screen task information of the second screen and the task information of the first interface before the transition. Specifically, before the transition, the first interface is either full-screen or a preset focused application interface for the first screen. The second screen displays a task interface in full-screen mode or a preset focused application interface for the second screen. After the transition of the first interface is complete, the first interface and other task interfaces on the second screen are displayed in a split-screen manner. It can be understood that the fact that the first interface is full-screen or a preset focused application interface for the first screen before the transition indicates that this interface receives high user attention or is of high importance. Similarly, the fact that the second screen displays a task interface in full-screen mode or a preset focused application interface for the second screen indicates that the second screen is performing a task that receives high user attention or is of high importance. Therefore, displaying the first interface in a split-screen manner after the transition ensures the first interface remains prominently displayed while avoiding interrupting the user's focused task interface on the second screen, providing a more user-friendly transition experience.

[0020] In one possible design, the display type after the transition from the first interface is related to the screen task information of the second screen. Before the transition, the second screen displays either a full-screen task interface or a preset focused application interface. After the transition, the first interface is displayed as a split-screen display, floating window, floating icon, floating ball, picture-in-picture, card, or control. It can be understood that the full-screen display of a task interface or a preset focused application interface before the transition indicates that the second screen is performing a task that is of high user attention or importance. Therefore, displaying the first interface in a non-full-screen format (e.g., a floating window or picture-in-picture) after the transition avoids interrupting the user's focused task on the second screen, providing a more user-friendly transition experience.

[0021] In one possible design, the display type of the first interface after the transition is the same as the display type of the first interface before the transition. For example, the first interface is displayed as a floating window on the first screen before the transition, and after the transition, the first interface can be displayed as a floating window on the second screen.

[0022] In one possible design, after the initial interface transition is complete, the first screen displays a floating window, floating icon, floating ball, application icon, or card corresponding to the initial interface. This allows users on the first screen to continue viewing or interacting with the initial interface, while preventing it from interfering with other tasks requiring focused attention.

[0023] In one possible design, when the above-mentioned transition is a screen-sharing transition, the first operation is the action of swiping one or more fingers on the first interface at a speed less than or equal to a preset threshold for a certain distance and then leaving. This first operation is used for screen-sharing the first interface. By conforming to the operating habits of most users, making it easy for users to remember and trigger the screen-sharing transition, the interaction performance between the in-vehicle terminal and the user can be improved while making it easier for users to remember and operate, thereby enhancing the user experience.

[0024] In one possible design, the aforementioned vehicle-mounted terminal performs screen scrolling of the first interface according to the intent of the first operation, including: the vehicle-mounted terminal scrolling the first interface to a target position; wherein, the target position is the termination position of the first operation on the first screen; or, the target position is calculated by the vehicle-mounted terminal based on the first operation; or, the target position is a preset position at the edge of the first screen. Based on this, screen scrolling functions such as fixing (pinning) the first interface to a certain position on the screen and moving the position of the first interface can be realized to meet the diverse needs of users.

[0025] In one possible design, before the first interface transition, the first screen displays both the first and second interfaces in a split-screen manner. The first operation is when a user uses one or more fingers to slide a certain distance from the first interface towards the second interface at a speed less than or equal to a preset threshold, and then leaves the first interface. After the first interface transition is complete, the vehicle terminal swaps the positions of the first and second interfaces. Based on this, the position swapping of the split-screen interfaces can be achieved conveniently and quickly.

[0026] In one possible design, after the first interface is transferred across screens to the second screen, the method further includes: upon receiving an operation to transfer the first interface across screens to the first screen, the vehicle terminal transfers the first interface back to the first screen; wherein, after the first interface is transferred back to the first screen, the display type of the first interface is related to the task information when the first interface is displayed on the second screen and / or the screen task information of the first screen when the vehicle terminal receives the first operation. This application supports arbitrary transfer of interfaces between multiple screens, including reverse transfer.

[0027] In one possible design, the aforementioned vehicle-mounted terminal further includes a third screen. After the first interface is transferred across screens to the second screen, the method further includes: upon receiving an operation to transfer the first interface across screens to the third screen, the vehicle-mounted terminal transfers the first interface across screens to the third screen; wherein, after the first interface is transferred across screens to the third screen, the display type of the first interface is related to the task information of the first interface when it is displayed on the second screen and / or the screen task information of the third screen when the vehicle-mounted terminal receives the first operation. This application supports arbitrary transfer of interfaces between multiple screens, including relay transfer.

[0028] In one possible design, upon receiving a user's first operation to navigate to the first interface on the first screen, the first screen displays one or more first task interfaces, which include the first interface. The solution provided in this application is applicable to multi-tasking scenarios.

[0029] In one possible design, the aforementioned first screen is any one of the following screens in the vehicle: driver's side screen, passenger side screen, left rear screen, and right rear screen. As an example, the solution provided in this application is applicable to interface transitions on any screen of the driver's side screen, passenger side screen, left rear screen, or right rear screen in a vehicle.

[0030] In one possible design, the second screen is any one of the following screens in the vehicle: the driver's screen, the passenger's screen, the left rear screen, and the right rear screen; and the second screen is different from the first screen. As an example, the solution provided in this application is applicable to switching the interface to any screen in the vehicle.

[0031] Secondly, embodiments of this application provide a control method that can collaboratively display a single image using multiple displays to provide a user with an immersive viewing experience. This method can be applied to an electronic device including a first display, a second display, and a third display, wherein the second and third displays are located on opposite sides of the first display. The method may include: displaying a first interface on the first display, displaying a second interface on the second display, and displaying a third interface on the third display; wherein the second interface is an interface obtained by applying a first effect processing to a portion of the first interface closer to the second display; the third interface is an interface obtained by applying the first effect processing to a portion of the first interface closer to the third display; the first effect processing is any one of the following: Gaussian blur processing, solid color gradient processing, or particle animation processing.

[0032] In this method, when an electronic device with multiple displays displays a first interface on a first display, it can control the second and third displays to simultaneously display different special effects interfaces related to the first interface by displaying special effects interfaces corresponding to a portion of the first interface closer to the second display on a second display and displaying special effects interfaces corresponding to a portion of the first interface closer to the third display on a third display. Thus, by presenting a single interface through the collaboration of multiple displays, a richer display effect can be provided, enhancing the user's immersive viewing experience.

[0033] In one possible design, the second interface and the third interface may have the same or different dimensions.

[0034] In this method, the size relationship between the second and third interfaces can be flexibly set, which helps to improve the flexibility of the interface display.

[0035] In one possible design, the method further includes: upon receiving a first operation for transferring a first interface on the first display screen, transferring the first interface according to the intent of the first operation; the transfer includes same-screen transfer and cross-screen transfer; after receiving the first operation for transferring the first interface on the first display screen, the method further includes: when it is determined that the transfer is a cross-screen transfer, the second interface is not displayed on the second display screen, and the third interface is not displayed on the third display screen.

[0036] In this method, when the first interface displayed on the first display screen undergoes cross-screen transition, the electronic device can stop displaying the special effects interface related to the first interface on the displays on both sides of the first display screen, and can turn off the special effects in time to avoid unnecessary power consumption.

[0037] In one possible design, the first electronic device includes a first OS and a second OS; wherein the first OS is used to control the first display screen, and the second OS is used to control the second display screen; displaying the second interface on the second display screen includes: determining a fourth interface through the first OS; wherein the fourth interface is: the first interface, or a portion of the first interface closer to the second display screen, or an interface obtained after performing part or all of the processing steps of the first effect processing on the portion of the first interface closer to the second display screen; storing the fourth interface in a first memory through the first OS; retrieving the fourth interface from the first memory through the second OS; determining the second interface based on the fourth interface through the second OS; and displaying the second interface on the second display screen through the second OS.

[0038] In this method, different displays can be controlled by different operating systems (OS). When displaying the special effects interface corresponding to the first interface, the process of generating the special effects interface can be completed by the OS of any one display, or by different OSes working together. Therefore, this method offers high flexibility and can flexibly select the OS to execute the special effects interface generation process based on the processing capabilities or processing pressure of different OSes, thereby improving processing efficiency. Furthermore, different OSes can share memory, allowing each OS to read data from shared memory and store processed data in shared memory, thus providing high access efficiency and saving data storage space.

[0039] In one possible design, determining the second interface based on the fourth interface by the second OS includes: when the fourth interface is the first interface, the second OS determines a portion of the first interface closest to the second display screen based on the fourth interface, and applies the first effect processing to this portion of the first interface closest to the second display screen to obtain the second interface; or, when the fourth interface is a portion of the first interface closest to the second display screen, the second OS applies the first effect processing to the fourth interface to obtain the second interface; or, when the fourth interface is an interface obtained after performing part of the first effect processing on the portion of the first interface closest to the second display screen, the second OS performs the remaining processing on the fourth interface to obtain the second interface; or, when the fourth interface is an interface obtained after performing all of the first effect processing on the portion of the first interface closest to the second display screen, the second OS uses the fourth interface as the second interface.

[0040] In this method, if the interface obtained by the second OS from the first OS is the original interface without special effects processing, the second OS can perform complete special effects processing on that interface. If the interface obtained by the second OS from the first OS is an interface with partial special effects processing, the second OS can perform the remaining special effects processing on that interface. If the interface obtained by the second OS from the first OS is an interface with complete special effects processing, the second OS can directly use that interface. Therefore, the second OS can perform corresponding subsequent processing according to the processing progress of the first OS, exhibiting high flexibility. When the first OS is under heavy processing pressure, the second OS can undertake some or all of the special effects processing tasks, thereby improving processing efficiency.

[0041] In one possible design, the first display screen, the second display screen, and the third display screen belong to the same operating system.

[0042] In this method, the first display screen, the second display screen, and the third display screen belong to the same OS, so that the OS can directly and quickly control the three display screens, thereby improving the control efficiency to a certain extent.

[0043] Thirdly, embodiments of this application provide a control method that can collaboratively display a single image through multiple displays to provide a user with an immersive viewing experience. This method can be applied to electronic devices including a first display, a second display, and a third display, wherein the second and third display are located on opposite sides of the first display; the method may include: displaying a first interface on the first display, displaying a second interface on the second display, and displaying the second interface on the third display; wherein the second interface is an interface obtained by applying particle animation effects to the first interface.

[0044] In this method, when an electronic device with multiple displays shows a first interface on the first display, it can also display special effects interfaces corresponding to the first interface on the second and third displays. This allows multiple displays to work together to present a single interface, thereby providing richer display effects and enhancing the user's immersive viewing experience.

[0045] In one possible design, the method further includes: upon receiving a first operation for transferring the first interface on the first display screen, transferring the first interface according to the intent of the first operation; the transfer includes same-screen transfer and cross-screen transfer; after receiving the first operation for transferring the first interface on the first display screen, the method further includes: when the transfer is a cross-screen transfer, the second interface is not displayed on the second display screen and the second interface is not displayed on the third display screen.

[0046] In this method, when the first interface displayed on the first display screen undergoes cross-screen transition, the display of special effects related to the first interface can be stopped on other display screens, thus turning off the special effects in a timely manner and avoiding unnecessary power consumption.

[0047] In one possible design, the first electronic device includes a first OS and a second OS; wherein the first OS is used to control the first display screen, and the second OS is used to control the second display screen; displaying the second interface on the second display screen includes: determining a third interface through the first OS; wherein the third interface is: the first interface, or an interface obtained after performing part or all of the particle motion effect processing on the first interface; storing the third interface in a first memory through the first OS; retrieving the third interface from the first memory through the second OS; determining the second interface based on the third interface through the second OS; and displaying the second interface on the second display screen through the second OS.

[0048] In this method, different displays can be controlled by different operating systems (OS). When displaying the special effects interface corresponding to the first interface, the process of generating the special effects interface can be completed by the OS of any one display, or by different OSes working together. Therefore, this method offers high flexibility and can flexibly select the OS to execute the special effects interface generation process based on the processing capabilities or processing pressure of different OSes, thereby improving processing efficiency. Furthermore, different OSes can share memory, allowing each OS to read data from shared memory and store processed data in shared memory, thus providing high access efficiency and saving data storage space.

[0049] In one possible design, the first display screen, the second display screen, and the third display screen belong to the same operating system.

[0050] In this method, the first display screen, the second display screen, and the third display screen belong to the same OS, so that the OS can directly and quickly control the three display screens, thereby improving the control efficiency to a certain extent.

[0051] Fourthly, embodiments of this application provide a control method that can provide users with an immersive viewing experience by simultaneously displaying a content interface and a corresponding special effects interface on a single display screen. This method can be applied to an electronic device including a first display screen, and may include: displaying a first interface in a first area on the first display screen and displaying a second interface in a second area on the first display screen; wherein the second area is an area on the first display screen other than the first area; and the second interface is an interface obtained by applying particle animation effects to the first interface.

[0052] In this method, when the electronic device displays the first interface on the first display screen, it can simultaneously display the content interface and the special effects interface on the same display screen by displaying the special effects interface in the display area outside the first interface on the first display screen. Therefore, it can provide richer display effects and enhance the user's immersive viewing experience.

[0053] In one possible design, the method further includes: upon receiving a first operation for transferring a first interface on the first display screen, transferring the first interface according to the intent of the first operation; the transfer includes same-screen transfer and cross-screen transfer; after receiving the first operation for transferring the first interface on the first display screen, the method further includes: when the transfer is a cross-screen transfer, the second interface is not displayed on the first display screen.

[0054] In this method, when the first interface displayed on the first display screen undergoes cross-screen transition, the display screen can stop displaying the special effects interface related to the first interface, thus turning off the special effects in a timely manner and avoiding unnecessary power consumption.

[0055] Fifthly, embodiments of this application provide a control method that can collaboratively display a single image through multiple displays to provide a user with an immersive viewing experience. This method can be applied to a first electronic device including a first display and a second display; the method can include: displaying a first interface on the first display and a second interface on the second display; sending a third interface to the second electronic device so that the second electronic device displays the third interface on a third display; or sending a fourth interface to the second electronic device so that the second electronic device displays the third interface on the third display after generating the third interface based on the fourth interface; wherein the second electronic device includes the third display, and the second and third display are respectively located on opposite sides of the first display; the second interface is an interface obtained by applying a first effect processing to a portion of the first interface closer to the second display; the third interface is an interface obtained by applying the first effect processing to a portion of the first interface closer to the third display; the fourth interface is: a portion of the first interface closer to the third display, or an interface obtained by applying part or all of the first effect processing to a portion of the first interface closer to the third display; the first effect processing is any one of the following: Gaussian blur processing, solid color gradient processing, particle animation processing.

[0056] In this method, when the first electronic device displays a first interface on a first display screen, it can control its second display screen to display a special effects interface corresponding to the first interface. Simultaneously, by sending the first interface, or a first interface with partial or complete special effects processing, to the second electronic device, the first electronic device can determine the special effects interface corresponding to the first interface and then display the corresponding special effects interface on its third display screen. Therefore, this method supports the first and second electronic devices in collaboratively displaying the first interface on the first display screen and the related special effects interfaces on the second and third display screens, thereby providing richer display effects and enhancing the user's immersive viewing experience.

[0057] In one possible design, the second interface and the third interface may have the same or different dimensions.

[0058] In this method, the size relationship between the second and third interfaces can be flexibly set, which helps to improve the flexibility of the interface display.

[0059] Sixthly, embodiments of this application provide a control method that can collaboratively display a single image through multiple displays to provide a user with an immersive viewing experience. This method can be applied to a first electronic device including a first display screen; the method may include: when a first interface is displayed on the first display screen, sending a second interface and a third interface to a second electronic device, so that the second electronic device displays the second interface and the third interface on a second display screen and a third display screen respectively; or, when the first interface is displayed on the first display screen, sending the first interface to the second electronic device, so that the second electronic device generates a second interface and a third interface based on the first interface and then displays the second interface and the third interface on a second display screen and a third display screen respectively; wherein, the second electronic device includes a second display screen and a third display screen, the second display screen and the third display screen being located on opposite sides of the first display screen; the second interface is an interface obtained by applying a first effect processing to a portion of the first interface closer to the second display screen; the third interface is an interface obtained by applying the first effect processing to a portion of the first interface closer to the third display screen; the first effect processing is any one of the following: Gaussian blur processing, solid color gradient processing, particle animation processing.

[0060] In this method, when the first electronic device displays a first interface on a first display screen, it sends the first interface, or a first interface with partial or complete special effects processing, to a second electronic device. This enables the second electronic device to determine the special effects interface corresponding to the first interface, and subsequently display the corresponding special effects interface on its second and third display screens. Therefore, this method supports the first and second electronic devices in collaboratively displaying the first interface on the first display screen and the related special effects interface on the second and third display screens, thereby providing richer display effects and enhancing the user's immersive viewing experience.

[0061] In one possible design, the second interface and the third interface may have the same or different dimensions.

[0062] In this method, the size relationship between the second and third interfaces can be flexibly set, which helps to improve the flexibility of the interface display.

[0063] In a seventh aspect, embodiments of this application provide a control method that can collaboratively display a single screen to provide a user with an immersive viewing experience. This method can be applied to a first electronic device including a first display screen; the method may include: when a first interface is displayed on the first display screen, sending a second interface to a second electronic device to cause the second electronic device to display the second interface on the second display screen; or sending a third interface to the second electronic device to cause the second electronic device to display the second interface on the second display screen after generating the second interface based on the third interface; when the first interface is displayed on the first display screen, sending a fourth interface to a third electronic device to cause the third electronic device to display the fourth interface on the third display screen; or sending a fifth interface to the third electronic device to cause the third electronic device to display the fourth interface on the third display screen after generating the fourth interface based on the fifth interface; wherein the second electronic device includes the second display screen, the third electronic device includes the third display screen, and the second display screen and the third display screen... The display screens are located on both sides of the first display screen; the second interface is an interface obtained by applying a first effect processing to a portion of the first interface closer to the second display screen; the third interface is a portion of the first interface closer to the second display screen, or an interface obtained by applying part or all of the first effect processing to a portion of the first interface closer to the second display screen; the fourth interface is an interface obtained by applying the first effect processing to a portion of the first interface closer to the third display screen; the fifth interface is a portion of the first interface closer to the third display screen, or an interface obtained by applying part or all of the first effect processing to a portion of the first interface closer to the third display screen; the first effect processing is any one of the following: Gaussian blur processing, solid color gradient processing, particle animation processing.

[0064] In this method, when the first electronic device displays a first interface on the first display screen, it sends the first interface, or a first interface with partial or complete special effects processing, to the second and third electronic devices respectively. This enables the second and third electronic devices to determine the special effects interface corresponding to the first interface and then display the corresponding special effects interface on their own displays. Therefore, this method supports the first, second, and third electronic devices to collaboratively display the first interface on the first display screen and the special effects interface related to the first interface on the second and third display screens, thereby providing richer display effects and enhancing the user's immersive viewing experience.

[0065] In one possible design, the second interface and the third interface may have the same or different dimensions.

[0066] In this method, the size relationship between the second and third interfaces can be flexibly set, which helps to improve the flexibility of the interface display.

[0067] In one possible design, the method described in any one of the second to seventh aspects above further includes: when displaying the first interface on the first display screen, adjusting the control parameters of the air conditioning equipment in the space where the first display screen is located according to the volume of the audio corresponding to the first interface; wherein the control parameters are positively correlated with the volume, and the control parameters include at least one of the following: air outlet air volume, air outlet wind speed, and air outlet time.

[0068] In this method, the electronic device can determine the control parameters of the air conditioning device based on the displayed interface, and control the air conditioning according to the determined control parameters. Therefore, it can provide some auxiliary immersive experience with the help of the air conditioning when displaying content interface, thereby providing richer and more diverse immersive services and improving the user's immersive experience.

[0069] In one possible design, the method described in any one of the second to seventh aspects above further includes: when displaying the first interface on the first display screen, determining the target temperature corresponding to the scene of the first interface according to a preset correspondence between scene and temperature; and adjusting the temperature of the air conditioning equipment in the space where the first display screen is located to the target temperature.

[0070] In this method, the electronic device can determine the temperature parameters of the air conditioner based on the displayed interface, and adjust the temperature of the air conditioner according to the determined temperature parameters. This allows the temperature felt by the user to correspond to the content of the interface seen by the user, thereby improving the user's immersive experience.

[0071] In one possible design, the method described in any one of the second to seventh aspects above further includes: when displaying a first interface on the first display screen, determining a first target color based on at least one color present in the first interface; wherein the first target color is any one of the at least one colors, or the first target color is the average color of some or all of the at least one colors; and adjusting the light color and / or brightness of a first lighting device in the space where the first display screen is located based on the first target color.

[0072] In this method, the electronic device can determine the color, brightness and other control parameters of the lighting device according to the displayed interface, and control the lighting device according to the determined control parameters. Therefore, it can provide some auxiliary immersive experience with the help of the lighting device when displaying content interface, thereby providing richer and more diverse immersive services and improving the user's immersive experience.

[0073] Eighthly, embodiments of this application provide a control method that improves the flexibility and practicality of controlling audio output devices to play audio in scenarios with multiple audio output devices. This method can be applied to a first electronic device and may include: when a first display screen displays first content, playing first audio corresponding to the first content using a first audio output device; wherein the first display screen is any one of a plurality of display screens located within a first spatial region; in response to a received first operation, displaying the first content on the first display screen, and displaying the first content on a second display screen; wherein the second display screen is included among the plurality of display screens; in response to the first operation, the first audio output device does not play the first audio, and the first audio is played using a second audio output device; or, the first audio continues to be played using the first audio output device; or, the first audio is played using an audio output device of a predetermined type located within the first spatial region. The first audio output device is associated with a first audio zone, and the second audio output device is associated with a second audio zone. The first audio zone is a candidate audio zone associated with the first display screen among a plurality of candidate audio zones, and the second audio zone is a candidate audio zone associated with the second display screen among the plurality of candidate audio zones. In the plurality of candidate audio zones, each candidate audio zone is associated with one or more audio output devices within the first spatial region. And / or, the first audio output device includes at least one audio output device of the same type, and the second audio output device includes at least one audio output device of the same type. The type includes at least one of the following: a state type indicating the static or dynamic state of the audio output device; a position type indicating the location range of the audio output device; and a device type of the audio output device. The interface containing the first content is the first interface.

[0074] In this method, in scenarios with multiple displays and audio output devices in a spatial area, when an electronic device displays content and plays corresponding audio on a display, it can select the corresponding audio zone from multiple audio zones and use the audio output device associated with that zone to play the audio. When content on one display is transferred to another, the electronic device can also flexibly select the audio output device used for playing the audio after the transfer. Based on this approach, the control device can partition the displays and audio output devices in the spatial area using audio zones, and flexibly select the audio output device for playing the audio corresponding to the content on each display, without requiring manual intervention, thus achieving high control efficiency. It can also adapt to audio control needs in more common scenarios, exhibiting high versatility and practicality.

[0075] In one possible design, if the first audio is media audio or call audio; or, if the service providing the first audio is a media service or call service; in response to the first operation, the first audio output device does not play the first audio, and the second audio output device plays the first audio.

[0076] In this method, users have a high demand for listening to the corresponding audio when watching media / call content. Therefore, when the electronic device determines that the content transferred from the first display screen to the second display screen is media / call content, or determines that the audio corresponding to the content is media / call audio, or determines that the audio service is a media / call service, it can switch the audio output device that plays the audio of the content. This can achieve the effect of media / call audio following the screen, improving the user's audio listening experience.

[0077] In one possible design, if the first audio is any of the following: navigation tone, notification tone, system tone, alarm tone; or, the service providing the first audio is any of the following: navigation service, notification service, system service, alarm service; or, the display type corresponding to the first content is any of the following: floating window, picture-in-picture, control, card; in response to the first operation, the first audio continues to be played using the first audio output device.

[0078] In this method, navigation tones, notification tones, system tones, and alarm tones are primarily heard by the driver in the vehicle. Therefore, it is more in line with the user's actual needs that these tones do not change when the content corresponding to them changes. This method is more suitable for audio control scenarios in vehicles and ensures a high level of listening experience for the user during control. When users view floating windows, picture-in-picture, controls, and cards, the need to listen to the corresponding audio is relatively low, and the time spent viewing these content changes may be relatively short. Therefore, when these content changes, the corresponding audio does not change, which reduces the complexity of audio control and has a smaller impact on the user experience.

[0079] In one possible design, if the first audio is a call audio, in response to the first operation, the first audio is played using all audio output devices of a set type located within the first spatial region.

[0080] In this method, when the electronic device determines that the audio corresponding to the content transferred from the first display screen to the second display screen is call audio, it switches the audio playback mode to use an audio output device of a specified type within the spatial area. For example, it switches the audio playback mode to use all or some audio output devices of a specified type within the spatial area. For instance, when the video call interface is transferred from the central control screen to the passenger-side screen, it can switch to playing the call audio using all the vehicle's speakers, ensuring that all users within the spatial area can hear the call audio, thereby meeting the needs of users within the spatial area to participate in the call and improving the user experience. As another example, when the video call interface is transferred from the central control screen to the passenger-side screen, it can switch to playing the call audio using the front speakers (driver's seat speaker and passenger seat speaker), satisfying the call experience of front-seat users.

[0081] In one possible design, the method further includes: in response to a first voice instruction from a first user, playing a third audio signal using an audio output device associated with the first audio region; wherein the spatial region where the first user is located is the spatial region associated with the first audio region; and in response to a second voice instruction from a second user, playing a fourth audio signal using an audio output device associated with the second audio region; wherein the spatial region where the second user is located is the spatial region associated with the second audio region.

[0082] In this method, when the electronic device determines that the location of the user who issued the voice instruction has changed (e.g., a user in a different location in the vehicle issues a voice instruction), it can switch the audio output device to play the audio in response to the user's instruction, which can ensure the continuity and smoothness of the user listening to the response audio, thereby improving the user experience.

[0083] In one possible design, in response to a received first operation, the first display screen does not display the first content, and before the second display screen displays the first content, the method further includes: displaying second content on the second display screen and playing second audio corresponding to the second content using a third audio output device; wherein the third audio output device is associated with the second audio region; the step of displaying the first content on the second display screen includes: displaying the first content and the second content in a split-screen manner on the second display screen; or, displaying the first content in a first window on the second display screen; wherein the first window is superimposed on the window containing the second content, and the size of the first window is smaller than the size of the window containing the second content; after the first display screen does not display the first content in response to a received first operation, and after the second display screen displays the first content, the method further includes: continuing to play the second audio using the third audio output device.

[0084] In this method, before the content on the first display screen is transferred to the second display screen, the second display screen can display the content and play the corresponding audio. After the content on the first display screen is transferred to the second display screen, the second display screen can display the transferred content in a split screen or window. The content originally displayed on the second display screen is still partially or fully visible, and the electronic device can continue to play the audio corresponding to the content. This can avoid the situation where the picture and audio do not match, and ensure that the user's audio-visual experience is consistent.

[0085] In one possible design, in response to a received first operation, the first display screen does not display the first content, and before the second display screen displays the first content, the method further includes: displaying second content on the second display screen and playing second audio corresponding to the second content using a third audio output device; wherein the third audio output device is associated with the second audio region; the step of displaying the first content on the second display screen includes: displaying the first content on the second display screen and not displaying the second content; after the first display screen does not display the first content in response to the received first operation, and after the second display screen displays the first content, the method further includes: the third audio output device does not play the second audio.

[0086] In this method, before the content on the first display screen is transferred to the second display screen, the second display screen can display the content and play the corresponding audio. After the content on the first display screen is transferred to the second display screen, the transferred content is displayed in full screen on the second display screen. The content originally displayed on the second display screen is no longer visible to the user, and the electronic device stops playing the audio corresponding to the content. This can avoid the situation where the picture and audio do not match, and ensure that the user's vision and hearing are consistent.

[0087] In one possible design, after the third audio output device stops playing the second audio, the method further includes: in response to a received second operation, the second display screen stops displaying the first content and displays the second content on the second display screen; and continues to play the second audio using the third audio output device.

[0088] In this method, when the transferred content is no longer displayed on the second display screen, the electronic device can use the audio output device that played the audio corresponding to the content on the second display screen before the transferred content to continue playing the audio corresponding to the content originally displayed on the second display screen, thereby continuing the service before the transferred content, improving the continuity of content display and audio playback on the second display screen, and thus improving the user experience.

[0089] In one possible design, after the third audio output device stops playing the second audio, the method further includes: in response to a received third operation, displaying the first content on the first display screen, and the second display screen not displaying the first content and displaying the second content on the second display screen; continuing to play the first audio using the first audio output device, and continuing to play the second audio using the third audio output device.

[0090] In this method, after the content on the first display screen is transferred to the second display screen for display, when the content from the first display screen is removed from the display on the second display screen, the electronic device can switch back to the audio playback mode before the content transfer, thereby continuing the service before the content transfer, improving the continuity of content display and audio playback on the second display screen, and thus improving the user experience.

[0091] In one possible design, in response to a received first operation, the first display screen does not display the first content, and after the second display screen displays the first content, the method further includes: when the first content is a portion of the display area of ​​the second display screen, in response to a received fourth operation, displaying the first content in full screen on the second display screen; and using an audio output device associated with the second audio zone to play only the first audio, while the audio output device associated with the first audio zone does not play the first audio.

[0092] In this method, after content is transferred from the first display screen to the second display screen and is not displayed in full screen, the electronic device can maintain its audio playback mode. When the content, previously displayed in full screen, becomes full screen on the second display screen, the electronic device can switch its audio playback mode and play only the audio corresponding to that content. This method allows for adaptive audio control based on changing scenarios, improving the flexibility of audio control and the user experience.

[0093] In one possible design, before playing the first audio corresponding to the first content using the first audio output device, the method further includes: determining the first audio output device; wherein determining the first audio output device includes: determining the first audio zone based on the first display screen; and selecting the audio output device with the highest priority among the at least one audio output device as the first audio output device. In this method, when the electronic device displays content on the display screen, it can use the audio output device with the highest priority in the display screen's associated audio zone to play the corresponding audio. Based on this method, the electronic device can flexibly select the audio output device to play the audio corresponding to the content on different display screens, and it can do so without manual intervention, thus achieving high control efficiency.

[0094] In one possible design, selecting the audio output device with the highest priority among the at least one audio output devices as the first audio output device includes: obtaining a priority ranking of the at least one audio output device associated with the first audio zone; and selecting the audio output device with the highest priority among the at least one audio output devices as the first audio output device based on the priority ranking of the at least one audio output device.

[0095] In one possible design, determining the first audio region based on the first display screen includes: selecting the candidate audio region associated with the first display screen as the first audio region from among the plurality of candidate audio regions according to a set association relationship between the display screen and the candidate audio regions; or, determining the first audio region based on a received audio region selection operation; wherein the audio region selection operation is used to select one candidate audio region from among the plurality of candidate audio regions as the first audio region.

[0096] In this method, the electronic device can select the audio region associated with the display screen based on the pre-configured association between the display screen and the candidate audio region, or it can select the audio region associated with the display screen based on the user's instructions. On the one hand, it can reduce manual intervention and improve efficiency, and on the other hand, it allows for manual intervention, thus offering high flexibility.

[0097] In one possible design, obtaining the priority order of at least one audio output device associated with the first audio region includes: selecting a target priority information corresponding to the audio type of the first audio from multiple priority information according to a set correspondence between audio type and priority information; wherein each priority information in the multiple priority information is used to indicate a priority order of the at least one audio output device associated with the first audio region, and different priority information corresponds to different audio types; and determining the priority order of the at least one audio output device according to the target priority information.

[0098] In this method, for at least one audio output device associated with the same audio region, the priority order of the at least one audio output device is different when playing different types of audio. Therefore, the electronic device can select a more suitable audio output device for audio playback according to the type of audio to be played, thereby improving the user's listening experience and providing a high degree of flexibility in audio control.

[0099] In one possible design, before the first audio output device plays the first audio and the second audio output device plays the first audio, the method further includes:

[0100] Determine the second audio output device; wherein, determining the second audio output device includes: determining the second audio zone according to the second display screen; selecting the audio output device with the highest priority among at least one audio output device associated with the second audio zone as the second audio output device.

[0101] In one possible design, selecting the audio output device with the highest priority among the at least one audio output devices associated with the second audio region as the second audio output device includes: obtaining a priority ranking of the at least one audio output devices associated with the second audio region; and selecting the audio output device with the highest priority among the at least one audio output devices associated with the second audio region as the second audio output device according to the priority ranking of the at least one audio output device associated with the second audio region.

[0102] In one possible design, the first space area is a space area inside the vehicle cabin, and any audio output device includes at least one of the following: a vehicle speaker, a headrest speaker, and a Bluetooth headset.

[0103] Ninthly, embodiments of this application provide a control method that improves the flexibility and practicality of controlling audio output devices to play audio in scenarios with multiple audio output devices. This method can be applied to a first electronic device and may include: when a first display screen displays first content, playing first audio corresponding to the first content using a first audio output device; wherein the first display screen is any one of a plurality of display screens located within a first spatial region; in response to a received first operation, displaying the first content on the first display screen and displaying the first content on a second display screen; or, in response to a received second operation, displaying first sub-content on the first display screen and displaying second sub-content on the second display screen; wherein the first content includes the first sub-content and the second sub-content; playing the first audio using a second audio output device and a third audio output device; or, playing the first audio using an audio output device of a predetermined type located within the first spatial region; wherein the second display screen is included among the plurality of display screens, and the first audio output... The device is associated with a first audio zone, the second audio output device is associated with the first audio zone, and the third audio output device is associated with a second audio zone; the first audio zone is a candidate audio zone associated with the first display screen among a plurality of candidate audio zones, and the second audio zone is a candidate audio zone associated with the second display screen among the plurality of candidate audio zones; in the plurality of candidate audio zones, each candidate audio zone is associated with one or more audio output devices within the first spatial region; and / or, the first audio output device includes at least one audio output device of the same type, the second audio output device includes at least one audio output device of the same type, and the third audio output device includes at least one audio output device of the same type; wherein, the type includes at least one of the following: a state type for indicating the dynamic or static state of the audio output device; a position type for indicating the location range of the audio output device; and a device type of the audio output device. The interface containing the first content is the first interface.

[0104] In this method, in scenarios with multiple displays and audio output devices in a spatial area, when an electronic device displays content and plays corresponding audio on a display, it can select the corresponding audio zone from multiple audio zones and use the audio output device associated with that zone to play the audio. When content on one display is copied or partially transferred to another display, the electronic device can also flexibly select the audio output device used for playback after the transfer. Based on this approach, the control device can partition the displays and audio output devices in the spatial area using audio zones, and flexibly select the audio output device corresponding to the content on each display based on the audio zones, without requiring manual intervention, thus achieving high control efficiency. It can also adapt to audio control needs in more common scenarios, exhibiting high versatility and practicality.

[0105] In one possible design, the second audio output device is the same as the first audio output device; and / or, the second audio output device is of the same type as the third audio output device.

[0106] In this method, when content is transferred from one display screen to another, the electronic device can continue playing the audio corresponding to that content using the original audio output device, while simultaneously playing the audio corresponding to the content using the audio output device of the new display screen. This ensures a consistent listening experience for users on different display screens. Alternatively, the electronic device can switch to a completely new audio output device of the same type for playback, facilitating consistent audio playback quality and unified management.

[0107] In one possible design, after displaying the first content on the first display screen in response to a received first operation, and after displaying the first content on the second display screen, the method further includes: in response to a received third operation, the first display screen not displaying the first content, and continuing to display the first content on the second display screen; playing the first audio only using the audio output device associated with the second audio zone, while the audio output device associated with the first audio zone does not play the first audio; or, in response to a received fourth operation, continuing to display the first content on the first display screen, and the second display screen not displaying the first content; playing the first audio using the audio output device associated with the first audio zone, while the audio output device associated with the second audio zone does not play the first audio.

[0108] In this method, in scenarios where content is copied, both displays show the same content, and the audio output devices associated with both displays play the corresponding audio. When one display stops displaying the content, the electronic device can turn off the audio output device associated with that display and continue displaying the content on the other display while continuing to play the corresponding audio using the audio output device associated with that display. This satisfies the needs of users on each display and improves the user experience.

[0109] In one possible design, after displaying the first sub-content on the first display screen in response to a received second operation, and after displaying the second sub-content on the second display screen, the method further includes: in response to a received fifth operation, the second display screen not displaying the second sub-content, and displaying the first content on the first display screen; playing the first audio using an audio output device associated with the first audio region, wherein the audio output device associated with the second audio region does not play the first audio; or, in response to a received sixth operation, the first display screen not displaying the first sub-content, and displaying the first content on the second display screen; playing the first audio using an audio output device associated with the second audio region, wherein the audio output device associated with the first audio region does not play the first audio.

[0110] In this method, when displaying content in a spliced ​​format, two screens display the same content, and the audio output devices associated with both screens play the corresponding audio. When one screen stops displaying the content, the electronic device can turn off the audio output device associated with that screen, and can use the other screen to display the complete content and continue playing the corresponding audio using the audio output device associated with that screen. This satisfies the needs of users on each screen and improves the user experience.

[0111] In one possible design, before playing the first audio corresponding to the first content using the first audio output device, the method further includes: determining the first audio output device; wherein, determining the first audio output device includes: determining the first audio zone based on the first display screen; and selecting the audio output device with the highest priority among the at least one audio output device as the first audio output device.

[0112] In one possible design, selecting the audio output device with the highest priority among the at least one audio output devices as the first audio output device includes: obtaining a priority ranking of the at least one audio output device associated with the first audio zone; and selecting the audio output device with the highest priority among the at least one audio output devices as the first audio output device based on the priority ranking of the at least one audio output device.

[0113] In one possible design, determining the first audio region based on the first display screen includes: selecting the candidate audio region associated with the first display screen as the first audio region from among the plurality of candidate audio regions according to a set association relationship between the display screen and the candidate audio regions; or, determining the first audio region based on a received audio region selection operation; wherein the audio region selection operation is used to select one candidate audio region from among the plurality of candidate audio regions as the first audio region.

[0114] In one possible design, obtaining the priority order of at least one audio output device associated with the first audio region includes: selecting a target priority information corresponding to the audio type of the first audio from multiple priority information according to a set correspondence between audio type and priority information; wherein each priority information in the multiple priority information is used to indicate a priority order of the at least one audio output device associated with the first audio region, and different priority information corresponds to different audio types; and determining the priority order of the at least one audio output device according to the target priority information.

[0115] In one possible design, before playing the first audio using the second and third audio output devices, the method further includes: determining the second audio output device; and determining the third audio output device; wherein determining the third audio output device includes: determining the second audio region based on the second display screen; obtaining a priority ranking of at least one audio output device associated with the second audio region; and selecting the audio output device with the highest priority among the at least one audio output device associated with the second audio region as the third audio output device based on the priority ranking of the at least one audio output device associated with the second audio region.

[0116] In one possible design, the first space area is a space area inside the vehicle cabin, and any audio output device includes at least one of the following: a vehicle speaker, a headrest speaker, and a Bluetooth headset.

[0117] In a tenth aspect, this application provides an electronic device including a display screen, a memory, and one or more processors; wherein the memory is used to store computer program code, the computer program code including computer instructions; when the computer instructions are executed by one or more processors, the electronic device causes the electronic device to perform any of the first to ninth aspects or any possible design described in any of the first to ninth aspects.

[0118] In one aspect, this application provides a computer-readable storage medium storing a computer program that, when run on a computer, causes the computer to perform the method described in any one of the first to ninth aspects or any possible design of any one of the first to ninth aspects.

[0119] In a twelfth aspect, this application provides a computer program product comprising a computer program or instructions that, when executed on a computer, cause the computer to perform any of the first to ninth aspects described above or any possible design of any of the first to ninth aspects described above, as described in the method.

[0120] In a thirteenth aspect, this application provides a chip system including a processor and a memory, wherein the memory stores instructions; when the instructions are executed by the processor, they implement the methods of any possible implementation of any of the first to ninth aspects. The chip system may be composed of chips or may include chips and other discrete devices.

[0121] For the beneficial effects described in aspects 10 to 13 above, please refer to the descriptions of the beneficial effects in the corresponding content of aspects 1 to 9 above, which will not be repeated here. Attached Figure Description

[0122] Figure 1 This application provides a schematic diagram of a full-screen cross-screen transition process.

[0123] Figure 2 This is a schematic diagram illustrating a split-screen display of multiple task interfaces provided in an embodiment of this application.

[0124] Figure 3 A schematic diagram illustrating a task interface displayed in full-screen mode, as provided in an embodiment of this application;

[0125] Figure 4 A schematic diagram illustrating a task interface displayed in the form of a floating window, as provided in an embodiment of this application;

[0126] Figure 5 A schematic diagram illustrating a task interface displayed as a floating icon, provided in an embodiment of this application;

[0127] Figure 6 A schematic diagram illustrating a task interface displayed in a picture-in-picture format according to an embodiment of this application;

[0128] Figure 7 A schematic diagram illustrating a task interface displayed in card format, provided for an embodiment of this application;

[0129] Figure 8 A schematic diagram showing two task interfaces provided in the embodiments of this application in the form of notifications;

[0130] Figure 9A A schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application;

[0131] Figure 9B This application provides a schematic diagram of the distribution of a vehicle-mounted terminal display screen.

[0132] Figure 9C A schematic diagram of the software structure of an electronic device provided in an embodiment of this application;

[0133] Figure 10 A flowchart of a vehicle interface transition method provided in this application embodiment;

[0134] Figure 11 This application provides a schematic diagram illustrating the process of displaying multiple task interfaces on a display screen.

[0135] Figure 12 This is a schematic diagram illustrating another process of displaying multiple task interfaces on a display screen, as provided in an embodiment of this application.

[0136] Figure 13 A schematic diagram of a gesture used to represent the intention of interface transition, provided in an embodiment of this application;

[0137] Figure 14A This is a schematic diagram illustrating the process by which an in-vehicle terminal acquires information related to a sliding event, as provided in an embodiment of this application.

[0138] Figure 14B A schematic diagram illustrating the correspondence between a sliding direction and a target screen, provided for an embodiment of this application;

[0139] Figure 14C A schematic diagram of a scenario for representing the intent of interface transition, provided as an embodiment of this application;

[0140] Figure 14D A schematic diagram of another scenario for representing the interface transition intention provided in an embodiment of this application;

[0141] Figure 15 This application provides a schematic diagram of cross-screen streaming in an embodiment. Figure 1 ;

[0142] Figure 16 This application provides a schematic diagram of cross-screen streaming in an embodiment. Figure 2 ;

[0143] Figure 17 This application provides a schematic diagram of cross-screen streaming in an embodiment. Figure 3 ;

[0144] Figure 18 This application provides a schematic diagram of cross-screen streaming in an embodiment. Figure 4 ;

[0145] Figure 19 This application provides a schematic diagram of cross-screen streaming in an embodiment. Figure 5 ;

[0146] Figure 20 This application provides a schematic diagram of cross-screen streaming in an embodiment. Figure 6 ;

[0147] Figure 21 This application provides a schematic diagram of cross-screen streaming in an embodiment. Figure 7 ;

[0148] Figure 22 This application provides a schematic diagram of cross-screen streaming in an embodiment. Figure 8 ;

[0149] Figure 23 Schematic diagram nine illustrating cross-screen workflow provided in this application embodiment;

[0150] Figure 24 This application provides a schematic diagram of cross-screen streaming in an embodiment. Figure 10 ;

[0151] Figure 25 This application provides a schematic diagram of cross-screen streaming in an embodiment. Figure 10 one;

[0152] Figure 26 This application provides a schematic diagram of cross-screen streaming in an embodiment. Figure 10 two;

[0153] Figure 27 This application provides a schematic diagram of cross-screen streaming in an embodiment. Figure 10 three;

[0154] Figure 28A This application provides a schematic diagram of cross-screen streaming in an embodiment. Figure 10 five;

[0155] Figure 28B This application provides a schematic diagram of cross-screen streaming in an embodiment. Figure 10 six;

[0156] Figure 29 This application provides a schematic diagram of cross-screen streaming in an embodiment. Figure 10 seven;

[0157] Figure 30 This application provides a schematic diagram of cross-screen streaming in an embodiment. Figure 10 eight;

[0158] Figure 31This application provides a schematic diagram of cross-screen streaming in an embodiment. Figure 10 Nine;

[0159] Figure 32 This application provides a schematic diagram of cross-screen streaming in an embodiment. Figure 2 ten;

[0160] Figure 33 This application provides a schematic diagram of cross-screen streaming in an embodiment. Figure 2 eleven;

[0161] Figure 34 This application provides a schematic diagram of screen sharing in its embodiments. Figure 1 ;

[0162] Figure 35 This application provides a schematic diagram of screen sharing in its embodiments. Figure 2 ;

[0163] Figure 36 This application provides a schematic diagram of screen sharing in its embodiments. Figure 3 ;

[0164] Figure 37 Reverse flow illustration provided for embodiments of this application Figure 1 ;

[0165] Figure 38 Reverse flow illustration provided for embodiments of this application Figure 2 ;

[0166] Figure 39 This application provides a schematic diagram of cross-screen streaming in an embodiment. Figure 2 twelve;

[0167] Figure 40 A schematic diagram of the touch area when different users perform touch operations according to embodiments of this application;

[0168] Figure 41 A schematic diagram illustrating an application scenario of a multi-screen collaborative display method provided in this application embodiment;

[0169] Figure 42 A schematic diagram of the architecture of a control system provided in an embodiment of this application;

[0170] Figure 43 A schematic diagram illustrating a multi-screen collaborative display method provided in an embodiment of this application;

[0171] Figure 44 A schematic diagram of the architecture of a control system provided in an embodiment of this application;

[0172] Figure 45 A schematic diagram illustrating a multi-screen collaborative display method provided in an embodiment of this application;

[0173] Figure 46 A schematic diagram of the architecture of a control system provided in an embodiment of this application;

[0174] Figure 47 A schematic diagram illustrating a multi-screen collaborative display method provided in an embodiment of this application;

[0175] Figure 48 A schematic diagram illustrating a Gaussian blurring method provided in an embodiment of this application;

[0176] Figure 49 A schematic diagram of an interface for Gaussian blur processing provided in an embodiment of this application;

[0177] Figure 50 A schematic diagram illustrating a method for solid color gradient processing provided in an embodiment of this application;

[0178] Figure 51 A schematic diagram of a solid color gradient interface provided in an embodiment of this application;

[0179] Figure 52 A schematic diagram illustrating a particle motion effect processing method provided in an embodiment of this application;

[0180] Figure 53 A schematic diagram of an interface for particle motion effect processing provided in an embodiment of this application;

[0181] Figure 54 A schematic diagram of an interface for particle motion effect processing provided in an embodiment of this application;

[0182] Figure 55 A schematic diagram of an interface for particle motion effect processing provided in an embodiment of this application;

[0183] Figure 56 A schematic diagram of the architecture of a control system provided in an embodiment of this application;

[0184] Figure 57 A schematic diagram illustrating the division of sound zones within a vehicle cabin, provided as an embodiment of this application;

[0185] Figure 58 A schematic diagram of the functional hierarchy in a control device provided in an embodiment of this application;

[0186] Figure 59 A flowchart illustrating an audio control method provided in an embodiment of this application;

[0187] Figure 60 A schematic diagram illustrating an audio playback method provided in an embodiment of this application;

[0188] Figure 61A schematic diagram illustrating the influencing factors of audio control provided in an embodiment of this application;

[0189] Figure 62 A schematic diagram illustrating an audio control scenario and control method provided in an embodiment of this application;

[0190] Figure 63 A schematic diagram illustrating an audio control scenario and control method provided in an embodiment of this application;

[0191] Figure 64A A schematic diagram illustrating an audio control scenario and control method provided in an embodiment of this application;

[0192] Figure 64B A schematic diagram illustrating an audio control scenario and control method provided in an embodiment of this application;

[0193] Figure 65 A schematic diagram illustrating an audio control scenario and control method provided in an embodiment of this application;

[0194] Figure 66 A schematic diagram illustrating an audio control scenario and control method provided in an embodiment of this application;

[0195] Figure 67 A schematic diagram illustrating an audio control scenario and control method provided in an embodiment of this application;

[0196] Figure 68 A schematic diagram illustrating an audio control scenario and control method provided in an embodiment of this application;

[0197] Figure 69 A schematic diagram illustrating an audio control scenario and control method provided in an embodiment of this application;

[0198] Figure 70 A schematic diagram illustrating an audio control scenario and control method provided in an embodiment of this application;

[0199] Figure 71 A flowchart illustrating an audio control method provided in an embodiment of this application;

[0200] Figure 72A A schematic diagram illustrating an audio control scenario and control method provided in an embodiment of this application;

[0201] Figure 72B A schematic diagram illustrating an audio control scenario and control method provided in an embodiment of this application;

[0202] Figure 73 A flowchart illustrating an audio control method provided in an embodiment of this application;

[0203] Figure 74AA schematic diagram illustrating an audio control scenario and control method provided in an embodiment of this application;

[0204] Figure 74B A schematic diagram illustrating an audio control scenario and control method provided in an embodiment of this application;

[0205] Figure 74C A schematic diagram illustrating an audio control scenario and control method provided in an embodiment of this application;

[0206] Figure 75A A schematic diagram illustrating an audio control scenario and control method provided in an embodiment of this application;

[0207] Figure 75B A schematic diagram illustrating an audio control scenario and control method provided in an embodiment of this application;

[0208] Figure 76 A schematic diagram illustrating an audio control method provided in an embodiment of this application;

[0209] Figure 77 A schematic diagram illustrating an audio control method provided in an embodiment of this application;

[0210] Figure 78 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0211] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the embodiments of this application will be further described in detail below with reference to the accompanying drawings. In the description of the embodiments of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined with "first" and "second" may explicitly or implicitly include one or more of that feature.

[0212] It should be understood that in the embodiments of this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be single or multiple.

[0213] Currently, vehicles are equipped with an increasing number of displays, and users have a growing need for cross-screen interaction (such as cross-screen transitions and collaborative operations) across different displays. However, current interactions between in-vehicle displays typically involve full-screen transitions, which is insufficient to meet the diverse interactive needs of users. Therefore, how to efficiently perform interface transitions and provide users with intelligent displays that meet their needs and habits is a problem that requires further research.

[0214] Furthermore, with the increasing number of displays in vehicles, multi-screen immersive technologies have also developed. Currently, multi-screen immersive technologies mainly include two forms: displaying the same image on multiple screens or splicing the same image across multiple screens. Among these, multi-screen splicing is more commonly used to create immersive experiences. For example, multiple screens can be spliced ​​together to display a startup animation after passengers board; multiple screens can be spliced ​​together to display a navigation interface while the vehicle is in motion; and multiple screens can be spliced ​​together to display a video interface while playing a video. These methods of splicing images have high requirements for the displayed content, generally requiring customized display content of specific sizes from specific manufacturers. Therefore, they can only be applied in specific scenarios (such as pre-set scenarios like driving effects, rest mode, map and music rhythm effects, etc.), and the immersive experience they can provide is limited, resulting in low practicality.

[0215] In addition to display devices, vehicles are increasingly equipped with audio output devices (such as speakers). Taking the vehicle cabin as an example, current audio output devices include in-car speakers, headrest speakers, and Bluetooth headsets. Users in different positions within the cabin may have different audio listening needs, thus requiring flexible selection of the audio output device based on user requirements. Furthermore, the content displayed on screens at different locations may differ, corresponding to different audio playback requirements. Therefore, the audio output device used needs to be adjusted accordingly when displaying different content on different screens. Current audio control solutions for the vehicle cabin primarily involve allowing users to manually select the desired audio playback mode from a variety of preset options. After selection, the audio output devices in the cabin play audio according to the chosen mode. Different audio playback modes correspond to different audio output devices or methods. This audio control solution requires manual intervention, and the limited number of user-selectable audio playback modes, limiting control to preset fixed patterns, makes the audio playback control process relatively rigid, resulting in low flexibility and practicality.

[0216] In view of the above problems, this application provides a control method for controlling the content display mode and audio playback mode in a multi-screen scenario, thereby improving the flexibility and practicality of control.

[0217] The methods provided in this application include interface transition methods in multi-screen scenarios, multi-screen collaborative display methods, and audio control methods. The interface transition method can be used to achieve cross-screen transitions of displayed interfaces between different displays. In some embodiments, this method can also achieve same-screen cross-region (or cross-position) transitions of displayed interfaces on the same display. The multi-screen collaborative display method is used to achieve the effect of multiple displays collaboratively displaying images, thereby providing users with an immersive viewing experience. The audio control method is used to control the way audio corresponding to the display is played, and also to achieve audio flow between different displays.

[0218] To facilitate understanding, the following is a brief introduction to some of the names or terms that may appear in the embodiments of this application:

[0219] (1) Split-screen display

[0220] The "split-screen display" described in this embodiment refers to dividing the display screen into multiple areas, with each area displaying an application window for a task interface. At the same time, multiple application windows for task interfaces can be displayed through the various areas of the display screen.

[0221] For example, please refer to Figure 2 , Figure 2 This illustration shows a schematic diagram of multiple task interfaces displayed in a split-screen format according to an embodiment of this application. Wherein, Figure 2 Interface A and Interface B are displayed on the display screen 100 in a split-screen format. Interface A and Interface B can be task interfaces of the same application or task interfaces of different applications.

[0222] (2) Full-screen display

[0223] In this embodiment, "full-screen display" refers to displaying a task interface application window in full-screen mode on the display screen. Specifically, displaying a task interface in full-screen mode means displaying the task interface across all available display areas on the screen.

[0224] It should be noted that, in this embodiment, displaying a task interface in full screen does not mean that the display screen will not display other interface elements simultaneously. For example, while the task interface is displayed in full screen, a status bar can also be displayed. The status bar can display information such as the network identifier of the vehicle terminal (e.g., a Wireless Fidelity (Wi-Fi) network identifier) ​​and remaining battery level. Of course, when the task interface is displayed in full screen, the display screen may display not only the status bar but also other interface elements, which will not be elaborated upon in this embodiment.

[0225] For example, please refer to Figure 3 , Figure 3 This illustration shows a schematic diagram of a task interface displayed in full-screen mode according to an embodiment of this application. Figure 3 The window containing interface C is displayed in full screen on display screen 100.

[0226] (3) Application window

[0227] In this embodiment, the "application window" refers to the basic unit set up by an application in a graphical user interface (GUI) for using data. The application can be an application integrated into the device's operating system (such as Bluetooth, gallery, etc.) or a user-installed application (such as map applications, music applications, video applications, email applications, shopping applications, etc.), and this embodiment does not impose any limitations.

[0228] In the embodiments of this application, application windows include video application windows, navigation application windows, music application windows, etc.

[0229] For example, application windows include full-screen application windows and split-screen application windows. See, for instance, [example...]. Figure 2 ,in Figure 2 Interface A and Interface B are window application interfaces, and the windows containing Interface A and Interface B are displayed in a split-screen manner on the display screen 100. For example, please refer to... Figure 3 ,in Figure 3 The interface C shown is the window application interface, and the window containing interface C is displayed in full screen on display screen 100.

[0230] (4) Floating window

[0231] In this embodiment, a "floating window" refers to a movable window that floats on the display screen. For example, a floating window can float on top of an application window displayed on the display screen, and any operation performed by the user on the lower layer (such as an operation on the application window) will not affect the display of the floating window (including its display position, display type, etc.).

[0232] For example, please refer to Figure 4 , Figure 4 This illustration shows a schematic diagram of a task interface displayed in the form of a floating window, according to an embodiment of this application. Figure 4 The application interface E is displayed in full screen on the display screen 100, and the interface D is displayed in the floating window 401. The floating window 401 is displayed above the application interface E. The user's operation in the lower layer (such as operation on interface E) will not affect the display of the floating window.

[0233] (5) Floating icon

[0234] In this embodiment, the "floating icon" refers to a movable icon that floats on the display screen. For example, the floating icon can float above an application window displayed on the screen, and any user operation on the application window will not affect the display of the floating icon (including its display position, display type, etc.).

[0235] For example, please refer to Figure 5 , Figure 5 This illustration shows a schematic diagram of a task interface displayed as floating icons, according to an embodiment of this application. Figure 5 The application interface E shown is displayed in full screen on the display screen 100. Icon 501 floats above the application interface E. User operations on the lower layer (such as operations on interface E) will not affect the display of icon 501. Icon 501 can correspond to task interface D. For example, the vehicle terminal can respond to the user's access operation to icon 501 and display the task interface corresponding to icon 501 (i.e., Figure 4 Interface D shown in the figure.

[0236] (6) Picture-in-picture (PiP)

[0237] The “picture-in-picture” described in this application embodiment refers to a video screen (hereinafter referred to as “sub-screen”) being presented independently on another interface (such as another video screen (hereinafter referred to as “main screen”)) in an overlay form. The sub-screen can always be overlaid on the main screen, and any operation of the main screen by the user will not affect the display of the sub-screen (including display position, display type, etc.).

[0238] For example, please refer to Figure 6 , Figure 6 This illustration shows a schematic diagram of a task interface displayed in a picture-in-picture format according to an embodiment of this application. Wherein, Figure 6 The video application interface 601 shown is displayed in full screen on the display screen 100, and the video screen 602 is overlaid on the video application interface 601. The user's operation on the video application interface 601 will not affect the display of the sub-screen.

[0239] (7) Cards

[0240] The "card" mentioned in this application embodiment is also called a "service card". It refers to placing some important interface information or operation entry points on the card in order to achieve the purpose of direct service access.

[0241] As one possible form, the card can be displayed independently on the screen.

[0242] As another possible form, cards can be embedded into other applications as part of their interface and support features such as page pull-ups.

[0243] For example, please refer to Figure 7 , Figure 7 This illustration shows a schematic diagram of a task interface displayed in card format according to an embodiment of this application. Wherein, Figure 7 The display screen 100 shows a navigation card interface 701, a weather card interface 702, and a music card interface 703. For example, the in-vehicle terminal can display a detailed information interface (i.e., a task interface) corresponding to a card in response to a user's access to that card.

[0244] (8) Notification

[0245] In this embodiment, "notification" refers to application-related notifications that pop up on the screen, received messages, etc. For example, in this embodiment, a notification might be WeChat. Notification messages, call notifications, etc.

[0246] For example, please refer to Figure 8 , Figure 8 The diagram illustrates two task interfaces displayed in the form of notifications, as provided in embodiments of this application. Among them, Figure 8 (a) and Figure 8 Interface C, shown in (b), is displayed on screen 100. Upon receiving a new WeChat message... When a message is sent, the vehicle terminal displays... Figure 8 WeChat (a) shown in the middle Message notification. Optionally, the in-vehicle terminal can respond to the user's WeChat notification. Accessing the message, displaying the WeChat account. The detailed message information interface (i.e., the task interface). Alternatively, when a new video call request is received, the in-vehicle terminal displays... Figure 8 The notification of a pending video call is shown in (b) above. Optionally, the vehicle terminal may display a detailed information interface (i.e., a task interface) of the video call in response to the user's action of answering the notification of the pending video call. Alternatively, the vehicle terminal may hang up the video call in response to the user's action of rejecting the notification of the pending video call.

[0247] (9) Vehicle-mounted terminal

[0248] The vehicle-mounted terminal described in this application embodiment is a terminal device installed on a vehicle. Exemplarily, the vehicle-mounted terminal can be integrated into the vehicle. Optionally, the vehicle-mounted terminal can also be installed independently of the vehicle.

[0249] In this embodiment, "vehicle" does not refer to a specific mode of transportation. Optionally, a vehicle can be a ground-based vehicle, such as a car, bus, subway, or high-speed train. Optionally, a vehicle can also be a water-based vehicle, such as a boat, hovercraft, or submarine. Optionally, a vehicle can also be an air vehicle, such as an airplane or helicopter.

[0250] (10) Electronic devices

[0251] An electronic device may be a device with display functionality. Optionally, an electronic device may be a device equipped with one or more displays.

[0252] In some embodiments of this application, the electronic device may be an in-vehicle terminal.

[0253] In other embodiments of this application, the electronic device may be a portable device, such as a mobile phone, tablet computer, wearable device with wireless communication capabilities (e.g., watch, bracelet, helmet, earphone, etc.), augmented reality (AR) / virtual reality (VR) device, laptop computer, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), etc. The electronic device may also be a smart home device (e.g., smart TV, smart speaker, etc.), smart car, smart robot, workshop equipment, wireless terminal in self-driving, wireless terminal in remote medical surgery, wireless terminal in smart grid, wireless terminal in transportation safety, wireless terminal in smart city, or wireless terminal in smart home, flying equipment (e.g., smart robot, hot air balloon, drone, airplane), etc.

[0254] In some embodiments of this application, the electronic device may also be a portable terminal device that includes other functions such as a personal digital assistant and / or a music player. Exemplary embodiments of the portable terminal device include, but are not limited to, devices running iOS. Android Microsoft Alternatively, it could be a portable terminal device with another operating system. The aforementioned portable terminal device could also be other portable terminal devices, such as a laptop computer with a touch-sensitive surface (e.g., a touch panel). It should also be understood that in some other embodiments of this application, the aforementioned electronic device may not be a portable terminal device, but rather a desktop computer with a touch-sensitive surface (e.g., a touch panel).

[0255] The structure of the device to which the method provided in the embodiments of this application is applicable will be described exemplarily below.

[0256] As an example, please refer to Figure 9A , Figure 9A A schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application is shown. Optionally, the electronic device can be a vehicle-mounted terminal.

[0257] like Figure 9A As shown, the electronic device 900 may include a processor 910, an external memory interface 920, an internal memory 921, a universal serial bus (USB) interface 930, a charging management module 940, a power management module 941, a battery 942, antenna 1, antenna 2, a mobile communication module 950, a wireless communication module 960, an audio module 970, a speaker 970A, a receiver 970B, a microphone 970C, a headphone jack 970D, a sensor module 980, buttons 990, a motor 991, an indicator 992, a camera 993, a display screen 994, and a SIM card interface 995, etc. The sensor module 980 may include a gyroscope sensor, an accelerometer, a proximity sensor, a fingerprint sensor, a touch sensor, a temperature sensor, a pressure sensor, a distance sensor, a magnetic sensor, an ambient light sensor, a barometric pressure sensor, a bone conduction sensor, etc.

[0258] Understandable Figure 9A The electronic device 900 shown is merely an example and does not constitute a limitation on the electronic device. The electronic device may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. Figure 9A The various components shown can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.

[0259] The processor 910 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). These different processing units may be independent devices or integrated into one or more processors.

[0260] The controller can serve as the central nervous system and command center of the electronic device 900. It generates operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. The digital signal processor (DSP) processes digital signals, including digital image signals and other digital signals. For example, when the electronic device selects a frequency, the DSP performs Fourier transforms on the frequency energy. The video codec is used to compress or decompress digital video. The electronic device can support one or more video codecs, allowing it to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4. The neural network processing unit (NPU) is a neural network (NN) computing processor that rapidly processes input information by borrowing from biological neural network structures, such as the transmission patterns between neurons in the human brain, and can continuously learn. The NPU enables intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0261] The processor 910 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 910 is a cache memory. This memory can store instructions or data that the processor 910 has just used or that are used repeatedly. If the processor 910 needs to use the instruction or data again, it can directly retrieve it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 910, and thus improves the efficiency of the system.

[0262] The execution of the control method provided in this application embodiment can be controlled by the processor 910 or by calling other components. For example, it can call the processing program of this application embodiment stored in the internal memory 921, or call the processing program of this application embodiment stored in a third-party device through the external memory interface 920 to control the wireless communication module 960 to perform data communication with other devices, thereby improving the intelligence and convenience of the electronic device 900 and enhancing the user experience. The processor 910 may include different devices. For example, when integrating a CPU and a GPU, the CPU and GPU can cooperate to execute the control method provided in this application embodiment. For example, some algorithms in the control method can be executed by the CPU, and other algorithms can be executed by the GPU to achieve faster processing efficiency.

[0263] In some embodiments, the processor 910 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a user identity module interface, and / or a universal serial bus interface, etc.

[0264] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 910 may include multiple I2C buses. The processor 910 can couple touch sensors, microphones, cameras 993, etc., through different I2C bus interfaces.

[0265] For example, in this embodiment, the processor 910 can couple to the touch sensor via an I2C interface, enabling the processor 910 and the touch sensor to communicate via the I2C bus interface, thereby realizing the touch function of the electronic device. Optionally, the processor 910 can couple to the camera 993 via an I2C interface, enabling the processor 910 and the camera 993 to communicate via the I2C bus interface, thereby realizing the image acquisition function of the electronic device.

[0266] In some embodiments of this application, the processor 910 can obtain touch operations detected by the touch sensor on the display screen, such as click operations, long press operations, preset gesture operations, or drag operations, through the I2C bus interface, thereby determining the specific intention corresponding to the touch operation, and then responding to the touch operation, such as cross-screen interface flow, same-screen interface transition, audio flow, etc.

[0267] Optionally, when the touch sensor detects a user's touch operation on the display screen, the processor 910 can obtain image information from the camera 993 via the I2C bus interface, and then identify the user who input the touch operation, so as to perform the corresponding interface flow according to the user's identity. For example, when the electronic device receives an operation from a user to open an application on the driver's side screen, and identifies the user as a front passenger based on the image information obtained by the camera 993, it can directly respond to the operation of opening the application and display the application interface on the front passenger screen.

[0268] The I2S interface can be used for audio communication. In some embodiments, the processor 910 may include multiple I2S buses. The processor 910 can be coupled to the audio module 970 via the I2S bus to enable communication between the processor 910 and the audio module 970. In some embodiments, the audio module 970 can transmit audio signals to the wireless communication module 960 via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.

[0269] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 970 and the wireless communication module 960 can be coupled via the PCM bus interface. In some embodiments, the audio module 970 can also transmit audio signals to the wireless communication module 960 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0270] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 910 and the wireless communication module 960. For example, the processor 910 communicates with the Bluetooth module in the wireless communication module 960 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 970 can transmit audio signals to the wireless communication module 960 via the UART interface to enable music playback through Bluetooth headphones.

[0271] The MIPI interface can be used to connect the processor 910 to peripheral devices such as the display screen 994 and the camera 993. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 910 and the camera 993 communicate via the CSI interface to achieve the image acquisition function of the electronic device. The processor 910 and the display screen 994 communicate via the DSI interface to achieve the display function of the electronic device.

[0272] The GPIO interface is configurable via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 910 to a camera 993, a display 994, a wireless communication module 960, an audio module 970, a sensor module 980, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0273] The USB 930 interface is a USB standard compliant interface, which can be a Mini USB interface, Micro USB interface, USB Type-C interface, etc. The USB 930 interface can be used for data transfer between electronic devices and peripheral devices (such as mobile phones and speakers). It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as gaming devices.

[0274] It should be understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a limitation on the structure of the electronic device. In other embodiments of this application, the electronic device may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0275] Display screen 994 is used to display images, videos, etc. Display screen 994 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 900 may include one or N displays screens 994, where N is a positive integer greater than 1. Display screen 994 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces (GUIs). For example, display screen 994 can display photos, videos, web pages, or documents, etc.

[0276] In this embodiment of the application, the display screen 994 can be an integral flexible display screen, or it can be a splicing display screen composed of two rigid screens and a flexible screen located between the two rigid screens.

[0277] In this embodiment of the application, the electronic device may include multiple displays 994. For example, such as Figure 9B As shown, for electronic devices in a car, such as an in-vehicle terminal, the in-vehicle terminal may include a driver's screen, a passenger's screen, a left rear screen, and a right rear screen. Similarly, for electronic devices in a bus, such as an in-vehicle terminal, the in-vehicle terminal may include a driver's screen and one or more displays installed inside the passenger compartment.

[0278] Electronic devices implement display functions through a graphics processing unit (GPU), a display screen 994, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 994 and the application processor. The GPU performs data and geometric calculations for graphics rendering. The processor 910 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0279] In this embodiment, the GPU can be used for interface rendering. The display screen 994 can be used to display the interface. Exemplarily, the interface may include, but is not limited to, application interfaces (such as browser interfaces, office application interfaces, email interfaces, news application interfaces, map application interfaces, social application interfaces, etc.), floating windows, floating icons, floating balls, picture-in-picture, cards, notifications, mini-program interfaces, etc.

[0280] A camera 993 (either a front-facing camera or a rear-facing camera, or a single camera that can function as both) is used to capture still images or videos. Typically, the camera 993 may include a photosensitive element, such as a lens assembly, and an image sensor. The lens assembly includes multiple lenses (convex or concave lenses) for collecting light signals reflected from the object being photographed and transmitting these signals to the image sensor. The image sensor generates a raw image of the object based on the light signals. For example, an optical image of the object is projected onto the photosensitive element through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signals into electrical signals, which are then transmitted to an ISP (Image Signal Processor) for conversion into digital image signals. The ISP outputs the digital image signals to a DSP (Digital Signal Processor) for processing. The DSP converts the digital image signals into standard primary color (RGB) or YUV format image signals.

[0281] In this embodiment of the application, the electronic device may include one or more cameras 993.

[0282] Electronic devices can achieve image acquisition functions (such as taking pictures or capturing images) through image signal processors (ISPs), cameras 993, video codecs, GPUs, displays 994, and application processors. In this application, the camera 993 can be an optical zoom lens, etc., and this application is not limited thereto.

[0283] The ISP (Image Signal Processor) is used to process data fed back from the camera 993. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set within the camera 993.

[0284] The external memory interface 920 can be used to connect external memory cards, such as Micro SD cards, to expand the storage capacity of electronic devices. The external memory card communicates with the processor 910 through the external memory interface 920 to perform data storage functions. For example, audio, video, and image files can be saved on the external memory card.

[0285] Internal memory 921 can be used to store computer executable program code, which includes instructions. Processor 910 executes various functional applications and data processing of electronic device 900 by running the instructions stored in internal memory 921. Internal memory 921 may include a program storage area and a data storage area. The program storage area may store the operating system, application code required for at least one function, etc. The data storage area may store data created during the use of electronic device 900 (such as task cards, etc.).

[0286] The internal memory 921 may also store one or more computer programs corresponding to the algorithm of the control method provided in the embodiments of this application. The one or more computer programs are stored in the internal memory 921 and configured to be executed by one or more processors 910. The one or more computer programs include instructions that can be used to perform the various steps in the following embodiments.

[0287] In addition, the internal memory 921 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0288] Of course, the algorithm code of the control method provided in this application embodiment can also be stored in external memory. In this case, the processor 910 can run the algorithm code of the control method stored in external memory through the external memory interface 920.

[0289] A touch sensor, also known as a "touch panel," can be located on a display screen 994. The touch sensor and display screen 994 together form a touch display screen, also called a "touch screen." The touch sensor detects touch operations applied to or near it. The touch sensor transmits the detected touch operation (including touch location, touch pressure, contact area, and touch duration) to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 994. In some embodiments, the touch sensor may also be located on the surface of the electronic device 900, in a different position than the display screen 994.

[0290] In the embodiments of this application, the touch operation detected by the touch sensor can be an operation performed by the user with their finger on or near the touch screen, or an operation performed by the user with a stylus, stylus, stylus ball, or other touch auxiliary tool on or near the touch screen. This application does not limit the scope of the operation.

[0291] The wireless communication function of electronic device 900 can be implemented through antenna 1, antenna 2, mobile communication module 950, wireless communication module 960, modem processor, and baseband processor.

[0292] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 900 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.

[0293] The mobile communication module 950 can provide wireless communication solutions, including 2G / 3G / 4G / 5G, for use on the electronic device 900. The mobile communication module 950 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 950 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 950 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 950 may be housed in the processor 910. In some embodiments, at least some functional modules of the mobile communication module 950 and at least some modules of the processor 910 may be housed in the same device. In this embodiment, the mobile communication module 950 can also be used for information interaction with other devices.

[0294] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to a speaker 970A, receiver 970B, etc.) or displays images or videos through a display screen 994. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 910 and may be housed in the same device as the mobile communication module 950 or other functional modules.

[0295] The wireless communication module 960 can provide solutions for wireless communication applications on the electronic device 900, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 960 can be one or more devices integrating at least one communication processing module. The wireless communication module 960 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signal, and sends the processed signal to processor 910. The wireless communication module 960 can also receive signals to be transmitted from processor 910, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2. In this embodiment, the wireless communication module 960 is used to establish connections with other electronic devices for data interaction. Alternatively, the wireless communication module 960 can be used to access access point devices, send control commands to other electronic devices, or receive data from other electronic devices.

[0296] In addition, electronic device 900 can implement audio functions such as music playback and recording through audio module 970, speaker 970A, receiver 970B, microphone 970C, headphone jack 970D, and application processor.

[0297] The audio module 970 is used to convert digital audio information into analog signal output, and also to convert analog audio input into digital audio signals. The audio module 970 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 970 may be located in the processor 910, or some functional modules of the audio module 970 may be located in the processor 910.

[0298] The 970A speaker, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. Electronic devices can use the 970A speaker to allow users to listen to audio or make hands-free calls.

[0299] The receiver 970B, also known as the "earpiece", is used to convert audio electrical signals into sound signals.

[0300] Microphone 970C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 970C, inputting the sound signal into microphone 970C. In this application, the electronic device can be equipped with at least two microphones 970C, such as a local microphone or a wireless microphone. In other embodiments, the electronic device can be equipped with three, four, or more microphones 970C to achieve functions such as sound signal acquisition and noise reduction. In the embodiments of this application, the electronic device can acquire real-world sound signals through microphone 970C.

[0301] Electronic device 900 can receive input from button 990, generating key signal inputs related to user settings and function control. Electronic device 900 can use motor 991 to generate vibration alerts (such as vibration alerts for incoming calls). Indicator 992 in electronic device 900 can be an indicator light, used to indicate charging status, battery level changes, messages, missed calls, notifications, etc. SIM card interface 995 in electronic device 900 is used to connect a SIM card. The SIM card can be inserted into or removed from SIM card interface 995 to achieve contact and separation with electronic device 900.

[0302] The power management module 940 is used to supply power to the processor 910, internal memory 921, display 994, camera 993, and wireless communication module 963.

[0303] It should be understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device. In practical applications, the electronic device 900 may include, but is not limited to, the following: Figure 9A The number of more or fewer components shown is not limited in the embodiments of this application. The illustrated electronic device 900 is merely an example, and the electronic device 900 may have more or fewer components than shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.

[0304] The software system of the electronic device 900 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses the layered architecture Android system as an example to exemplify the software structure of the electronic device.

[0305] Layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. For example... Figure 9CAs shown, the software architecture can be divided into four layers, from top to bottom: the application layer, the application framework layer (framework, FWK), the runtime and system libraries, and the Linux kernel layer.

[0306] The application layer is the top layer of the operating system and includes native operating system applications such as camera, gallery, calendar, Bluetooth, music, video, and messaging. The applications discussed in this application are referred to as "applications" and are software programs capable of performing one or more specific functions. Typically, multiple applications can be installed on an electronic device. Examples include camera applications, email applications, and smart home control applications. The applications mentioned below can be system applications pre-installed at the factory or third-party applications downloaded by the user from the network or obtained from other electronic devices during use.

[0307] Of course, for developers, they can write applications and install them into this layer. In one possible implementation, the application can be developed using the Java language, by calling the Application Programming Interface (API) provided by the application framework layer. Developers can then interact with the underlying operating system (such as the kernel layer) through the application framework to develop their own applications.

[0308] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer can include predefined functions. It may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0309] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.

[0310] Content providers are used to store and retrieve data, and make that data accessible to applications. This data may include files (e.g., documents, videos, images, audio), text, and other information.

[0311] A view system includes visual controls, such as controls that display text, images, documents, and other content. View systems can be used to build applications. An interface in a display window can consist of one or more views. For example, a display interface including a text message notification icon could include a view that displays text and a view that displays images.

[0312] The phone manager provides communication functionality for electronic devices. The notification manager allows applications to display notification information in the status bar; it can be used to convey informative messages and can disappear automatically after a short pause without user interaction.

[0313] The runtime includes the core libraries and the virtual machine. The runtime is responsible for the scheduling and management of the Android system.

[0314] The system's core library consists of two parts: one part contains the functionalities that the Java language needs to call, and the other part is the system's core library. The application layer and application framework layer run in a virtual machine. Taking Java as an example, the virtual machine executes the Java files in the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0315] The system library can include multiple functional modules. For example: a surface manager, a media library, a 3D graphics processing library (e.g., OpenGL ES), a 2D graphics engine (e.g., SGL), and an image processing library. The surface manager manages the display subsystem and provides fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of various common audio and video formats, as well as still image files. The media library supports various audio and video encoding formats, such as MPEG4, H.564, MP3, AAC, AMR, JPG, and PNG. The 3D graphics processing library implements 3D graphics drawing, image rendering, compositing, and layer processing. The 2D graphics engine is the drawing engine for 2D graphics.

[0316] The kernel layer provides the core system services of the operating system, such as security, memory management, process management, network protocol stack, and driver models, all of which are implemented based on the kernel layer. The kernel layer also serves as an abstraction layer between the hardware and software stacks. This layer contains many drivers related to electronic devices, including: display drivers; keyboard drivers as input devices; Flash drivers for memory-based devices; camera drivers; audio drivers; Bluetooth drivers; and WiFi drivers.

[0317] It is important to understand that the functional services described above are just an example. In practical applications, electronic devices may be divided into more or fewer functional services based on other factors, or the functions of each service may be divided in other ways, or they may not be divided into functional services but work as a whole.

[0318] The interface transition method, multi-screen collaborative display method, and audio control method provided in the embodiments of this application are described below.

[0319] Part 1: Interface Transition Methods

[0320] The interface transition method provided in this application embodiment can realize the cross-screen transition of the task interface on the first screen to the second screen for display. For example, the task interface can be understood as the interface corresponding to the application running on the vehicle terminal.

[0321] In some embodiments, a multitasking interface may be displayed on the first screen. Based on embodiments of this application, an interface transition method is provided that can transition one of the multitasking interfaces displayed on the first screen to the second screen, or simultaneously transition multiple (e.g., two) multitasking interfaces displayed on the first screen to the second screen.

[0322] In other embodiments, a task interface may be displayed on the first screen. Based on embodiments of this application, a method for interface transition is provided to transfer the task interface displayed on the first screen to a second screen.

[0323] Optionally, in other embodiments of this application, an interface transition method is provided based on the embodiments of this application to realize the simultaneous transition of the task interface on the first screen from the first position to the second position of the first screen.

[0324] Furthermore, after the task interface on the first screen is transferred to the second screen for display, based on the interface transfer method provided in the embodiments of this application, the task interface transferred to the second screen can also be transferred back to the first screen for display, or the task interface transferred to the second screen can be transferred to the third screen for display.

[0325] Alternatively, after the task interface on the first screen is simultaneously moved from its first position to its second position on the first screen, based on the interface flow method provided in this application embodiment, the task interface moved to the second position on the first screen can also be moved across screens to the second screen for display, or the task interface moved to the second position on the first screen can be simultaneously moved to a third position on the first screen for display. The third position may be the same as or different from the first position; this application embodiment does not limit this.

[0326] In one embodiment of this application, based on an interface transition method, when a vehicle terminal performs an interface transition, it can determine the display type on the target screen after the transition based on the task information of the target screen (such as a second screen) before the transition. The target screen task information before the transition may include the display type and / or classification information of the task interface displayed on the target screen before the transition.

[0327] Optionally, based on the interface transition method provided in the embodiments of this application, when the vehicle terminal performs interface transition, it can determine the display type on the target screen after the interface transition based on the task information when the first interface was displayed on the original screen (such as the first screen) before the interface transition. The task information when the first interface was displayed on the original screen (such as the first screen) before the interface transition includes the display type and / or classification information of the first interface when it was displayed on the original screen (such as the first screen) before the interface transition.

[0328] Optionally, based on the embodiments of this application, an interface transition method is provided. When the vehicle terminal performs interface transition, it can also determine the display type on the target screen after the interface transition based on the task information of the first interface when it was displayed on the original screen (such as the first screen) and / or the task information of the target screen (such as the second screen).

[0329] The display type of the task interface is used to characterize the presentation of the task interface. For example, the display type of the task interface may include, but is not limited to, any of the following: full-screen display, split-screen display, floating window, floating icon, floating ball, picture-in-picture, service card, control, or notification, etc.

[0330] The category information corresponding to the task interface is used to identify whether the task interface is a preset focused application interface. Preset focused application interfaces are those that users have pre-set as having high priority. It's understandable that in an in-vehicle scenario, some applications receive high user attention or are of high importance, requiring priority display. Therefore, users can set preset focused applications according to their specific needs. For preset focused application interfaces, during interface display, including before and after interface transitions, the in-vehicle terminal will prioritize their prominent display (e.g., full-screen display) to avoid interference from other interfaces and facilitate user viewing and / or operation.

[0331] For example, preset focused applications include map applications, navigation applications, or other applications related to driving safety, or applications that users frequently use, such as video applications, social applications, and entertainment applications (e.g., game applications, music applications, office applications, etc.). This application does not specifically limit the preset focused applications.

[0332] In this embodiment, the preset focused applications may differ for different displays on the in-vehicle terminal. For example, for the driver's screen, the preset focused application may be a map application, a navigation application, or other applications related to driving safety; for the passenger screen, left rear screen, or right rear screen, the preset focused application may be a video application, a social application, an entertainment application (such as a game application, a music application, an office application, etc.), or other applications that users frequently use on the corresponding display screen.

[0333] It should be noted that the embodiments of this application are not limited to the specific display type of the task interface on the original screen and the target screen before the interface transition.

[0334] As one possible structure, the original screen and the target screen described in this application embodiment can belong to a single vehicle-mounted terminal, and the original screen and the target screen can share the processor, memory, and other modules of the vehicle-mounted terminal. That is, the vehicle-mounted terminal can include multiple displays, each of which can operate independently, such as playing audio and video, or operating entertainment games. Communication connections are established between the multiple displays. For example, the multiple displays can communicate through a communication bus interface. Alternatively, the multiple displays can communicate through an in-vehicle local area network.

[0335] As another possible structure, the original screen and the target screen described in this application embodiment can belong to different vehicle terminals, and a communication connection is established between the vehicle terminals. The cross-screen flow of the task interface described in this application embodiment is actually a cross-device interface flow. For example, the vehicle terminals can communicate through a communication bus interface or through an in-vehicle local area network.

[0336] It should be noted that in the embodiments of this application, "screen" or "display screen" can also be referred to as "display screen". For example, "first screen" can also be referred to as "first display screen"; "original screen" can also be referred to as "original display screen"; and "target screen" can also be referred to as "target display screen".

[0337] The following will describe in detail an interface transition method provided by the embodiments of this application, taking an in-vehicle terminal including multiple displays (such as a first screen, a second screen, and a third screen) and specific implementation examples.

[0338] In some embodiments, assuming that a task interface (referred to as the first task interface) is displayed on the original screen (such as the first screen), an interface flow method provided by the embodiments of this application can realize the cross-screen flow of one or more of the multiple task interfaces to the target screen (such as the second screen or the third screen) for display.

[0339] Please refer to Figure 10 , Figure 10 The flowchart of the interface transition method provided in the embodiment of this application is shown. Figure 1 .like Figure 10 As shown, an interface transition method provided in this application embodiment may include S1001-S1002:

[0340] S1001: The vehicle terminal displays one or more first task interfaces on the first screen.

[0341] In some embodiments, the vehicle terminal displays a first task interface on a first screen.

[0342] In other embodiments, the vehicle terminal displays multiple first task interfaces on a first screen.

[0343] In this embodiment of the application, one or more first task interfaces can be displayed on the first screen of the vehicle terminal in any display type.

[0344] If the vehicle terminal displays a first task interface on the first screen, this first task interface can be displayed in full screen on the first screen (e.g., Figure 3 As shown in the image, it can also be displayed on the first screen desktop, notification center, control center, and other pages in the form of floating windows, floating icons, floating balls, picture-in-picture, cards, controls, or notifications.

[0345] If the vehicle terminal displays multiple primary task interfaces on the first screen, in some examples, these multiple primary task interfaces may not all be displayed in full screen on the first screen. For example, such as Figure 2 As shown, interface A and interface B are displayed in a split-screen format on display screen 100. For example, as... Figure 7 As shown, the navigation card interface 701, the weather interface 702, and the song card interface 703 are displayed on the display screen 100 in a non-full-screen manner.

[0346] In other examples, one of the multiple first-task interfaces can be displayed full-screen on the first screen, while other interfaces are displayed as floating windows, floating icons, floating balls, picture-in-picture, cards, controls, or notifications. For example, ... Figure 4 As shown, interface E is displayed in full screen on display screen 100, while interface D is displayed as a floating window on display screen 100. For example, ... Figure 5 As shown, interface E is displayed in full screen on display screen 100, while task interface D is displayed as a floating icon on display screen 100. For example, ... Figure 6 As shown, the video application interface 601 is displayed in full screen on the display screen 100, and the video frame 602 is displayed on the display screen 100 in a picture-in-picture format. For example, as... Figure 7 As shown, interface 701 is displayed full-screen on display screen 100, with the sports and health card, memo card, and express delivery tracking card displayed on display screen 100 in card format. For example, ... Figure 8 As shown in (a), interface C is displayed in full screen on display screen 100, WeChat The notification message is displayed on screen 100. For example, ... Figure 8 As shown in (b), interface C is displayed in full screen on display screen 100, and a notification for a pending video call is displayed on display screen 100.

[0347] In this embodiment, the vehicle-mounted terminal can display the multiple first task interfaces on a first screen in response to a user's operation of opening multiple first task interfaces. For example, as Figure 11 As shown, when the vehicle terminal displays the interface 1101 in full screen on the display screen 100 (e.g., the display screen 100 can be the first screen), in response to the user's operation of opening application 1, the vehicle terminal displays the interface 1103 corresponding to application 1 on the display screen 100. Wherein, as... Figure 11 As shown, interface 1103 can be displayed on top of interface 1101 in the form of a floating window or picture-in-picture; interface 1103 and interface 1101 can also be displayed on display screen 100 in a split-screen display form.

[0348] Optionally, if Figure 11 The application associated with interface 1101 shown is the preset focused application corresponding to display screen 100. When the vehicle terminal displays interface 1101 in full screen on display screen 100, it responds to the user's operation of opening application 1 (such as...). Figure 11 As shown in the example of the user clicking the application 1 icon, the vehicle terminal can always maintain the full-screen display of interface 1101, displaying the corresponding interface 1103 of application 1 in the form of a floating window or picture-in-picture. Based on this, it can ensure that interfaces with high attention and / or high importance are displayed prominently, avoiding interference from other interfaces, and facilitating user viewing and operation.

[0349] Alternatively, if Figure 11 The application associated with interface 1101 shown is the preset focused application corresponding to display screen 100. When the vehicle terminal displays interface 1101 in full screen on display screen 100, in response to the user's operation of opening application 1, assuming application 1 is not a preset focused application, the vehicle terminal can display interface 1103 and interface 1101 corresponding to application 1 on display screen 100 in a split-screen format according to a preset ratio. For example, in the split-screen display, the ratio of the interfaces corresponding to the preset focused application and the non-preset focused application can be 1:2 or 2:1.

[0350] Alternatively, if Figure 11 The application to which interface 1101 belongs is the preset focused application corresponding to display screen 100. When the vehicle terminal displays interface 1101 in full screen through display screen 100, in response to the user's operation of opening application 1, assuming that application 1 is the preset focused application, the vehicle terminal can display interface 1103 and interface 1101 corresponding to application 1 on display screen 100 in a split-screen form with an interface ratio of 1:1.

[0351] Optionally, such as Figure 12 As shown, in the vehicle terminal via Figure 11When the display screen 100 shows the full-screen interface 1101, in response to the user's operation of opening application 1, if the vehicle terminal displays the interface 1103 corresponding to application 1 in the form of a floating window or picture-in-picture, the vehicle terminal can also perform adaptive layout adjustment (such as adaptive position adjustment) on the full-screen interface 1101 to avoid the interface 1103 from obscuring the interface 1101.

[0352] As an example, if interface 1103 obscures the focus area (or focal area) on interface 1101, the vehicle terminal can adaptively adjust the position of the focus area (or focal area) of interface 1101 based on the area obscured by interface 1103 on interface 1101, so that the focus area (or focal area) of interface 1101 is not obscured by interface 1103. The focus area (or focal area) of interface 1101 can be determined by the vehicle terminal based on one or more of the following: the function of the information displayed on interface 1101, the application function corresponding to interface 1101, the type of multiple layers on interface 1101, user-defined settings, etc., which are not limited in this embodiment. For example, when interface 1101 is a navigation application interface, the focus area of ​​interface 1101 can be the area displayed for the current navigation route. Optionally, the vehicle terminal can also respond to the user's operation of opening a task combination by displaying multiple first task interfaces corresponding to that task combination on the first screen. Alternatively, the vehicle terminal may go through other processes until multiple first task interfaces are displayed on the first screen; this application embodiment does not limit this.

[0353] It should be noted that, Figure 11 and Figure 12 As an example, the application icons (such as the icons of application 1 and application 2) are always displayed (as shown in the floating display) on the display screen 100. In some embodiments, the application icons may also be displayed on the display screen by the vehicle terminal in response to the user's operation of accessing the display screen desktop or accessing recently used application icons, etc. This application does not impose specific limitations. Further optionally, after the vehicle terminal responds to the user's operation of opening application 1 and displays the interface 1103 corresponding to application 1, the application icon may no longer be displayed on the display screen.

[0354] S1002: The vehicle-mounted terminal receives the user's first operation on the first interface. The first interface is one of one or more first task interfaces. The first operation is used to navigate to the first interface.

[0355] The first operation refers to the user's interaction with one or more first task interfaces displayed on the first screen. The first operation may include, but is not limited to, preset swipe operations, preset touch operations, voice operations, preset body movements, etc., which are not limited in this application.

[0356] For example, preset swipe operations include a one-finger swipe quickly on the first interface and then release, a one-finger swipe slowly on the first interface for a certain distance and then release, and multi-finger (such as two or three fingers) swipe quickly on the first interface and then release, and multi-finger (such as two or three fingers) swipe slowly on the first interface for a certain distance and then release. Preset touch operations include long press operations (such as a press duration meeting a time threshold t), double-tap operations, multi-tap operations (such as two-tap operations, three-tap operations, etc.), multi-finger pinch operations (such as two-finger pinch operations, three-finger pinch operations, etc.), and multi-finger outward expansion operations (such as two-finger outward expansion operations, three-finger outward expansion operations, etc.). Preset body movements include preset air gesture operations and preset facial expressions.

[0357] In this embodiment of the application, the first operation received by the vehicle terminal can be used to switch between screens or to switch between screens simultaneously.

[0358] The user intents corresponding to different preset swipe operations, preset touch operations, voice operations, preset body movements, etc., can be preset and associated by the user or preset by the system.

[0359] For example, if a user has set a preset action of quickly swiping two fingers across the first screen and then leaving, which is associated with cross-screen navigation, then when the in-vehicle terminal receives the user's action of quickly swiping two fingers across the first screen, it can determine that the user's intention is to navigate across the first screen. Similarly, if a user has set a preset action of slowly swiping two fingers across the first screen a certain distance and then leaving, which is associated with same-screen navigation, then when the in-vehicle terminal receives the user's action of slowly swiping two fingers across the first screen a certain distance and then leaving, it can determine that the user's intention is to navigate within the same screen.

[0360] Optionally, to facilitate user operation and provide a more efficient interface transition experience, in some embodiments, the in-vehicle terminal can associate the interface transition intention with a swipe operation of one or more fingers at different speeds (or accelerations). For example, cross-screen transition can be associated with a swipe operation of one or more fingers quickly swiping and then leaving; same-screen transition can be associated with a swipe operation of one or more fingers slowly swiping a certain distance and then leaving. Alternatively, cross-screen transition can be associated with a swipe operation of one or more fingers slowly swiping a certain distance and then leaving, and same-screen transition can be associated with a swipe operation of one or more fingers quickly swiping and then leaving. This application does not impose specific limitations.

[0361] In this embodiment, "fast" and "slow" are relative concepts. For example, if the sliding speed (or sliding acceleration) is greater than a preset threshold, the vehicle terminal can consider the sliding as fast; if the sliding speed (or sliding acceleration) is less than or equal to the preset threshold, the vehicle terminal can consider the sliding as slow. Alternatively, if the sliding speed (or sliding acceleration) is greater than or equal to the preset threshold, the vehicle terminal can consider the sliding as fast; if the sliding speed (or sliding acceleration) is less than the preset threshold, the vehicle terminal can consider the sliding as slow.

[0362] For example, please refer to Figure 13 , Figure 13 An example of a gesture used to represent the intent of interface transition, provided in an embodiment of this application, is illustrated. Figure 13 The gesture 'a' shown is a quick two-finger swipe followed by a release. When a user inputs gesture 'a' onto the screen, the specific process includes the following: two fingers touch the screen (...). Figure 13 As shown in a1) → Quickly slide and leave the display screen (as shown in a2 in 13). Figure 13 The gesture b shown is an operation where two fingers slowly slide a certain distance and then leave. When a user inputs gesture b onto the display screen, the specific process includes the following: two fingers touch the display screen ( Figure 13 As shown in b1) → Slow swipe distance L (as shown in b2 in 13) → Two fingers leave the display screen ( Figure 13 (See b3). In addition, when cross-screen transition is associated with an operation of quickly swiping with one or more fingers and then leaving, and when same-screen transition is associated with an operation of slowly swiping with one or more fingers and then leaving, optionally, the distance L of the slow swipe can be the distance the first interface moves on the first screen.

[0363] It's understandable that one-finger or multi-finger swipe gestures align with most users' operating habits, making them easier to remember and use. Therefore, by recognizing specific interface transition intentions based on different swipe speeds (or swipe accelerations), such as cross-screen transition intentions and same-screen transition intentions, it's possible to improve user memory and operation while also enhancing the interaction performance between the in-vehicle terminal and the user, thereby improving the user experience.

[0364] In this embodiment of the application, as an example, the vehicle terminal can determine the sliding speed of the user's finger on the display screen based on the received MotionEvent (such as MotionEvent.ACTION_MOVE (hereinafter referred to as "ACTION_MOVE event")). The sliding speed of the user's finger on the display screen can be represented by the number of pixels the user's finger slides on the display screen per unit time (e.g., 1 second).

[0365] As can be understood, a MotionEvent is a time sequence related to user touch. A user's finger movement on the display represents a touch event (such as a swipe). For multi-finger swipes, the first finger touching the display generates a MotionEvent.ACTION_DOWN event (hereinafter referred to as "ACTION_DOWN event"); the second and subsequent fingers touching the display generate an ACTION_POINTER_DOWN event; the multi-finger swipe generates an ACTION_MOVE event; when a finger leaves the display (not the last one), an ACTION_POINTER_UP event is generated; and when the last finger leaves the display, a MotionEvent.ACTION_UP event (hereinafter referred to as "ACTION_UP event") is generated.

[0366] The ACTION_DOWN event indicates the start of a multi-finger swipe operation. That is, the ACTION_DOWN event is triggered when the vehicle terminal detects that a touch point on the display screen has been pressed.

[0367] The ACTION_MOVE event is triggered by a user's multi-finger pressing and swiping operation on the screen. That is, when the vehicle terminal detects that multiple touch points on the display screen have been pressed and moved, the ACTION_MOVE event will be triggered.

[0368] The ACTION_UP event indicates the end of a multi-finger swipe operation. That is, the ACTION_UP event is triggered when the vehicle terminal detects that no touch point on the display screen has been pressed by the user.

[0369] Based on the aforementioned touch event mechanism, as one possible implementation method, the in-vehicle terminal can be based on... Figure 14A The method shown determines, based on the received user's first operation on the first interface, whether the operation is used to transition the first interface across screens to the second screen or to transition it within the same screen. Among these... Figure 10 The first operation performed by the user on the first interface in S1002 shown can correspond to Figure 14A ACTION_DOWN+ACTION_POINTER_DOWN+ACTION_MOVE+ACTION_POINTER_UP+ACTION_UP event shown.

[0370] like Figure 14A As shown in S1401, the vehicle terminal can determine and store the initial positions of multiple user fingers on the display screen based on the received ACTION_DOWN and ACTION_POINTER_DOWN events.

[0371] For example, upon receiving an ACTION_DOWN event, the vehicle terminal can determine and store the index of the first finger the user touches on the display screen, as well as the initial position coordinates of that finger on the display screen (referred to as initial coordinates). For example, the vehicle terminal can determine the initial position of the user's finger on the display screen based on the finger index, store the finger index in an ArrayList, and store the coordinates of the initial position (i.e., the initial coordinates) in a HashMap according to the finger index.

[0372] Similarly, upon receiving the ACTION_POINTER_DOWN event, the vehicle terminal can determine and store the finger index of one or more other fingers that the user is touching the display screen, as well as the initial coordinates of those fingers on the display screen. For example, the vehicle terminal can determine the initial position of one or more of the user's other fingers on the display screen based on their indexes, store the finger indexes in an ArrayList, and store the initial coordinates in a HashMap according to their indexes.

[0373] like Figure 14A As shown in S1402, the vehicle terminal can calculate the sliding speed based on the received ACTION_MOVE event and mark whether the sliding speed is greater than a preset threshold.

[0374] For example, upon receiving an ACTION_MOVE event, the vehicle terminal calculates the average speed of one or more finger swipes in real time. For example, the average speed of one or more finger swipes may include the speed of one or more fingers along the x-axis and the speed along the y-axis. The vehicle terminal can determine whether the swipe speed is greater than the corresponding preset threshold by comparing the speed of one or more fingers along the x-axis and the speed along the y-axis with preset thresholds respectively, and further mark whether it is greater than the preset threshold.

[0375] Optionally, ACTION_MOVE events will be generated multiple times during one-finger or multi-finger swipes, so the flag indicating whether the value exceeds the preset threshold will also be refreshed multiple times.

[0376] Furthermore, such as Figure 14A As shown in S1403, when the ACTION_UP event is received, the vehicle terminal determines whether to switch between screens or within the same screen based on the sliding speed flag.

[0377] For example, if the user's finger slides on the display screen at a speed greater than (or greater than or equal to) a preset threshold, the vehicle terminal can consider the slide as a fast slide; if the user's finger slides on the display screen at a speed less than or equal to (or less than) the preset threshold, the vehicle terminal can consider the slide as a slow slide.

[0378] It should be noted that cross-screen swiping can only be truly achieved if the speed in the swiping direction exceeds a preset threshold. For example, to determine the swiping speed in the right and left directions, it is necessary to check whether the speed along the x-axis exceeds the preset threshold; to determine the swiping speed in the front and back directions, it is necessary to check whether the speed along the y-axis exceeds the preset threshold. Optionally, for other directions, either the speed along the x-axis or y-axis can be used to determine whether it exceeds the preset threshold.

[0379] Based on the above mechanism, the vehicle terminal can determine whether the user's interface flow intention is cross-screen flow or same-screen flow.

[0380] For example, such as Figure 14A As shown, if the sliding speed is marked as the first mark, then the cross-screen transition branches described in S1404-1 and S1405-1 are executed. The first mark indicates that the sliding speed is greater than a preset threshold.

[0381] S1404-1: The vehicle terminal determines the sliding direction of multiple fingers of the user on the display screen based on the received ACTION_POINTER_UP and ACTION_UP events.

[0382] For example, upon receiving an ACTION_POINTER_UP event, the vehicle terminal can store the termination position coordinates (hereinafter referred to as termination coordinates) in a HashMap according to the finger index of the corresponding finger. Similarly, upon receiving an ACTION_UP event, the vehicle terminal can store the termination coordinates of the last finger leaving the display screen in a HashMap according to the finger index.

[0383] For example, the vehicle terminal can calculate the sliding direction of each finger based on the initial coordinates (e.g., (startPointX, startPointY)) and ending coordinates (e.g., (endPointX, endPointY)) of the multiple fingers stored in the HashMap.

[0384] For example, the sliding direction can be calculated based on the following formula 1:

[0385] Calculation formula 1: Math.atan2((endPointY-startPointY),(endPointX-startPointX))*(180 / Math.PI).

[0386] As an example, for multi-finger swipe operations, when calculating the swipe speed, the vehicle terminal can calculate the swipe speed of each finger and average the swipe speeds of multiple fingers to obtain the final swipe speed as the swipe speed of the first operation. Alternatively, it can arbitrarily choose the swipe speed of any one finger as the swipe speed of the first operation; this embodiment does not impose any limitation. Similarly, when determining the swipe direction of the first operation, the vehicle terminal can first determine the swipe direction of each finger and then use the consistent direction of the swipes of multiple fingers as the swipe direction of the first operation. Alternatively, it can arbitrarily choose the swipe direction of any one finger as the swipe direction of the first operation; this embodiment does not impose any limitation. Furthermore, when determining the swipe distance of the first operation, it can first determine the swipe distance of each finger and calculate the average as the swipe distance of the first operation. Alternatively, it can arbitrarily choose the swipe distance of any one finger as the swipe distance of the first operation; this embodiment does not impose any limitation.

[0387] S1405-1: The vehicle terminal determines the target screen for cross-screen navigation based on the direction of the user's finger swiping on the display screen.

[0388] As one possible implementation, the in-vehicle terminal can determine which screen is the target screen based on the swiping direction of one or more fingers quickly sliding on the first interface and the positional relationship between the original screen and multiple displays. The target screen can be the display that the swiping direction is pointing to.

[0389] Or, for example, such as Figure 14A As shown, if the sliding speed is marked as the second mark, the vehicle terminal executes the same-screen flow branch described in S1404-2 and S1405-2. The second mark indicates that the sliding speed is less than or equal to a preset threshold.

[0390] S1404-2: The vehicle terminal determines the sliding distance and direction of multiple fingers of the user on the display screen based on the received ACTION_POINTER_UP and ACTION_UP events.

[0391] For example, the vehicle terminal can calculate the sliding distance and direction of each finger based on the initial coordinates (e.g., (startPointX, startPointY)) and ending coordinates (e.g., (endPointX, endPointY)) of the multiple fingers stored in a HashMap. For instance, the sliding direction can be calculated based on Equation 1 above, and the sliding distance can be calculated based on Equation 2 below:

[0392] Formula 2:

[0393] S1405-2: The vehicle terminal determines the target position for simultaneous screen scrolling based on the sliding distance and direction of the user's finger on the display screen.

[0394] Optionally, for screen mirroring, the vehicle terminal can also determine whether the sliding distance of the finger on the display screen is greater than a preset threshold after calculating the sliding distance. If the sliding distance is greater than the preset threshold, the vehicle terminal executes S1405-2. If the sliding distance is less than or equal to the preset threshold, the vehicle terminal can keep the interface displayed in its original position.

[0395] Optionally, in this embodiment, during the user's one-finger or multi-finger swipe on the first interface, the first interface can move following the user's finger. For example, the vehicle terminal can call a Rect object (such as mWindowDragBounds) representing the window position in the terminal system during the user's one-finger or multi-finger swipe on the first interface to achieve the effect of the first interface moving with the user's finger.

[0396] The sliding direction of a user's one or more fingers on the first interface can be represented by the angle between the user's finger sliding trajectory and the positive direction of the horizontal axis of a preset coordinate system. For example, the user's finger coordinates are the coordinates of the user's finger in the preset coordinate system. The preset coordinate system is such as the xOy coordinate system, where the origin O of the xOy coordinate system can be the upper left corner of the first screen, the x-axis can be the upper edge of the first screen, where the direction to the right is the +x-axis direction (i.e., the positive direction of the horizontal axis to the right), and the y-axis can be the left edge of the first screen, where the direction downwards is the +y-axis direction (i.e., the positive direction of the vertical axis upwards). This application does not limit the specific setting of the preset coordinate system xOy.

[0397] For example, if the angle is Figure 14B Within the range of [-22.5°, 22.5°), assuming the pre-set sliding direction [-22.5°, 22.5°) corresponds to the screen located to the right of the original screen, the vehicle terminal determines the screen to the right of the original screen, i.e., the target screen, based on the positional relationship between the original screen and multiple displays. For example, if the original screen is the driver's side screen, the target screen can be determined to be the passenger's side screen. If the original screen is the left rear screen, the target screen can be determined to be the right rear screen.

[0398] For example, if the angle is Figure 14B Within the range of [-67.5°, -22.5°), assuming the pre-set sliding direction [-67.5°, -22.5°) corresponds to the screen located to the right front of the original screen, the vehicle terminal determines the screen located to the right front of the original screen, i.e., the target screen, based on the positional relationship between the original screen and multiple displays. For example, if the original screen is the left rear screen, then the target screen can be determined to be the passenger-side screen.

[0399] For example, if the angle is Figure 14B Within the range of [-112.5°, -67.5°), assuming the pre-set sliding direction [-112.5°, -67.5°) corresponds to the screen directly in front of the original screen, the vehicle terminal determines the screen directly in front of the original screen, i.e., the target screen, based on the positional relationship between the original screen and multiple displays. For example, if the original screen is the left rear screen, the target screen can be determined to be the driver's side screen. If the original screen is the right rear screen, the target screen can be determined to be the passenger's side screen.

[0400] For example, if the angle is Figure 14B Within the range of [-157.5°, -112.5°), assuming the pre-set sliding direction [-157.5°, -112.5°] corresponds to the screen located to the left front of the original screen, the vehicle terminal determines the screen located to the left front of the original screen, i.e., the target screen, based on the positional relationship between the original screen and multiple displays. For example, if the original screen is the right rear screen, then the target screen can be determined to be the driver's side screen.

[0401] For example, if the angle is Figure 14B Within the range of [157.5°, -157.5°), assuming the pre-set sliding direction [157.5°, -157.5°) corresponds to the screen located to the left of the original screen, the vehicle terminal determines the screen located to the left of the original screen, i.e., the target screen, based on the positional relationship between the original screen and multiple displays. For example, if the original screen is the passenger-side screen, the target screen can be determined to be the driver-side screen. If the original screen is the right rear screen, the target screen can be determined to be the left rear screen.

[0402] For example, if the angle is Figure 14B Within the range of [112.5°, 157.5°), assuming the pre-set sliding direction [112.5°, 157.5°) corresponds to the screen located to the left rear of the original screen, the vehicle terminal determines the screen located to the left rear of the original screen, i.e., the target screen, based on the positional relationship between the original screen and multiple displays. For example, if the original screen is the passenger-side screen, then the target screen can be determined to be the left rear screen.

[0403] For example, if the angle is Figure 14B Within the range of [67.5°, 112.5°), assuming the pre-set sliding direction [67.5°, 112.5°) corresponds to the screen directly behind the original screen, the vehicle terminal determines the screen directly behind the original screen, i.e., the target screen, based on the positional relationship between the original screen and multiple displays. For example, if the original screen is the driver's side screen, the target screen can be determined to be the left rear screen. If the original screen is the passenger's side screen, the target screen can be determined to be the right rear screen.

[0404] For example, if the angle is Figure 14BWithin the range of [22.5°, 67.5°), assuming that the pre-set sliding direction [22.5°, 67.5°) corresponds to the screen located to the right rear of the original screen, the vehicle terminal determines the screen located to the right rear of the original screen, i.e., the target screen, based on the positional relationship between the original screen and multiple displays.

[0405] For example, if the original screen is the driver's side screen, then the target screen can be determined to be the right rear screen. It should be noted that... Figure 14B The correspondence between the sliding direction and the target screen shown is merely an example, and the embodiments in this application do not impose specific limitations. For example, if the angle is... Figure 14B Within the range of [67.5°, 112.5°), assuming the pre-set sliding direction [67.5°, 112.5°) corresponds to all screens located behind the original screen, the vehicle terminal determines all screens located behind the original screen, i.e., the target screens, based on the positional relationship between the original screen and multiple displays. For example, if the original screen is the driver's side screen, then the target screens can be determined to be the left and right rear screens.

[0406] In other embodiments, the vehicle terminal can also determine whether the user's interface flow intention is a cross-screen flow or a same-screen flow based on other mechanisms. For example, when the vehicle terminal receives the user's first operation on the first interface, it can determine whether the user's interface flow intention is a cross-screen flow or a same-screen flow, and the position of the first interface after the flow, based on the position of the first interface before the flow and the positional relationship between the displays. Figure 14C As shown, display screen 2 is located to the right of display screen 1. Taking display screen 1 as the first screen, if the position of the first interface before the transition is close to the right side of display screen 1, and the first operation is to slide the first interface to the right, then the vehicle terminal can determine that the user's interface transition intention is a cross-screen transition, such as transitioning the first interface from display screen 1 to display screen 2. Figure 14D As shown, if the position of the first interface before the transition is close to the right side of display screen 1, and the first operation is to slide the first interface to the left, then the vehicle terminal can determine that the user's interface transition intention is a simultaneous screen transition, such as transitioning the first interface from the right side of display screen 1 to the left side of display screen 1. Similarly, if the position of the first interface before the transition is close to the left side of display screen 1, and the first operation is to slide the first interface to the right, then the vehicle terminal can determine that the user's interface transition intention is a simultaneous screen transition, such as transitioning the first interface from the left side of display screen 1 to the right side of display screen 1.

[0407] Similarly, if display screen 2 is located to the right of display screen 1, taking display screen 2 as the first screen, if the position of the first interface before the transition is close to the left side of display screen 2, and the first operation is to slide the first interface to the left, then the vehicle terminal can determine that the user's interface transition intention is cross-screen transition, such as transitioning the first interface from display screen 2 to display screen 1; if the position of the first interface before the transition is close to the left side of display screen 2, and the first operation is to slide the first interface to the right, then the vehicle terminal can determine that the user's interface transition intention is same-screen transition, such as transitioning the first interface from the left side of display screen 2 to the right side of display screen 2.

[0408] For example, such as Figure 10 As shown, if the first operation is used to transfer the first interface across screens, the vehicle terminal executes S1003-1 and S1004-1; if the first operation is used to transfer the first interface within the same screen, the vehicle terminal executes S1003-2 and S1004-2.

[0409] S1003-1: The vehicle terminal determines that the target screen is the second screen.

[0410] In some embodiments of this application, the vehicle terminal can determine the target screen based on a first operation received for transferring the first interface across screens.

[0411] Taking the first operation used to switch the first interface across screens as an example, which is a user's one or more fingers quickly swiping and then leaving, in some embodiments, the vehicle terminal can determine the target screen based on the direction of the user's finger swipe. The specific methods and processes for determining the target screen can be found in the detailed description above, and will not be repeated here.

[0412] It is understandable that when an in-vehicle terminal includes multiple displays (e.g., a first screen and a second screen), the in-vehicle terminal must know the relative positions of these displays. Similarly, when multiple displays (e.g., a first screen and a second screen) belong to different in-vehicle terminals, the in-vehicle terminal to which the first screen belongs can know the relative positions of the multiple displays. For example, the in-vehicle terminal stores the specific positions of the multiple displays. Based on this, in this embodiment, the in-vehicle terminal can determine the target screen when navigating to the first interface across screens based on the direction of the user's finger swipe and the relative positions of the multiple displays.

[0413] As an example, when multiple displays (e.g., a first screen and a second screen) belong to different in-vehicle terminals, the in-vehicle terminal to which the first screen belongs can obtain the relative positional relationship of the multiple displays based on automatic positioning technology. For example, automatic positioning technology could be ultrasonic positioning technology. The in-vehicle terminal to which the first screen belongs can use ultrasonic positioning technology to emit ultrasonic signals through a speaker installed therein and receive echo signals of ultrasonic signals from other in-vehicle terminals through a microphone installed therein. Furthermore, the in-vehicle terminal to which the first screen belongs can use triangulation technology to determine the specific positions of the multiple in-vehicle terminals within the vehicle based on the transmission paths of the emitted and received signals, combined with the relative positional relationship of the speaker and microphone, thereby determining the relative positional relationship of the multiple in-vehicle terminals, which is the relative positional relationship of the multiple displays.

[0414] Alternatively, if multiple displays (e.g., the first screen and the second screen) belong to different vehicle terminals, the vehicle terminal to which the first screen belongs can determine the specific locations of the multiple vehicle terminals within the vehicle based on relevant configuration information such as vehicle system configuration information or through other methods, thereby determining the relative positional relationship of the multiple vehicle terminals, which is the relative positional relationship of the multiple displays. This application does not specifically limit the specific methods and processes described in the embodiments.

[0415] In some embodiments of this application, a one-to-one interface transition can be achieved based on the method provided in the embodiments of this application.

[0416] For example, the method provided in the embodiments of this application can realize cross-screen flow of any interface on any screen to any other screen. For example, for a car, it can realize cross-screen flow of the interface from the driver's screen to the passenger screen, from the driver's screen to the left rear screen, from the driver's screen to the right rear screen, from the passenger screen to the driver screen, from the passenger screen to the left rear screen, from the passenger screen to the right rear screen, from the left rear screen to the driver screen, from the left rear screen to the passenger screen, from the left rear screen to the right rear screen, from the right rear screen to the driver screen, from the right rear screen to the passenger screen, and from the right rear screen to the left rear screen.

[0417] Please refer to Figures 15-17 , Figures 15-17 Taking a vehicle-mounted terminal including display screen 1, display screen 2, display screen 3 and display screen 4 as an example, several schematic diagrams of sliding operations for cross-screen flow to different display screens provided in the embodiments of this application are shown.

[0418] For example, if display screen 1 (i.e., the first screen) receives Figure 15 The user's action of quickly swiping two fingers to the right on the first interface (i.e., swiping in the direction of display screen 2) and then leaving the screen is as follows: Figure 15As shown, based on the sliding direction of the operation and the relative positions of display screens 1, 2, 3, and 4, the vehicle terminal can determine that the target screen is display screen 2, located to the right of display screen 1. That is, the intention of the above operation is to transfer the first interface from display screen 1 to display screen 2.

[0419] For example, if display screen 1 (i.e., the first screen) receives... Figure 16 The user's action 5, where two fingers quickly swipe down on the first interface (i.e., the swipe direction points towards display screen 3) and then leave, is as follows: Figure 16 As shown, based on the sliding direction of the operation and the relative positions of display screens 1, 2, 3, and 4, the vehicle terminal can determine that the target screen is display screen 3, which is located behind display screen 1. That is, the intention of the above operation is to transfer the first interface from display screen 1 to display screen 3.

[0420] For example, if display screen 1 (i.e., the first screen) receives... Figure 17 The user's action of quickly swiping two fingers down and to the right on the first interface (i.e., swiping in the direction of display screen 4) and then leaving the screen is as follows: Figure 17 As shown, based on the sliding direction of the operation and the relative positions of display screens 1, 2, 3, and 4, the vehicle terminal can determine that the target screen is display screen 4, located to the right rear of display screen 1. That is, the intention of the above operation is to transfer the first interface from display screen 1 to display screen 4.

[0421] In other embodiments of this application, a one-to-many interface transition can be achieved based on the method provided in the embodiments of this application.

[0422] For example, the method provided in the embodiments of this application can realize the cross-screen flow of any interface on any screen to multiple other screens. For example, for a car, it can realize the cross-screen flow of the interface from the driver's screen to the rear screens (including the left and right rear screens), and from the rear screens (such as the left or right rear screens) to the front screens (including the driver's screen and the passenger screen).

[0423] For example, such as Figure 18 As shown, assuming the vehicle-mounted terminal includes display screen 1, display screen 2, display screen 3, and display screen 4, if display screen 1 (i.e., the first screen) receives... Figure 18 The user's action of quickly swiping down on the first interface with two fingers (i.e., swiping in the direction of the rear seats) and then leaving the interface allows the in-vehicle terminal to determine the target screen as the display screen (including display screens 3 and 4) located behind display screen 1, based on the swiping direction and the relative positions of display screens 1, 2, 3, and 4. In other words, the intention of the above operation is to transfer the first interface from display screen 1 to the rear display screens (including display screens 3 and 4).

[0424] It should be noted that, Figures 15-18 The illustrated cross-screen scrolling operation is only an example of a directional cross-screen scrolling operation. The method provided in this application embodiment can also be applied to non-directional cross-screen scrolling. For example, the terminal device can also respond to the user's second operation on the first interface to scroll the first interface across all other screens of the vehicle terminal.

[0425] in addition, Figures 15-18 These are merely examples of several interfaces before and after cross-screen transitions; this application does not limit the specific display during the cross-screen interface transition process. For example, after receiving a swipe operation for cross-screen transition, the vehicle terminal can also display prompts on the original screen and / or the target screen, respectively, to indicate that a cross-screen transition is imminent and that the cross-screen transition interface is about to be received, or to allow the user to confirm that a cross-screen transition is imminent and that the cross-screen transition interface is about to be received, thus preventing erroneous interface transitions caused by user misoperation. Alternatively, for example, during the transition of the first interface from the original screen to the target screen, the first interface can also feature an animation of the interface on the original screen shrinking → transitioning to the target screen. Alternatively, for example, if the aspect ratios of the original screen and the target screen are different, the vehicle terminal can adjust the display ratio of the first interface on the target screen after the interface transition to a ratio adapted to the aspect ratio of the target screen. Alternatively, for example, if the sizes of the original screen and the target screen are different, the vehicle terminal can also display the first interface at a size adapted to the target screen size after the interface transition.

[0426] S1004-1: The vehicle-mounted terminal displays the first interface on the second screen using the first display type. The first display type is related to the task information before the transition to the first interface and / or the screen task information of the second screen.

[0427] The task information before the first interface transition is used to characterize the display type and / or classification information of the first interface when it is displayed on the first screen before the interface transition. The display type of the first interface when it is displayed on the first screen is used to characterize the presentation of the first interface when it is displayed on the first screen. For example, the display type of the first interface before the transition may include, but is not limited to, any of the following: full-screen display, split-screen display, floating window, floating icon, floating ball, picture-in-picture, card, control, or notification, etc. The classification information of the first interface when it is displayed on the first screen is used to characterize whether the first interface is a preset focused application interface.

[0428] The screen task information of the second screen is used to characterize the display type and / or classification information of the task interface on the second screen before the interface transition. The display type of the task interface on the second screen is used to characterize the presentation of the task interface on the second screen. For example, the display type of the task interface on the second screen may include, but is not limited to, any of the following: full-screen display, split-screen display, floating window, floating icon, floating ball, picture-in-picture, card, control, or notification, etc. The classification information of the task interface on the second screen is used to characterize whether the task interface on the second screen is a preset focused application interface.

[0429] In some embodiments, the second screen of the vehicle terminal does not display a task interface. For example, the second screen of the vehicle terminal displays a desktop, notification center, control center, etc. Optionally, when the second screen of the vehicle terminal displays a system page (e.g., settings page), it can also be considered that the second screen of the vehicle terminal does not display a task interface.

[0430] In other embodiments, a task interface (such as a second task interface) is displayed on the second screen of the vehicle terminal.

[0431] In other embodiments, the second screen of the vehicle terminal displays multiple task interfaces (such as multiple second task interfaces).

[0432] In this embodiment of the application, one or more second task interfaces can be displayed on the second screen of the vehicle terminal in any display type.

[0433] If a second task interface is displayed on the second screen of the vehicle terminal, this second task interface can be displayed in full screen on the second screen (e.g., Figure 3 As shown, it can also be displayed on the second screen's desktop, notification center, control center, and other pages in the form of a floating window, floating icon, floating ball, picture-in-picture, card, control, or notification.

[0434] If the second screen of the vehicle terminal displays multiple second task interfaces, in some examples, these multiple second task interfaces can be displayed in a split-screen manner on the second screen, such as... Figure 2 As shown. In other examples, one of the multiple second task interfaces can be displayed full-screen on the second screen, while other interfaces are displayed on the second screen in the form of floating windows, floating icons, floating balls, picture-in-picture, cards, controls, or notifications, such as... Figure 4 , Figure 5 , Figure 6 , Figure 8 (a) or Figure 8 As shown in (b) of the diagram.

[0435] Similarly, if multiple second task interfaces are displayed on the second screen of the vehicle terminal, these multiple task interfaces may be displayed on the second screen in response to the user's operation of opening multiple second task interfaces; or, the multiple task interfaces may be displayed on the second screen in response to the user's operation of opening a task combination. This application embodiment does not limit the specific process by which the vehicle terminal displays multiple second task interfaces on the second screen.

[0436] It's understandable that the second screen is the target screen. When the user transitions from the first screen to the second screen, the display type of the first screen on the second screen may be influenced by the task interface currently displayed on the second screen, in order to provide an intelligent display that meets user needs and habits. For example, if the in-vehicle terminal ignores the task interface on the second screen and directly displays the first screen in full screen on the second screen, it may forcibly interrupt the user's focus on the task interface on the second screen, affecting the user experience. Conversely, if the in-vehicle terminal ignores the task interface on the second screen and directly displays the first screen in a non-full-screen format on the second screen, and the second screen did not originally display the task interface, the user may need to manually adjust the non-full-screen first screen to full-screen mode, also affecting the user experience.

[0437] Furthermore, users typically navigate from the first screen to the second screen intending to use the first screen as the primary focus for the second task. Therefore, to provide an intelligent display that meets user needs and habits, the display type of the first screen on the second screen may be influenced by its original display type or category on the first screen. For example, if the in-vehicle terminal disregards information about whether the first screen was previously displayed in full screen or as a primary task interface on the first screen, and directly displays the first screen in a non-full-screen format on the second screen, users may need to manually adjust the non-full-screen first screen to full-screen mode if the second screen did not originally display a task interface, thus impacting the user experience.

[0438] Therefore, in this embodiment of the application, when performing cross-screen interface transition, the vehicle terminal determines the specific display type of the first interface on the second screen after the transition by obtaining the task information before the transition of the first interface and / or the screen task information of the second screen, so as to display the first interface on the second screen with a more reasonable display effect after the interface transition, thereby improving the user experience.

[0439] The following will use specific examples to illustrate the display effect of the in-vehicle terminal displaying the first interface that flows from the first screen on the second screen, in cases (A) to (C):

[0440] Situation (A): The display effect of the first interface that flows from the first screen on the second screen of the vehicle terminal is related to the screen task information of the second screen before the flow.

[0441] In some embodiments, the vehicle terminal displays the first interface in full-screen mode through the second screen (i.e., the first display type is full-screen display), and the first display type is determined by the vehicle terminal based on the screen task information of the second screen.

[0442] For example, the screen task information of the second screen indicates that no task interface is displayed on the second screen. The vehicle terminal can decide to switch to the second screen and then display the first interface in full screen based on the screen task information of the second screen.

[0443] For example, the second screen may display the desktop, notification center, control center, or system interface (such as the settings page).

[0444] The second screen is located to the right of the first screen, such as Figure 19 As shown, in response to the user's operation of quickly swiping two fingers across the first interface on the first screen and then leaving, the vehicle terminal will transfer the first interface on the first screen to the second screen. After the transfer, the vehicle terminal will display the first interface in full screen on the second screen.

[0445] in, Figure 19 The example shown only uses the case where the first interface is displayed in full screen on the first screen before the transition. If the first interface is displayed in the form of split screen, floating window, floating icon, floating ball, picture-in-picture, card or notification on the first screen before the transition, and the task interface is not displayed on the second screen, the vehicle terminal can also decide to display the first interface in full screen on the second screen after the transition based on the screen task information of the second screen.

[0446] For example, Figures 20-24 Taking the second screen located to the right of the first screen as an example, this application illustrates several examples of interface transitions for in-vehicle terminals provided in its embodiments, responding to a user's operation of quickly swiping and then leaving the first interface on the first screen. Figure 20 The example illustrates how, before the transition, interface A (i.e., the first interface) is displayed on the first screen in a split-screen manner with interface B, and the vehicle terminal decides, based on the screen task information of the second screen, to display interface A (i.e., the first interface) in full screen on the second screen. Figure 21 The example illustrates how, before the transition, interface D (i.e., the first interface) is displayed as a floating window on the first screen along with interface E, and the vehicle terminal decides, based on the screen task information of the second screen, to display interface D (i.e., the first interface) in full screen on the second screen. Figure 22 The example illustrates how, before the transition, the icon of interface D (i.e., the first interface) is displayed as a floating icon along with interface E on the first screen. The vehicle terminal then decides, based on the screen task information of the second screen, to display interface D (i.e., the first interface) in full screen on the second screen. Figure 23The example shown illustrates how, when a memo card (i.e., the first interface) is displayed as a card on the first screen before the transition, the vehicle terminal decides, based on the screen task information of the second screen, to display the memo interface (i.e., the first interface) in full screen on the second screen after the transition. Figure 24 The example illustrates a scenario where, before the transition, the pending video call (i.e., the first interface) is displayed on the first screen as a notification along with interface C. The vehicle terminal then decides, based on the screen task information of the second screen, to display the pending video call interface (i.e., the first interface) in full screen on the second screen after the transition.

[0447] Alternatively, for example, the screen task information of the second screen indicates that the task interface on the second screen is displayed in a non-full-screen form before the transition. For example, the display type of the task interface on the second screen is any of the following: split-screen window, floating window, floating icon, floating ball, card, control or notification. The vehicle terminal can decide to display the first interface in full screen on the second screen after the transition based on the screen task information of the second screen.

[0448] For example, Figures 25-26 Taking the second screen located to the right of the first screen as an example, this application illustrates two examples of interface transitions for in-vehicle terminals provided in response to a user's quick two-finger swipe and subsequent exit from the first interface on the first screen. Figure 25 The example illustrates a scenario where interface A (i.e., the first interface) is displayed on the first screen in a split-screen manner with interface B before the transition, and the second screen displays interface B as a floating window. Based on the screen task information of the second screen, the vehicle terminal decides to display interface A (i.e., the first interface) in full screen on the second screen after the transition. Figure 26 This illustrates a scenario where interface A (the first interface) and interface B are displayed in a split-screen format before the transition. The first screen displays new WeChat messages in the form of notifications, while the second screen displays them in the form of notifications. In the case of a message, the vehicle terminal decides whether to display an example of interface A (i.e., the first interface) in full screen on the second screen after the flow, based on the screen task information of the second screen.

[0449] in, Figures 25-26 This example only illustrates the scenario where the first interface is displayed in a split-screen format on the first screen before the transition. For examples of interface transitions where the first interface is displayed in other display types before the transition, please refer to the examples above or below. Similarly, for examples of interface transitions where the task interface on the second screen is displayed in other non-full-screen formats (such as picture-in-picture, floating icons, split-screen windows, cards, floating balls, etc.), please refer to the examples above or below; they will not be listed here.

[0450] Alternatively, for example, the screen task information of the second screen indicates that the task interface on the second screen before the transition does not include a preset focused application interface. Based on the screen task information of the second screen, the vehicle terminal can decide to display the first interface in full screen on the second screen after the transition. For example, suppose... Figure 27 The interface B shown is not the preset application-focused interface. The vehicle terminal decides to display interface E (i.e. the first interface) in full screen on the second screen after the transition based on the screen task information of the second screen.

[0451] It is understood that in this embodiment of the application, when there is no task interface displayed on the second screen, or no full-screen task interface, or no preset focused application interface, the vehicle terminal can directly display the first interface in full screen on the second screen after the interface transition, so as to ensure that the first interface can be displayed prominently without the user having to manually adjust it, avoid interference from other interfaces to the interface, and facilitate the user to view the first interface and / or operate on the first interface through the second screen, providing the user with a more efficient and user-friendly interface transition experience.

[0452] In other embodiments, the vehicle terminal displays the first interface flowing from the first screen through the second screen in a non-full-screen format (such as the first display type being split-screen display, floating window, floating icon, floating ball, picture-in-picture, card, or notification, etc.). The first display type is determined by the vehicle terminal based on the screen task information of the second screen.

[0453] For example, the screen task information of the second screen indicates that the second screen includes a full-screen task interface. After the vehicle terminal decides the display type of the first interface after the flow based on the screen task information of the second screen, it is a split-screen display, a floating window, or a picture-in-picture, etc.

[0454] For example, Figures 28A-28B Taking the second screen located to the right of the first screen as an example, this application illustrates two examples of interface transitions for in-vehicle terminals provided in response to a user's quick two-finger swipe and subsequent exit from the first interface on the first screen. Figure 28A The example illustrates a scenario where interface A (i.e., the first interface) is displayed on the first screen in a split-screen format with interface B before the transition, and interface C is displayed in full screen on the second screen. Based on the screen task information of the second screen, the vehicle terminal decides whether to display interface A (i.e., the first interface) and interface C in a split-screen format (i.e., non-full screen) on the second screen after the transition. Figure 28B The example illustrates a scenario where, before the transition, the first interface (i.e., interface A) is displayed in a split-screen format with interface B on the first screen, and the second screen displays interface C in full screen. Based on the screen task information of the second screen, the vehicle terminal decides whether to display interface A (i.e., the first interface) together with the full-screen interface C on the second screen in the form of a floating window or picture-in-picture, according to the screen task information of the second screen.

[0455] in, Figures 28A-28BThe example shown is that the first interface is displayed on the first screen in a split-screen manner before the transition. For examples of interface transitions where the first screen task interface is displayed in other display types (such as full-screen display, floating window, etc.) before the transition, please refer to the examples above or below. They will not be listed here one by one.

[0456] Alternatively, for example, the screen task information of the second screen indicates that a preset focused application interface is displayed on the second screen. After the vehicle terminal decides the flow based on the screen task information of the second screen, the display type of the first interface is split-screen display, floating window, or picture-in-picture, etc.

[0457] For example, Figures 28A-28B Interface C shown can be a preset focused application interface. The vehicle terminal, based on the screen task information of the second screen, decides whether to display interface A (i.e., the first interface) and interface C (e.g., ...) via a split-screen display on the second screen after the transition. Figure 28A As shown), or the vehicle terminal decides, based on the screen task information of the second screen, to display interface A (i.e., the first interface) in the form of a floating window or picture-in-picture on the full-screen interface C of the second screen after the transition (e.g. Figure 28B (As shown).

[0458] In the case where the preset focused application interface on the first screen and the second screen are displayed in a split-screen manner after the transition, the interface ratio of the preset focused application interface on the first screen and the second screen can be [missing information]. Figure 27 The ratio shown is 1:1, but it can also be 1:2 or 2:1, depending on the specific settings. This application does not limit the specific ratio.

[0459] It is understood that in this embodiment of the application, when there is a full-screen task interface or a preset focused application interface on the second screen, the vehicle terminal can display the first interface on the second screen in the form of split-screen display, floating window or picture-in-picture after the interface transition, so as to avoid interrupting the task interface that the user is focusing on on the second screen and to provide the user with a more user-friendly interface transition experience.

[0460] Situation (B): The display effect of the first interface that flows from the first screen on the second screen of the vehicle terminal is related to the task information before the first interface flows.

[0461] In some embodiments, after the interface transition, the vehicle terminal displays the first interface in full screen on the second screen (i.e., the first display type is full screen display), and the first display type is determined by the vehicle terminal based on the task information displayed on the first screen before the first interface transition.

[0462] For example, the vehicle terminal can display the first interface on the second screen using the same display type as when the first interface is displayed on the first screen. For instance, if the first interface is displayed in full-screen mode on the first screen, the vehicle terminal can decide to switch screens and then display the first interface in full-screen mode on the second screen.

[0463] like Figure 27 As shown, when interface D is displayed on the first full-screen display interface E (i.e., the first interface) in the form of a floating window or picture-in-picture, in response to the user's operation of quickly swiping and leaving interface E (i.e., the first interface) on the first screen, the vehicle terminal decides to display interface E (i.e., the first interface) in full-screen mode on the second screen after the transition, based on the display type of interface E (i.e., the first interface) when it was displayed on the first screen. Figure 27 After the transition shown, the full-screen interface B that was originally displayed on the second screen is obscured or replaced by the full-screen interface E (i.e., the first interface), while the interface D that was originally displayed on the first screen can continue to maintain its original display type.

[0464] It's understandable that interface transitions are typically based on communication between in-vehicle occupants. Therefore, we can consider the transition as a way to move the focus of attention from the first screen to the second screen, making it the focus of attention on that second screen. Based on this, to provide users with a more efficient and user-friendly interface transition experience, the in-vehicle device can, after the transition, display the first interface that was previously displayed in full screen on the first screen on the second screen. This ensures the first interface remains prominently displayed without requiring manual adjustment by the user, avoids interference from other interfaces, and allows users to easily view and / or operate on the first interface from the second screen.

[0465] For example, when the first interface is displayed on the first screen, it is a preset focused application interface. The vehicle terminal can decide to switch to display the first interface in full screen on the second screen. Based on this, it can ensure that the interface with high user attention or importance is displayed prominently, avoid interference from other interfaces, and facilitate user viewing and / or operation.

[0466] In other embodiments, the vehicle terminal displays the first interface in a non-full-screen format (i.e., the first display type is split-screen display, floating window, picture-in-picture, etc.) through the second screen. The first display type is determined by the vehicle terminal based on the task information displayed on the first screen before the first interface is transferred.

[0467] For example, the vehicle-mounted terminal can display the first interface on the second screen using the same display type as when it was displayed on the first screen before the first interface transition. For example, as Figure 29As shown, when interface D (i.e., the first interface) is displayed on the first screen in the form of a floating window along with interface E displayed in full screen, in response to the user's operation of quickly swiping two fingers away from interface D (i.e., the first interface) on the first screen, the vehicle terminal decides to display it on the second screen in the form of a floating window after the transition, based on the display type when interface D (i.e., the first interface) was displayed on the first screen before the transition.

[0468] Similarly, if the first interface is displayed in picture-in-picture mode on the first screen before the transition, the vehicle terminal can also decide to display the first interface in picture-in-picture mode on the second screen after the transition (see reference). Figure 29 (These will not be listed individually here.)

[0469] Situation (C): The display effect of the first interface that flows from the first screen on the second screen of the vehicle terminal is related to the task information before the first interface flows and the screen task information of the second screen before the flow.

[0470] In some embodiments, the vehicle terminal can analyze the screen task information of the second screen. If the screen task information of the second screen indicates that the second screen includes a full-screen task interface or a preset focused application interface is displayed on the second screen, the vehicle terminal can decide to switch to display the first interface in a non-full-screen form.

[0471] Furthermore, after the vehicle terminal makes a decision on the flow based on the screen task information of the second screen and displays the first interface in a non-full-screen format, the vehicle terminal can determine the specific display type (i.e., the first display type) of the first interface on the second screen after the flow.

[0472] For example, assuming the first interface is displayed in split-screen mode on the first screen before the transition, the in-vehicle terminal can determine that the first interface will be displayed in split-screen mode on the second screen after the transition. Assuming the first interface is displayed in full-screen mode on the first screen before the transition, the in-vehicle terminal can determine that the first interface will be displayed in split-screen, floating window, or picture-in-picture mode on the second screen after the transition. Furthermore, assuming the first interface is displayed in floating window mode on the first screen after the transition, the in-vehicle terminal can determine that the first interface will be displayed in floating window mode on the second screen after the transition. Similarly, assuming the first interface is displayed in picture-in-picture mode on the first screen after the transition, the in-vehicle terminal can determine that the first interface will be displayed in picture-in-picture mode on the second screen after the transition.

[0473] For example, such as Figure 28A As shown, in the case where the first interface (i.e., interface A) is displayed on the first screen in a split-screen manner with interface B before the flow, and the second screen displays interface C in full screen, after the vehicle terminal decides to flow, the second screen displays interface A (i.e., the first interface) and interface C in a split-screen manner.

[0474] For example Figure 31As shown, if the first interface (i.e., interface A) is displayed as a floating window on the full-screen interface B on the first screen before the transition, and the second screen displays interfaces C and D in a split-screen manner, the vehicle terminal can decide to display interface A (i.e., the first interface) as a floating window on the split-screen interfaces C and D on the second screen after the transition.

[0475] In other embodiments, if the screen task information of the second screen indicates that the second screen does not include a full-screen task interface and there is no preset focused application interface on the second screen, the vehicle terminal can further analyze the task information before the first interface transition. If the task information before the first interface transition indicates that the first interface was displayed in full screen and / or the first interface was a preset focused application interface when it was displayed on the first screen before the transition, the vehicle terminal can decide to display the first interface in full screen on the second screen after the transition (i.e., the first display type is full-screen display).

[0476] For example, such as Figure 30 As shown, in the case of a first screen displaying interface A (i.e., the first interface) and interface B, and a second screen displaying interfaces C and D, assuming that interfaces C and D are not the preset focused application interfaces, while interface A is the preset focused application interface, in response to the user's operation of quickly swiping two fingers away from interface A (i.e., the first interface) on the first screen, the vehicle terminal can decide to switch and display the first interface in full screen on the second screen. Wherein, Figure 30 After the transition shown, the original split-screen interfaces C and D on the second screen are obscured or replaced by the full-screen first interface.

[0477] Similarly, if the screen task information of the second screen indicates that the second screen does not include a full-screen task interface, and there is no preset focused application interface on the second screen, and the first interface is a preset focused application and is displayed as a floating window, floating icon, floating ball, picture-in-picture, card, control, or notification on the first screen, the vehicle terminal can also decide to switch the display to the second screen in full screen. For specific examples, please refer to the examples above or below; they will not be listed here again.

[0478] It should be noted that, Figure 20 , Figures 25-26 , Figures 28A-28B and Figure 30 Taking, for example, after interface A (i.e., the first interface) transitions from the first screen to the second screen, the first screen displays interface B, which was previously displayed in a split-screen manner on the first screen, in full screen. In other embodiments of this application, after the first interface transitions from the first screen to the second screen, the first screen may also maintain the remaining interfaces displayed in the same display type and position as before the transition.

[0479] Optionally, in some embodiments, the vehicle terminal may also decide the display type of the first interface after the flow based on user settings or system settings. Alternatively, the vehicle terminal may also decide the specific display type of the first interface after the flow based on other relevant factors, which is not specifically limited in the embodiments of this application.

[0480] Additionally, it should be noted that the embodiments of this application do not limit the specific position of the first interface when it is displayed on the second screen in a non-full-screen form such as a floating window or picture-in-picture after the interface transition. It depends on the specific device settings or interface layout.

[0481] It should be noted that the above embodiments of this application only illustrate that after the first interface transitions from the first screen to the second screen, the first screen no longer displays information related to the first interface. In other embodiments of this application, after the first interface transitions from the first screen to the second screen, the first screen may still display small interfaces such as application icons or floating icons corresponding to the first interface. Based on this, it is convenient for the original screen user to still view or operate the first interface, and it can avoid the first interface interfering with other focused tasks on the first screen.

[0482] For example, such as Figure 32 As shown, when interface D is displayed as a floating window on the first full-screen display interface E (i.e., the first interface), in response to the user's operation of quickly swiping and leaving interface E (i.e., the first interface) with two fingers, the vehicle terminal decides to display interface E (i.e., the first interface) in full-screen mode on the second screen after the transition, based on the display type of interface E (i.e., the first interface) when it was displayed on the first screen before the transition. Figure 32 After the flow is shown, the first screen can display the icon (such as the application icon or floating icon) corresponding to interface E (i.e. the first interface).

[0483] Alternatively, if the first screen was previously displayed in full-screen or split-screen mode, after the transition to the second screen, the first screen can still display the first screen in a small format, such as a floating window, picture-in-picture, or card. This allows the original screen user to still view or interact with the first screen, while preventing the first screen from interfering with other tasks requiring focused attention on that screen. For example, such as... Figure 32 As shown, when interface E transitions from the first screen to the second screen, when the user clicks the corresponding icon (or floating window, picture-in-picture, or card, etc.) on interface E on the first screen, interface E can transition back to the first screen from the second screen.

[0484] For example, such as Figure 33As shown, with the first screen displaying interface A (i.e., the first interface) and interface B, and the second screen displaying interface C and interface D, assuming that interface C and interface D are not the preset focused application interface, and interface A is the preset focused application interface, in response to the user's operation of quickly swiping two fingers on interface A (i.e., the first interface) on the first screen and then leaving, the vehicle terminal can decide to switch and then display the first interface in full screen on the second screen.

[0485] Alternatively, if interface C and / or interface D are preset application-focused interfaces, in Figure 33 After the interface A shown (i.e. the first interface) transitions from the first screen to the second screen, the second screen can display the first interface as a floating window.

[0486] in, Figure 33 After the flow shown, interface A (i.e., the first interface) is displayed on the first screen. This first interface is displayed on the first screen in the form of a floating window, picture-in-picture, or card. It should also be noted that the above embodiments of this application only use the case where the first screen includes multiple task interfaces as an example. The method provided in the embodiments of this application is also applicable to the case where the first screen includes only one interface.

[0487] Furthermore, it should be noted that the above embodiments of this application only use the cross-screen flow of one task interface (i.e., the first interface) as an example. The method provided in the embodiments of this application can also support the cross-screen flow of multiple task interfaces at one time. For example, if a user's multi-finger swipe and release operation applies to the display area of ​​multiple task interfaces on the first screen, the vehicle terminal will simultaneously flow these multiple task interfaces to the second screen. It can be understood that, based on the interface flow method provided in the embodiments of this application, users can trigger the cross-screen flow of task interfaces from the original screen to the target screen through cross-screen flow operations that conform to user operating habits and are easy to remember and operate, so as to meet the diverse needs of users, such as flowing to other passengers for use or being assisted by other passengers in performing related operations.

[0488] For example, based on the interface transition method provided in the embodiments of this application, the vehicle terminal can respond to the driver's operation of switching the navigation interface (i.e., the first interface) across screens and display the navigation interface (i.e., the first interface) through the passenger screen or other display screens, so that passengers in the corresponding positions can assist the driver in performing navigation-related operations, such as adding waypoints, modifying destinations, etc., eliminating safety hazards when the driver performs navigation-related operations, ensuring vehicle driving safety, and improving user experience.

[0489] For example, based on the interface switching method provided in the embodiments of this application, the vehicle terminal can respond to the driver's operation of switching the music interface (i.e., the first interface) across screens and display the music interface (i.e., the first interface) through the passenger screen or other display screens, so that passengers in the corresponding positions can assist the driver in performing music-related operations, such as music search and music switching, thereby eliminating safety hazards when the driver performs music-related operations, ensuring vehicle driving safety, and improving user experience.

[0490] For example, based on the interface transition method provided in the embodiments of this application, the vehicle terminal can respond to the driver's operation of transitioning the video call to be answered (i.e., the first interface) across screens, and display the video call interface to be answered (i.e., the first interface) on the passenger screen or other display screen, so that the passenger located in the corresponding position can take over or assist the driver in answering the video call, so that the driver can focus on driving the vehicle, ensure vehicle driving safety, and improve the user experience.

[0491] For example, based on the interface transition method provided in this application embodiment, the in-vehicle terminal can respond to the driver by transitioning the animation playback interface (i.e., the first interface) to the display screen (such as the right rear screen or left rear screen) at the location of the child in the vehicle, making it convenient for the child to watch animations. Based on this, it can solve the problem of children being unable to independently play animations due to their lack of knowledge of animation search and playback operations, and it also enables adults to monitor the activities children perform through the display screen, thus improving the user experience.

[0492] Furthermore, based on the interface transition method provided in this application embodiment, the vehicle terminal can also analyze the task information of the target screen and / or the task information of the interface to be transitioned, so as to display the task interface transitioned from the original screen on the target screen in an appropriate display type after the interface transition. Through this method, the task interface transitioned from the original screen can be displayed with the most prominent display effect without affecting the user's current focus on the target screen, thereby reducing subsequent user operations and providing a more efficient and user-friendly interface transition experience.

[0493] For example, when the target screen has a user focused on a task, the vehicle terminal can display the task interface that flows from the original screen on the target screen in a split-screen display, floating window, or picture-in-picture format that does not obstruct the user's focus on the task.

[0494] For example, when there is no user focused on the task on the target screen, the vehicle terminal can display the task interface that flows from the original screen in a prominent full-screen display, reducing the user's manual operation of the task interface.

[0495] Furthermore, during the cross-screen transition of the task interface, animation effects can be applied to the task interface to improve the user's visual experience. For example, when a full-screen task transitions from the original screen (e.g., the central control screen) to the target screen (e.g., the passenger screen), if the widths of the central control screen and the passenger screen are the same, the user can obtain a relatively smooth visual effect. However, if the widths of the central control screen and the passenger screen are different, the different sizes of the task interface displayed on the central control screen and the passenger screen will affect the user's visual experience. Therefore, in this embodiment, animation effects can be applied to the transitioning task interface. In one possible implementation, after the full-screen or split-screen task interface transitions to the target screen, the task interface can be adaptively laid out, that is, the task interface can be processed according to the size of the target screen to adapt its display effect to the size of the target screen. In this method, by first translating the task interface and then scaling it, the task interface can be quickly transitioned to the target screen. In another possible implementation, during the transition of the full-screen or split-screen task interface to the target screen, such as when the task interface traverses the original screen and the target screen, the task interface can be deformed and transitioned simultaneously. In this method, visual continuity can be improved by scaling and panning the task interface.

[0496] The above examples illustrate cross-screen transitions, such as... Figure 10 As shown, for the case of screen mirroring, that is, if the first operation received by the vehicle terminal in S1002 is used to mirror the first interface, the vehicle terminal executes the following S1003-2 and S1004-2:

[0497] S1003-2: The vehicle-mounted terminal determines the target location.

[0498] In this embodiment of the application, the vehicle terminal can determine the target location based on the received first operation for simultaneously displaying the first interface.

[0499] Taking the operation of slowly swiping a certain distance with one or more fingers and then leaving the screen as an example, for the purpose of simultaneously displaying the first interface, in some embodiments, the vehicle terminal can determine the target position based on the swiping distance of the user's finger. The specific methods and processes for determining the target position can be found in the detailed description above, and will not be repeated here.

[0500] S1004-2: The vehicle terminal displays the first interface at the target location using a second display type, based on the screen task information of the first screen. The second display type is related to the screen task information of the first screen.

[0501] The screen task information of the first screen is used to characterize the display type and / or classification information of the task interface on the first screen before the interface transition. The screen task information of the first screen includes the task information before the first interface transition.

[0502] In some embodiments, assuming the first interface is displayed full-screen on the first screen before the transition, the vehicle terminal can determine that the second display type is a preset display type, such as a floating window, floating icon, floating ball, picture-in-picture, or card. The specific type depends on the settings of the vehicle device (including factory settings or manual settings). The specific size of the floating window, floating icon, floating ball, picture-in-picture, or card also depends on the settings of the vehicle device (including factory settings or manual settings).

[0503] For example, such as Figure 34 As shown, when the first interface is displayed in full screen before the transition, in response to the user's slow two-finger swipe across the first interface for a distance (e.g., a distance L) and then leaving, the vehicle terminal determines that the intention of this operation is to transition the first interface to the target location. For example, the target location could be the position where the user's two fingers leave the first screen; or, the target location could be a preset position, such as the edge of the screen. Considering that the first interface is currently displayed in full screen, the vehicle terminal determines the display type of the first interface at the target location after the transition based on a preset display type, such as... Figure 34 The floating window or picture-in-picture shown.

[0504] In other embodiments, assuming the first interface is displayed in its original position on the first screen before the transition (not full screen), and no other task interfaces are displayed at the target location, the vehicle terminal can determine that the second display type is the display type of the first interface before the transition. That is, assuming the first interface is displayed in its original position on the first screen before the transition (not full screen), the vehicle terminal can maintain the original display type and move the first interface from its original position to the target location.

[0505] For example, such as Figure 35 As shown, when the first interface is displayed as a floating window at position A (the original position) on the first screen, in response to a user's operation of slowly swiping two fingers across the first interface a distance (e.g., a distance L) and then leaving, the vehicle terminal can maintain the original floating window of the first interface and move it from position A (the original position) to position B (the target position) where the user's two fingers leave the first screen. Alternatively, the vehicle terminal can maintain the original floating window of the first interface and move it from position A (the original position) to a preset position, such as the edge of the display screen (the target position).

[0506] Regarding situations where the first interface is displayed in its original position on the first screen in the form of picture-in-picture, floating icons, cards, etc., before the transfer, the vehicle terminal can also keep the original display type of the first interface unchanged and move the first interface from its original position to the target position. These will not be listed one by one here.

[0507] In other embodiments, assuming that the first interface is displayed on the first screen in a split-screen manner with other interfaces (such as the second interface) before the transition, and the target position is the task interface (i.e. the second interface) displayed in a split-screen manner with the first interface, the vehicle terminal can decide to swap the positions of the first interface and the second interface (i.e., the position of the second interface before the transition is the target position of the first interface).

[0508] For example, such as Figure 36 As shown, when the first interface and the second interface are displayed in a split-screen manner on the first screen, in response to the user's operation of slowly swiping two fingers from the first interface to the display area of ​​the second interface and then leaving, the vehicle terminal can keep the original split-screen window of the first interface unchanged and swap the positions of the first interface and the second interface.

[0509] It is understood that, based on the interface flow method provided in the embodiments of this application, users can trigger the screen flow of the task interface from one position (i.e., the original position) to another position (i.e., the target position) through the screen flow operation that conforms to user operating habits and is easy to remember and operate, so as to meet the diverse needs of users, such as fixing (Pin) the full-screen interface to a certain position on the screen, or moving the position of the task interface, or swapping the task interfaces displayed in split screen, etc.

[0510] Optionally, based on the interface transition method provided in the embodiments of this application, the vehicle terminal can also support reverse transition of the first interface that has transitioned from the first screen to the second screen.

[0511] For example, such as Figure 37 As shown, the first interface (such as...) will be displayed on the vehicle terminal. Figure 37 As shown in Interface A), after the user navigates from the first screen to the second screen, the vehicle terminal can, based on the user's operation of navigating from the second screen to the first screen, reverse the flow of the first screen (which had already been navigated from the first screen to the second screen) back to the first screen. Among these, Figure 37 The display type of the first interface after reverse flow shown is only an example. This application embodiment does not limit it and depends on the specific situation.

[0512] For example, during the reverse flow process, the vehicle terminal can determine the target screen as the first screen based on the user's first operation on the first interface on the second screen (such as a quick swipe and leave with one or more fingers). It then determines the display type of the first interface on the first screen after the flow based on the current screen task information and / or the task information of the first interface, and further displays the first interface on the first screen with the determined display type, thus realizing the reverse flow from the first interface to the first screen. In this reverse flow process, the second screen is the original screen, and the first screen is the target screen. For the specific process of the reverse flow, please refer to the above-described process of the first interface flowing across screens from the first screen to the second screen.

[0513] Or, for example, such as Figure 38 As shown, the first interface (such as...) will be displayed on the vehicle terminal. Figure 38 As shown in the diagram, after the interface (E) transitions from the first screen to the second screen, the vehicle terminal can, based on the user's operation of reversing the flow of the first interface triggered on the first screen (such as...), return to the first screen. Figure 38 The user's action of clicking the icon corresponding to interface E on the first screen reverses the flow of the first interface, which has already transitioned from the first screen to the second screen, back to the first screen. Figure 38 The display type of the first interface after reverse navigation shown is only an example and is not limited in this application embodiment; it depends on the specific situation. For example, the first screen can be the driver's side screen, and the second screen can be the passenger side screen or the rear screen. In this way, the user can control the reverse navigation of the first interface through the driver's side screen. Furthermore, the operation that triggers the reverse navigation of the first interface on the first screen can also be clicking on the floating window, floating ball, card, etc., corresponding to interface E.

[0514] Alternatively, based on the interface transition method provided in the embodiments of this application, after the vehicle terminal transitions the first interface from the first screen to the second screen, the vehicle terminal can also support simultaneous screen transition of the first interface on the second screen. For example, the vehicle terminal can, according to the user's simultaneous screen transition operation, transition the first interface that has transitioned from the first screen to the second screen from its original position to the target position. Regarding the simultaneous screen transition of the first interface on the second screen, the specific process of simultaneous screen transition of the first interface on the first screen in the above embodiments can be referred to, and will not be repeated here.

[0515] Alternatively, based on the interface transition method provided in the embodiments of this application, after the vehicle terminal transitions the first interface from the first screen to the second screen, the vehicle terminal can also support the first interface to transition to other displays (such as the third screen) again. Regarding the transition of the first interface from the second screen to the third screen, please refer to the specific process of the transition from the first screen to the second screen in the above embodiments, which will not be repeated here.

[0516] It should be noted that in the above embodiments of this application, the vehicle terminal switches the first interface displayed on the original screen (such as the first screen) to the target screen (such as the second screen) based on the user's cross-screen switching operation. In some embodiments, the vehicle terminal can also switch the first interface to the target screen (such as the second screen) based on the user's cross-screen switching operation when the process corresponding to the first interface has been started but not yet displayed. The user's cross-screen switching operation is, for example, the operation of a passenger at the target screen location opening the first interface on the first screen.

[0517] For example, such as Figure 39As shown, assuming the first screen is the homepage of application A, in response to detecting a user opening application A on the first screen and determining that the user is a passenger at the second screen location, the in-vehicle terminal launches application A, draws the homepage interface of application A (i.e., the first screen), and displays the first screen on the second screen. Optionally, as... Figure 39 As shown, after the vehicle terminal displays the first interface through the second screen, the icon of application A can still be displayed on the first screen. Alternatively, after the vehicle terminal displays the first interface through the second screen, the first screen can also display the first interface in the form of a floating window, floating icon, or other small interface to avoid interference with other focused tasks on the first screen. This application embodiment does not limit this.

[0518] Alternatively, for example, assuming the first interface is a sub-interface of another interface (such as the third interface), in response to detecting a user accessing the first interface from the third interface, and determining that the user is a passenger at the second screen location, the in-vehicle terminal draws the first interface and displays it on the second screen. Optionally, after the in-vehicle terminal displays the first interface on the second screen, the third interface may continue to be displayed on the first screen. Alternatively, after the in-vehicle terminal displays the first interface on the second screen, the third interface may no longer be displayed on the first screen; this embodiment of the application does not impose limitations.

[0519] Alternatively, assuming the first interface is the detailed information interface corresponding to a certain card (i.e., the first interface), and the application corresponding to that card is not currently running, in response to detecting a user clicking on the card on the first screen and determining that the user is a passenger at the second screen location, the in-vehicle terminal launches the application corresponding to the card, draws the detailed information interface of the card (i.e., the first interface), and displays the first interface on the second screen. Optionally, after the in-vehicle terminal displays the first interface on the second screen, the first screen can also display the first interface in the form of a floating window, floating icon, floating ball, or other small interface to avoid interference with other focused tasks on the first screen. This application embodiment does not limit this.

[0520] As one possible implementation, the in-vehicle terminal can capture image information within a viewfinder using a camera when it receives a cross-screen navigation operation. It's understood that the camera's viewfinder typically includes an image of the user who initiated the cross-screen navigation operation. Furthermore, the in-vehicle terminal can identify the user who triggered the cross-screen navigation operation based on the user image information captured by the camera. The specific methods and processes for determining user identity based on user image information can be found in conventional technologies and will not be elaborated upon here.

[0521] As another possible implementation, when receiving a cross-screen transition operation, the in-vehicle terminal can create a touch profile corresponding to the operation based on information such as the touch position, touch force, and contact area on the first screen. This touch profile represents the area of ​​contact between the user's finger and the screen. Furthermore, the in-vehicle terminal can determine the user identity that triggered the cross-screen transition operation based on the touch profile.

[0522] Taking the driver's screen as the first screen as an example, it can be understood that... Figure 40 As shown, if the user who triggers the cross-screen transition is a passenger in the driver's seat, the contact area between the user's finger and the screen corresponding to the cross-screen transition is as follows: Figure 40 As shown in (a); if the user who triggered the cross-screen transition is a passenger in the front passenger seat, then the contact area between the user's finger and the screen corresponding to the cross-screen transition is as follows. Figure 40 As shown in (b) of the diagram. Wherein, from Figure 40 The contact area shown in (a) is at the same level as... Figure 40 As shown in (b) of the image, the user's fingertips are pointing towards the upper right and upper left, respectively. Based on this, the vehicle terminal can determine the direction of the user's fingertips by analyzing the contact area between the user's finger and the screen, and then determine the user identity that triggered the cross-screen navigation operation based on the direction of the user's fingertips.

[0523] Alternatively, the vehicle terminal can also determine the identity of the user who triggered the cross-screen transfer operation through other methods, which are not specifically limited in this application embodiment.

[0524] It is understood that, based on the interface flow method provided in the embodiments of this application, the vehicle terminal can not only trigger the cross-screen flow of the task interface from the original screen to the target screen according to the user's cross-screen flow operation, but also trigger the same-screen flow of the task interface from one position (i.e., the original position) to another position (i.e., the target position) on the screen according to the user's same-screen flow operation, so as to meet the diverse needs of users, such as flowing to other passengers for use or being assisted by other passengers to perform related operations, or fixing (Pin) the full-screen interface to a certain position on the screen or moving the position of the task interface, etc.

[0525] Furthermore, based on the interface transition method provided in this application embodiment, the vehicle terminal can also analyze the task information of the target screen and / or the task information of the interface to be transitioned, so as to display the task interface transitioned from the original screen on the target screen in an appropriate display type after the interface transition. Through this method, the task interface transitioned from the original screen can be displayed with the most prominent display effect without affecting the user's current focus on the target screen, thereby reducing subsequent user operations and providing a more efficient and user-friendly interface transition experience.

[0526] Part Two: Multi-Screen Collaborative Display Methods

[0527] The multi-screen collaborative display method provided in this application embodiment can collaboratively display a single image on multiple displays to provide users with an immersive viewing experience. The content displayed or the way the content is displayed differs on each display. Based on the multi-screen collaborative display method provided in this application embodiment, when one display shows a content interface, other displays can display content based on the content on that display, enabling multiple displays to collaboratively present a single image, thereby enhancing the atmosphere and providing a better display effect.

[0528] Figure 41 This diagram illustrates an application scenario of a multi-screen collaborative display method provided in this application embodiment. In the multi-screen collaborative display method provided in this application embodiment, among multiple displays, a first display can show a first interface, and the second and third displays can display content based on the first interface. For example... Figure 41 As shown, in terms of display control methods, the control mechanisms for the first, second, and third displays can be any of the following: a single-core single-operating system (OS) control mechanism, a single-core multi-OS control mechanism, or a multi-core multi-OS control mechanism. Regarding display effects, the first interface displayed on the first display can be any interface, and the second and third displays can display interfaces rendered from the first interface. The rendering effect can be any of the following: Gaussian blur, solid color gradient, or particle animation. Optionally, in the multi-screen collaborative display method provided in this application embodiment, when displaying a multi-screen collaborative screen, the surrounding elements of the multiple displays, such as other devices in the space where the multiple displays are located, can also be controlled according to the displayed screen to achieve immersive screen display with the assistance of other devices. For example, as... Figure 41 As shown, the surrounding elements of multiple displays may include ambient lighting, seats, air conditioning, etc.

[0529] The multi-screen collaborative display method provided in this application embodiment can be applied in a vehicle cockpit scenario, where the first display screen, second display screen, and third display screen can be displays configured in the cockpit. Optionally, the first display screen, second display screen, and third display screen can be displays belonging to the same vehicle terminal, in which case the control mechanism for the first display screen, second display screen, and third display screen is a single-chip multi-screen mechanism (including the aforementioned single-chip single-OS mechanism and single-chip multi-OS mechanism); alternatively, the first display screen, second display screen, and third display screen can be displays belonging to different vehicle terminals, in which case the control mechanism for the first display screen, second display screen, and third display screen is a multi-chip multi-screen mechanism (including the aforementioned multi-chip multi-OS mechanism).

[0530] In some embodiments of this application, the second and third displays may be located on either side of the first display. For example, the second and third displays may be located on the left and right sides of the first display. Of course, the relative positional relationship between the first, second, and third displays may also be other, and the first, second, and third displays are not required to be distributed in the manner described above in the embodiments of this application.

[0531] In some embodiments of this application, the first display screen can be any of the display screens described in the first part of the preceding text (i.e., the content of the interface transition method section) or the third part of the following text (i.e., the content of the audio control method section), and the second and third display screens can be display screens located on either side of the aforementioned display screen. In some embodiments of this application, when the user activates the immersive display mode, the multi-screen collaborative display method provided in the embodiments of this application can be used for content display.

[0532] The multi-screen collaborative display method provided in this application embodiment will be described below with reference to specific application scenarios. In particular, the following description uses a scenario where the second and third displays are located on the left and right sides of the first display, respectively. Implementation methods for other relative position scenarios can refer to the implementation methods in this scenario, and will not be described in detail in this application embodiment.

[0533] I. Single-chip single-OS control of multi-screen scenarios

[0534] In this scenario, the first display screen, the second display screen, and the third display screen belong to the same electronic device (e.g., the same vehicle terminal), and the electronic device is configured with only one OS. The control mechanism of the first display screen, the second display screen, and the third display screen is a single-core single OS control mechanism.

[0535] For example, Figure 42 This is a schematic diagram of the architecture of a control system provided in an embodiment of this application. This control system can be deployed in a single-chip, single-OS electronic device. For example... Figure 42 As shown, the control system may include a display management module, an effects processing module, a first display screen, a second display screen, and a third display screen.

[0536] The display management module controls and manages the first, second, and third display screens. The effects processing module applies effects processing to the first interface displayed on the first display screen, enabling the display management module to display the processed first interface on the second and third display screens.

[0537] Optionally, the control system may also include a first application. The first application can be used to draw a first interface and control the first display screen to display the first interface via the display screen management module. The first application is an application installed in the electronic device and running on the first display screen; the first interface can be any interface within the first application.

[0538] Optionally, when the electronic equipment to which the control system belongs adopts Figure 9C When implementing the software architecture shown, the display management module and effects processing module in the control system can be deployed on... Figure 9C In the application framework layer shown.

[0539] It is important to understand that the functional modules in the control system described above are just an example. In practical applications, electronic devices can also be divided into more or fewer functional modules according to other factors, or the functions of each module can be divided in other ways, or they can work as a whole without dividing into functional modules.

[0540] Reference Figure 43 Taking the control system applied to the above-mentioned single-chip single-OS scenario as an example, a multi-screen collaborative display method provided in this application embodiment may include:

[0541] S4301: After the first application in the electronic device draws the screen to be displayed based on the content to be displayed, it sends the drawn screen data to the display screen management module in the electronic device.

[0542] The first application can draw the image to be displayed in each refresh cycle of the first display screen.

[0543] S4302: The display management module synthesizes the screen data to obtain the first interface to be displayed.

[0544] S4303: The display management module sends the content of the first interface to the effect processing module in the electronic device.

[0545] S4304: The effects processing module renders the content of the first interface to obtain the second and third interfaces.

[0546] The rendering process can be any of the following: Gaussian blur, solid color gradient, or particle animation. Specific processing steps are described in the examples below and will not be detailed here.

[0547] S4305: The effects processing module sends the content of the second interface and the content of the third interface to the display management module.

[0548] S4306: After receiving the content of the second interface and the content of the third interface, the display management module displays the first interface on the first display screen, the second interface on the second display screen, and the third interface on the third display screen.

[0549] Based on the above method, when an electronic device with multiple displays shows the first interface on the first display, it can control the second and third displays to show special effects interfaces related to the first interface, thereby providing richer display effects and enhancing the user's immersive viewing experience.

[0550] II. Single-chip multi-OS control of multi-screen scenarios

[0551] In this scenario, the first display screen, the second display screen, and the third display screen belong to the same electronic device (e.g., the same vehicle terminal), and the electronic device is configured with multiple operating systems. The control mechanism of the first display screen, the second display screen, and the third display screen is a single-core multi-OS control mechanism.

[0552] For example, Figure 44 This is a schematic diagram of the architecture of a control system provided in an embodiment of this application. This control system can be deployed in a single-chip, multi-OS electronic device. For example... Figure 42 As shown, the control system includes at least a first OS and a second OS. The first OS includes a first display management module, a first effects processing module, and a first display screen, while the second OS may include a second display management module, a second effects processing module, and a second display screen.

[0553] As an optional implementation method, such as Figure 42 In scenario 1 shown, the third display screen can belong to the first OS. In this scenario, the first OS is used to control both the first and third display screens. The specific control method can be found in [reference needed]. Figure 42 The control method of the OS in the control system shown will not be described in detail here.

[0554] As another alternative implementation method, such as Figure 42 In scenario 2 shown, the third display screen can belong to the second OS. In this scenario, the second OS is used to control both the second and third display screens. The specific control method can be found in [reference needed]. Figure 42 The control method of the OS in the control system shown will not be described in detail here.

[0555] As another alternative implementation method, such as Figure 42 In scenario 3 shown, the third display screen can belong to the third operating system. In this case, the control system also includes a third operating system, which includes a third display screen management module, a third effects processing module, and the third display screen itself.

[0556] In the above methods, each display screen management module in the control system is used to control and manage the corresponding display screen. Each effect processing module is used to process the first interface displayed on the first display screen, so that the display screen management module in the OS can display the processed first interface on the corresponding display screen.

[0557] Optionally, the first OS may also include a first application. The first application can be used to draw a first interface and control the first display screen to display the first interface through the first display screen management module. The first interface can be any interface within the first application.

[0558] In the above single-core multi-OS scenario, multiple OSs in the control system (first OS and second OS, or first OS, second OS and third OS) can share memory. Functional modules in each OS can read data from the shared memory and store processed data in the shared memory, thus providing high access efficiency and saving data storage space in the control system.

[0559] It is important to understand that the functional modules in the control system described above are just an example. In practical applications, electronic devices can also be divided into more or fewer functional modules according to other factors, or the functions of each module can be divided in other ways, or they can work as a whole without dividing into functional modules.

[0560] Reference Figure 45 Taking the control system applied to the above-mentioned single-core multi-OS scenario as an example, a multi-screen collaborative display method provided in this application embodiment may include:

[0561] S4501: After drawing the screen to be displayed based on the content to be displayed, the first application in the first OS of the electronic device sends the drawn screen data to the first display screen management module in the first OS.

[0562] The first application can draw the image to be displayed in each refresh cycle of the first display screen.

[0563] S4502: The first display screen management module synthesizes the screen data to obtain the first interface to be displayed.

[0564] S4503: The first display screen management module determines the target content based on the content of the first interface and stores the target content in the shared memory of the first OS and the second OS of the electronic device; wherein, the target content is the content of the first interface or the content obtained by the first effect processing module after partially or completely rendering the content of the first interface.

[0565] The rendering process can be any of the following: Gaussian blur, solid color gradient, or particle animation. Specific processing steps are described in the examples below and will not be detailed here.

[0566] In some embodiments of this application, after obtaining the first interface, the first display management module can directly use the content of the first interface as the target content and store it in shared memory; or, after obtaining the first interface, the first display management module can use the first effect processing module to perform a partial rendering process on the content of the first interface (i.e., a part of a complete rendering process), and use the obtained content as the target content and store it in shared memory; or, after obtaining the first interface, the first display management module can use the first effect processing module to perform a full rendering process on the content of the first interface (i.e., a complete rendering process), and use the obtained content as the target content and store it in shared memory.

[0567] The method by which the first display management module determines the target content can be dynamically adjusted based on the performance of the first OS and the second OS. For example, when the utilization rate of the central processing unit (CPU) or graphics processing unit (GPU) allocated on the first OS is higher than a set value, the first display management module can directly use the content of the first interface as the target content, or it can use the content obtained by the first effects processing module after partially rendering the content of the first interface as the target content. In this method, when the processing pressure on the CPU or GPU of the first OS is high, the first OS does not perform rendering processing on the content of the first interface or only performs partial rendering processing, leaving the remaining rendering processing work to be performed by the second OS, thereby avoiding or reducing the pressure on the CPU or GPU of the first OS and improving the overall processing efficiency. As another example, when it is determined that the utilization rate of the central processing unit (CPU) or graphics processing unit (GPU) allocated on the second OS is higher than a set value, the first OS can use the content obtained after partially or fully rendering the content of the first interface as the target content. In this method, when the CPU or GPU of the second OS is under heavy processing pressure, the first OS performs partial or full rendering of the content of the first interface, so that the first OS can share part of the rendering work, which can reduce or avoid the pressure on the CPU or GPU of the second OS during the rendering process, thereby improving the overall processing efficiency.

[0568] S4504: The first display screen management module displays the first interface on the first display screen.

[0569] S4505: The second display management module in the second OS of the electronic device retrieves the target content from shared memory.

[0570] S4506: The second display management module determines whether the target content is content that has undergone full rendering processing. If yes, proceed to step S4507; otherwise, proceed to step S4508.

[0571] S4507: The second display management module synthesizes the target content to obtain the second interface. Then, it executes step S4509.

[0572] S4508: The second display management module renders the target content through the second effect processing module to obtain the second interface. Then, step S4509 is executed.

[0573] Specifically, when the target content is unrendered, the second effects processing module can perform a complete rendering process on the target content to obtain the second interface. When the target content is partially rendered, the second effects processing module can perform the remaining rendering process on the target content to obtain the second interface.

[0574] S4509: The second display management module displays the second interface on the second display screen.

[0575] The above process illustrates how the first OS and the second OS in an electronic device display interfaces on the first display screen and the second display screen, respectively. For the third display screen, there are three possible scenarios:

[0576] 1) When the third display screen belongs to the first OS, the method for the first OS to display the interface on the third display screen may be as follows: after obtaining the first interface, the first display screen management module sends the content of the first interface to the first effect processing module; the first effect processing module renders the content of the first interface to obtain the third interface; the first effect processing module sends the content of the third interface to the first display screen management module; the first display screen management module displays the third interface according to the received content.

[0577] 2) When the third display screen belongs to the second OS, the method of the second OS displaying the interface on the third display screen can refer to the method of the second OS displaying the second interface on the second display screen as described in steps S4505 to 4509 of the above process, and will not be repeated here.

[0578] 3) When the third display screen belongs to the third OS, the method of the third OS displaying the interface on the third display screen can refer to the method of the second OS displaying the second interface on the second display screen as described in steps S4505 to S4509 of the above process, and will not be repeated here.

[0579] Based on the above method, multiple operating systems in an electronic device can work together to display the first interface on the first display screen and display special effects interfaces related to the first interface on the second and third display screens, thereby providing richer display effects and enhancing the user's immersive viewing experience.

[0580] III. Multi-chip, multi-OS control of multi-screen scenarios

[0581] In this scenario, the first display screen, the second display screen, and the third display screen belong to different electronic devices (e.g., different vehicle terminals), and each electronic device can be configured with one or more operating systems. Each operating system can include one or more display screens. The control mechanism for the first display screen, the second display screen, and the third display screen is a multi-core multi-OS control mechanism.

[0582] For example, Figure 46 This is a schematic diagram of the architecture of a control system provided in an embodiment of this application. This control system can be deployed in multiple electronic devices. Taking, for example, the first display screen and the second display screen in this control system being deployed in different electronic devices and belonging to different operating systems, as shown... Figure 46 As shown, the control system includes at least a first electronic device and a second electronic device. The first electronic device includes at least a first operating system (OS), and the second electronic device includes at least a second OS. The first OS includes a first display management module, a first effects processing module, and a first display screen. The second OS includes a second display management module, a second effects processing module, and a second display screen.

[0583] Optionally, the first electronic device may include only the first OS, or it may include more OSes. The same applies to the second electronic device.

[0584] As an optional implementation, the third display screen ( Figure 46 (Not shown in the image) can belong to either the first OS or the second OS. In this scenario, the specific control method for the first OS or the second OS to control multiple displays can be found in [reference needed]. Figure 42 The control method of the OS in the control system shown will not be described in detail here.

[0585] As an alternative implementation, the third display screen can be part of a third operating system (OS), which includes a third display screen management module, a third effects processing module, and the third display screen itself. In one possible scenario, the third OS can be part of either the first or second electronic device. In another possible scenario, the third OS can be part of a third electronic device, in which case the control system also includes a third electronic device. The method by which multiple OSs within the first, second, or third electronic devices control the display screen can be referred to... Figure 44 The control method of the OS in the control system shown will not be described in detail here.

[0586] In the above methods, each display screen management module in the control system is used to control and manage the corresponding display screen. Each effect processing module is used to process the first interface displayed on the first display screen, so that the display screen management module in the OS can display the processed first interface on the corresponding display screen.

[0587] Optionally, the first OS may also include a first application. The first application can be used to draw a first interface and control the first display screen to display the first interface through the first display screen management module. The first interface can be any interface within the first application.

[0588] In the multi-chip, multi-OS scenario described above, multiple OSes belonging to the same electronic device within the control system can share memory. Different electronic devices (or OSes of different electronic devices) cannot share memory but can send and receive data via network streams.

[0589] It is important to understand that the functional modules in the control system described above are just an example. In practical applications, electronic devices can also be divided into more or fewer functional modules according to other factors, or the functions of each module can be divided in other ways, or they can work as a whole without dividing into functional modules.

[0590] Reference Figure 47 Taking the control system applied to the above-mentioned multi-core multi-OS scenario as an example, a multi-screen collaborative display method provided in this application embodiment may include:

[0591] S4701: After drawing the screen to be displayed based on the content to be displayed, the first application in the first OS of the first electronic device sends the drawn screen data to the first display screen management module in the first OS.

[0592] The first application can draw the image to be displayed in each refresh cycle of the first display screen.

[0593] S4702: The first display screen management module synthesizes the screen data to obtain the first interface to be displayed.

[0594] S4703: The first display screen management module determines the target content based on the content of the first interface and sends the target content to the second electronic device; wherein, the target content is the content of the first interface or the content obtained by the first effect processing module after partially or completely rendering the content of the first interface.

[0595] The methods for rendering processing, target content, and determining the target content can be referred to the relevant description of step S4503 in the aforementioned embodiments, and will not be repeated here.

[0596] S4704: The second display management module in the second OS of the second electronic device determines whether the target content received by the second electronic device is content that has undergone full rendering processing. If yes, proceed to step S4705; otherwise, proceed to step S4706.

[0597] S4705: The second display management module synthesizes the target content to obtain the second interface. Then, it executes step S4707.

[0598] S4706: The second display management module renders the target content through the second effect processing module to obtain the second interface. Then, it executes step S4707.

[0599] Specifically, when the target content is unrendered, the second effects processing module can perform a complete rendering process on the target content to obtain the second interface. When the target content is partially rendered, the second effects processing module can perform the remaining rendering process on the target content to obtain the second interface.

[0600] S4707: The second effects processing module displays the second interface on the second display screen.

[0601] The above process illustrates how the first OS of the first electronic device and the second OS of the second electronic device display interfaces on the first and second display screens, respectively. For the third display screen, there are the following five scenarios:

[0602] 1) When the third display screen belongs to the first OS, the method for the first OS to display the interface on the third display screen may be as follows: after obtaining the first interface, the first display screen management module sends the content of the first interface to the first effect processing module; the first effect processing module renders the content of the first interface to obtain the third interface; the first effect processing module sends the content of the third interface to the first display screen management module; the first display screen management module displays the third interface according to the received content.

[0603] 2) When the third display screen belongs to the second OS, the method of the second OS displaying the interface on the third display screen can refer to the method of the second OS displaying the second interface on the second display screen as described in steps S4704 to 4707 of the above process, and will not be repeated here.

[0604] 3) When the third display screen belongs to the third OS and the third OS belongs to the first electronic device, the method of the third OS displaying the interface on the third display screen can refer to the method of the first OS displaying the third interface on the third display screen as described in case 1) of the above process, and will not be repeated here.

[0605] 4) When the third display screen belongs to the third OS and the third OS belongs to the second electronic device, the method of the third OS displaying the interface on the third display screen can refer to the method of the second OS displaying the second interface on the second display screen as described in steps S4704 to 4707 of the above process, and will not be repeated here.

[0606] 5) When the third display screen belongs to the third OS and the third OS belongs to the third electronic device, the method of the third OS displaying the interface on the third display screen can refer to the method described in steps S4703 to 4707 of the above process, and will not be repeated here.

[0607] Based on the above method, multiple operating systems in multiple electronic devices can work together to display the first interface on the first display screen and display the special effects interface related to the first interface on the second and third display screens, thereby providing richer display effects and enhancing the user's immersive viewing experience.

[0608] The rendering processing method described in the above embodiments will be introduced below with specific examples.

[0609] 1. Gaussian blur processing

[0610] Reference Figure 48 Taking the control system provided in the above embodiments as an example, a Gaussian fuzzing method provided in this application embodiment may include:

[0611] S4801: The effects processing module determines the first interface based on the content of the first interface from the display management module.

[0612] The effects processing module and the display management module can be the effects processing module and display management module in any of the OSes described in the preceding embodiments.

[0613] S4802: The effect processing module copies the interface of a set size from the first interface, which is closer to the target display screen, to obtain the first target interface; wherein, the target display screen is any display screen in the OS where the effect processing module is located.

[0614] Optionally, the target display screen can be the second display screen or the third display screen described in the above embodiments.

[0615] In some embodiments of this application, the display management module can pre-obtain the positional relationship between the target display screen and other display screens. The effects processing module can determine the positional relationship between the target display screen and the first display screen based on the positional relationship obtained by the display management module, and then determine the position of the first target interface cropped from the first interface based on this positional relationship. For example, when the target display screen is located to the left of the first display screen, the effects processing module can crop and copy a portion of the interface of a predetermined size from the left side of the first interface as the first target interface. As another example, when the target display screen is located to the right of the first display screen, the effects processing module can crop and copy a portion of the interface of a predetermined size from the right side of the first interface as the first target interface.

[0616] For example, such as Figure 49 As shown in diagram (a), in a scenario where the second and third displays are located on the left and right sides of the first display, respectively, the first interface can be... Figure 49 The first interface shown on the first display screen is illustrated in diagram (a). Taking a size set to one-third of the size of the first interface as an example, when the target display screen is a second display screen, the first target interface can be... Figure 49 The interface 1 shown in diagram (b) includes the content of the left third area of ​​the first interface; when the target display screen is a third display screen, the first target interface can be Figure 49 Interface 2 is shown in diagram (b) of the first interface, which includes the content of the right third area of ​​the first interface.

[0617] S4803: The effect processing module performs Gaussian blur processing on the first target interface to obtain the second target interface.

[0618] For example, when the target display screen is a second display screen, the second target interface can be... Figure 49 Interface 3 is shown in diagram (c) of the diagram. When the target display screen is a third display screen, the second target interface can be... Figure 49 Interface 4 is shown in diagram (c) of the diagram. It should be noted that... Figure 49 The interfaces 3 and 4 shown in diagram (c) are only used to represent the area occupied by the second target interface and do not represent the specific content of the second target interface.

[0619] S4804: The effect processing module stretches the second target interface to a set width along the target direction, and at the same time overlays a transparency gradient on the second target interface; wherein, the target direction is the direction from the first display screen to the target display screen; in the stretched second target interface, the interface transparency shows a decreasing trend along the target direction.

[0620] For example, the width can be set to the width of the target display screen. Of course, it can also be other widths, and this application embodiment does not impose any restrictions.

[0621] For example, when the target display screen is a second display screen, the stretched second target interface can be Figure 49 The interface 5 shown in diagram (d) has an area on the side facing the target direction displayed as black, while the area away from the target direction is displayed as transparent. The transparency of the interface gradually decreases along the target direction. When the target display screen is a third display screen, the stretched second target interface can be... Figure 49 The interface 6 shown in diagram (d) is characterized by an area displayed as black on the side facing the target, and an area displayed as transparent on the side away from the target. The transparency of the interface gradually decreases along the target direction. It should be noted that... Figure 49 The interfaces 5 and 6 shown in the (d) diagram are only used to represent the area occupied by the stretched second target interface and do not represent the specific content in the stretched second target interface.

[0622] Based on the above method, when the user interface is displayed on the first display screen, the second and third display screens can display a Gaussian blur rendering effect. By combining the three display screens, an immersive viewing experience can be provided to the user.

[0623] 2. Solid color gradient processing

[0624] Reference Figure 50 Taking the control system provided in the above embodiments as an example, a method for solid color gradient processing provided in this application embodiment may include:

[0625] S5001: The effect processing module determines the first interface based on the content of the first interface from the display management module.

[0626] S5002: The effect processing module copies the interface of a set size from the first interface that is closer to the target display screen to obtain the first target interface; wherein, the target display screen is any display screen in the OS where the effect processing module is located.

[0627] The specific implementation of steps S5001 to S5002 can refer to the method described in steps S4801 to S4802 in the above embodiments, and will not be repeated here.

[0628] For example, such as Figure 51 As shown in diagram (a), in a scenario where the second and third displays are located on the left and right sides of the first display, respectively, the first interface can be... Figure 51The first interface shown on the first display screen is illustrated in diagram (a). Taking a size set to one-third of the size of the first interface as an example, when the target display screen is a second display screen, the first target interface can be... Figure 51 The interface 1 shown in diagram (b) includes the content of the left third area of ​​the first interface; when the target display screen is a third display screen, the first target interface can be Figure 51 Interface 2 is shown in diagram (b) of the first interface, which includes the content of the right third area of ​​the first interface.

[0629] S5003: The effect processing module determines the target color based on the color of the first target interface.

[0630] For example, the target color can be any color selected from the colors on the first target interface, or the target color can be the average color of all colors on the first target interface. The target color can also be a color selected in other ways, which is not limited in this embodiment.

[0631] S5004: The effect processing module generates a second target interface based on the target color; wherein, in the second target interface, the interface color gradually changes from the target color to the set color along the target direction; the target direction is the direction from the first display screen to the target display screen.

[0632] For example, the color can be set to black.

[0633] For example, when the target display screen is a second display screen, the second target interface can be... Figure 51 The interface 3 shown in diagram (c) has an area on the side facing the target direction displayed as a set color, and an area on the side away from the target direction displayed as the target color. Along the target direction, the interface color gradually changes from the target color to the set color. When the target display screen is a third display screen, the second target interface can be... Figure 51 Interface 4, shown in diagram (c) of the diagram, displays the area on the side facing the target direction as the set color, and the area on the side away from the target direction as the target color. Along the target direction, the interface color gradually changes from the target color to the set color. It should be noted that... Figure 51 The interfaces 3 and 4 shown in diagram (c) are only used to represent the area occupied by the second target interface and do not represent the specific content of the second target interface.

[0634] Based on the above method, when the user interface is displayed on the first display screen, the second and third display screens can display a solid color gradient rendering effect. By combining the three display screens, an immersive viewing experience can be provided to the user.

[0635] 3. Particle motion effects processing

[0636] Reference Figure 52 Taking the control system provided in the above embodiments as an example, a particle motion effect processing method provided in this application embodiment may include:

[0637] S5201: The effects processing module determines the first interface based on the content of the first interface from the display management module.

[0638] The effects processing module and the display management module can be the effects processing module and display management module in any of the OSes described in the preceding embodiments.

[0639] S5202: The effects processing module generates a corresponding particle motion effect interface based on the first interface; wherein, the color of the particles in the particle motion effect interface is determined based on the color in the first interface.

[0640] As an optional implementation, the particle animation interface can display particle animations corresponding to the entire first interface. In this method, the second and third displays located on either side of the first display can display the same particle animation interface. Optionally, in this method, the color of particles at different positions in the particle animation interface can be determined based on the color of the corresponding position in the first interface, or it can be determined based on other methods; this application embodiment does not impose any limitations. For example, the effect processing module can perform Gaussian blur processing on the first interface, and then select colors from different positions in the processed interface as the colors of the particles corresponding to those positions. As another example, the effect processing module can use the color of a set position in the first interface as the color of the particles. Optionally, in this method, the size of the particle animation interface can be the same as the size of the first interface.

[0641] For example, such as Figure 53 As shown in diagram (a), in a scenario where the second and third displays are located on the left and right sides of the first display, respectively, the first interface can be... Figure 51 The first interface shown on the first display screen is illustrated in diagram (a). When the target display screen is the second display screen, the particle animation interface can be... Figure 53 Interface 1 is shown in diagram (b) of the diagram; when the target display screen is a third display screen, the particl...

Claims

1. A control method applied to a first electronic device, characterized in that, The first electronic device includes a first display screen and a second display screen, and the method includes: Display a first interface on the first display screen, and play the first audio corresponding to the first content included in the first interface using the first audio output device; Upon receiving a first operation for switching the first interface on the first display screen, the switching of the first interface is performed according to the intent of the first operation; In response to the first operation, a first sub-content is displayed on the first display screen, and a second sub-content is displayed on the second display screen; or, the first interface is displayed on the first display screen, and the first interface is displayed on the second display screen; wherein the first content includes the first sub-content and the second sub-content; In response to the first operation, the first audio is played using the second audio output device and the third audio output device; Wherein, the first audio output device is associated with a first sound zone, the second audio output device is associated with the first sound zone, and the third audio output device is associated with a second sound zone; the first sound zone is a candidate sound zone associated with the first display screen among a plurality of candidate sound zones, and the second sound zone is a candidate sound zone associated with the second display screen among the plurality of candidate sound zones; in the plurality of candidate sound zones, each candidate sound zone is associated with one or more audio output devices within a first spatial region; Wherein, after the transition of the first interface is completed, the display type of the first interface on the second display screen is related to the task information before the transition of the first interface and / or the screen task information of the second display screen; the task information before the transition of the first interface is used to characterize the display type and / or classification information of the first interface before the transition of the first interface; the screen task information of the second display screen is used to characterize the display type and / or classification information of the task interface on the second display screen before the transition of the first interface; the classification information is used to characterize whether the interface is a preset focused application interface of the screen.

2. The method as described in claim 1, characterized in that, The display type includes any of the following: application window, floating window, floating icon, floating ball, picture-in-picture, card, control, or notification.

3. The method as described in claim 1, characterized in that, The first operation is an operation in which one or more fingers slide on the first interface at a sliding speed greater than a preset threshold and then leave. The first operation is used to navigate across the first interface.

4. The method as described in claim 3, characterized in that, The process of transitioning the first interface according to the intent of the first operation includes: Based on the sliding direction of the first operation and the positional relationship between the first display screen and multiple display screens, the second display screen is determined to be the target screen for cross-screen switching; wherein, the sliding direction points to the second display screen; The first interface is then transferred across screens to the second display screen.

5. The method as described in claim 1, characterized in that, The display type of the first interface after the transition is the same as the display type of the first interface before the transition.

6. The method as described in claim 5, characterized in that, Before the transition, the first interface is displayed in full screen on the first display screen; after the transition of the first interface is completed, the first interface is displayed in full screen on the second display screen.

7. The method as described in claim 1, characterized in that, The display type of the first interface after the transition is related to the classification information of the first interface before the transition; The first interface is a preset focused application interface of the first display screen before the transition; after the transition of the first interface is completed, the first interface is displayed in full screen on the second display screen.

8. The method as described in claim 7, characterized in that, The display type after the first interface transition is also related to the screen task information of the second display screen; Prior to the transition to the first interface, the second display screen does not show the task interface, does not display the task interface in full screen, or does not display the preset focused application interface of the second display screen.

9. The method as described in claim 1, characterized in that, The display type after the first interface transition is related to the screen task information of the second display screen; Before the transition to the first interface, the second display screen does not show the task interface, does not display the task interface in full screen, or does not display the preset focused application interface of the second display screen; after the transition to the first interface is completed, the display type of the first interface is full screen.

10. The method as described in claim 1, characterized in that, The display type after the first interface transition is related to the screen task information of the second display screen; Before the transition to the first interface, the second display screen displays a task interface or a preset focused application interface on the second display screen in full screen; after the transition to the first interface is completed, the first interface and other task interfaces on the second display screen are displayed in a split-screen manner.

11. The method as described in claim 10, characterized in that, The display type of the first interface after the transition is also related to the task information of the first interface before the transition; Before the first interface transitions, the first interface is either a full-screen display or a preset focused application interface of the first display screen.

12. The method as described in claim 1, characterized in that, The display type after the first interface transition is related to the screen task information of the second display screen; Before the transition to the first interface, the second display screen displays a task interface or a preset focused application interface on the second display screen in full screen; after the transition to the first interface is completed, the display type of the first interface is split-screen display, floating window, floating icon, floating ball, picture-in-picture, card, or control.

13. The method as described in claim 12, characterized in that, The display type of the first interface after the transition is the same as the display type of the first interface before the transition.

14. The method as described in claim 1, characterized in that, The second audio output device is the same as the first audio output device; and / or The second audio output device is of the same type as the third audio output device.

15. The method as described in claim 14, characterized in that, After the first interface is displayed on the first display screen, and after the first interface is displayed on the second display screen, the method further includes: In response to the received second operation, the first display screen does not display the first interface, and the first interface continues to be displayed on the second display screen; the first audio is played using the audio output device associated with the second audio region, while the audio output device associated with the first audio region does not play the first audio; or In response to the received third operation, the first interface continues to be displayed on the first display screen, and the first interface is not displayed on the second display screen; the first audio is played using the audio output device associated with the first audio zone, and the audio output device associated with the second audio zone does not play the first audio.

16. The method as described in claim 14, characterized in that, After displaying the first sub-content on the first display screen and the second sub-content on the second display screen, the method further includes: In response to the received fourth operation, the second display screen does not display the second sub-content, and the first interface is displayed on the first display screen; the first audio is played using the audio output device associated with the first audio region, and the audio output device associated with the second audio region does not play the first audio; or In response to the received sixth operation, the first display screen does not display the first sub-content, and the second display screen displays the first interface; the first audio is played using the audio output device associated with the second audio zone, while the audio output device associated with the first audio zone does not play the first audio.

17. The method as described in claim 14, characterized in that, Before playing the first audio corresponding to the first interface using the first audio output device, the method further includes: Identify the first audio output device; The step of determining the first audio output device includes: The first audio zone is determined based on the first display screen; The audio output device with the highest priority among the at least one audio output device is selected as the first audio output device.

18. The method as described in claim 17, characterized in that, Selecting the audio output device with the highest priority from the at least one audio output device as the first audio output device includes: Obtain the priority order of at least one audio output device associated with the first audio region; Based on the priority order of the at least one audio output device, the audio output device with the highest priority is selected as the first audio output device.

19. The method as described in claim 17, characterized in that, Determining the first audio zone based on the first display screen includes: Based on the established association between the display screen and the candidate sound area, the candidate sound area associated with the first display screen is selected as the first sound area from the plurality of candidate sound areas; or The first pitch region is determined based on the received pitch region selection operation; wherein, the pitch region selection operation is used to select one candidate pitch region from the plurality of candidate pitch regions as the first pitch region.

20. The method as described in claim 14, characterized in that, Before playing the first audio using the second and third audio output devices, the method further includes: Determine the second audio output device; and determine the third audio output device; The determination of the third audio output device includes: The second audio region is determined based on the second display screen; Obtain the priority order of at least one audio output device associated with the second audio region; Based on the priority ranking of at least one audio output device associated with the second audio region, the audio output device with the highest priority among the at least one audio output devices associated with the second audio region is selected as the third audio output device.

21. The method as described in claim 1, characterized in that, The first spatial area is the space area inside the vehicle cabin, and any audio output device includes at least one of the following: vehicle speaker, headrest speaker, and Bluetooth headset.

22. The method as described in claim 1, characterized in that, After the transition of the first interface is completed, the first display screen shows the floating window, floating icon, floating ball, application icon or card corresponding to the first interface.

23. The method as described in claim 22, characterized in that, After completing the transition on the first interface, the method further includes: When a user clicks on a floating window, floating icon, floating ball, application icon, or card corresponding to the first interface displayed on the first screen, the first interface is switched back to the first screen. Wherein, after the first interface is transferred back to the first display screen across screens, the display type of the first interface is related to the task information when the first interface is displayed on the second display screen and / or the screen task information of the first display screen when the first operation is received.

24. The method as described in claim 1, characterized in that, The first electronic device further includes a third display screen, and after the first interface is transferred across screens to the second display screen, the method further includes: When an operation is received to transfer the first interface across screens to the third display screen, the first interface is transferred across screens to the third display screen. Wherein, after the first interface is transferred across screens to the third display screen, the display type of the first interface is related to the task information when the first interface is displayed on the second display screen and / or the screen task information of the third display screen when the first operation is received.

25. The method as described in claim 1 or 2, characterized in that, When a user performs a first operation to navigate to the first interface on the first display screen, one or more first task interfaces are displayed on the first display screen, and the one or more first task interfaces include the first interface.

26. The method as described in claim 1 or 2, characterized in that, The first display screen is any one of the following screens in the vehicle: driver's side screen, passenger side screen, left rear screen, and right rear screen; the second display screen is any one of the following screens in the vehicle: driver's side screen, passenger side screen, left rear screen, and right rear screen; and the second display screen is different from the first display screen.

27. The method as described in claim 1 or 2, characterized in that, The first electronic device further includes a fourth display screen and a fifth display screen; wherein the fourth display screen and the fifth display screen are respectively located on both sides of the first display screen; The method further includes: When the first interface is displayed on the first display screen, the third interface is displayed on the fourth display screen, and the fourth interface is displayed on the fifth display screen; The third interface is obtained by applying a first effect processing to the portion of the first interface closest to the fourth display screen; the fourth interface is obtained by applying the first effect processing to the portion of the first interface closest to the fifth display screen; the first effect processing is any one of the following: Gaussian blur processing, solid color gradient processing, particle animation processing.

28. The method as described in claim 27, characterized in that, After receiving a first operation for navigating to the first interface on the first display screen, the method further includes: The third interface is not displayed on the fourth display screen, and the fourth interface is not displayed on the fifth display screen.

29. The method as described in claim 27, characterized in that, The first electronic device includes a first OS and a second OS; wherein the first OS is used to control the first display screen, and the second OS is used to control the fourth display screen; The display of the third interface on the fourth display screen includes: The fifth interface is determined by the first OS; wherein the fifth interface is: the first interface, or a portion of the first interface that is closer to the fourth display screen, or an interface obtained by performing part or all of the processing in the first effect processing on the portion of the first interface that is closer to the fourth display screen. The fifth interface is stored in the first memory through the first OS; The fifth interface is obtained from the first memory via the second OS; The third interface is determined by the second OS based on the fifth interface; The third interface is displayed on the fourth display screen via the second OS.

30. The method as described in claim 29, characterized in that, The step of determining the third interface through the second OS based on the fifth interface includes: When the fifth interface is the first interface, the second OS determines a portion of the first interface closest to the fourth display screen based on the fifth interface, and applies the first effect processing to this portion to obtain the third interface; or When the fifth interface is a portion of the first interface closer to the fourth display screen, the second OS applies the first effect processing to the fifth interface to obtain the third interface; or When the fifth interface is obtained by performing part of the first effect processing on a portion of the first interface near the fourth display screen, the second OS performs the remaining processing on the fifth interface to obtain the third interface; or When the fifth interface is the interface obtained after performing all the processing steps of the first effect processing on the part of the first interface that is closer to the fourth display screen, the second OS uses the fifth interface as the third interface.

31. The method as described in claim 1 or 2, characterized in that, The first electronic device further includes a fourth display screen and a fifth display screen; wherein the fourth display screen and the fifth display screen are respectively located on both sides of the first display screen; The method further includes: When the first interface is displayed on the first display screen, a third interface is displayed on the fourth display screen, and the third interface is displayed on the fifth display screen; wherein, the third interface is an interface obtained by applying particle motion effects to the first interface.

32. The method as described in claim 31, characterized in that, After receiving a first operation for navigating to the first interface on the first display screen, the method further includes: The third interface is not displayed on the fourth display screen, and the third interface is not displayed on the fifth display screen.

33. The method as described in claim 31, characterized in that, The first electronic device includes a first OS and a second OS; wherein the first OS is used to control the first display screen, and the second OS is used to control the fourth display screen; The display of the third interface on the fourth display screen includes: The fourth interface is determined by the first OS; wherein the fourth interface is: the first interface, or the interface obtained after performing part or all of the particle motion effect processing on the first interface. The fourth interface is stored in the first memory through the first OS; The fourth interface is obtained from the first memory via the second OS; The third interface is determined by the second OS based on the fourth interface; The third interface is displayed on the fourth display screen via the second OS.

34. The method as described in claim 27, characterized in that, The first display screen, the fourth display screen, and the fifth display screen belong to the same operating system.

35. The method as described in claim 1 or 2, characterized in that, Displaying the first interface on the first display screen includes: The first interface is displayed in a first area on the first display screen; The method further includes: When the first interface is displayed on the first display screen, the third interface is displayed in the second area of ​​the first display screen; The second region is the region on the first display screen other than the first region; the third interface is the interface obtained by applying particle animation effects to the first interface.

36. The method as described in claim 35, characterized in that, After receiving a first operation for navigating to the first interface on the first display screen, the method further includes: The third interface is not displayed on the first display screen.

37. The method as described in claim 1 or 2, characterized in that, The first electronic device further includes a fourth display screen; prior to receiving a first operation for navigating to a first interface on the first display screen, the method further includes: When the first interface is displayed on the first display screen, the third interface is displayed on the fourth display screen; The fourth interface is sent to the second electronic device so that the second electronic device displays the fourth interface on the fifth display screen; or, the fifth interface is sent to the second electronic device so that the second electronic device displays the fourth interface on the fifth display screen after generating the fourth interface based on the fifth interface. The second electronic device includes the fifth display screen, and the fourth and fifth display screens are respectively located on both sides of the first display screen; the third interface is an interface obtained by applying a first effect processing to a portion of the first interface near the fourth display screen; the fourth interface is an interface obtained by applying the first effect processing to a portion of the first interface near the fifth display screen; the fifth interface is: a portion of the first interface near the fifth display screen, or an interface obtained by applying part or all of the first effect processing to a portion of the first interface near the fifth display screen; the first effect processing is any one of the following: Gaussian blur processing, solid color gradient processing, particle animation processing.

38. The method as described in claim 1 or 2, characterized in that, The method further includes: When the first interface is displayed on the first display screen, the third interface and the fourth interface are sent to the second electronic device so that the second electronic device displays the third interface and the fourth interface on the fourth display screen and the fifth display screen respectively; or, when the first interface is displayed on the first display screen, the first interface is sent to the second electronic device so that the second electronic device generates the third interface and the fourth interface according to the first interface and then displays the third interface and the fourth interface on the fourth display screen and the fifth display screen respectively. The second electronic device includes the fourth display screen and the fifth display screen, which are located on opposite sides of the first display screen. The third interface is an interface obtained by applying a first effect processing to a portion of the first interface closer to the fourth display screen. The fourth interface is an interface obtained by applying the first effect processing to a portion of the first interface closer to the fifth display screen. The first effect processing is any one of the following: Gaussian blur processing, solid color gradient processing, or particle animation processing.

39. The method as described in claim 1 or 2, characterized in that, The method further includes: When the first interface is displayed on the first display screen, the third interface is sent to the second electronic device so that the second electronic device displays the third interface on the fourth display screen; or, the fourth interface is sent to the second electronic device so that the second electronic device displays the third interface on the fourth display screen after generating the third interface based on the fourth interface. When the first interface is displayed on the first display screen, the fifth interface is sent to the third electronic device so that the third electronic device displays the fifth interface on the fifth display screen; or, the sixth interface is sent to the third electronic device so that the third electronic device displays the fifth interface on the fifth display screen after generating the fifth interface based on the sixth interface. The second electronic device includes the fourth display screen, and the third electronic device includes the fifth display screen. The fourth and fifth display screens are located on opposite sides of the first display screen. The third interface is an interface obtained by applying a first effect processing to a portion of the first interface closest to the fourth display screen. The fourth interface is either a portion of the first interface closest to the fourth display screen, or an interface obtained by applying part or all of the first effect processing to a portion of the first interface closest to the fourth display screen. The fifth interface is an interface obtained by applying the first effect processing to a portion of the first interface closest to the fifth display screen. The sixth interface is either a portion of the first interface closest to the fifth display screen, or an interface obtained by applying part or all of the first effect processing to a portion of the first interface closest to the fifth display screen. The first effect processing is any one of the following: Gaussian blur processing, solid color gradient processing, or particle animation processing.

40. An electronic device, characterized in that, The electronic device includes a display, a memory, and one or more processors; The memory is used to store computer program code, which includes computer instructions; when the computer instructions are executed by the one or more processors, the electronic device performs the method as described in any one of claims 1 to 39.

41. A chip system, characterized in that, The chip system includes a processing circuit and a storage medium, wherein the storage medium stores instructions; when the instructions are executed by the processing circuit, the processing circuit performs the method as described in any one of claims 1 to 39.

42. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when run on a computer, causes the computer to perform the method as described in any one of claims 1 to 39.

Images