Multi-screen interaction method and device for intelligent cabin and intelligent cabin

Abstract

The invention discloses a multi-screen interaction method and device for an intelligent cabin and the intelligent cabin. The method comprises the following steps: determining an operation event of a first screen according to a sliding operation on the first screen; if the operation event is a cross-screen operation event, obtaining screen array information of the intelligent cabin; analyzing the sliding operation according to the screen array information to determine a second screen which performs cross-screen interaction with the first screen; and moving a first application picture of the first screen to the second screen in a cross-screen manner according to the screen array information, so that the second screen responds to a sliding operation of the first screen. According to the invention, multi-screen information sharing and interaction can be realized in the intelligent cabin, the main driving screen is reversely controlled by other screens, and the interference to driving is reduced.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of multi-screen interaction, in particular to a multi-screen interaction method and device for a smart cockpit and a smart cockpit. BACKGROUND

[0002] At present, a smart car is usually equipped with a multi-screen system, that is, a plurality of physical display screens are configured in the cockpit of the smart car, for example, a main driver instrument screen, a copilot entertainment screen, a rear row entertainment screen, etc. These physical display screens are generally driven by a high-performance chip and a vehicle-side operating system, wherein each display screen has an independent operating system account and display configuration, and can independently realize optimization of content layout. In addition, the multi-screen system can also realize isolated display of information, for example, navigation information is displayed by the main driver display screen, and entertainment information is displayed by the rear row display screen. This design enables passengers in the vehicle to more conveniently obtain information based on their own needs, thereby improving the convenience and comfort of riding.

[0003] For the above-mentioned multi-screen system of a single system and multiple users, since the plurality of screens (multiple users) are isolated by software operating system users, screen information sharing and interaction cannot be directly realized. For the multi-screen system capable of realizing screen information sharing and interaction, information can only be pushed by the main driver screen to other screens or the function of other screens can only be controlled by the main driver screen, resulting in that the multi-screen interaction function is excessively integrated in the main driver screen, which interferes with driving and has a safety hazard. SUMMARY

[0004] The present application provides a multi-screen interaction method and device for a smart cockpit and a smart cockpit, which can realize multi-screen information sharing and interaction in the smart cockpit, and realize reverse control of the main driver screen by other screens, thereby reducing interference with driving.

[0005] In one aspect of the present application, a multi-screen interaction method for a smart cockpit is provided. The method comprises: determining an operation event of a first screen according to a sliding operation on the first screen; if the operation event is a cross-screen operation event, obtaining screen array information of the smart cockpit; analyzing the sliding operation according to the screen array information to determine a second screen for cross-screen interaction with the first screen; and moving a first application picture of the first screen to the second screen according to the screen array information, so that the second screen responds to the sliding operation of the first screen.

[0006] In another aspect of the present application, a multi-screen interaction device for a smart cockpit is provided. The device comprises: a memory; and at least one processor electrically coupled to the memory and configured to execute the computer program to perform the above-mentioned multi-screen interaction method for a smart cockpit.

[0007] In another aspect of the invention, a smart cockpit is provided. The smart cockpit includes: the aforementioned multi-screen interaction device for a smart cockpit; and a plurality of screens electrically coupled to the at least one processor and configured to receive user operations and display screens.

[0008] According to the technical solution of the present invention, by triggering a swipe operation on any screen, a cross-screen operation event can be controlled between the current first screen and a designated second screen, enabling the content of the current screen to move across screens to the designated screen. Multiple screens can move, switch, and share screen content based on swipe operations, facilitating information access and sharing for users in the cabin, effectively improving the convenience and comfort of the user's journey. Simultaneously, it eliminates the need to push information from the driver's screen to other screens, avoiding the integration of interactive functions onto a single screen and reducing driving interference. Attached Figure Description

[0009] Figure 1 This is a flowchart of a multi-screen interaction method according to an embodiment of the present invention;

[0010] Figure 2 This is a flowchart of another multi-screen interaction method according to an embodiment of the present invention;

[0011] Figure 3 This is a flowchart of a method for cross-screen mobile application display according to an embodiment of the present invention;

[0012] Figure 4 This is a schematic diagram illustrating the display of a cross-screen mobile application screen according to an embodiment of the present invention;

[0013] Figure 5 This is a flowchart of a method for controlling application screens across screens according to an embodiment of the present invention;

[0014] Figure 6 This is a block diagram of a multi-screen interaction device for a smart cockpit according to an embodiment of the present invention.

[0015] Figure 7 This is a block diagram of a system architecture for a smart cockpit according to an embodiment of the present invention. Detailed Implementation

[0016] To explain in detail the technical content, objectives, and effects of the present invention, the following description is provided in conjunction with the embodiments and accompanying drawings.

[0017] In existing technologies, for the aforementioned multi-screen systems with multiple users on a single system, since the multiple screens (multiple users) are isolated operating system users through software, direct screen information sharing and interaction cannot be achieved. Furthermore, for multi-screen systems that can achieve screen information sharing and interaction, information can typically only be pushed from the driver's screen to other screens or their functions controlled. This results in excessive integration of multi-screen interaction functions onto the driver's screen, interfering with driving and posing safety hazards.

[0018] To address at least the aforementioned technical problems, this disclosure provides a multi-screen interaction method for smart cockpits. According to this disclosure, by triggering a swipe operation on any screen, a cross-screen operation event is controlled between the current first screen and a designated second screen, enabling the content of the current screen to move across screens to the designated screen. In this manner, embodiments of this disclosure enable the movement, switching, and sharing of screen content across multiple screens based on swipe operations, facilitating information access and sharing for users within the cockpit, effectively improving the convenience and comfort of the user's journey. Simultaneously, it eliminates the need to push information from the driver's screen to other screens, avoiding the integration of interactive functions onto a single screen and reducing driving interference.

[0019] In the following, the technical solutions according to this disclosure will be described with reference to specific embodiments and in conjunction with the accompanying drawings.

[0020] Figure 1 This is a flowchart illustrating a multi-screen interaction method 100 for a smart cockpit according to an embodiment of the present disclosure. (Refer to...) Figure 1 The method 100 includes the following steps 102 to 108.

[0021] In step 102, the operation event of the first screen is determined based on the swipe operation on the first screen.

[0022] In some embodiments, the sliding distance of the sliding operation within a preset time threshold is determined based on the sliding trajectory of the sliding operation. If the sliding distance is detected to be greater than or equal to a preset proportion of the first screen, the operation event on the first screen is determined to be a cross-screen operation event. If the sliding distance is detected to be less than the preset proportion of the first screen, the operation event on the first screen is determined to be a single-screen operation event. In this way, the operation event currently indicated by the user is determined based on the magnitude of the sliding operation. When the sliding operation has a large sliding magnitude in a short period of time, it is determined that the user is currently indicating a cross-screen operation event. When the sliding operation has a small sliding magnitude in a short period of time, it is determined that the user is currently indicating a single-screen operation event. This simplifies the user's instructions for performing cross-screen operations and improves the user experience.

[0023] In some embodiments, the method 100 may further include: if the operation event is a single-screen operation event, moving the first application screen within the first screen according to the sliding direction of the sliding operation to respond to the sliding operation of the first screen. In this way, cross-screen operation functionality is achieved while maintaining compatibility with single-screen operation functionality.

[0024] In step 104, if the operation event is a cross-screen operation event, the screen array information of the smart cockpit is obtained. In some embodiments, the screen array information includes physical array information and / or logical array information.

[0025] In step 106, the swiping operation is parsed based on the screen array information to determine a second screen that interacts with the first screen across screens.

[0026] In some embodiments, the screen array information includes physical array information, and a second screen for cross-screen interaction with the first screen is determined based on the physical array information and the sliding direction of the sliding operation. In this way, since the screen positions of the smart cockpit have clear directional characteristics, after determining the sliding direction, the screen for which the user needs to perform cross-screen interaction can be directly located based on the current physical array information of the smart cockpit, simplifying cross-screen operation commands and improving the convenience of multi-screen interaction.

[0027] In step 108, the first application screen of the first screen is moved across the screen to the second screen according to the screen array information, so that the second screen responds to the swiping operation of the first screen.

[0028] In some embodiments, the screen array information further includes logical array information that maps to the physical array information. In this case, based on the physical array information and the logical array information, the first application screen of the first screen is migrated to the second screen. During the migration of the first application screen from the first screen to the second screen, an associated migration animation is displayed on both the first and second screens, and a corresponding audio zone switching process occurs. In this way, a switching animation is formed on the associated moving screen to represent that the current screen is performing a cross-screen migration operation, improving the visibility of the cross-screen operation.

[0029] In some embodiments, the process of switching audio zones corresponding to the first screen and the second screen in association includes: switching the target playback audio zone from the first audio zone of the first screen to the second audio zone of the second screen, such that the associated application on the first screen turns off the first audio zone, the associated application on the second screen turns on the second audio zone, and the second audio zone plays the sound of the associated application. In this way, the device associated with the application can be adaptively switched during cross-screen push notifications, improving the convenience of application push notifications.

[0030] In some embodiments, screen movement parameters are set based on the sliding distance and sliding speed of the sliding operation. Based on the screen movement parameters and the size information of the first screen, the first application screen of the first screen is divided into a continuous first sub-screen and a second sub-screen according to the sliding direction. Based on the physical array information and the logical array information, the first sub-screen is rendered onto the first screen in real time, so that the first screen creates an animation effect of moving out of the first application screen along the sliding direction. Based on the physical array information and the logical array information, the second sub-screen is rendered onto the second screen in real time, so that the second screen creates an animation effect of moving into the first application screen along the sliding direction. In this way, due to the differences in physical screens, screen misalignment may occur during multi-screen preview. Therefore, when moving the first application screen from the first screen to the second screen across screens, the first application screen is divided into a continuous first sub-screen and a second sub-screen based on the real-time changing screen movement parameters, and rendered onto the first screen and the second screen respectively, to create a transition effect from the first screen to the second screen, thereby avoiding screen misalignment and optimizing the cross-screen display effect.

[0031] In some embodiments, the first sub-screen is rendered in real-time to a first display memory corresponding to the first screen according to the logical array information, and the first sub-screen in the first display memory is rendered to the first screen according to the physical array information. In some embodiments, the second sub-screen is rendered in real-time to a second display memory corresponding to the second screen according to the logical array information, and the second sub-screen in the second display memory is rendered to the second screen according to the physical array information. In this way, since the screen movement parameters change in real-time based on the user's swipe operation, the first and second sub-screens also change accordingly. Therefore, by first rendering the sub-screens to the corresponding display memory, and then rendering the sub-screens in the display memory to the display interface for display, the updates of the sub-screens are smoother, visual flicker and jitter are reduced, and the multi-screen rendering effect is optimized.

[0032] In some embodiments, the method 100 may further include: if the second sub-screen is greater than or equal to a preset ratio of the second screen, then rendering the first application screen of the first screen to the second screen in real time. In this way, when the second sub-screen exceeds the preset ratio of the second screen, the first application screen is directly rendered to the second screen, thereby completing cross-screen movement, avoiding excessive system resource consumption during cross-screen rendering, simplifying the cross-screen rendering process, and improving the efficiency of cross-screen interaction.

[0033] In some embodiments, after rendering the first application screen from the first screen to the second screen in real time, the application permissions of the application corresponding to the first application screen are switched from the first screen to the second screen, and the application screen of the previously launched application on the first screen is rendered to the first screen. This enables cross-screen flow and sharing of applications across multiple screens. Based on swipe operations, users can push applications within their current screen to other users' screens and freely operate the application on other users' screens without needing to move their seats to view or operate the application. Simultaneously, the screen from which the application is moved out restores its previously launched application screen, optimizing the user experience of multi-screen interaction.

[0034] Figure 2 This is a flowchart illustrating a multi-screen interaction method 200 for a smart cockpit according to an embodiment of the present disclosure. (Refer to...) Figure 2 The method 200 includes the following steps 202 to 204.

[0035] In step 202, in response to the control operation of the third screen, the control operation is parsed according to the screen array information to determine the fourth screen controlled by the third screen.

[0036] In step 204, the fourth screen of the fourth screen is synchronized to the third screen, and user events of the third screen are distributed to the fourth screen so that the fourth screen responds to the control operations of the third screen.

[0037] In this way, users can control other users' screens from their current screen without moving their seats, improving the convenience of cross-screen interaction. In a specific application scenario, non-driving users can control the driver's screen from their own screen to assist the driver in interface operation, avoiding interference with the driver and improving driving safety.

[0038] In some embodiments, the method 200 may further include: in response to an end control operation of the third screen, acquiring a third application screen of the third screen, and rendering the third application screen onto the third screen according to the screen array information. In this way, after cross-screen control is completed, the normal display interface between the third and fourth screens is restored, ensuring the use of single-screen operation functionality.

[0039] Figure 3 This is a flowchart illustrating a method 300 for displaying a cross-screen mobile application screen according to an embodiment of the present invention. (See also...) Figure 3 The method 300 is applied to a multi-screen interaction device in a smart cockpit, and the method 300 includes the following steps 302 to 322.

[0040] In step 302, the user touches the first screen to trigger a swipe operation. Based on the collected swipe operation, the operation event type is filtered, calculated, and identified to determine that it is a cross-screen movement event.

[0041] In some embodiments, a user touches the first screen to trigger a UI operation. The operation event type is determined by filtering, calculating and identifying multiple collected UI operations. The UI operations include click operations, swipe operations and drag operations.

[0042] In some embodiments, the sliding distance is calculated based on the start and end positions of the sliding operation. For diagonal sliding operations, the sliding trajectory can be decomposed into horizontal and vertical sliding, and the sliding distances are calculated separately for each. If the cumulative sliding distance exceeds half the length or height of the first screen within a very short time threshold, the operation event type is determined to be a cross-screen operation event. If the cumulative sliding distance does not exceed half the length or height of the first screen, the operation event type is determined to be a single-screen operation event. For single-screen operation events, the first application screen is moved on the first screen according to the sliding direction of the sliding operation.

[0043] In some embodiments, cross-screen operation events include cross-screen movement events and cross-screen push application events.

[0044] In step 304, the physical array information and logical array information of the screen are obtained.

[0045] In some embodiments, the physical array information of the screen is directly obtained through the DRM interface in the smart cockpit, and then the physical array information is mapped to obtain the logical array information. The DRM interface is mainly used to manage the graphics processing unit (GPU) and other graphics hardware resources.

[0046] In step 306, a second screen for cross-screen interaction with the first screen is determined based on the physical array information and the sliding direction of the sliding operation.

[0047] In some embodiments, the first screen and the second screen can be any two screens within the smart cockpit. For example, the first screen can be the passenger-side screen. If the first screen is swiped to the left, the second screen interacting with it becomes the driver-side screen; if the first screen is swiped backward, the second screen interacting with it becomes the rear seat screen. As another example, the first screen can be the driver-side screen. If the first screen is swiped to the right, the second screen interacting with it becomes the passenger-side screen; if the first screen is swiped backward, the second screen interacting with it becomes the rear seat screen; and if the first screen is swiped upward, the second screen interacting with it becomes the instrument cluster screen.

[0048] In step 308, the system's display memory is obtained, and the physically contiguous display memory is allocated to the corresponding screens according to the logical array information.

[0049] In some embodiments, the display parameters (such as resolution, refresh rate, color gamut parameters, and response time) of the screens connected to the multi-screen interaction device may all be different. Therefore, the system's display memory is dynamically adjusted according to the maximum resolution and the number of screens. For example, when the maximum resolution of the screen is 1920×1080 and the current system is connected to 4 screens, the obtained physically contiguous display memory is 1920×1080×4×pixel length. In addition, for screens with a resolution lower than the maximum resolution, the system will simultaneously store the logical resolution and physical resolution of that screen.

[0050] In step 310, the screen movement parameters are calculated based on the sliding operation and preset animation parameters.

[0051] In some embodiments, the screen movement parameters include screen offset position and screen offset speed.

[0052] In step 312, the first application screen is divided into a continuous first sub-screen and a second sub-screen according to the sliding direction based on the screen movement parameters and the size information of the first screen.

[0053] Figure 4 This is a schematic diagram illustrating a cross-screen mobile application screen according to an embodiment of the present invention. (Refer to...) Figure 4 In some embodiments, the first application screen can be divided into a first sub-screen located within the display interface and a second sub-screen located outside the display interface based on the screen offset position and the size information of the first screen. Simultaneously, the screen offset position is updated in real time based on the screen offset speed, thereby updating the division position of the first application screen to obtain the updated first and second sub-screens, thus creating a transitional effect for cross-screen movement.

[0054] In step 314, the first sub-screen is rendered to the first display memory of the first screen according to the logical array information, and the second sub-screen is rendered to the second display memory of the second screen.

[0055] In some embodiments, before rendering the first sub-screen and the second sub-screen, a rendering synchronization signal between the first screen and the second screen is obtained. The rendering synchronization signal is a hardware synchronization signal or a precisely calculated software synchronization signal. The rendering synchronization signal drives the system to render the first sub-screen and the second sub-screen.

[0056] In step 316, based on the mapping relationship between physical array information and logical array information, the first sub-screen in the first display memory and the second sub-screen in the second display memory are copied to the corresponding screens respectively.

[0057] In some embodiments, the first sub-screen is rendered on the side of the first screen closest to the second screen, and the second sub-screen is rendered on the side of the second screen closest to the first screen. For example... Figure 4 As shown in (a1), the swipe direction on the first screen is to the right, at which point the first application screen is divided into a first sub-screen and a second sub-screen. The first sub-screen is rendered on the right side of the first screen, and the second sub-screen is rendered on the left side of the second screen. Figure 4 As shown in (b1), the sliding direction of the swipe operation on the first screen is to the left. At this time, the first application screen is divided into a first sub-screen and a second sub-screen. The first sub-screen is rendered on the left side of the first screen, and the second sub-screen is rendered on the right side of the second screen.

[0058] In some embodiments, during the migration of the first application screen from the first screen to the second screen, a user-defined cross-screen migration-out animation is displayed on the first screen, and a user-defined cross-screen migration-in animation is displayed on the second screen. Specifically, the cross-screen migration-out animation moves from the center of the first screen to the edge of the first screen along the migration-out direction of the first application screen, and the cross-screen migration-in animation moves from the edge of the second screen to the center of the second screen along the migration-in direction of the first application screen.

[0059] In step 318, if, within a very short time threshold, the second sub-screen exceeds half the width or length of the second screen, then the first application screen of the first screen is completely rendered onto the second screen, such as... Figure 4 As shown in (a2) and (b2).

[0060] In some embodiments, if the second sub-screen does not exceed half the width or length of the second screen within a very short time threshold, the previously launched second application screen is rendered onto the second screen to restore the original screen content of the second screen.

[0061] In some embodiments, if the second screen is displaying the application screen of another application before rendering the second sub-screen, the application screen is exited in order to complete the rendering of the second sub-screen.

[0062] In step 320, the application permissions of the application corresponding to the first application screen are switched from the first screen to the second screen.

[0063] In some embodiments, if the application corresponding to the first application screen is a music playback application, then application permissions such as song switching, volume adjustment, and lyrics display are switched from the first screen to the second screen. That is, the music playback application can be freely operated on the second screen, including entering the next level menu of the current application and returning to the previous level menu of the current application.

[0064] In some embodiments, during the process of switching application permissions from the first screen to the second screen, the first audio zone of the first screen is switched to the second audio zone of the second screen. The associated application on the first screen closes the first audio zone, and the associated application on the second screen opens the second audio zone, where the sound of the associated application is played. Specifically, the amplifier speaker used by the music playback application to play music is switched from the amplifier speaker on the first screen to the amplifier speaker on the second screen.

[0065] In some embodiments, if the second screen no longer operates the application pushed across the first screen, the application screen can be exited through a preset method.

[0066] In step 322, after the second screen has fully rendered the first application screen, the application screen of the previously launched application on the first screen is rendered onto the first screen to restore the previously launched application on the first screen.

[0067] In some embodiments, if the first screen does not contain a record of the last time the application was launched, the system desktop screen is rendered onto the first screen.

[0068] In some embodiments, the driving user (screen) can push the music application screen or navigation application screen to the non-driving user (screen) through the cross-screen application screen movement method 300. After the non-driving user (screen) completes the song / sound effect mode switching or navigation switching operation on the current application screen, the non-driving user (screen) then pushes the switched application screen to the driving user (screen) through the cross-screen application screen movement method 300. This helps the driving user (screen) complete the specified operation without requiring the driving user (screen) to operate actively, thus avoiding interference with driving.

[0069] Figure 5 This is a flowchart illustrating a method 400 for controlling an application screen across screens according to an embodiment of the present invention. (See also...) Figure 5The method 400 is applied to a multi-screen interaction device in a smart cockpit, and the method 400 includes the following steps 402 to 410.

[0070] In step 402, the user touches the third screen to trigger a click operation. Based on the collected click operation, the operation event type is filtered, calculated, and identified to determine that it is a control operation event.

[0071] In step 404, the fourth screen controlled by the third screen is determined based on the physical array information and the screen identifier selected based on the click operation.

[0072] In step 406, the fourth image of the fourth screen is obtained according to the logical array information, and then the fourth image of the fourth screen is synchronously rendered to the third screen based on the logical array information and the physical array information, so that the third screen and the fourth screen can achieve the same display control mode.

[0073] In some embodiments, the multiple screens in the smart cockpit are controlled by a single display mode by default.

[0074] In step 408, the user event triggered by the third screen is distributed to the fourth screen.

[0075] In some embodiments, to achieve synchronized control of the third and fourth screens, the time information of the third screen is synchronously distributed to the fourth screen to ensure that the two screens operate in sync.

[0076] In step 410, if the user touches the third screen to trigger the end control operation, the association of user events between the third screen and the fourth screen is terminated, and the third application screen of the third screen is obtained and rendered onto the third screen, so that the third screen and the fourth screen can resume the different display control mode.

[0077] In some embodiments, the cross-screen control method 400 allows any two users (screens) to watch the same video or view the same document simultaneously. During the viewing process, they can also share relevant information or operation events input by the users in real time. Information sharing can be achieved without the users needing to move their seats, thereby improving user convenience and experience.

[0078] According to another aspect of the invention, Figure 6 This is a block diagram illustrating a multi-screen interaction device 600 for a smart cockpit according to an embodiment of the present invention. (Refer to...) Figure 6 The multi-screen interaction device 600 includes a memory 602 and at least one processor 604. The at least one processor 604 is electrically coupled to the memory 602 and is configured to perform the multi-screen interaction methods for smart cockpits described in the embodiments above.

[0079] According to another aspect of the present invention, a smart cockpit is provided. The smart cockpit includes a multi-screen interaction device 600 for the smart cockpit and multiple screens. The multiple screens are electrically coupled to a processor and configured to receive user operations and display images.

[0080] Figure 7 This is a block diagram of a system architecture 700 for a smart cockpit according to an embodiment of the present invention. (Refer to...) Figure 7 The system architecture 700 for the smart cockpit includes an application processor 702, a graphics processing unit 704, a display processing unit 706, a storage unit 708, and a multi-user operating system 710. The application processor 702, graphics processing unit 704, display processing unit 706, and storage unit 708 are coupled to the multi-user operating system 710 of the smart cockpit. The multi-user operating system 710 executes the operations of the aforementioned cross-screen mobile application screen and cross-screen control application screen. Finally, user operations are received and corresponding screens are displayed through multiple screens 712.

[0081] In summary, the multi-screen interaction method and device for smart cockpits provided by this invention, and the smart cockpit itself, allow for cross-screen operation events between the current screen and a designated screen by triggering a swipe operation on any screen. Based on these cross-screen operation events, the content of the current screen is moved across screens to the designated screen. Thus, application push can be achieved between multiple screens based on swipe operations, enabling application screens to flow, switch, and be shared across multiple screens. In this way, when the driver is unable to operate the central control screen, other users can operate the central control screen on their respective screens without moving their seats, improving user convenience and avoiding interference with driving. Simultaneously, by triggering a control operation on any screen to control cross-screen control events between the current screen and a designated screen, the current screen and the designated screen can achieve a simultaneous display mode. Therefore, information sharing can be achieved between multiple screens based on control operations, allowing different users to view the same screen and broadening the application scenarios of multi-screen interaction.

[0082] The above description is merely an embodiment of the present invention and does not limit the patent scope of the present invention. Any equivalent modifications made based on the content of the present invention specification and drawings, or direct or indirect applications in related technical fields, are similarly included within the patent protection scope of the present invention.

Claims

1. A multi-screen interaction method for an intelligent cockpit, characterized in that, Comprise: determine an operation event of a first screen according to a sliding operation on the first screen; if the operation event is a cross-screen operation event, obtain screen array information of a smart cockpit; determine a second screen for cross-screen interaction with the first screen according to the screen array information; and migrate a first application picture of the first screen to the second screen according to the screen array information, so that the second screen responds to the sliding operation of the first screen. The screen array information comprises physical array information, 2. The multi-screen interaction method of claim 1, wherein, wherein determining a second screen for cross-screen interaction with the first screen according to the screen array information comprises: determining the second screen for cross-screen interaction with the first screen according to the physical array information and the sliding direction of the sliding operation. The screen array information further comprises logical array information in a mapping relationship with the physical array information, 3. The multi-screen interaction method of claim 2, wherein, wherein migrating a first application picture of the first screen to the second screen according to the screen array information comprises: migrating the first application picture of the first screen to the second screen according to the physical array information and the logical array information, wherein during the migration of the first application picture from the first screen to the second screen, an associated migration animation is displayed on the first screen and the second screen, and an associated switching process of the sound area corresponding to the first screen and the second screen occurs. Further comprise:

4. The multi-screen interaction method of claim 1, wherein, in response to a control operation of a third screen, determining a fourth screen controlled by the third screen according to the screen array information; and synchronizing a fourth application picture of the fourth screen to the third screen, and distributing a user event of the third screen to the fourth screen, so that the fourth screen responds to the control operation of the third screen. Further comprise:

5. The multi-screen interaction method of claim 4, wherein, in response to an end control operation of the third screen, obtaining a third application picture for the third screen; and rendering the third application picture to the third screen according to the screen array information. Determining an operation event of a first screen according to a sliding operation on the first screen comprises:

6. The multi-screen interaction method of claim 1, wherein, determining a sliding distance of the sliding operation within a preset time threshold based on a sliding track of the sliding operation; if it is detected that the sliding distance is greater than or equal to a preset proportion of the first screen, determining that the operation event of the first screen is a cross-screen operation event; and if it is detected that the sliding distance is less than the preset proportion of the first screen, determining that the operation event of the first screen is a single-screen operation event. Further comprise:

7. The multi-screen interaction method of claim 6, wherein, if the operation event is a single-screen operation event, moving the first application picture in the first screen according to the sliding direction of the sliding operation to respond to the sliding operation of the first screen. Migrating a first application picture of the first screen to the second screen according to the physical array information and the logical array information comprises:

8. The multi-screen interaction method of claim 3, wherein, setting a picture migration parameter according to the sliding distance and sliding speed of the sliding operation; ​ According to the picture moving parameter and the size information of the first screen, a first application picture of the first screen is divided into a first sub-picture and a second sub-picture in the sliding direction; According to the physical array information and the logical array information, the first sub-picture is rendered to the first screen in real time, so that the first screen forms an animation effect of moving out of the first application picture in the sliding direction; and According to the physical array information and the logical array information, the second sub-picture is rendered to the second screen in real time, so that the second screen forms an animation effect of moving into the first application picture in the sliding direction.

9. The multi-screen interaction method of claim 8, wherein, According to the physical array information and the logical array information, rendering the first sub-picture to the first screen in real time comprises: According to the logical array information, the first sub-picture is rendered to a first display memory corresponding to the first screen in real time; and According to the physical array information, the first sub-picture in the first display memory is rendered to the first screen; According to the physical array information and the logical array information, rendering the second sub-picture to the second screen in real time comprises: According to the logical array information, the second sub-picture is rendered to a second display memory corresponding to the second screen in real time; and According to the physical array information, the second sub-picture in the second display memory is rendered to the second screen.

10. The multi-screen interaction method of claim 8, wherein, Further comprising: If the second sub-picture is greater than or equal to a preset proportion of the second screen, rendering the first application picture of the first screen to the second screen in real time.

11. The multi-screen interaction method of claim 10, wherein, After rendering the first application picture of the first screen to the second screen in real time, further comprising: Switching an application permission of an application corresponding to the first application picture from the first screen to the second screen; and Rendering an application picture of an application last started by the first screen to the first screen.

12. The multi-screen interaction method of claim 3, wherein, The switching process of the sound area corresponding to the first screen and the second screen occurs in association with the switching process comprising: Switching a target playing sound area from a first sound area of the first screen to a second sound area of the second screen, so that an associated application of the first screen closes the first sound area, an associated application of the second screen opens the second sound area, and the second sound area plays sound of the associated application.

13. A multi-screen interaction device for an intelligent cockpit, characterized in that, Comprise: a memory; and at least one processor electrically coupled to the memory and configured to perform the multi-screen interaction method for a smart cockpit according to any one of claims 1 to 12.

14. An intelligent cabin, characterized in that, Comprise: the multi-screen interaction device for a smart cockpit according to claim 13; and a plurality of screens electrically coupled to the at least one processor and configured to receive user operations and display pictures.

Images