Human-machine interaction method and device for cockpit display screen and storage medium

Abstract

The present disclosure relates to a human-computer interaction method and device for a cockpit display and a storage medium, the method being applicable to an intelligent cockpit of a vehicle or an aircraft, the method comprising: in a desktop interface, displaying program cards of n application programs arranged according to a first layout (210); in the case where a first condition is met, displaying a window view corresponding to the desktop interface, the window view displaying icons of the n application programs arranged according to a first thumbnail layout, the first thumbnail layout corresponding to the first layout (220); in response to a first control operation on a program card of a first application program in the n application programs, switching the program card of the first application program to an icon of the first application program; following the first control operation, moving the icon of the first application program (230); and based on an end position of the first control operation, adjusting a display position of the icon of the first application program in the window view (240).

Description

Technical Field

[0001] This disclosure relates to the field of human-computer interaction, and in particular to a human-computer interaction method, apparatus and storage medium for a cockpit display screen. Background Technology

[0002] In the field of smart cockpits, especially in the field of in-vehicle smart cockpits, the cockpit display screen is the core carrier for information presentation and interaction. The management logic and display efficiency of its applications are directly related to driving safety and user operation convenience, and are a key link affecting the human-computer interaction experience.

[0003] Current application management for cockpit displays (such as in-vehicle displays) primarily employs a fixed grid layout or list display format. During driving, adjusting applications on the cockpit display requires first locating the application and then performing the corresponding operation, resulting in high complexity. Summary of the Invention

[0004] This disclosure provides a human-computer interaction method, apparatus, and storage medium for a cockpit display screen, the technical solution of which includes at least: According to one aspect of the present disclosure, a human-computer interaction method for a cockpit display screen is provided, the method comprising: The desktop interface displays application cards for n applications arranged in the first layout, where n is a positive integer. If the first condition is met, a window view corresponding to the desktop interface is displayed, and the window view displays icons of the n applications arranged in a first thumbnail layout, the first thumbnail layout corresponding to the first layout; In response to a first control operation on the program card of the first application among the n applications, the program card of the first application is switched to the icon of the first application; following the first control operation, the icon of the first application is moved. Based on the end position of the first control operation, adjust the display position of the icon of the first application in the window view.

[0005] According to one aspect of the present disclosure, a human-computer interaction device for a cockpit display screen is provided, the device being used to implement the steps of the above-described human-computer interaction method for a cockpit display screen. Optionally, the device includes: The display module is used to display the application cards of n applications arranged in a first layout on the desktop interface, where n is a positive integer; The display module is further configured to display a window view corresponding to the desktop interface when the first condition is met. The window view displays icons of the n applications arranged in a first thumbnail layout, and the first thumbnail layout corresponds to the first layout. The processing module is configured to, in response to a first control operation on the program card of a first application among the n applications, switch the program card of the first application to the icon of the first application; and, following the first control operation, move the icon of the first application. The processing module is further configured to adjust the display position of the icon of the first application in the window view based on the end position of the first control operation.

[0006] According to one aspect of the present disclosure, a human-machine interaction device for a cockpit display screen is provided, the device comprising: processor; Memory for storing the executable instructions of the processor; The processor is configured to implement the steps of the human-computer interaction method for the cockpit display screen described above.

[0007] According to one aspect of the present disclosure, a non-transitory computer-readable storage medium is provided, on which a computer program is stored, which, when executed by a processor, implements the steps of the human-computer interaction method for a cockpit display screen described above.

[0008] According to one aspect of the present disclosure, a computer program product is provided, the computer program product including computer instructions that, when executed by a processor, implement the steps of the human-computer interaction method for a cockpit display screen described above.

[0009] The technical solutions provided in this disclosure may have the following beneficial effects: On the one hand, by displaying a window view corresponding to the desktop interface, it is convenient to realize the linkage and interaction between the window view and the desktop interface, and the window view can be displayed only when specific conditions (such as the first condition) are met, which can improve efficiency. On the other hand, by performing a first control operation on the application's program card, the application's program card can be switched to the application's icon, and the position of the application's icon can be adjusted based on the end position of the first control operation. This expands the ways to adjust the application, reduces complexity, and makes the operation more convenient and faster. Attached Figure Description

[0010] To more clearly illustrate the technical solutions in the embodiments of this disclosure, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0011] Figure 1 This is a schematic diagram illustrating a cockpit display screen according to an exemplary embodiment; Figure 2 This is a flowchart illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment; Figure 3 This is a schematic diagram illustrating a desktop interface according to an exemplary embodiment; Figure 4 This is a schematic diagram illustrating a desktop interface according to an exemplary embodiment; Figure 5 This is a schematic diagram illustrating a method for displaying a window view according to an exemplary embodiment; Figure 6 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment; Figure 7 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment; Figure 8 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment; Figure 9 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment; Figure 10 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment; Figure 11 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment; Figure 12 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment; Figure 13 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment; Figure 14 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment; Figure 15 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment; Figure 16 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment; Figure 17 This is a schematic diagram illustrating a desktop interface switching method according to an exemplary embodiment; Figure 18 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment; Figure 19 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment; Figure 20 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment; Figure 21 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment; Figure 22 This is a block diagram illustrating a human-computer interaction device for a cockpit display screen according to an exemplary embodiment; Figure 23 This is a structural schematic diagram of a human-computer interaction device for a cockpit display screen, according to an exemplary embodiment. Detailed Implementation

[0012] To make the objectives, technical solutions, and advantages of this disclosure clearer, embodiments of this disclosure will be further described in detail below with reference to the accompanying drawings. Exemplary embodiments will be described in detail here, examples of which are illustrated in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0013] The terminology used in this disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The singular forms “a,” “the,” and “the” as used in this disclosure and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.

[0014] It should be understood that although the terms first, second, third, etc. may be used in this disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this disclosure, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the word "if" as used herein may be interpreted as "upon" or "when" or "in response to a determination".

[0015] In the following, the related technologies and terms involved in the present disclosure are introduced and explained. The embodiments of the present disclosure include at least part of the following contents: 1. Smart cockpit and cockpit display screen In some embodiments, the smart cockpit refers to a cockpit system integrating functions such as human-machine interaction, environment perception, and intelligent control, which aims to improve the operation convenience, safety and comfort of drivers and passengers. Optionally, the smart cockpit can be applied to various vehicles. For example, the smart cockpit can be applied to automobiles, aircrafts, and ships.

[0016] In the driving system of the smart cockpit, the cockpit display screen is an electronic screen installed inside the cockpit (such as a vehicle) for information display and human-machine interaction, which is the core hardware and visual carrier in the smart cockpit. The functions of the cockpit display screen include driving assistance and entertainment functions, etc. The cockpit display screen is the main interface for human-machine interaction, usually referring to the high-resolution touch screen or non-touch display panel on the center console, instrument panel, co-pilot or rear-seat entertainment system, which is responsible for presenting multi-modal contents such as vehicle information, function control, navigation maps, audio and video entertainment to users in a visual form. The cockpit display screen includes but is not limited to the following types: center control display screen (providing functions such as navigation, reversing image, audio entertainment, etc.), liquid crystal instrument panel (digitally displaying vehicle working state information such as vehicle speed, power, etc.), head-up display (projecting key information onto the front windshield, so that the driver can view it without looking down, improving safety), co-pilot and rear-seat entertainment screens (providing audio and video entertainment functions), streaming media rearview mirror or side view screen (capturing images through a camera and displaying them on the screen). Different from traditional consumer electronic screens, the design of the cockpit display screen must strictly follow driving safety specifications, emphasizing the immediacy of information reading, the simplicity of the interface and the short path of operation. With the development of the smart cockpit and related technologies, the cockpit display screen is evolving from a single-function display to an integrated, multi-screen linked, scene-adaptive comprehensive interaction platform, which is a key physical interface connecting vehicle functions, service ecology and user experience.

[0017] 2. Desktop The desktop is the core interactive interface that is displayed by default when the screen starts up. The desktop's functions include, but are not limited to: function integration, information display, personalization settings, and connecting the user with the screen. As the default initial interface, it can directly present the core content without requiring additional navigation.

[0018] The desktop can include one or more of the following: 3D car model control desktop, card-style desktop, immersive entertainment desktop, minimalist wallpaper desktop, interactive desktop, and quick control desktop. The 3D car model control desktop uses a 3D car model as the core visual element. The model can rotate and dynamically display the status of vehicle parts. It also integrates vehicle control functions such as seat adjustment, air conditioning control, and window operation, replacing complex text menus with intuitive and cool visual effects. This reduces the difficulty of vehicle control operation and enhances the technological feel of the interaction. The card-style desktop uses a segmented card layout, with each card corresponding to an independent function, such as navigation cards, music cards, air conditioning cards, and entertainment application cards. Cards can be dragged and repositioned, and some also support adding or deleting custom cards. It has a low operating threshold, adapts to the usage habits of different users, and can flexibly match the functional needs of different scenarios. The immersive entertainment desktop uses high-definition wallpapers or dynamic backgrounds as a base, integrating entertainment functions such as video playback, games, music, and screen projection. Some support 4K resolution display and external devices. It weakens complex operation elements, allowing passengers to focus on audio-visual content, games, etc., improving the comfort and enjoyment of the ride. The minimalist wallpaper desktop features exquisite static or dynamic wallpapers, retaining only a few core function entry points. It supports custom wallpaper changes, reducing interface clutter and alleviating visual fatigue from prolonged screen viewing. Simultaneously, it caters to the personalized aesthetic needs of drivers and passengers, creating a more personalized cabin environment. The interactive desktop supports cross-screen content flow, breaking the functional limitations of a single screen and enabling multi-screen information sharing and collaborative control. It adapts to the usage needs of different locations within the vehicle, making interaction more flexible and smooth, and enhancing the overall intelligent experience of the cabin. The quick control desktop integrates frequently used shortcut functions, with an interface primarily featuring large icons and simple buttons. Some functions support voice control, centralizing previously scattered control functions and shortening operation paths.

[0019] 3. Icon An icon is a graphical representation of a function or status indicator used in the user interface (UI) of an in-vehicle infotainment system or central control display. The functions of icons include, but are not limited to: function identification and entry (representing a specific application or function with a simple and intuitive graphic, such as a navigation application, music application, or seat heating function), information status display (displaying the real-time status of the vehicle or system, such as network connection, Bluetooth status, battery level, warning displays, etc.), and improving interaction efficiency and aesthetics (replacing or supplementing text descriptions, helping users quickly identify and operate, reducing cognitive load). Icons do not exist independently; they are part of the overall system interaction logic. As smart cockpits evolve towards scenario-based services, icons are also adjusted accordingly. For example, icons may be linked with voice, lighting, and other system functions to enhance the user's interactive experience.

[0020] 4. Program Card Application cards are visual interactive modules associated with a specified application. Application cards include one or more of the following characteristics: • Dynamically display real-time information for a specified application; • Integrates one or more entry points for operations / functions, enabling multiple functions without launching the full interface of the application; • At least one of the following: size, position, and display format can be flexibly adjusted by the user or system.

[0021] Unlike icons, which serve only as static launch points, application cards carry dynamic content for a single application and / or continuously update application data or information (such as navigation routes, music playback progress, and message notifications). Application cards also differ from feature-aggregated folders, which manage multiple application entry points; application cards do not collect or manage other applications or cards. Application cards are interactive cards or controls used to display real-time information about the application and implement all or part of the application's functions. They have real-time information preview capabilities and can be dynamically adjusted in real time.

[0022] Optionally, on the cockpit display, the application card may appear as a navigation preview, music playback controls, or air conditioning settings panel; in the virtual space of virtual reality (VR) or augmented reality (AR) glasses, the application card may appear as a floating, spatially positioned 3D information panel; on a head-up display (HUD), it can be integrated with the real field of view, displaying key navigation or safety prompts as a transparent layer. The application card can be presented and interacted with as a unified information module across device forms (such as in-vehicle screens, VR or AR spaces, and HUDs).

[0023] Each application card is associated with an application, and the visual presentation of the application card includes at least one of the following: an information display area for continuously updating and displaying data or information from the associated application, an interactive operation area for integrating one or more functions for the application, and an identification area for displaying the application name or icon.

[0024] Figure 1 This is a schematic diagram illustrating a cockpit display screen 100 according to an exemplary embodiment. The cockpit display screen 100 includes: program cards 110, icons 120, and a navigation area 130.

[0025] Each program card 110 is associated with an application. Different program cards 110 are associated with different applications, which can be navigation programs, vehicle control programs, communication programs, music programs, or any other applications that can run in an in-vehicle environment; this disclosure does not limit this. Program cards 110 can appear in the cockpit display screen 100 in the form of a rectangular area or other forms. Program cards 110 dynamically display the core implementation content of the associated application and provide key operation entry points. Program cards 110 are interactive cards or controls used to display real-time information of the application and to implement all or part of the application's functions, possessing real-time information preview capabilities and the ability to dynamically adjust in real time. In some embodiments, the application associated with program card 110 is a navigation program, which can display the driving route, next intersection operation prompts, and estimated arrival time in real time, and integrate operation buttons such as start navigation, end navigation, or mute. In some embodiments, the application associated with program card 110 is a music program, which can display information about the currently playing song and its album art in real time, and provide control buttons such as play, pause, previous track, and next track. In some embodiments, the application associated with program card 110 is an air conditioning control program. The program card 110 can display the in-vehicle temperature and cooling / heating mode in real time, and provide touch areas for temperature adjustment, mode switching, etc. This disclosure is not limited in comparison.

[0026] In some embodiments, a card separator control 140 is also present between adjacent program cards. Optionally, the card separator control may be visually represented as a thin line of a specified width, or it may also be represented as a recessed or raised spacer, or a small handle with a drag-and-drop prompt; this disclosure is not limited thereto. The card separator control is used to mark the boundaries between two adjacent program cards and serves as a direct object for the user to adjust the layout.

[0027] In some embodiments, the program card 110 also includes a control 150 for controlling the movement and / or size change of the program card. Optionally, the control 150 may be three dots or a square, and this disclosure is not limited thereto. For example, by clicking... Figure 1 The three dots 150 on the program card can be used to move the program card.

[0028] Each icon 120 is associated with an application. Different icons 120 are associated with different applications, which may include navigation programs, vehicle control programs, communication programs, music programs, or any other applications that can run in an in-vehicle environment; this disclosure does not limit this. Icons 120 may appear in the cockpit display screen 100 in the form of a rectangular area or other forms, and the size of the icon 120 is generally smaller than the size of the application card 110. Icons 120 provide a functional identifier and / or access point for the associated application. In some embodiments, the application associated with icon 120 is a navigation program, and the icon 120 provides a functional identifier or access point for the navigation program; clicking the icon 120 allows access to the navigation program. In some embodiments, the application associated with icon 120 is a music program, and the icon 120 provides a functional identifier or access point for the music program; clicking the icon 120 allows access to the music program.

[0029] In some embodiments, a navigation area 130 (i.e., ...) is included within the cockpit display screen 100. Figure 1 The area enclosed by the white dashed box in the middle). The position of the navigation area 130 is usually fixed, and it may be located at the bottom of the desktop interface of the cockpit display 100 (e.g., Figure 1 (As shown) or at the top or side edge, and the navigation area does not disappear when other applications are opened. In some embodiments, one or more icons 120 and / or one or more buttons may be placed on the navigation area. In some embodiments, a music icon may be placed on the navigation area, allowing users to enter music programs, etc., by clicking the music icon in the navigation area.

[0030] In some embodiments, the navigation area includes a window view. The window view may also be referred to as a desktop minimap or thumbnail view. The window view includes one or more icons 120. In some embodiments, the cockpit display 100 includes a desktop view and a window view. The desktop view includes one or more program cards 110, and the window view includes one or more icons 120; the desktop view and the window view... Figure 1One-to-one correspondence. In embodiments of this disclosure, the desktop view may also be referred to as a desktop interface. In some embodiments, the desktop interface includes one or more sub-interfaces, each sub-interface including one or more program cards. Optionally, the number of program cards in each sub-interface may be the same or different. Further, the size of the program cards in each sub-interface may be the same or different.

[0031] In some embodiments, there is a one-to-one correspondence between program cards 110 and icons 120. For example, if the application associated with program card 110 is a music application, then there is an icon 120 associated with that music application.

[0032] Optionally, Figure 1 The illustration shown is merely an example of the infrastructure including application cards 110 and icons 120. In a real deployment, the cockpit display 100 can display more than two application cards 110 simultaneously, for example, including application cards 110 associated with three different applications and three icons 120 associated with those three different applications. Alternatively, it can include application cards 110 associated with four different applications and four icons 120 associated with those four different applications. All application cards constitute a dynamically adjustable visual card layout, and all icons constitute a dynamically adjustable visual icon layout. In some embodiments, card separator controls may be included between different application cards 110, and all application cards 110 and card separator controls together constitute a dynamically adjustable visual card layout. In some embodiments, icon separator controls may be included between different icons 120, and all icons 120 and icon separator controls together constitute a dynamically adjustable visual icon layout.

[0033] Optionally, different program cards 110 may be arranged in parallel, or in a vertical, or in a grid pattern; this disclosure does not limit this arrangement.

[0034] Optionally, the different icons 120 may be arranged in parallel, or in a vertical, or in a grid pattern; this disclosure does not limit this arrangement.

[0035] In some embodiments, the number of program cards 110 may be one or more, and the number of icons 120 may also be one or more, which is not limited in this disclosure. In one possible implementation, the number of program cards 110 and the number of icons 120 are the same.

[0036] In some embodiments, the cockpit display screen 100 is mounted on the dashboard in the center of the cockpit, in the area to the right of the steering wheel and between the driver and passenger seats. Optionally, the cockpit display screen 100 can also be mounted behind the steering wheel to display vehicle status, navigation information, and driver assistance information to the driver; and / or, the cockpit display screen 100 can also be mounted directly in front of the passenger seat, on the back of the front seats, behind the center armrest, or tilted down from the roof to provide passengers with audio-visual entertainment, independent navigation, games, and vehicle environmental control functions; and / or, the cockpit display screen 100 can also be mounted via a robotic arm or sliding rail, and its height and angle can be adjusted within a certain range to adapt to different driver seating positions or usage scenarios. This disclosure does not limit this aspect.

[0037] Optionally, the cockpit display 100 is not limited to a single physical screen; it may be composed of multiple physical screens seamlessly spliced ​​together to form a continuous, wide display area. Multiple application cards 110 are arranged and interact with across multiple physical screens on their continuous display area, with a layout logic consistent with the embodiment on a single screen.

[0038] In some embodiments, the cockpit display 100 is connected to other cockpit displays or other terminals in the cockpit via an internal vehicle communication bus (such as an Ethernet vehicle bus or a Controller Area Network (CAN) bus); the program cards 110 associated with multiple applications in the cockpit display 100 are implemented through corresponding service function modules in the screen interface.

[0039] Figure 2 This is a flowchart illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment. The method can be executed by a smart cockpit and includes at least one of the following steps 210-280: Step 210: On the desktop interface, display the application cards of n applications arranged according to the first layout.

[0040] Where n is a positive integer.

[0041] In some embodiments, the cockpit display includes a desktop interface, which includes one or more sub-interfaces, each sub-interface including one or more application cards. One of the multiple sub-interfaces is displayed simultaneously on the cockpit display. Optionally, the number of application cards in each sub-interface may be the same or different. Further, the size of the application cards in each sub-interface may be the same or different. In some embodiments, the desktop interface is a portion of the available display area in the desktop display, and the desktop interface includes one or more application cards, exemplarily... Figure 3This is a schematic diagram illustrating a desktop interface according to an exemplary embodiment. Figure 3 As shown, the cockpit display includes a desktop interface. Figure 3 The desktop interface shown includes three sub-interfaces. The first sub-interface 310 includes three program cards (i.e., program card 1, program card 2, and program card 3) and a navigation (Dock) area. The second sub-interface 320 includes three program cards (i.e., program card 4, program card 5, and program card 6). The third sub-interface 330 includes one program card (i.e., program card 7). At this time, the first sub-interface is the sub-interface displayed on the cockpit display screen 100 and can be called the main interface.

[0042] The navigation area is typically located in a fixed position; it can be at the bottom, top, or side edge of the cockpit display 100's desktop interface, and it does not disappear when other applications are opened. For example... Figure 3 As shown, the navigation area is located at the bottom of the first sub-interface 310 (or the main interface). In some embodiments, the navigation area may be located at the bottom of the second sub-interface or the bottom of the third sub-interface. For example, the second sub-interface is the main interface, in which case the navigation area is located at the bottom of the second sub-interface. Alternatively, the third sub-interface is the main interface, in which case the navigation area is located at the bottom of the third sub-interface.

[0043] In some embodiments, the navigation area may contain one or more icons and / or one or more buttons. In some embodiments, a music icon may be placed on the navigation area, allowing users to access music programs, etc., by clicking the music icon. In some embodiments, a button may be placed on the navigation area, allowing users to return to a specific sub-interface by clicking this button. By directly clicking the icons or buttons in the navigation area, users can perform one-click operations without navigating through multiple menus to find functions, thus improving operational efficiency and safety while driving and enhancing the user experience.

[0044] In some embodiments, an application card is associated with a corresponding application and serves as an independent interactive interface unit for dynamically displaying the core real-time information and key operations of that application when it runs in the foreground or background. Unlike icons, which only serve as static launch points, application cards carry dynamic content for a single application and continuously update the application's data information (such as navigation routes and music playback progress). Unlike function-aggregated folders that manage multiple application entry points, application cards do not collect or manage other applications or cards. In some embodiments, application cards are designed and extracted interactive cards for displaying the core real-time information and key operations of the application, possessing real-time information preview capabilities and the ability to dynamically adjust in real time. In some embodiments, application cards display the interface of a running application. A running application refers to a program currently running in the background or foreground. The display interface of a running application refers to the user interface presented by the application during runtime. It is understood that an application card is not just a simple icon or name; it also displays the currently running interface content of the application in real time.

[0045] Optionally, on the cockpit display, the application card may appear as a navigation preview, music playback controls, or an air conditioning settings panel; in the virtual space of virtual reality (VR) or augmented reality (AR) glasses, the application card may appear as a floating, spatially positioned stereoscopic information panel; on the HUD, the application card may be integrated with the real field of view, displaying key navigation or safety prompts as a transparent layer. In some embodiments, the application card may transcend device form factors (such as in-vehicle screens, VR or AR spaces, and HUDs) and be presented and interacted with as a unified information module, which is not limited in this disclosure.

[0046] In some embodiments, each application card is associated with an application, and the visual presentation of the application card includes one or more of the following: an information display area for continuously updating and displaying core data from the associated application, an interactive operation area integrating one or more commonly used functions for the application, and an identification area for displaying the application name or icon.

[0047] In some embodiments, the application name is displayed in the upper left corner, upper right corner, center position, or other position on the application card, which is not limited in this disclosure.

[0048] For example, program card 1 is an independent interactive interface unit associated with application 1, such as First Music, used to dynamically display its core real-time information and key operations. Visually, program card 1 continuously updates and displays core data from First Music, such as the album art, song title, and artist name of the currently playing music. Program card 1 integrates one or more interactive operation areas for commonly used functions of First Music, such as pause or play buttons, previous or next track buttons, single loop, playlist loop, or random loop buttons, like or favorite buttons, and a music progress bar. The name of First Music is displayed in the upper left corner of program card 1. First Music can be any music application, and this disclosure does not limit it.

[0049] In some embodiments, the human-computer interaction method for a cockpit display screen can be applied to at least one of the following in the vehicle cockpit: central control display screen, passenger entertainment screen, front integrated screen, rear entertainment screen, control screen below the central control, instrument panel screen, head-up display, steering wheel display screen, electronic exterior rearview mirror display screen, armrest display screen, window display screen, door touch screen, roof-mounted screen, front seat back screen, rear central control screen, and safe driving interaction screen.

[0050] In some embodiments, the human-machine interaction method for cockpit displays can be applied to screens with information and entertainment functions within the vehicle cabin, including: a central control display, a passenger entertainment screen, and a front integrated screen. The central control display can be located in the center of the front row, above the center console (saddle seat), in the position of the traditional radio / air conditioning panel. The central control display is the core screen for operating the vehicle's infotainment system, map navigation, adjusting vehicle settings, Bluetooth phone calls, playing music, and accessing the panoramic view. The passenger entertainment screen is located on the dashboard panel directly in front of the passenger seat and supports watching movies, listening to music, watching short videos, or casting games. To prevent driver distraction, these screens are typically equipped with anti-peeping coatings or algorithms, appearing completely black or extremely dark from the driver's perspective. The front integrated screen extends horizontally from the driver's side A-pillar to the passenger side A-pillar. The integrated front-row screen can unify the instrument panel, central control display, passenger entertainment screen, and even electronic exterior rearview mirror display under a large, continuous glass panel (such as the 45-inch 8K screen in the Geely Galaxy E8), greatly enhancing the futuristic and cohesive feel of the cabin. Rear-row entertainment screens refer to all screens providing audio-visual entertainment for second-row and rear passengers. They primarily aim to alleviate boredom for rear passengers (especially children or VIPs on long journeys) by supporting independent audio-visual entertainment. Specifically, rear-row entertainment screens can include one or more of the following forms: ceiling-mounted screens, front seatback screens, and rear central control screens. Ceiling-mounted screens can be suspended in the center of the roof (usually at the junction of the front and rear sunroofs), while front seatback screens can be mounted directly behind the backs of the driver and front passenger seats. For example, rear passengers on the left and right can each have an independent screen, without interference (such as in the BMW 7 Series and Mercedes-Benz S-Class), supporting Bluetooth headphones; one passenger can watch cartoons on the left and conduct video conferences on the right. The rear center control screen can be located in any of the following positions: behind the front center armrest (facing the rear passengers' feet) or embedded in the panel after the rear center armrest is unfolded. The rear center control screen allows rear passengers to independently adjust the rear independent air conditioning temperature, seat massage intensity, the opening and closing of the electric sunshade, the temperature of the car refrigerator, and the audio volume.

[0051] In some embodiments, the human-machine interaction method for cockpit displays can be applied to screens within the vehicle cabin that provide vehicle functions and detailed controls, including: a control screen below the center console, door touchscreens, and window displays. The control screen below the center console can be located below the main center console screen, extending to the gear shift lever or cupholder area. For example, the control screen below the center console is an independent touchscreen (such as the dual-screen lower screen in the Audi A8L or the dual-screen layout in Land Rover), specifically used to adjust the vehicle's air conditioning, seat heating / ventilation, touch input, or adjust the air suspension and driving modes. Door touchscreens can be embedded near the door handle on the inside of the door or on the inside of the B-pillar, serving as miniature control panels for convenient passenger use. Window displays can be hidden within the interlayer of the side window glass or projected onto the window (currently commonly found on the outer windows of cutting-edge concept cars or high-end models). For example, inside the car, the window display can turn the side window into a transparent interactive screen, showing the weather or AR attraction information; outside the car (such as the outer glass of the B-pillar on some models), the window can display the battery level, a welcome message, or the facial recognition unlock status when the owner approaches.

[0052] In some embodiments, the human-machine interaction method for cockpit displays can be applied to screens within the vehicle cockpit that provide driving and navigation functions, including: instrument panel screens, head-up displays, steering wheel displays, and safety driving interaction screens. The instrument panel screen is located directly behind the steering wheel and in front of the driver. Optionally, the instrument panel screen displays vehicle speed, battery / fuel consumption, driving range, navigation thumbnails, and real-time 3D environmental modeling of the driving assistance system. The head-up display is a projection unit located inside the lower part of the windshield, projecting images onto the windshield in front of the driver. The head-up display allows the driver to see speed, navigation arrows, and speed limit signs without looking down. The head-up display can combine a front camera and algorithms to directly and dynamically "draw" navigation guide lines and ground-level arrows onto the real road surface, achieving a combination of virtual and real elements. The safety driving interaction screen is typically located on the upper edge of the steering wheel or above the instrument panel. The steering wheel display can be embedded in the steering wheel. For example, steering wheel displays can be embedded in the central area of ​​the steering wheel (avoiding airbags) or on the spokes and touch areas of the steering wheel. These are commonly found in supercars, racing cars, or highly futuristic concept cars (such as some Ferrari models). They are used to display the current track mode, gear, lap time, or as a touch-sensitive adjustment panel for high-frequency, quick functions. Electronic exterior mirror displays usually appear in pairs, located on either side of the A-pillar inside the vehicle, or on the upper edge of the front door lining near the A-pillar. For example, images captured by high-definition cameras outside the vehicle are displayed in real-time on the two electronic exterior mirror displays inside the car. This overcomes disadvantages such as poor visibility at night, glass obstruction in rain or snow, and large blind spots, providing a wider and clearer rear view. Safety driving interaction screens do not display redundant entertainment information, but only core safety driving data: such as gear position, speed, and brief intelligent driving prompts. They can be used in conjunction with a head-up display to keep the driver's focus more on the road. For example, a safety driving interaction screen can be a small strip of light-emitting diode (LED) screen located on the steering wheel. In some embodiments, the human-computer interaction method for the cockpit display screen can be applied to other screens in the vehicle cockpit, or to screens in other cockpits, and this disclosure does not limit it.

[0053] The first layout will be explained in detail below.

[0054] In some embodiments, the first layout refers to the spatial organization rules of the application cards of n applications in the available display area in an initial state. The available display area is the desktop interface of a cockpit display screen, or the virtual canvas of VR glasses or AR glasses. This disclosure primarily uses the desktop interface of a cockpit display screen as an example for illustration.

[0055] Optionally, the n applications included in the first layout can be applications of the same type or applications of different types. Optionally, the first layout is a system-preset default layout, such as the layout defined in the factory settings; or the first layout is a personalized layout that the user set and saved last time; or the first layout is the layout when the user last exited; or the first layout is a recommended layout that the system intelligently infers based on the user's historical usage habits.

[0056] In some embodiments, the first layout defines the initial arrangement, size ratio, and relative position of application cards for n applications on the cockpit display screen. The initial arrangement includes one or more of the following: the application cards for n applications are arranged horizontally to form a horizontal card list; the application cards for n applications are arranged vertically to form a vertical card list; or the application cards for n applications are arranged in a grid matrix, with the arrangement automatically adapting to the screen shape, user settings, or scene mode. The embodiments of this disclosure primarily use the arrangement of n application cards arranged horizontally as an example for illustration.

[0057] In some embodiments, all program cards within the first layout are set to have the same preset size, for example... Figure 3 The seven application cards in the first layout have a uniform card size or a basic card size. In some embodiments, the application cards within the first layout have different sizes. For example, the size of the application cards within the first layout is 1.5 times or 3 times the basic card size. For example, Figure 4 This is a schematic diagram illustrating a desktop interface according to an exemplary embodiment. Figure 4 As shown, a desktop interface includes three sub-interfaces. The first sub-interface includes two program cards (program card 1 and program card 2), the second sub-interface includes three program cards (program card 3, program card 4, and program card 5), and the third sub-interface includes two program cards (program card 6 and program card 7). Program card 1 is twice the size of the base card, while the remaining program cards are the same size as the base card. Furthermore, the size of the program cards within the first layout can be dynamically adjusted. For example, when a user wants to zoom in on the map, they can drag and drop the program card to the desired size. In the embodiments of this disclosure, the size of the program cards can be dynamically adjusted to meet different user needs and improve the interactive experience.

[0058] Step 220: If the first condition is met, display a window view corresponding to the desktop interface. The window view displays icons of n applications arranged according to the first thumbnail layout, and the first thumbnail layout corresponds to the first layout.

[0059] Optionally, the first condition includes one or more of the following: a first control operation is detected; the first control operation is a movement operation; the first control operation is a drag operation; a click operation on a first button is detected; a preset gesture operation is detected; or a preset voice is detected.

[0060] In some embodiments, displaying a window view corresponding to the desktop interface when a first condition is met includes: displaying a window view corresponding to the desktop interface in response to a first control operation on a program card of any one of the n applications; or, displaying a window view corresponding to the desktop interface in response to a drag operation on a program card of any one of the n applications; or, displaying a window view corresponding to the desktop interface in response to a click operation on a first button on the desktop interface; or, displaying a window view corresponding to the desktop interface in response to a preset gesture operation on the desktop interface; or, displaying a window view corresponding to the desktop interface in response to a preset voice operation on the cockpit display screen.

[0061] In some embodiments, in response to a first control operation on a program card of any one of n applications, a window view corresponding to the desktop interface is displayed. Optionally, the first control operation on a program card of any application (such as the first application) includes, but is not limited to, a click and drag operation, a click and drag down operation, a click and drag up operation, a swipe down or drag down operation, a swipe up or drag up operation, a swipe left or drag up operation, and a swipe right or drag down operation. In some embodiments, when the first control operation is a drag operation, a window view corresponding to the desktop interface is displayed. Optionally, when the window view is displayed or appears, the icon of the first application differs from the icons of other applications, such as in color or brightness. For example, the icon of the first application is gray, while the icons of other applications are colored.

[0062] For example, in response to a click and drag operation on a program card (such as program card 3), a window view corresponding to the desktop interface is displayed. In some embodiments, the first control operation on the program card may be a first control operation on the program card directly on the desktop interface, or it may be a mapping of a first control operation performed on another device connected to the cockpit display to the desktop interface. For example, the first control operation on the program card may be a movement operation performed on a touchpad mapped to the desktop interface. This disclosure does not limit this.

[0063] In some embodiments, a window view corresponding to the desktop interface is displayed in response to a click operation on a first button on the desktop interface. In some embodiments, the first button is located on the desktop interface in a location other than where the application card is located. In some embodiments, the first button on the desktop interface is located in the left sidebar, and a window view corresponding to the desktop interface is displayed in response to a click operation on the first button in the left sidebar. In some embodiments, the first button on the desktop interface is located in the navigation area, and a window view corresponding to the desktop interface is displayed in response to a click operation on the first button in the navigation area. It should be noted that in some embodiments, the first button may also be located in a location other than the cockpit display screen, and this disclosure does not limit this. For example, the first button may be located on the steering wheel, and a window view can be displayed by clicking the first button.

[0064] In some embodiments, in response to a preset gesture operation on the desktop interface, a window view corresponding to the desktop interface is displayed. In some embodiments, the preset gesture operation includes, but is not limited to, operations directly on the desktop interface: two-finger swipe down, two-finger tap, three-finger swipe down, and three-finger tap. Figure 5 This is a schematic diagram illustrating a method for displaying a window view according to an exemplary embodiment. For example... Figure 5 As shown, in response to a three-finger swipe down on the desktop screen, a window view corresponding to the desktop interface is displayed. For simplicity, Figure 5 Only the program cards of the first sub-interface of the desktop interface are shown. The layouts of the second and third sub-interfaces correspond to the layouts of the second and third sub-regions of the window view. In some embodiments, preset gesture operations may include gesture operations that do not directly touch the desktop interface, such as pinching a finger in the first region or snapping a finger in the first region. The first region may be the area where the driver is located, or it may include an area jointly determined by the driver and the in-vehicle camera; this disclosure does not limit this. In some embodiments, the preset gesture operations may be preset by the in-vehicle system or personalized by the user.

[0065] In some embodiments, in response to a preset voice command on the cockpit display, a window view corresponding to the desktop interface is displayed. In some embodiments, the voice assistant is activated, and the corresponding operation is instructed to be performed via voice. For example, the voice assistant is instructed to perform the corresponding operation by issuing the command "Please display the window view". In some embodiments, it is not necessary to activate the voice assistant; after the driver issues a command, the processing module in the cockpit display recognizes the driver's voice and command, and then displays the window view corresponding to the desktop interface. In some embodiments, the preset voice command can be preset by the in-vehicle system or can be personalized by the user.

[0066] In some embodiments, the window view displays icons of n applications arranged in a first thumbnail layout, which corresponds to a first layout.

[0067] The window view and the first thumbnail layout are described in detail below. In some embodiments, the window view corresponds to the desktop interface. The desktop interface includes multiple sub-interfaces, each including one or more program cards. The window view includes multiple sub-regions, each including one or more icons. Optionally, multiple sub-interfaces or one sub-interface from multiple sub-interfaces are displayed simultaneously on the cockpit display. In one possible implementation, one sub-interface from multiple sub-interfaces is displayed simultaneously on the cockpit display. This disclosure is primarily described using the example of displaying one sub-interface from multiple sub-interfaces simultaneously on the cockpit display. In some embodiments, the number of sub-regions included in the window view is the same as the number of sub-interfaces included in the desktop interface, and the multiple sub-regions correspond one-to-one with the multiple sub-interfaces.

[0068] In some embodiments, the window view is a portion of the available display area in the desktop display. Optionally, the window view may be overlaid on the desktop interface, or the window view may be located in the top displayable area of ​​the cockpit display, or the window view may be located in the bottom displayable area of ​​the cockpit display, or the window view may be located in other areas of the cockpit display; this disclosure is not limited thereto. This disclosure uses the example of a window view being overlaid on the desktop interface for illustration.

[0069] In some embodiments, the window view is a mapping of the desktop interface, and the area size of the window view is smaller than or equal to the area size of the desktop interface. This disclosure uses the example of the window view having an area size smaller than the desktop interface area size for illustration.

[0070] In some embodiments, each icon is associated with an application, serving as the application's identifier; different applications have different icons. In some embodiments, an application is associated with an application card and an icon, with the application card and icon corresponding to each other. In some embodiments, the icon can serve as a static launch point for the application, visually reflecting the application's functional attributes; for example, a user can quickly access map services by clicking the icon corresponding to a map.

[0071] For example, Figure 6 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment. Figure 6As shown, the desktop interface includes three sub-interfaces. The first sub-interface is the main interface, including program card 1, program card 2, and program card 3. The second sub-interface includes program card 4, program card 5, and program card 6. The third sub-interface includes program card 7. The window view 600 corresponds to the desktop interface and includes three sub-areas. The first sub-area 610 includes icon 1, icon 2, and icon 3. The second sub-area 620 includes icon 4, icon 5, and icon 6. The third sub-area 630 includes icon 7. Specifically, program card 1 and icon 1 correspond to the same application (e.g., application 1); program card 2 and icon 2 correspond to the same application (e.g., application 2); program card 3 and icon 3 correspond to the same application (e.g., application 3); program card 4 and icon 4 correspond to the same application (e.g., application 4); program card 5 and icon 5 correspond to the same application (e.g., application 5); program card 6 and icon 6 correspond to the same application (e.g., application 6); and program card 7 and icon 7 correspond to the same application (e.g., application 7).

[0072] In some embodiments, the first thumbnail layout refers to the spatial organization rules of the icons of n applications in the available display area in the initial state. The available display area is a window view of the cockpit display screen, or a virtual canvas of VR glasses or AR glasses. This disclosure primarily uses a window view of the cockpit display screen as an example for illustration.

[0073] In some embodiments, the first thumbnail layout defines the initial arrangement, size ratio, and relative position of the icons of n applications in the window view. The initial arrangement includes one or more of the following: the icons of the n applications are arranged horizontally to form a horizontal icon list; the icons of the n applications are arranged vertically to form a vertical icon list; or the icons of the n applications are arranged in a grid matrix, with the arrangement automatically adapted according to the screen shape, user settings, or scene mode. The embodiments of this disclosure primarily use the arrangement of the icons of the n applications arranged horizontally as an example for illustration.

[0074] In some embodiments, all icons within the first thumbnail layout are set to have the same preset size, for example... Figure 6 The seven icons in the first thumbnail layout have a uniform icon size or a base icon size. In some embodiments, the icons within the first thumbnail layout have different sizes. For example, the size of the icons within the first thumbnail layout is 1.5 times or 3 times the size of the base icon size. Furthermore, the size of the icons within the first thumbnail layout can be dynamically adjusted.

[0075] In some embodiments, the first thumbnail layout corresponds to the first layout. In the initial state, the icons of n applications are arranged horizontally in sequence in the window view, and the program cards of n applications are also arranged horizontally in sequence on the desktop interface. When the icon of an application is at the x-th position in the window view, the program card of that application is also at the x-th position on the desktop interface; where x is a positive integer less than or equal to n.

[0076] In the embodiments of this disclosure, the x-th position in the desktop interface can be understood as the position of the x-th application card among the application cards of n applications, where the application cards are arranged horizontally in sequence and each application card is of the basic card size. The x-th position in the window view can be understood as the position of the x-th icon among the icons of n applications, where the icons are arranged horizontally in sequence and each icon is of the basic icon size. For example, as... Figure 6 As shown, icon 1 is in the first position in window view 600, and program card 1 is also in the first position on the desktop interface; icon 7 is in the seventh position in window view 600, and program card 7 is also in the seventh position on the desktop interface.

[0077] In the embodiments of this disclosure, displaying a window view on the cockpit display screen can help users quickly locate the target application and perform operations on the target application; and displaying (or calling up) the window view only when a specific condition (first condition) is met can improve efficiency.

[0078] Optionally, layout adjustments for the application can include the following methods: Method 1: In response to a first control operation on the program card of the first application among n applications, the program card of the first application is switched to the icon of the first application; following the first control operation, the icon of the first application is moved.

[0079] Method 2: In response to a second control operation on the program card of the second application among n applications, the icon of the second application is switched to the program card of the second application; following the second control operation, the program card of the second application is moved.

[0080] Method 3, in response to a first operation on the program card of a third application among n applications, controls the program cards of the n applications arranged according to the first layout to be adjusted to the program cards of the m applications arranged according to the second layout; and controls the icons of the n applications arranged according to the first thumbnail layout to be adjusted to the icons of the m applications arranged according to the second thumbnail layout.

[0081] Method 4, in response to a second operation on the icon of a third application among n applications, controls the icons of the n applications arranged according to the first thumbnail layout to be adjusted to the icons of the t applications arranged according to the third thumbnail layout; and controls the program cards of the n applications arranged according to the first layout to be adjusted to the program cards of the t applications arranged according to the third layout.

[0082] The following sections will provide a detailed explanation of each of these methods.

[0083] Method 1: In response to a first control operation on the program card of the first application among n applications, the program card of the first application is switched to the icon of the first application; following the first control operation, the icon of the first application is moved.

[0084] Optionally, the human-computer interaction method for the cockpit display screen may include the following steps: Step 230: In response to a first control operation on the program card of the first application among the n applications, switch the program card of the first application to the icon of the first application; following the first control operation, move the icon of the first application.

[0085] In some embodiments, in response to a first control operation on the program card of the first application among n applications, the program card of the first application is switched to the icon of the first application, and in response to the user's release operation, the program card of the first application is automatically moved to a program card display position on the desktop interface (such as the first program card display position on the desktop interface).

[0086] In some embodiments, in response to a first control operation on a program card of a first application among n applications, switching the program card of the first application to an icon of the first application; and moving the icon of the first application following the first control operation, includes: switching the program card of the first application to an icon of the first application upon detecting a first control operation on a program card of the first application; and moving the icon of the first application following a drag path of the first control operation.

[0087] Specifically, upon detecting a first control operation on the program card of the first application, switching the program card of the first application to the icon of the first application includes: upon detecting a first control operation on the program card of the first application, switching the program card of the first application to a preset card, and displaying the icon of the first application in the preset card. It should be noted that before detecting the first control operation, the corresponding position of the icon of the first application in the window view can be considered as the original position (or original display position) of the icon of the first application. Optionally, the icon of the first application displayed in the preset card differs from the icon of the first application displayed in its original position (or original display position) in one or more of the following aspects: size, color, and brightness. For example, the size of the icon of the first application displayed in its original position (or original display position) is smaller than the size of the icon of the first application displayed in the preset card, and / or, the color of the icon of the first application displayed in its original position (or original display position) is a first color, and the color of the icon of the first application displayed in the preset card is a second color.

[0088] Wherein, the first application is any one of the n applications. Optionally, the first control operation on the program card of the first application includes, but is not limited to, a click and drag operation, a click and drag down operation, a click and drag up operation, a swipe down or drag down operation, a swipe up or drag up operation, a swipe left or drag up operation, and a swipe right or drag down operation. Optionally, the preset card satisfies at least one of the following: the display size of the preset card is smaller than the display size of the program card of the first application; the display size of the preset card is larger than the display size of the icon of the first application; the preset card displays a predefined background color. Optionally, the predefined background color can be gray, pink, etc., and this disclosure does not limit it. Further, the preset card can display a prompt, for example, the preset card can display the words "Drag to adjust sort" to indicate the user's operation. Optionally, during the dragging process of the first control operation, when the size of the preset card is reduced to a certain size (preconfigured), the displayed words on the preset card (such as "Drag to adjust sort") will disappear.

[0089] For example, Figure 7 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment. Figure 7As shown, the desktop interface includes three sub-interfaces, and correspondingly, the window view includes three sub-areas. For simplicity, only the first sub-interface of the desktop interface is shown here. Upon detecting a first control operation 710 (such as clicking without dragging) on ​​program card 2, program card 2 is switched to a preset card 720. Optionally, the preset card 720 is gray, and icon 2 and the words "Drag to adjust sort" can be displayed on the preset card 720, allowing the user to perform subsequent operations based on this prompt.

[0090] In some embodiments, the first control operation includes moving the application card of a first application in the desktop interface to another location in the cockpit display that is neither the desktop interface nor a window view. For example, in some embodiments, the application card of the first application in the desktop interface is moved out of the displayable area of ​​the cockpit display. In this case, the application card of the first application will not be displayed on the desktop interface, and the icon of the first application will not be displayed in the window view.

[0091] In some embodiments, during the dragging process of the first control operation, the display size of the preset card gradually decreases. Further, during the dragging process of the first control operation, the display size of the icon of the first application displayed in the preset card remains unchanged. Optionally, the minimum size of the preset card is equal to the size of the icon of the first application. This can be understood as the application card of the first application switching to the icon of the first application.

[0092] Specifically, moving the icon of the first application following the drag path of the first control operation includes: moving the icon of the first application along the drag direction of the drag path of the first control operation. For example, the first control operation is a click and drag downwards operation, moving the icon of the first application downwards. Alternatively, the first control operation is a click and drag upwards operation, moving the icon of the first application upwards.

[0093] Step 240: Based on the end position of the first control operation, adjust the display position of the icon of the first application in the window view.

[0094] In some embodiments, adjusting the display position of the first application's icon in the window view based on the end position of the first control operation includes: if the end position of the first control operation is within the window view, displaying the first application's icon at a first icon display position in the window view, and de-displaying the first application's icon at a second icon display position in the window view; wherein, the first icon display position is the icon display position corresponding to the end position of the first control operation, and the second icon display position is the icon display position where the first application's icon was located before the first control operation was detected. Optionally, the first icon display position may be the same as the second icon display position, or the first icon display position may be different from the second icon display position. In one possible implementation, the first icon display position and the second icon display position are different.

[0095] For example, such as Figure 7 As shown, the first control operation 710 for program card 2 is a click and drag operation. If the end position of the first control operation 710 is within the window view (such as the second sub-area), then icon 2 is displayed at the first icon display position in the window view. For example, if the end position of the first control operation 710 is located at the position of the first icon in the second sub-area of ​​the window view, that is, the first icon display position is the position of icon 4, then icon 2 is displayed at the position of icon 4 in the window view, and the display of icon 2 at the original position of icon 2 is canceled in the window view.

[0096] Optionally, the application card of the first application is located in the first sub-interface among multiple sub-interfaces; adjusting the display position of the icon of the first application in the window view based on the end position of the first control operation includes: if the end position of the first control operation is located in the first sub-region among multiple sub-regions, then adjusting the display position of the icon of the first application in the first sub-region. Here, the first sub-region is the sub-region corresponding to the first sub-interface. This can be understood as follows: when the user drags the application card of the first application located in the first sub-interface into the window view, the original display position of the icon of the first application is in the first sub-region, and the end position of the drag remains in the first sub-region.

[0097] For example, such as Figure 7 As shown, program card 2 is located in the first sub-interface of the desktop interface, and correspondingly, icon 2 is located in the first sub-area of ​​the window view. The first control operation 710 for program card 2 is a click and drag operation. If the end position of the first control operation 710 is located at the position of icon 3 in the window view, which is still within the first sub-area of ​​the window view, then the display position of icon 2 in the first sub-area is adjusted, and icon 2 is moved to the original position of icon 3.

[0098] Alternatively, the application card of the first application is located in the first sub-interface of multiple sub-interfaces; based on the end position of the first control operation, the display position of the first application icon in the window view is adjusted, including: if the end position of the first control operation is located in the second sub-region of multiple sub-regions, then the icon of the first application is displayed in the second sub-region, and the icon of the first application is undisplayed in the first sub-region; wherein, the first sub-region is the sub-region corresponding to the first sub-interface, and the second sub-region is another sub-region different from the first sub-region. This can be understood as the user dragging the application card of the first application located in the first sub-interface into the window view; the original display position of the first application icon is located in the first sub-region, and the end position of the drag is located in another sub-region different from the first sub-region.

[0099] For example, such as Figure 7 As shown, program card 2 is located in the first sub-interface of the desktop interface, and correspondingly, icon 2 is located in the first sub-area of ​​the window view. The first control operation 710 for program card 2 is a click and drag operation. If the end position of the first control operation 710 is located at the position of icon 4 in the window view, which belongs to the second sub-area of ​​the window view, then the display position of icon 2 is adjusted in the second sub-area, moving icon 2 to the original position of icon 4.

[0100] In some embodiments, in response to adjusting the display position of the icon of the first application in the window view, the final display position of the icon of the first application in the window view is determined, and the program card of the first application is displayed at the first program card display position in the desktop interface; wherein, the first program card display position is the program card display position corresponding to the final display position of the icon of the first application in the window view. For example, when a user drags the program card of the first application into the window view and releases it, the display position of the icon of the first application is dynamically adjusted within the window view according to the end position of the drag (the icon of the first application disappears from its original display position and appears at the new display position), and the display position of the program card of the first application in the desktop view is automatically and synchronously adjusted, so that the display position of the program card of the first application in the desktop view corresponds to the display position of the icon of the first application. Optionally, the first program card display position may be the same as the original display position of the program card of the first application, or the first program card display position may be different from the original display position of the program card of the first application. In one possible implementation, the first program card display position is different from the original display position of the program card of the first application.

[0101] In some embodiments, in response to adjusting the display position of the icon of the first application in the window view, determining the final display position of the icon of the first application in the window view, and displaying the application card of the first application at the first application card display position in the desktop interface, includes: if the final display position of the icon of the first application in the window view is located in a first sub-region in the window view, then displaying the application card of the first application at the first application card display position in the desktop interface, wherein the first application card display position is located in a first sub-interface of the desktop interface. The first sub-region is a sub-region corresponding to the first sub-interface.

[0102] For example, the program card of the first application is located in the first sub-interface among multiple sub-interfaces. If the end position of the first control operation is located in the first sub-region among multiple sub-regions, the display position of the icon of the first application is adjusted in the first sub-region. It can be determined that the final display position of the icon of the first application in the window view is located in the first sub-region of the window view. Then, the program card of the first application is displayed at the first program card display position in the desktop interface, and the first program card display position is located in the first sub-interface of the desktop interface.

[0103] like Figure 7 As shown, program card 2 is located in the first sub-interface of the desktop interface, and correspondingly, icon 2 is located in the first sub-area of ​​the window view. The first control operation 710 for program card 2 is a click and drag operation. If the ending position of the first control operation 710 is within the original position of icon 3 in the window view, still belonging to the first sub-area of ​​the window view, then the display position of icon 2 is adjusted in the first sub-area, moving icon 2 to the original position of icon 3, and displaying program card 2 at the first program card display position on the desktop interface. The first program card display position is located in the first sub-interface of the desktop interface where program card 3 (i.e.,...) was originally located. Figure 7 The location of program card 3 shown.

[0104] In some embodiments, in response to adjusting the display position of the icon of the first application in the window view, determining the final display position of the icon of the first application in the window view, and displaying the program card of the first application at the first program card display position in the desktop interface, includes: if the final display position of the icon of the first application in the window view is located in a second sub-region in the window view, then displaying the program card of the first application at the first program card display position in the desktop interface, wherein the first program card display position is located in a second sub-interface of the desktop interface; wherein the first sub-region is a sub-region corresponding to the first sub-interface, the second sub-region is a sub-region corresponding to the second sub-interface, and the second sub-region is another sub-region different from the first sub-region.

[0105] For example, the application card of the first application is located in the first sub-interface of a plurality of sub-interfaces. If the end position of the first control operation is located in the second sub-region of the plurality of sub-regions, then the icon of the first application is displayed in the second sub-region, and the icon of the first application is de-displayed in the first sub-region. It can be determined that the final display position of the icon of the first application in the window view is located in the second sub-region of the window view. Then, the application card of the first application is displayed at the first application card display position in the desktop interface, and the first application card display position is located in the second sub-interface of the desktop interface. Here, the first sub-region is the sub-region corresponding to the first sub-interface, the second sub-region is the sub-region corresponding to the second sub-interface, the second sub-region is another sub-region different from the first sub-region, and the second sub-interface is another sub-interface different from the first sub-interface.

[0106] like Figure 7 As shown, program card 2 is located in the first sub-interface of the desktop interface, and correspondingly, icon 2 is located in the first sub-area of ​​the window view. The first control operation 710 for program card 2 is a click and drag operation. If the end position of the first control operation 710 is located in the original position of icon 4 within the window view, which belongs to the second sub-area of ​​the window view, then the display position of icon 2 is adjusted in the second sub-area, moving icon 2 to the original position of icon 4, and displaying program card 2 in the first program card display position on the desktop interface. The first program card display position is located in the second sub-interface of the desktop interface where program card 4 was originally located (the first program card display position in the second sub-interface).

[0107] Furthermore, in response to displaying the program card of the first application at the first program card display position in the desktop interface, the display positions of the program cards of other applications besides the first application in the desktop interface are adjusted; based on the display positions of the program cards of other applications, the display positions of the icons of other applications in the window view are adjusted; wherein the display positions of the program cards of other applications correspond to the display positions of the icons of other applications.

[0108] Optionally, if the display position of the first application card is the same as the original display position of the application card of the first application, the display positions of the application cards of other applications besides the first application in the desktop interface do not need to be adjusted. Accordingly, the display positions of the icons of other applications besides the first application in the window view also do not need to be adjusted.

[0109] Alternatively, if the first application card is displayed after the original display position of the first application's application card, the application cards of other applications between the original display position of the first application's application card and the first application card display position are moved forward. Correspondingly, the icons of other applications between the original display position of the first application's icon (the second icon display position) and the first icon display position are moved forward.

[0110] Alternatively, if the first application card display position precedes the original display position of the first application's application card, the application cards of other applications between the first application card display position and the original display position of the first application's application card are shifted backward. Correspondingly, the icons of other applications between the first icon display position and the original display position (second icon display position) of the first application's icon are shifted backward.

[0111] In some embodiments, a first control operation on the application card of a first application directly or indirectly affects the position and / or size and / or visibility of the icons of n applications, causing a change in the first thumbnail layout. In some embodiments, a first control operation on the application card of a first application directly or indirectly affects the position and / or size and / or visibility of the application cards of n applications, thereby causing a change in the first layout.

[0112] In some embodiments, in response to a first control operation on the program card of a first application among n applications, the program card of the first application is switched to the icon of the first application, and the icons of the n applications arranged according to a first thumbnail layout are moved to obtain icons of m applications arranged according to a second thumbnail layout; and in the desktop interface, the program cards of the n applications arranged according to the first layout are moved accordingly to obtain program cards of the m applications arranged according to the second layout. Here, the second thumbnail layout corresponds to the second layout, and m is a positive integer.

[0113] In some embodiments, controlling the program cards of n applications arranged in a first layout to be adjusted to program cards of m applications arranged in a second layout includes: dynamically adjusting the size, position, and display or visibility state of one or more program cards among the n program cards according to the direction of movement and / or the distance of movement, and adjusting them to program cards of m applications arranged in the second layout; controlling the icons of n applications arranged in a first thumbnail layout to be adjusted to icons of m applications arranged in the second thumbnail layout includes: dynamically adjusting the size, position, and display or visibility state of one or more icons among the n icons according to the direction of movement and / or the distance of movement, and adjusting them to icons of m applications arranged in the second thumbnail layout.

[0114] The second layout and the second abbreviated layout will be explained in detail below.

[0115] Optionally, the second layout is a spatial organization rule different from the first layout, which defines the size, position, and visibility status of the adjusted m program cards within the currently available display area; the second thumbnail layout is a spatial organization rule different from the first thumbnail layout, which defines the size, position, and visibility status of the adjusted m icons within the currently available display area.

[0116] In some embodiments, the first layout and the second layout include the same number of application cards, and the first thumbnail layout and the second thumbnail layout also include the same number of icons. The process of adjusting the application cards of n applications arranged according to the first layout to the application cards of m applications arranged according to the second layout includes operations such as moving some or all application cards to the left, moving them to the right, or swapping their positions. The process of adjusting the icons of n applications arranged according to the first thumbnail layout to the icons of m applications arranged according to the second thumbnail layout includes operations such as moving some or all icons to the left, moving them to the right, or swapping their positions.

[0117] In some embodiments, the first layout and the second layout include different numbers of application cards, and the first thumbnail layout and the second thumbnail layout also include different numbers of icons. The process of adjusting the application cards of n applications arranged according to the first layout to the application cards of m applications arranged according to the second layout includes some or all of the application cards being moved in or out. The process of adjusting the icons of n applications arranged according to the first thumbnail layout to the icons of m applications arranged according to the second thumbnail layout includes some or all of the icons being moved in or out.

[0118] For example, in response to a first operation (e.g., removing from the desktop or the available display area) on a program card (e.g., program card 1) of a first application among n applications, the program cards of the n applications arranged according to the first layout are adjusted to program cards of m applications arranged according to the second layout; and the icons of the n applications arranged according to the first thumbnail layout are adjusted to icons of the m applications arranged according to the second thumbnail layout. The resulting second layout includes n-1 program cards, and the second thumbnail layout also includes n-1 icons. Therefore, the number of program cards included in the first layout and the second layout are different, and the number of icons included in the first thumbnail layout and the second thumbnail layout are also different.

[0119] In some embodiments, when the card sizes of at least one application card in the first layout and the second layout are different, the process of adjusting the application cards of n applications arranged according to the first layout to the application cards of m applications arranged according to the second layout includes a continuous or stepwise change in the card sizes of one or more application cards. In some embodiments, when the icon sizes of at least one icon in the first thumbnail layout and the second thumbnail layout are different, the process of adjusting the icons of n applications arranged according to the first thumbnail layout to the icons of m applications arranged according to the second thumbnail layout includes a continuous or stepwise change in the icon sizes of one or more icons.

[0120] In some embodiments, during the process of adjusting the application cards of n applications arranged according to a first layout to the application cards of m applications arranged according to a second layout, the application cards of the adjusted applications (such as the application card of the first application) display default fill content. Optionally, the default fill content includes, but is not limited to, at least one of the following: a static placeholder image, cached content from the previous frame, and a solid color background. A static placeholder image refers to the static icon of the application or a general graphic representing its functional category, such as the default fill content for XX Music being the icon of XX Music or a musical note symbol; cached content from the previous frame refers to the content displayed by the application at the last moment before the layout adjustment, such as the default fill content for the application card of XX Navigation being a screenshot of a static map of the nearest intersection when it is zoomed out; a solid color background refers to the application's theme color or the system's default color filling the card area. This disclosure primarily uses a solid color background as an example for the default fill content.

[0121] For example, Figure 8 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment. Figure 8 As shown, Figure 8 Subgraph a consists of program cards of n applications arranged according to the first layout and icons of n applications arranged according to the first thumbnail layout. Figure 8 Sub-image b consists of application cards for m applications arranged according to the second layout and icons for m applications arranged according to the second thumbnail layout. In response to a first control operation on the application card (application card 3) of the first application among the seven applications, the control program card 3 is switched to icon 3. Based on the end position of the first control operation, the first icon display position (corresponding to) in the window view is adjusted. Figure 8 Icon 3 is displayed at the location of icon 3 in sub-image b. Optionally, since icon 3 is located in the first icon display position, and the first icon display position is after the icons of all applications, the control is located in the second icon display position (corresponding to...). Figure 8The icons (icons 4, 5, 6, and 7) between the position of icon 3 in sub-figure a and the first icon display position are moved forward one position in sequence in the window view, resulting in the icons of the six applications arranged according to the second thumbnail layout. Correspondingly, in the desktop interface, program cards 4, 5, 6, and 7 are moved forward one position in sequence, resulting in program cards of the six applications arranged according to the second layout. Alternatively, since program card 3 is switched to icon 3, program cards 4, 5, 6, and 7 are moved forward one position in sequence in the desktop interface, resulting in program cards of the six applications arranged according to the second layout. Correspondingly, icons 4, 5, 6, and 7 are moved forward one position in sequence in the window view, resulting in the icons of the six applications arranged according to the second thumbnail layout.

[0122] In the embodiments of this disclosure, by performing a first control operation on the program card in the desktop interface, the program card in different sub-interfaces can be edited, that is, cross-screen editing can be achieved, thereby improving operation efficiency and ease of use, and enhancing the human-computer interaction experience.

[0123] It is necessary to understand that Figure 2 Taking steps 210 to 240 as examples only, a possible implementation of the human-computer interaction method for the cockpit display screen is shown, which does not limit this disclosure.

[0124] Method 2: In response to a second control operation on the program card of the second application among n applications, the icon of the second application is switched to the program card of the second application; following the second control operation, the program card of the second application is moved.

[0125] Optionally, the human-computer interaction method for the cockpit display screen may include the following steps: Step 250: In response to a second control operation on the icon of the second application among the n applications, the icon of the second application is switched to the program card of the second application; following the second control operation, the program card of the second application is moved.

[0126] In some embodiments, in response to a second control operation on the icon of a second application among n applications, switching the icon of the second application to a program card of the second application; following the second control operation, moving the program card of the second application includes: switching the icon of the second application to a program card of the second application upon detecting a second control operation on the icon of the second application; and moving the program card of the second application following a drag path of the second control operation.

[0127] Specifically, when a second control operation is detected targeting the icon of the second application, switching the icon of the second application to the application card of the second application includes: when a second control operation is detected targeting the icon of the second application, displaying a preset card and displaying the icon of the second application in the preset card; and when the second control operation satisfies a second condition, switching the preset card to the application card of the second application.

[0128] Optionally, the second condition includes, but is not limited to, one or more of the following: detecting that a preset card has moved to the program card display position; detecting that a preset card has expanded to the size of a program card; a long press duration exceeding a preset threshold; and an operation trajectory including a set path. When the second control operation satisfies the second condition, the preset card is switched to the program card of the second application; the preset card and the icon of the second application displayed in the preset card are de-displayed. It is important to note that the disappearance (de-display) of the preset card and the disappearance (de-display) of the icon of the second application displayed in the preset card occur simultaneously. In other words, when the preset card disappears from the cockpit display screen interface, its content, i.e., the icon of the second application, is also simultaneously removed from the cockpit display screen interface, thereby ensuring a smooth transition of interface elements and no redundant display elements remain.

[0129] The second application is any one of the n applications. Optionally, the second application can be the same as the first application. Alternatively, the second application can be different from the first application. Optionally, the second control operation for the program card of the second application includes, but is not limited to, click and drag operation, click and drag down operation, click and drag up operation, swipe down or drag down operation, swipe up or drag up operation, swipe left or drag up operation, and swipe right or drag down operation. Optionally, the preset card satisfies at least one of the following: the display size of the preset card is smaller than the display size of the program card of the first application; the display size of the preset card is larger than the display size of the icon of the first application; the preset card displays a predefined background color. Optionally, the predefined background color can be gray, pink, etc., and this disclosure does not limit it. Further, the preset card can display prompts, for example, the preset card can display the words "Drag to adjust sort" to indicate the user's operation.

[0130] For example, Figure 9 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment. Figure 9As shown, the desktop interface includes three sub-interfaces, and correspondingly, the window view includes three sub-areas. For simplicity, only the second sub-interface of the desktop interface is shown here. Upon detecting a second control operation on icon 5 (such as clicking without dragging), icon 5 is switched to the preset card 910. Optionally, the preset card 920 is gray.

[0131] In some embodiments, the second control operation includes moving the icon of the second application in the window view to another location on the cockpit display screen that is neither the desktop interface nor the window view. For example, in some embodiments, the icon of the second application in the window view is moved out of the displayable area of ​​the cockpit display screen. In this case, the application card of the second application will not be displayed on the desktop interface, and the icon of the second application will not be displayed in the window view.

[0132] In some embodiments, during the dragging process of the second control operation, the display size of the preset card gradually increases. Further, during the dragging process of the second control operation, the display size of the icon of the second application displayed in the preset card remains unchanged. Optionally, the maximum size of the preset card is equal to the size of the application card of the second application. This can be understood as the preset card switching to the application card of the second application.

[0133] Specifically, moving the application card of the second application based on the drag path of the second control operation includes: moving the application card of the second application along the drag direction of the drag path of the second control operation.

[0134] Step 260: Based on the end position of the second control operation, adjust the display position of the program card of the second application in the desktop interface.

[0135] In some embodiments, adjusting the display position of the application card of the second application in the desktop interface based on the end position of the second control operation includes: if the end position of the second control operation is located within the desktop interface, then displaying the application card of the second application in the second application card display position in the desktop interface; wherein, the second application card display position is the application card display position corresponding to the end position of the second control operation.

[0136] For example, such as Figure 9 As shown, the second control operation for icon 5 is a click and drag operation. If the end position of the second control operation is within the desktop interface (such as the second sub-interface), then program card 5 will be displayed in the second program card display position on the desktop interface. For example, if the end position of the second control operation is located in the position of the third program card in the second sub-interface of the desktop interface, then program card 5 will be displayed in that position.

[0137] Optionally, the icon of the second application is located in the first sub-region of multiple sub-regions; based on the end position of the second control operation, the display position of the application card of the second application in the desktop interface is adjusted, including: if the end position of the second control operation is located in the first sub-interface of multiple sub-interfaces, then the display position of the application card of the second application in the first sub-interface is adjusted. This can be understood as follows: when the user drags the icon of the second application located in the first sub-region into the desktop interface, the original display position of the application card of the second application is in the first sub-interface, and the end position of the drag remains in the first sub-interface.

[0138] Alternatively, the icon of the second application is located in the first sub-region of multiple sub-regions; based on the end position of the second control operation, the display position of the application card of the second application in the desktop interface is adjusted, including: if the end position of the second control operation is located in the second sub-interface of multiple sub-interfaces, then the application card of the second application is displayed in the second sub-interface; wherein, the second sub-interface is the sub-interface corresponding to the second sub-region, and the second sub-interface is another sub-interface different from the first sub-interface. This can be understood as the user dragging the icon of the second application located in the first sub-region into the desktop interface; the original display position of the application card of the second application is in the first sub-interface, and the end position of the drag is in another sub-interface different from the first sub-interface.

[0139] In some embodiments, in response to adjusting the display position of the application card of the second application in the desktop interface, the final display position of the application card of the second application in the desktop interface is determined, and the icon of the second application is displayed at the third icon display position in the window view; wherein, the third icon display position is the icon display position corresponding to the final display position of the application card of the second application in the desktop interface. For example, a user drags the icon of the second application located in the first sub-area into the desktop interface, and after releasing the drag, the display position of the application card of the second application in the desktop interface is dynamically adjusted according to the end position of the drag, and the display position of the icon of the second application in the window view is automatically and synchronously adjusted accordingly, so that the display position of the application card of the second application in the desktop interface corresponds to the display position of the icon of the second application in the window view. Optionally, the third icon display position may be the same as the original display position of the icon of the second application. Alternatively, the third icon display position may be different from the original display position of the icon of the second application. In one possible implementation, the third icon display position is different from the original display position of the icon of the second application.

[0140] In some embodiments, in response to adjusting the display position of the application card of the second application in the desktop interface, determining the final display position of the application card of the second application in the desktop interface, and displaying the icon of the second application at the third icon display position in the window view, includes: if the final display position of the application card of the second application in the desktop interface is located in a first sub-interface of the desktop interface, then displaying the icon of the second application at the third icon display position in the window view, wherein the third icon display position is located in a first sub-region of the window view. The first sub-interface is a sub-interface corresponding to the first sub-region.

[0141] For example, the icon of the second application is located in the first sub-region of multiple sub-regions (which can be understood as the original position of the icon of the second application being located in the first sub-region). If the end position of the second control operation is located in the first sub-interface of multiple sub-interfaces, then adjusting the display position of the program card of the second application in the first sub-interface can determine that the final display position of the program card of the second application in the desktop interface is located in the first sub-interface of the desktop interface. Then, the icon of the second application is displayed at the third icon display position in the window view, and the third icon display position is located in the first sub-region of the window view.

[0142] In some embodiments, in response to adjusting the display position of the application card of the second application in the desktop interface, determining the final display position of the application card of the second application in the desktop interface, and displaying the icon of the second application at the third icon display position in the window view, includes: if the final display position of the application card of the second application in the desktop interface is located in a second sub-interface of the desktop interface, then displaying the icon of the second application at the third icon display position in the window view, wherein the third icon display position is located in a second sub-region of the window view. The second sub-interface is a sub-interface corresponding to the second sub-region, and the second sub-interface is another sub-interface different from the first sub-interface.

[0143] For example, the icon of the second application is located in the first sub-region of multiple sub-regions (which can be understood as the original position of the icon of the second application being located in the first sub-region). If the end position of the second control operation is located in the second sub-interface of multiple sub-interfaces, it can be determined that the final display position of the program card of the second application in the desktop interface is located in the second sub-interface of the desktop interface. Then, the icon of the second application is displayed at the third icon display position in the window view, and the third icon display position is located in the second sub-region of the window view.

[0144] Furthermore, in response to displaying the icon of the second application at the third icon display position in the window view, the display positions of the icons of other applications besides the first application in the window view are adjusted; based on the display positions of the icons of other applications, the display positions of the program cards of other applications in the desktop interface are adjusted; wherein the display positions of the icons of other applications correspond to the display positions of the program cards of other applications.

[0145] Optionally, if the third icon display position is the same as the original display position of the second application's icon, the display positions of the icons of other applications besides the first application in the window view do not need to be adjusted. Correspondingly, the display positions of the program cards of other applications in the desktop interface also do not need to be adjusted.

[0146] Alternatively, if the third icon is displayed after the original display position of the second application's icon, the icons of other applications positioned between the original display position of the second application's icon and the third icon display position are moved forward. Correspondingly, the program cards of other applications positioned between the original display position of the second application's program card and its final display position on the desktop interface are moved forward.

[0147] Alternatively, if the third icon is displayed before the original display position of the second application's icon, the icons of other applications positioned between the third icon and the original display position of the second application's icon are shifted backward. Correspondingly, the program cards of other applications positioned between the final display position of the second application's program card on the desktop interface and its original display position are shifted backward.

[0148] In some embodiments, a second control operation on the icon of a second application directly or indirectly affects changes in the position and / or size and / or visibility of the icons of n applications, thereby causing a change in the first thumbnail layout. In some embodiments, a second control operation on the icon of a second application directly or indirectly affects changes in the position and / or size and / or visibility of the application cards of n applications, thereby causing a change in the first layout.

[0149] In some embodiments, in response to a second control operation on the icon of a second application among n applications, the icon of the second application is switched to a program card of the second application, and the program cards of the n applications arranged in a first layout are moved to obtain program cards of m applications arranged in a second layout; and in the window view, the icons of the n applications arranged in a first thumbnail layout are moved to obtain icons of m applications arranged in a second thumbnail layout.

[0150] For example, Figure 10 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment. Figure 10 As shown, Figure 10 Subgraph a consists of program cards of n applications arranged according to the first layout and icons of n applications arranged according to the first thumbnail layout. Figure 10 Sub-image b consists of application cards for m applications arranged according to the second layout and icons for m applications arranged according to the second thumbnail layout. In response to a second control operation targeting the icon (icon 3) of the second application among the seven applications, control icon 3 to switch to an application card, changing from sub-image a in 10 to... Figure 10 During the process of sub-image b, the size of the preset card gradually increases. Based on the end position of the second control operation, the second program card display position (corresponding to) in the desktop interface is adjusted. Figure 10 The program card 3 is displayed at the location of program card 3 in sub-figure b. Since program card 3 is located in the second program card display position, and the second program card display position is in the original display position of program card 3 (corresponding to...) Figure 10 Before the position of program card 3 in sub-figure a, the program cards (program card 4, program card 5, program card 6, and program card 7) located between the second program card display position and the original display position of program card 3 are successively shifted one position backward, resulting in the program cards of the 7 applications arranged according to the second layout. Correspondingly, control icons 4, 5, 6, and 7 are successively shifted one position backward in the window view.

[0151] In the embodiments of this disclosure, by performing a second control operation on the icon of the application, the icon of the second application is switched to the program card of the second application, and the display position of the program card of the second application is adjusted in the desktop interface based on the end position of the second control operation. Thus, the operation of the program card in the desktop interface can be indirectly realized by controlling the icon in the window view. In other words, the desktop interface layout can be adjusted by adjusting the window view layout, making the adjustment of the application more lightweight and convenient.

[0152] Method 3, in response to a first operation on the program card of a third application among n applications, controls the program cards of the n applications arranged according to the first layout to be adjusted to the program cards of the m applications arranged according to the second layout; and controls the icons of the n applications arranged according to the first thumbnail layout to be adjusted to the icons of the m applications arranged according to the second thumbnail layout.

[0153] Optionally, the human-computer interaction method for the cockpit display screen may include the following steps: Step 270: In response to the first operation on the program card of the third application among the n applications, control the program cards of the n applications arranged according to the first layout to be adjusted to the program cards of the m applications arranged according to the second layout; and control the icons of the n applications arranged according to the first thumbnail layout to be adjusted to the icons of the m applications arranged according to the second thumbnail layout. Wherein, the second thumbnail layout corresponds to the second layout, and m is a positive integer.

[0154] In some embodiments, the third application is any one of n applications. The first operation on the program card of the third application includes one or more of the following: a user initiates and sustains a dragging or moving gesture on the program card of the third application using a finger, stylus, or other input device for a period of time or distance. Optionally, the dragging or moving gesture is a continuous displacement gesture initiated and sustained along a direction generally parallel to the card arrangement direction, or the dragging or moving gesture is a continuous displacement gesture initiated and sustained along a direction generally perpendicular to the card arrangement direction; this disclosure does not limit this.

[0155] In some embodiments, a first operation on the application card of a third application directly affects the position and / or size and / or visibility of the application cards of n applications, causing a change in the first layout. In some embodiments, a first operation on the application card of a third application indirectly affects the position and / or size and / or visibility of the icons of n applications, thereby causing a change in the first thumbnail layout. In some embodiments, a first operation on the application card of a third application directly affects the position and / or size and / or visibility of the application cards of n applications, causing a change in the first layout. Since the first layout corresponds to the first thumbnail layout, a change in the first layout will also lead to a change in the first thumbnail layout.

[0156] In some embodiments, controlling the program cards of n applications arranged in a first layout to be adjusted to program cards of m applications arranged in a second layout includes: dynamically adjusting the size, position, and display or visibility state of one or more program cards among the n program cards according to the direction of movement and / or the distance of movement, and adjusting them to program cards of m applications arranged in the second layout; controlling the icons of n applications arranged in a first thumbnail layout to be adjusted to icons of m applications arranged in the second thumbnail layout includes: dynamically adjusting the size, position, and display or visibility state of one or more icons among the n icons according to the direction of movement and / or the distance of movement, and adjusting them to icons of m applications arranged in the second thumbnail layout.

[0157] For the differences between the second layout, the second abbreviated layout, the first layout and the second layout, and the first abbreviated layout and the second abbreviated layout, please refer to the corresponding descriptions in the above embodiments, which will not be repeated here.

[0158] In some embodiments, during the process of adjusting the program cards of n applications arranged according to the first layout to the program cards of m applications arranged according to the second layout, the program cards of the adjusted applications (such as the program cards of the first application) display default fill content. Optionally, the default fill content includes, but is not limited to, at least one of the following: a static placeholder image, cached content from the previous frame, and a solid color background. A static placeholder image refers to the static icon of the application or a general graphic representing its functional category, such as the default fill content for XX Music being the icon of XX Music or a musical note symbol; cached content from the previous frame refers to the content displayed by the application at the last moment before the layout adjustment, such as the default fill content for the XX Navigation program card being a screenshot of a static map of the nearest intersection when it is zoomed out; a solid color background refers to the application's theme color or the system's default color filling the card area. This disclosure primarily uses a solid color background as an example for illustration.

[0159] In some embodiments, the first operation includes a first movement operation; in response to the first operation on the program card of a third application among n applications, controlling the program cards of the n applications arranged according to a first layout to be adjusted to program cards of m applications arranged according to a second layout; and controlling the icons of the n applications arranged according to a first thumbnail layout to be adjusted to icons of the m applications arranged according to a second thumbnail layout, including: in response to the first movement operation on the program card of the third application among n applications, in the desktop interface, controlling the program card of the third application to move from a first position to a second position, and controlling the program cards of the n applications arranged according to the first layout to move in the opposite direction of the movement direction of the first movement operation, to obtain program cards of the m applications arranged according to the second layout; and in the window view, controlling the icon of the third application to move from a third position to a fourth position, and controlling the icon of the n applications arranged according to the first thumbnail layout to move in the opposite direction of the movement direction of the first movement operation, to obtain icons of the m applications arranged according to the second thumbnail layout. Wherein, the first position corresponds to the third position, and the second position corresponds to the fourth position.

[0160] In some embodiments, the first movement operation includes a backward / right movement operation. In response to the first movement operation (e.g., a backward / right movement operation) on the program card of a third application among n applications, in the desktop interface, the program card of the third application is controlled to move from a first position to a second position, and the program cards of the n applications arranged according to a first layout are controlled to move in the opposite direction of the movement direction of the first movement operation (e.g., a forward / left movement direction), resulting in program cards of m applications arranged according to a second layout; and in the window view, the icon of the third application is controlled to move from a third position to a fourth position, and the icons of the n applications arranged according to a first thumbnail layout are controlled to move in the opposite direction of the movement direction of the first movement operation (e.g., a forward / left movement direction), resulting in icons of m applications arranged according to a second thumbnail layout.

[0161] For example, Figure 11 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment. Figure 11 As shown, Figure 11 Subgraph a consists of program cards of n applications arranged in the first layout and icons of n applications arranged in the first thumbnail layout. Figure 11 Sub-image b consists of the application cards of m applications arranged according to the second layout and the icons of m applications arranged according to the second thumbnail layout. Figure 11 In sub-figure a, the desktop interface includes program cards of 7 applications arranged in the first layout. The window view corresponding to the desktop interface includes icons of these 7 applications arranged in the first thumbnail layout. Program card 1 is moved to the right (i.e., the program card of the third application is program card 1). Figure 11 Sub-figure b's desktop interface includes application cards for seven applications arranged in a second layout, and the window view corresponding to the desktop interface includes icons for these seven applications arranged in a second thumbnail layout. In response to a first movement operation on application card 1, application card 1 moves from a first position on the desktop interface (corresponding to...) Figure 11 The program card 1 in sub-image a is moved to the second position on the desktop interface (corresponding to...). Figure 11 The position of program card 1 in subgraph a); program cards 2, 3, and 4 move in the opposite direction to the rightward movement, that is, move one position to the left, or move forward to fill in the gap. Among them, program card 2 is moved from the second position on the desktop interface (corresponding to...). Figure 11 Move the program card 2 from its position in sub-image a to the first position on the desktop (corresponding to...). Figure 11 The location of program card 2 in sub-figure b), program card 3 is located in the 3rd position on the desktop interface (corresponding to Figure 11 The program card 3 in sub-image a is moved to the second position on the desktop interface (corresponding to...). Figure 11 The location of program card 3 in sub-figure b), program card 4 is located in the 4th position on the desktop interface (corresponding to Figure 11 The program card 4 in sub-image a is moved to the 3rd position on the desktop interface (corresponding to...). Figure 11 The position of program card 4 in sub-figure b). In the window view, in response to the first move operation of program card 1, icon 1 moves from the first position in the window view (corresponding to...). Figure 11 The position of icon 1 in sub-image a) is moved to the 4th position in the window view (corresponding to...). Figure 11 The position of icon 1 in sub-image b); icons 2, 3, and 4 are moved one position to the left in sequence, where icon 2 is moved from the second position in the window view (corresponding to...). Figure 11 The position of icon 2 in sub-image a) is moved to the first position in the window view (corresponding to...). Figure 11 The position of icon 2 in sub-image b), icon 3 is located at the 3rd position in the window view (corresponding to Figure 11 The position of icon 3 in sub-image a) is moved to the second position in the window view (corresponding to...). Figure 11 The position of icon 3 in sub-image b), icon 4 is located at the 4th position in the window view (corresponding to Figure 11 The position of icon 4 in sub-image a) is moved to the 3rd position in the window view (corresponding to...). Figure 11 (The location of icon 4 in subgraph b).

[0162] In some embodiments, the first movement operation includes a forward / leftward movement operation. In response to the first movement operation (e.g., a forward / leftward movement) on the program card of a third application among n applications, in the desktop interface, the program card of the third application is controlled to move from a first position to a second position, and the program cards of the n applications arranged according to a first layout are controlled to move in the opposite direction of the movement direction of the first movement operation (e.g., a backward / rightward movement direction), resulting in program cards of m applications arranged according to a second layout; and in the window view, the icon of the third application is controlled to move from a third position to a fourth position, and the icons of the n applications arranged according to a first thumbnail layout are controlled to move in the opposite direction of the movement direction of the first movement operation (e.g., a backward / rightward movement direction), resulting in icons of m applications arranged according to a second thumbnail layout.

[0163] For example, Figure 12This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment. Figure 12 As shown, Figure 12 Subgraph a consists of program cards of n applications arranged in the first layout and icons of n applications arranged in the first thumbnail layout. Figure 12 Sub-image b consists of the application cards of m applications arranged according to the second layout and the icons of m applications arranged according to the second thumbnail layout. Figure 12 In sub-figure a, the desktop interface includes program cards of 7 applications arranged in the first layout. The window view corresponding to the desktop interface includes icons of these 7 applications arranged in the first thumbnail layout. Program card 3 is moved to the left (i.e., the program card of the third application is program card 3). Figure 12 In sub-figure b, the desktop interface includes application cards for seven applications arranged in a second layout, and the window view corresponding to the desktop interface includes icons for these seven applications arranged in a second thumbnail layout. In response to a first move operation on application card 3, application card 3 moves from its third position to its first position on the desktop interface; application cards 1 and 2 move in the opposite direction to the leftward movement, i.e., to the right, where application card 1 moves from its first position to its second position on the desktop interface, and application card 2 moves from its second position to its third position. In the window view, in response to the first move operation on application card 3, icon 3 moves from its third position to its first position on the window view; icon 1 and icon 2 move to the right, where icon 1 moves from its first position to its second position on the window view, and icon 2 moves from its second position to its third position on the window view.

[0164] For example, Figure 13 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment. Figure 13 As shown, Figure 13 Sub-figure a indicates that program card 3 is moved to the left of program card 1. At this time, icon 3 is selected (represented by a dashed box). Figure 13 Sub-image b indicates that after the movement, both program card 1 and program card 2 move one position to the right. Ultimately, program card 1 will land in the first position of the first sub-interface of the desktop interface. Correspondingly, in the window view, both icon 1 and icon 2 move one position to the right. Ultimately, icon 3 will land in the first position of the first sub-area of ​​the window view. Before the final display position of program card 3 is determined, icon 3 is in a selected or editable state.

[0165] In some embodiments, the desktop interface includes multiple sub-interfaces, and one of the multiple sub-interfaces is displayed on the cockpit display at the same time; the first position and the second position are located in the same sub-interface; or, the first position and the second position are located in different sub-interfaces.

[0166] In some embodiments, the first and second positions are located in the same sub-interface, and the third and fourth positions are located in the same sub-region. For example, as shown... Figure 12 As shown, in the desktop interface, the first and second positions are both located in the first sub-interface, and in the window view, the third and fourth positions are both located in the first sub-area.

[0167] In some embodiments, the first and second positions are located in different sub-interfaces, and the third and fourth positions are located in different sub-regions. For example, as... Figure 11 As shown, in the desktop interface, the first position is located in the first sub-interface, and the second position is located in the second sub-interface; and in the window view, the third position is located in the first sub-area, and the fourth position is located in the second sub-area.

[0168] In some embodiments, the first movement operation includes: swapping the positions of two application cards. In response to the first movement operation of application cards for two applications among n applications (e.g., swapping the positions of application card 1 and application card 4), in the desktop interface, the application card of a third application is moved from a first position to a second position, and the application cards of the n applications arranged according to a first layout are moved to obtain application cards of m applications arranged according to a second layout; and in the window view, the icon of the third application is moved from a third position to a fourth position, and the icons of the n applications arranged according to a first thumbnail layout are moved to obtain icons of m applications arranged according to a second thumbnail layout.

[0169] For example, such as Figure 14 As shown, Figure 14 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment. Figure 14 As shown, Figure 14 Subgraph a consists of program cards of n applications arranged in the first layout and icons of n applications arranged in the first thumbnail layout. Figure 14 Sub-image b consists of the application cards of m applications arranged according to the second layout and the icons of m applications arranged according to the second thumbnail layout. Figure 14In sub-figure a, the desktop interface includes program cards of 7 applications arranged in the first layout, and the window view corresponding to the desktop interface includes icons of these 7 applications arranged in the first thumbnail layout. Program card 1 and program card 4 swap positions. Figure 14 In sub-figure b, the desktop interface includes application cards for seven applications arranged in a second layout, and the window view corresponding to the desktop interface includes icons for these seven applications arranged in a second thumbnail layout. In response to the swapping operation of application card 1 and application card 4, application card 1 moves from the first position to the fourth position on the desktop interface; application card 4 moves from the fourth position to the first position on the desktop interface, while the positions of the remaining application cards remain unchanged. In the embodiments of this disclosure, by performing a first operation on the application cards of the applications included in the desktop interface, the order of the application cards in the desktop interface can be directly changed, adjusting the layout of the desktop interface. This allows for quick focusing on key applications based on real-time needs in driving scenarios, eliminating the need to first search for the application's location, reducing complexity, and improving human-computer interaction efficiency and operational smoothness. Furthermore, performing the first operation on the application cards of the applications included in the desktop interface also indirectly changes the layout in the window view, allowing users to quickly locate target applications through the desktop interface and / or the window view, improving the human-computer interaction experience.

[0170] Method 4, in response to a second operation on the icon of a third application among n applications, controls the icons of the n applications arranged according to the first thumbnail layout to be adjusted to the icons of the t applications arranged according to the third thumbnail layout; and controls the program cards of the n applications arranged according to the first layout to be adjusted to the program cards of the t applications arranged according to the third layout.

[0171] Optionally, the human-computer interaction method for the cockpit display screen may include the following steps: Step 280: In response to the second operation on the icon of the third application among the n applications, control the icons of the n applications arranged according to the first thumbnail layout to be adjusted to the icons of the t applications arranged according to the third thumbnail layout; and control the program cards of the n applications arranged according to the first layout to be adjusted to the program cards of the t applications arranged according to the third layout.

[0172] The third abbreviated layout corresponds to the third layout, and t is a positive integer.

[0173] In some embodiments, the third application is any one of n applications, and the second operation on the icon of the third application includes one or more of the following: a user initiates and sustains a drag or move gesture on the icon of the third application using a finger, stylus, or other input device for a period of time or distance. Optionally, the drag or move gesture is a continuous displacement gesture initiated and sustained along a direction generally parallel to the card arrangement direction, or the drag or move gesture is a continuous displacement gesture initiated and sustained along a direction generally perpendicular to the card arrangement direction; this disclosure does not limit this.

[0174] In some embodiments, the second operation on the icon of the third application directly affects the position and / or size and / or visibility of the icons of n applications, causing a change in the first thumbnail layout. In some embodiments, the second operation on the icon of the third application indirectly affects the position and / or size and / or visibility of the application cards of n applications, thereby causing a change in the first layout. In some embodiments, the second operation on the icon of the third application directly affects the position and / or size and / or visibility of the icons of n applications, causing a change in the first thumbnail layout. Since the first layout corresponds to the first thumbnail layout, a change in the first thumbnail layout will also cause a change in the first layout (e.g., the first layout refreshes in real time as the first thumbnail layout changes).

[0175] In some embodiments, controlling the icons of n applications arranged in a first thumbnail layout to be adjusted to the icons of t applications arranged in a third thumbnail layout includes: dynamically adjusting the size, position, and display or visibility state of one or more of the n icons according to the direction of movement and / or the distance of movement, and adjusting them to the icons of the t applications arranged in the third thumbnail layout; controlling the program cards of the n applications arranged in the first layout to be adjusted to the program cards of the t applications arranged in the third layout includes: dynamically adjusting the size, position, and display or visibility state of one or more program cards of the n program cards according to the direction of movement and / or the distance of movement, and adjusting them to the program cards of the t applications arranged in the third layout.

[0176] Optionally, the third thumbnail layout is a spatial organization rule different from the first thumbnail layout. It defines the size, position, and visibility status of the adjusted t icons within the currently available display area. The third layout is a spatial organization rule different from the first layout. It defines the size, position, and visibility status of the adjusted t program cards within the currently available display area.

[0177] In some embodiments, the first layout and the third layout include the same number of application cards, and the first thumbnail layout and the third thumbnail layout also include the same number of icons. The process of adjusting the icons of n applications arranged according to the first thumbnail layout to the icons of t applications arranged according to the third thumbnail layout includes operations to move some or all icons to the left, to the right, or to swap positions; and the process of adjusting the application cards of n applications arranged according to the first layout to the application cards of t applications arranged according to the third layout includes operations to move some or all application cards to the left, to the right, or to swap positions.

[0178] In some embodiments, the first layout and the third layout include different numbers of application cards, and the first thumbnail layout and the third thumbnail layout also include different numbers of icons. The process of adjusting the icons of n applications arranged according to the first thumbnail layout to the icons of t applications arranged according to the third thumbnail layout includes some or all icon movement in or out operations (e.g., moving icons out of the window view); and the process of adjusting the application cards of n applications arranged according to the first layout to the application cards of t applications arranged according to the third layout includes some or all application card movement in or out operations (e.g., moving icons out of the desktop interface).

[0179] In some embodiments, when the card sizes of at least one application card in the first layout and the third layout are different, the process of adjusting the application cards of n applications arranged according to the first layout to the application cards of t applications arranged according to the third layout includes a continuous or stepwise change in the card sizes of one or more application cards. In some embodiments, when the icon sizes of at least one icon in the first thumbnail layout and the third thumbnail layout are different, the process of adjusting the icons of n applications arranged according to the first thumbnail layout to the icons of t applications arranged according to the third thumbnail layout includes a continuous or stepwise change in the icon sizes of one or more icons.

[0180] In some embodiments, during the process of adjusting the icons of n applications arranged according to a first thumbnail layout to the icons of t applications arranged according to a third thumbnail layout, the icons of the applications being adjusted (such as the icon of the third application) may be in a selected state or a blurred state (e.g., represented by a dashed border or a solid color background). This disclosure does not limit this.

[0181] In some embodiments, the second operation includes a second movement operation; in response to the second operation on the icon of a third application among n applications, controlling the icons of the n applications arranged in a first thumbnail layout to be adjusted to the icons of t applications arranged in a third thumbnail layout; and controlling the program cards of the n applications arranged in the first layout to be adjusted to the program cards of the t applications arranged in the third layout, including: in response to the second movement operation on the icon of the third application among n applications, in the window view, controlling the icon of the third application to move from a fifth position to a sixth position, and controlling the icons of the n applications arranged in the first thumbnail layout to move in the opposite direction of the movement direction of the second movement operation, to obtain the icons of the t applications arranged in the third thumbnail layout; and in the desktop interface, controlling the program cards of the third application to move from a seventh position to an eighth position, and controlling the program cards of the n applications arranged in the first layout to move in the opposite direction of the movement direction of the second movement operation, to obtain the program cards of the t applications arranged in the third layout.

[0182] The fifth position corresponds to the seventh position, and the sixth position corresponds to the eighth position.

[0183] In some embodiments, the second movement operation includes a backward / right movement operation. In response to the second movement operation (e.g., a backward / right movement operation) on the icon of a third application among n applications, in the window view, the icon of the third application is controlled to move from a fifth position to a sixth position, and the icons of the n applications arranged according to the first thumbnail layout are controlled to move in the opposite direction of the movement direction of the second movement operation (e.g., a forward / left movement direction), resulting in t application icons arranged according to the third thumbnail layout; and in the desktop interface, the program card of the third application is controlled to move from a seventh position to an eighth position, and the program cards of the n applications arranged according to the first layout are controlled to move in the opposite direction of the movement direction of the second movement operation (e.g., a forward / left movement direction), resulting in t application cards arranged according to the third layout.

[0184] For example, Figure 15 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment. Figure 15 As shown, Figure 15 Subgraph a consists of program cards of n applications arranged in the first layout and icons of n applications arranged in the first thumbnail layout. Figure 15 Sub-image b consists of the application cards of t applications arranged according to the third layout and the icons of t applications arranged according to the third thumbnail layout. Figure 15In sub-figure a, the desktop interface includes program cards of 7 applications arranged according to the first layout. The window view corresponding to the desktop interface includes icons of these 7 applications arranged according to the first thumbnail layout. Icon 5 is moved to the right (i.e., the icon of the third application is icon 5). Figure 15 Sub-figure b's desktop interface includes application cards for seven applications arranged in a third layout, and the corresponding window view includes icons for these seven applications arranged in a third thumbnail layout. In response to a second move operation on icon 5, in the window view, icon 5 moves from its fifth position (corresponding to...) Figure 15 The position of icon 5 in sub-image a) is moved to the sixth position (corresponding to...). Figure 15 The position of icon 5 in sub-figure b), icon 6 moves in the opposite direction of the second movement operation, that is, forward or left by one position. Also, in the desktop interface, program card 5 is moved from the seventh position (corresponding to...) Figure 15 The position of program card 5 in subgraph a) is moved to the eighth position (corresponding to...). Figure 15 (The position of program card 5 in subgraph b), and program card 6 is moved one position to the left.

[0185] In some embodiments, the second movement operation includes a forward / leftward movement operation. In response to the second movement operation (e.g., a forward / leftward movement operation) on the icon of a third application among n applications, in the window view, the icon of the third application is controlled to move from a fifth position to a sixth position, and the icons of the n applications arranged in the first thumbnail layout are controlled to move in the opposite direction of the movement direction of the second movement operation (e.g., a backward / rightward movement direction), resulting in t application icons arranged in the third thumbnail layout; and in the desktop interface, the application card of the third application is controlled to move from a seventh position to an eighth position, and the application cards of the n applications arranged in the first layout are controlled to move in the opposite direction of the movement direction of the second movement operation (e.g., a backward / rightward movement direction), resulting in t application cards arranged in the third layout.

[0186] For example, Figure 16 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment. Figure 16 As shown, Figure 16 Subgraph a consists of program cards of n applications arranged in the first layout and icons of n applications arranged in the first thumbnail layout. Figure 16 Sub-image b consists of the application cards of t applications arranged according to the third layout and the icons of t applications arranged according to the third thumbnail layout. Figure 16In sub-figure a, the desktop interface includes program cards of 7 applications arranged in the first layout, and the window view corresponding to the desktop interface includes icons of these 7 applications arranged in the first thumbnail layout, with icon 3 moved to the left. Figure 16 Sub-figure b's desktop interface includes application cards for six applications arranged in the third layout, and the corresponding window view includes icons for these six applications arranged in the third thumbnail layout. In response to a second movement operation of icon 3, icon 3 moves from its fifth position in the window view (corresponding to...). Figure 16 The position of icon 3 in sub-image a) is moved to the sixth position (corresponding to...). Figure 16 The position of icon 3 in sub-image b); icon 7 moves in the opposite direction to the leftward movement, that is, to the right, and moves from the second sub-region of the window view to the third sub-region. In the desktop interface, program card 3 moves from the seventh position (corresponding to...) Figure 16 The position of program card 3 in subgraph a) is moved to the eighth position (corresponding to...). Figure 16 (The position of program card 3 in sub-image b); program card 7 moves to the right and moves from the second sub-interface of the desktop interface to the third sub-interface.

[0187] In some embodiments, the window view includes multiple sub-regions, and multiple sub-regions are displayed simultaneously on the cockpit display; the fifth position and the sixth position are located in the same sub-region; or, the fifth position and the sixth position are located in different sub-regions.

[0188] In some embodiments, the fifth and sixth positions are located in the same sub-region. For example... Figure 15 As shown, both the fifth and sixth positions are located in the second sub-region of the window view.

[0189] In some embodiments, the fifth and sixth positions are located in different sub-regions. For example... Figure 16 As shown, the fifth position is located in the third sub-region of the window view, and the sixth position is located in the second sub-region of the window view.

[0190] In some embodiments, the second movement operation includes: swapping the positions of two icons. In response to the second movement operation (e.g., swapping the positions of icons 5 and 6) for n applications, in the window view, the icon of the third application is moved from the fifth position to the sixth position, and the icons of the n applications arranged according to the first thumbnail layout are moved to obtain icons of t applications arranged according to the third thumbnail layout; and in the desktop interface, the program card of the third application is moved from the seventh position to the eighth position, and the program cards of the n applications arranged according to the first layout are moved to obtain program cards of t applications arranged according to the third layout.

[0191] For example, such as Figure 15 As shown, Figure 15 Subgraph a consists of program cards of n applications arranged in the first layout and icons of n applications arranged in the first thumbnail layout. Figure 15 Sub-image b consists of application cards for t applications arranged according to the third layout and icons for t applications arranged according to the third thumbnail layout. In response to an operation that swaps the positions of icons 5 and 6 among the 7 applications, in the window view, control icon 5 is moved from the fifth position in the window view (corresponding to...). Figure 15 The position of icon 5 in sub-image a) is moved to the sixth position (corresponding to...). Figure 15 In sub-image b, icon 5 is located at a different position. Icon 6 moves from the sixth position to the fifth position in the window view. Also, in the desktop interface, program card 5 moves from the seventh position (corresponding to...) Figure 15 The position of program card 5 in subgraph a) is moved to the eighth position (corresponding to...). Figure 15 (The position of program card 5 in sub-figure b), program card 6 moves from the eighth position to the seventh position in the desktop interface.

[0192] In the embodiments of this disclosure, by performing a second operation on the icons of applications included in the window view, the layout of the window view can be changed, thereby changing the layout of the desktop interface. This expands the ways to adjust the desktop interface layout, allowing for quick focus on key applications based on real-time needs in driving scenarios, improving human-computer interaction efficiency and operational smoothness. In some embodiments, the display position of the window view is fixed. Specifically, the window view is displayed at a fixed position on the cockpit display screen 100. Optionally, the window view is located at the bottom of the cockpit display screen. Alternatively, the window map is located at the top of the cockpit display screen. For example, it is overlaid on the desktop interface, and the size of the window view is smaller than the desktop interface. In some embodiments, the window view is located on the side of the cockpit display screen, including the left and right sides. Alternatively, the window view is located in other positions on the cockpit display screen; this disclosure does not limit the scope of the comparison. By fixing the display of the window view, operations on the window view can be performed directly, saving time.

[0193] It should be noted that in the embodiments of this disclosure, methods 1 to 4 described above can be implemented independently or in combination, and all of them fall within the protection scope of this disclosure.

[0194] The following explains some special scenarios.

[0195] In some embodiments, the window view can be fixedly displayed on the cockpit display screen, without needing to meet the first condition. In the embodiments of this disclosure, fixing the window view on the cockpit display screen can help users quickly locate the target application and perform operations on the target application; displaying the window view through certain operations can save cockpit display screen resources, and the window view can be called up only when needed, improving efficiency.

[0196] In some embodiments, when a first sub-interface of a plurality of sub-interfaces is displayed on the cockpit display, in response to an operation on a second sub-region of the window view, the first sub-interface displayed on the cockpit display is switched to the second sub-interface; wherein the second sub-interface is the sub-interface corresponding to the second sub-region. Optionally, the first sub-interface can be any one of the plurality of sub-interfaces included in the desktop interface. The first sub-interface is the sub-interface corresponding to the first sub-region. When a first sub-interface of a plurality of sub-interfaces is displayed on the cockpit display, in response to an operation on a non-first sub-region of the window view, the first sub-interface displayed on the cockpit display can be switched to the sub-interface corresponding to a non-first sub-region. In some embodiments, an operation on the second sub-region of the window view includes: clicking any position within the second sub-region of the window view. For example, clicking an icon within the second sub-region of the window view. This disclosure does not limit this.

[0197] For example, Figure 17 This is a schematic diagram illustrating a desktop interface switching method according to an exemplary embodiment. For example... Figure 17 As shown, in response to clicking icon 4 in the second sub-area of ​​the window view (such as... Figure 17 Icon 4 in sub-figure a) switches the first sub-interface (including program card 1, program card 2 and program card 3) displayed on the cockpit display to the second sub-interface (including program card 4, program card 5 and program card 6).

[0198] In some embodiments, when a first sub-interface of a plurality of sub-interfaces is displayed on the cockpit display, in response to an operation on a third sub-region of the window view, the first sub-interface displayed on the cockpit display is switched to the third sub-interface; wherein, the third sub-interface is the sub-interface corresponding to the third sub-region. In some embodiments, the operation on the third sub-region of the window view includes: clicking any position in the third sub-region of the window view. For example, clicking an icon in the third sub-region of the window view. This disclosure does not limit this.

[0199] In the embodiments of this disclosure, the desktop interface (or main interface) can be switched by clicking on a sub-area in the window view, which is convenient and can improve the human-computer interaction experience.

[0200] In some embodiments, in the desktop interface, the application cards of n applications include a first type of application card with a first size and a second type of application card with a second size, the first size being different from the second size. In some embodiments, in the window view, the icons of the n applications include a first type of icon with a third size and a second type of icon with a fourth size, the third size being different from the fourth size. Optionally, the second size is 2 or 3 times the first size, and the fourth size is 2 or 3 times the third size.

[0201] For example, Figure 18 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment. Figure 18 As shown, in the desktop interface, program cards 1, 4, 5, 6, and 7 are first-class program cards with a first size; program cards 2 and 3 are second-class program cards with a second size. The second size is twice the size of the first size. Furthermore, in the window view, icons 1, 4, 5, 6, and 7 are first-class icons with a third size; icons 2 and 3 are second-class icons with a fourth size. The fourth size is twice the size of the third size.

[0202] In some embodiments, in response to a second operation on the icon of a first application among n applications, a first type of application card having a first size can be adjusted to a second type of application card having a second size, and a first type of icon having a third size can be adjusted to a second type of icon having a fourth size; conversely, a second type of application card having a second size can be adjusted to a first type of application card having a first size, and a second type of icon having a fourth size can be adjusted to a first type of icon having a third size.

[0203] For example, Figure 19 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment. Figure 19 Yes Figure 18 The result of moving icon 5 to the left. For example... Figure 19 As shown, Figure 19 In subgraph a, in response to a leftward movement operation for icon 5 in the window view, icon 5 ( Figure 19 (Displayed against a solid color background) from the ninth position ( Figure 18 The position of icon 5 in the image is moved to the tenth position. Figure 19 The location of icon 5 in the image is shown. Icons 2 and 3 have been resized from the fourth size to the third size, icon 4 has been moved one position to the left, and icons 6 and 7 have been moved two positions to the left. Correspondingly, in the desktop interface, program card 5 (…) Figure 19(Displayed against a solid color background) from the eleventh position ( Figure 18 The program card 5 in the program is moved to the twelfth position. Figure 19 (The position of program card 5 in the program), program card 2 and program card 3 are both adjusted from the second size to the first size, program card 4 is moved 1 position to the left, and program card 6 and program card 7 are both moved 2 positions to the left. Figure 19 In subgraph b, in response to a leftward movement operation for icon 5 in the window view, icon 5 moves from the ninth position in the window view. Figure 18 The position of icon 5 in the image is moved to the tenth position. Figure 19 The position of icon 5 in the image is shown. Icon 2 is adjusted from the fourth size to the third size. The size and position of icons 3 and 4 remain unchanged. Icons 6 and 7 are both moved one position to the left. Correspondingly, in the desktop interface, program card 5 is moved from the eleventh position (…). Figure 18 The program card 5 in the program is moved to the twelfth position. Figure 19 (The position of program card 5 in the program) Program card 2 is adjusted from the second size to the first size, the size and position of program card 3 and program card 4 remain unchanged, and program card 6 and program card 7 are both moved one position to the left.

[0204] In some embodiments, the desktop interface may include four sub-interfaces, each of which may include program cards for multiple applications. The window view corresponding to the desktop interface may include four sub-regions, each of which includes icons for multiple applications. This disclosure does not limit this aspect.

[0205] For example, Figure 20 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment. Figure 20 As shown, Figure 20In sub-figure a, the desktop interface includes four sub-interfaces: the first sub-interface includes program cards 1 and 2, the second includes program cards 3 and 4, the third includes program cards 5 and 6, and the fourth includes program card 7. The corresponding window view includes four sub-areas: the first sub-area includes icon 1 and icon 2, the second includes icon 3 and icon 4, the third includes icon 5 and icon 6, and the fourth includes icon 7. Program cards 1, 4, 6, and 7 are first-type program cards with a first size; program cards 2, 3, and 5 are second-type program cards with a second size, which is twice the size of the first size. Furthermore, in the window view, icon 1, 4, 6, and 7 are first-type icons with a third size; icon 2, 3, and 5 are second-type icons with a fourth size, which is twice the size of the third size. Figure 20 Subgraph b is a Figure 20 The result of moving application card 7 to the left in subgraph a. The icon or application card of the moved application is displayed with a solid color background, while the icon or application card of the affected application is displayed with a dotted background.

[0206] In some embodiments, a negative one screen (or negative one interface) exists in the desktop interface, and a negative one area exists in the window view corresponding to the desktop interface. In the negative one screen, the movement of application cards from applications outside the negative one screen is not supported. Application cards from applications within the negative one screen can be freely moved out, but once moved out, they cannot be moved back into the negative one screen. In the negative one area, the movement of application icons from applications outside the negative one area is not supported. Application icons from applications within the negative one area can be freely moved out, but once moved out, they cannot be moved back into the negative one area. Optionally, the user can specify which application cards are included in the negative one screen. The user can move the application cards of important / frequently used applications to the negative one screen, and the application cards of other applications will be moved accordingly. The user can also specify which application icons are included in the negative one area. The user can move the icons of important / frequently used applications to the negative one area, and the icons of other applications will be moved accordingly.

[0207] In some embodiments, the negative one screen refers to a quick information and service center located on the left or right side of the main desktop screen (desktop) in a smart cockpit or vehicle system. Correspondingly, the negative one area is also located on the left or right side of the window view. This disclosure does not limit this.

[0208] For example, Figure 21 This is a schematic diagram illustrating a human-computer interaction method for a cockpit display screen according to an exemplary embodiment. Figure 21As shown, the leftmost area of ​​the desktop interface has a negative one screen, which includes program card 1. Program card 1 can be freely moved out of the negative one screen, but once it is moved out, it cannot be moved back into the negative one screen. Correspondingly, the leftmost area of ​​the window view has a negative one region, which includes icon 1. Icon 1 can be freely moved out of the negative one region, but once it is moved out, it cannot be moved back into the negative one region.

[0209] In the embodiments of this disclosure, by designing a negative one screen, key applications can be fixed on the desktop interface to prevent accidental touches or deletions, meet the needs of different users, and improve the human-computer interaction experience.

[0210] In the embodiments of this disclosure, the operation methods of the application and the order of the application's program cards or icons can be expanded through the linkage interaction in the desktop interface and window view. Moving the application's program cards or icons can realize the layout adjustment of the global interface (such as the desktop interface), making the operation more convenient and improving the human-computer interaction experience.

[0211] The various embodiments disclosed herein can be combined in any way to form new embodiments, all of which are within the protection scope of this disclosure.

[0212] The following are embodiments of the apparatus disclosed herein, which can be used to execute embodiments of the method disclosed herein. For details not disclosed in the apparatus embodiments of this disclosure, please refer to the embodiments of the method disclosed herein.

[0213] Please refer to Figure 22 This diagram illustrates a block diagram of a human-machine interface device for a cockpit display screen according to an embodiment of the present disclosure. The human-machine interface device 2200 for the cockpit display screen has the function of performing the aforementioned human-machine interface method for a cockpit display screen. Figure 22 As shown, the device 2200 may include a display module 2210 and a processing module 2220.

[0214] Display module 2210 is used to display program cards of n applications arranged in a first layout on the desktop interface, where n is a positive integer.

[0215] The display module 2210 is further configured to display a window view corresponding to the desktop interface when a first condition is met. The window view displays icons of the n applications arranged in a first thumbnail layout, and the first thumbnail layout corresponds to the first layout.

[0216] Processing module 2220 is configured to, in response to a first control operation on the program card of a first application among the n applications, switch the program card of the first application to the icon of the first application; and, following the first control operation, move the icon of the first application.

[0217] The processing module 2220 is further configured to adjust the display position of the icon of the first application in the window view based on the end position of the first control operation.

[0218] In some embodiments, the processing module 2220 is further configured to: upon detecting the first control operation on the application card of the first application, switch the application card of the first application to the icon of the first application; and move the icon of the first application following the drag path of the first control operation.

[0219] In some embodiments, the processing module 2220 is further configured to: upon detecting the first control operation on the program card of the first application, switch the program card of the first application to a preset card, and display the icon of the first application in the preset card.

[0220] In some embodiments, the preset card satisfies at least one of the following: the display size of the preset card is smaller than the display size of the application card of the first application; the display size of the preset card is larger than the display size of the icon of the first application; the preset card displays a predefined background color.

[0221] In some embodiments, during the dragging process of the first control operation, the display size of the preset card is gradually reduced.

[0222] In some embodiments, the processing module 2220 is further configured to: follow the drag direction of the drag path of the first control operation to move the icon of the first application.

[0223] In some embodiments, the display module 2210 is further configured to: if the end position of the first control operation is located within the window view, display the icon of the first application at a first icon display position in the window view, and de-display the icon of the first application at a second icon display position in the window view; wherein, the first icon display position is the icon display position corresponding to the end position of the first control operation, and the second icon display position is the icon display position where the icon of the first application was located before the first control operation was detected.

[0224] In some embodiments, the desktop interface includes multiple sub-interfaces, the window view includes multiple sub-regions, and the cockpit display screen displays one of the multiple sub-interfaces at the same time; the number of sub-regions included in the window view is the same as the number of sub-pages included in the desktop interface, and the multiple sub-regions and the multiple sub-interfaces correspond one-to-one.

[0225] In some embodiments, the application card of the first application is located in the first sub-interface among the plurality of sub-interfaces; the processing module 2220 is further configured to: if the end position of the first control operation is located in the first sub-region among the plurality of sub-regions, then adjust the display position of the icon of the first application in the first sub-region; or, if the end position of the first control operation is located in the second sub-region among the plurality of sub-regions, then display the icon of the first application in the second sub-region and de-display the icon of the first application in the first sub-region; wherein, the first sub-region is a sub-region corresponding to the first sub-interface, and the second sub-region is another sub-region different from the first sub-region.

[0226] In some embodiments, the processing module 2220 is further configured to: in response to adjusting the display position of the icon of the first application in the window view, determine the final display position of the icon of the first application in the window view, and display the program card of the first application at a first program card display position in the desktop interface; wherein, the first program card display position is a program card display position corresponding to the final display position of the icon of the first application in the window view.

[0227] In some embodiments, the display module 2210 is further configured to: if the final display position of the icon of the first application in the window view is located in a first sub-region of the window view, then display the program card of the first application at a first program card display position in the desktop interface, wherein the first program card display position is located in a first sub-interface of the desktop interface; if the final display position of the icon of the first application in the window view is located in a second sub-region of the window view, then display the program card of the first application at a first program card display position in the desktop interface, wherein the first program card display position is located in a second sub-interface of the desktop interface; wherein the first sub-region is a sub-region corresponding to the first sub-interface, the second sub-region is a sub-region corresponding to the second sub-interface, and the second sub-region is another sub-region different from the first sub-region.

[0228] In some embodiments, the processing module 2220 is further configured to: in response to displaying the program card of the first application at the first program card display position in the desktop interface, adjust the display position of the program cards of other applications besides the first application in the desktop interface; and adjust the display position of the icons of the other applications in the window view based on the display position of the program cards of the other applications; wherein the display position of the program cards of the other applications corresponds to the display position of the icons of the other applications.

[0229] In some embodiments, the processing module 2220 is further configured to: switch the icon of the second application to a program card of the second application in response to a second control operation on the icon of the second application among the n applications; move the program card of the second application following the second control operation; and adjust the display position of the program card of the second application in the desktop interface based on the end position of the second control operation.

[0230] In some embodiments, the processing module 2220 is further configured to: upon detecting a second control operation targeting the icon of the second application, switch the icon of the second application to the application card of the second application; and move the application card of the second application following the drag path of the second control operation.

[0231] In some embodiments, the display module 2210 is further configured to: display a preset card and display the icon of the second application in the preset card when the second control operation for the icon of the second application is detected; the processing module 2220 is further configured to: switch the preset card to the program card of the second application when the second control operation satisfies the second condition.

[0232] In some embodiments, the processing module 2220 is further configured to: gradually increase the display size of the preset card during the dragging process of the second control operation.

[0233] In some embodiments, the display module 2210 is further configured to: if the end position of the second control operation is located within the desktop interface, display the program card of the second application at the second program card display position in the desktop interface; wherein the second program card display position is the program card display position corresponding to the end position of the second control operation.

[0234] In some embodiments, the processing module 2220 is further configured to: in response to adjusting the display position of the program card of the second application in the desktop interface, determine the final display position of the program card of the second application in the desktop interface, and display the icon of the second application at a third icon display position in the window view; wherein the third icon display position is an icon display position corresponding to the final display position of the program card of the second application in the desktop interface.

[0235] In some embodiments, the processing module 2220 is further configured to: in response to a first operation on the program cards of a third application among the n applications, control the program cards of the n applications arranged according to the first layout to be adjusted to program cards of m applications arranged according to a second layout; and control the icons of the n applications arranged according to the first thumbnail layout to be adjusted to icons of the m applications arranged according to the second thumbnail layout, the second thumbnail layout corresponding to the second layout, where m is a positive integer; and / or, in response to a second operation on the icons of the third application among the n applications, control the icons of the n applications arranged according to the first thumbnail layout to be adjusted to icons of t applications arranged according to a third thumbnail layout; and control the program cards of the n applications arranged according to the first layout to be adjusted to program cards of the t applications arranged according to the third layout, the third thumbnail layout corresponding to the third layout, where t is a positive integer.

[0236] In some embodiments, the first operation includes a first movement operation; the processing module 2220 is further configured to: in response to the first movement operation on the program card of the third application among the n applications, in the desktop interface, control the program card of the third application to move from a first position to a second position, and control the program cards of the n applications arranged according to the first layout to move in the opposite direction of the movement direction of the first movement operation, to obtain the program cards of the m applications arranged according to the second layout; and in the window view, control the icon of the third application to move from a third position to a fourth position, and control the icons of the n applications arranged according to the first thumbnail layout to move in the opposite direction of the movement direction of the first movement operation, to obtain the icons of the m applications arranged according to the second thumbnail layout; wherein the first position corresponds to the third position, and the second position corresponds to the fourth position.

[0237] In some embodiments, the second operation includes a second movement operation; the processing module 2220 is further configured to: in response to the second movement operation on the icon of a third application among the n applications, in the window view, control the icon of the third application to move from a fifth position to a sixth position, and control the icons of the n applications arranged according to the first thumbnail layout to move in the opposite direction of the movement direction of the second movement operation, to obtain the icons of the t applications arranged according to the third thumbnail layout; and in the desktop interface, control the program card of the third application to move from a seventh position to an eighth position, and control the program cards of the n applications arranged according to the first layout to move in the opposite direction of the movement direction of the second movement operation, to obtain the program cards of the t applications arranged according to the third layout; wherein the fifth position corresponds to the seventh position, and the sixth position corresponds to the eighth position.

[0238] In some embodiments, in the desktop interface, the program cards of the n applications include a first type of program card with a first size and a second type of program card with a second size, wherein the first size is different from the second size; in the window view, the icons of the n applications include a first type of icon with a third size and a second type of icon with a fourth size, wherein the third size is different from the fourth size.

[0239] In some embodiments, the first condition includes one or more of the following: detecting the first control operation; the first control operation being a movement operation; the first control operation being a drag operation; detecting a click operation on a first button; detecting a preset gesture operation; detecting a preset voice.

[0240] In some embodiments, the method is applied to at least one of the following in the vehicle cabin: central control display screen, passenger entertainment screen, front integrated screen, rear entertainment screen, control screen below central control, instrument panel screen, head-up display, steering wheel display screen, electronic exterior rearview mirror display screen, armrest display screen, window display screen, door touch screen, roof-mounted screen, front seat back screen, rear central control screen, and safe driving interaction screen.

[0241] It should be noted that the apparatus provided in the above embodiments is only illustrated by the division of the above functional modules when implementing its functions. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here. Figure 23This is a schematic diagram illustrating the structure of a human-machine interface device for a cockpit display screen according to an exemplary embodiment. The human-machine interface device 2300 for the cockpit display screen can be used to perform the method steps in the above embodiments. The human-machine interface device 2300 for the cockpit display screen includes: a processor 2301, an input / output device 2302, a memory 2303, and a touchscreen 2304.

[0242] The processor 2301 includes one or more processing cores. The processor 2301 executes various functional applications and information processing by running software programs and modules.

[0243] The memory 2303 can be connected to the processor 2301 and the input / output device 2302.

[0244] The memory 2303 can be used to store a computer program executed by the processor, and the processor 2301 is used to execute the computer program to implement the various steps in the above method embodiments.

[0245] Furthermore, the memory 2303 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, including but not limited to: magnetic disks or optical disks, electrically erasable programmable read-only memory, erasable programmable read-only memory, static on-demand memory, read-only memory, magnetic memory, flash memory, and programmable read-only memory.

[0246] For details not described in this embodiment, please refer to the method-side embodiment above, which will not be repeated here.

[0247] This disclosure also provides a computer-readable storage medium storing a computer program for execution by a processor to implement the human-computer interaction method for a cockpit display screen executed by the aforementioned computer device. In some embodiments, the computer-readable storage medium may include ROM (Read-Only Memory), RAM (Random-Access Memory), SSD (Solid State Drives), or optical disc, etc. The random access memory may include ReRAM (Resistance Random Access Memory) and DRAM (Dynamic Random Access Memory).

[0248] This disclosure also provides a chip, which includes programmable logic circuits and / or program instructions, for implementing the above-described human-machine interaction method for a cockpit display screen when the chip is running.

[0249] This disclosure also provides a computer program product, which includes a computer program stored in a computer-readable storage medium. A processor reads from the computer-readable storage medium and executes the computer program to implement the above-described human-computer interaction method for a cockpit display screen.

[0250] It should be understood that the term "instruction" mentioned in the embodiments of this disclosure can be a direct instruction, an indirect instruction, or an indication of a relationship. For example, A instructing B can mean that A directly instructs B, such as B being able to obtain information through A; it can also mean that A indirectly instructs B, such as A instructing C, so B can obtain information through C; or it can mean that there is a relationship between A and B.

[0251] In the description of the embodiments of this disclosure, the term "correspondence" may indicate a direct or indirect correspondence between two things, or an association between two things, or a relationship of instruction and being instructed, configuration and being configured, etc.

[0252] In some embodiments of this disclosure, "predefined" can be achieved by pre-storing corresponding codes, tables or other means in the device that can be used to indicate relevant information, and this disclosure does not limit the illustrative implementation methods thereto.

[0253] In this article, "multiple" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship.

[0254] In this article, "greater than or equal to" can mean greater than or equal to, and "less than or equal to" can mean less than or equal to.

[0255] Furthermore, the step numbers described herein are merely illustrative of one possible order of execution between the steps. In some other embodiments, the steps may not be executed in the order of their numbers, such as two steps with different numbers being executed simultaneously, or two steps with different numbers being executed in the reverse order of the figures. This disclosure does not limit this practice.

[0256] Those skilled in the art will recognize that the functions described in the embodiments of this disclosure in one or more of the foregoing examples can be implemented using hardware, software, firmware, or any combination thereof. When implemented in software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any medium that facilitates the transfer of a computer program from one place to another. Storage media can be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0257] The above description is merely an exemplary embodiment of this disclosure and is not intended to limit this disclosure. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this disclosure should be included within the protection scope of this disclosure.

Claims

1. A human-computer interaction method for a cockpit display screen, characterized in that, The method includes: The desktop interface displays application cards for n applications arranged in the first layout, where n is a positive integer. If the first condition is met, a window view corresponding to the desktop interface is displayed, and the window view displays icons of the n applications arranged in a first thumbnail layout, the first thumbnail layout corresponding to the first layout; In response to a first control operation on the program card of the first application among the n applications, the program card of the first application is switched to the icon of the first application; following the first control operation, the icon of the first application is moved. Based on the end position of the first control operation, adjust the display position of the icon of the first application in the window view.

2. The method according to claim 1, characterized in that, In response to a first control operation on the program card of a first application among the n applications, the program card of the first application is switched to the icon of the first application. Following the first control operation, moving the icon of the first application includes: Upon detecting the first control operation on the application card of the first application, the application card of the first application is switched to the icon of the first application. Move the icon of the first application by following the drag path of the first control operation.

3. The method according to claim 2, characterized in that, The step of switching the application card of the first application to the icon of the first application upon detecting the first control operation on the application card of the first application includes: Upon detecting the first control operation on the application card of the first application, the application card of the first application is switched to a preset card, and the icon of the first application is displayed in the preset card.

4. The method according to claim 3, characterized in that, The preset card satisfies at least one of the following: The display size of the preset card is smaller than the display size of the program card of the first application; The display size of the preset card is larger than the display size of the icon of the first application; The preset card displays a predefined background color.

5. The method according to claim 3, characterized in that, The method further includes: During the dragging process of the first control operation, the display size of the preset card is gradually reduced.

6. The method according to claim 2, characterized in that, Moving the icon of the first application by following the drag path of the first control operation includes: Follow the drag direction of the drag path of the first control operation to move the icon of the first application.

7. The method according to any one of claims 1 to 6, characterized in that, Adjusting the display position of the first application's icon in the window view based on the end position of the first control operation includes: If the end position of the first control operation is within the window view, then the icon of the first application is displayed at the first icon display position in the window view, and the icon of the first application is de-displayed at the second icon display position in the window view. The first icon display position is the icon display position corresponding to the end position of the first control operation, and the second icon display position is the icon display position where the icon of the first application was located before the first control operation was detected.

8. The method according to any one of claims 1 to 6, characterized in that, The desktop interface includes multiple sub-interfaces, the window view includes multiple sub-regions, and the cockpit display screen displays one of the multiple sub-interfaces at the same time. The number of sub-regions included in the window view is the same as the number of sub-pages included in the desktop interface, and the multiple sub-regions and the multiple sub-interfaces correspond one-to-one.

9. The method according to claim 8, characterized in that, The application card of the first application is located in the first sub-interface among the plurality of sub-interfaces; Adjusting the display position of the first application's icon in the window view based on the end position of the first control operation includes: If the end position of the first control operation is located in the first sub-region of the plurality of sub-regions, then the display position of the icon of the first application is adjusted in the first sub-region; or, If the end position of the first control operation is located in the second sub-region of the plurality of sub-regions, then the icon of the first application is displayed in the second sub-region, and the icon of the first application is de-displayed in the first sub-region; The first sub-region is the sub-region corresponding to the first sub-interface, and the second sub-region is another sub-region different from the first sub-region.

10. The method according to any one of claims 1 to 9, characterized in that, The method further includes: In response to adjusting the display position of the icon of the first application in the window view, the final display position of the icon of the first application in the window view is determined, and the program card of the first application is displayed at the first program card display position in the desktop interface. The first program card display position is the program card display position corresponding to the final display position of the icon of the first application in the window view.

11. The method according to claim 10, characterized in that, The step of responding to adjusting the display position of the icon of the first application in the window view, determining the final display position of the icon of the first application in the window view, and displaying the program card of the first application at the first program card display position in the desktop interface includes: If the final display position of the icon of the first application in the window view is located in the first sub-area of ​​the window view, then the program card of the first application is displayed at the first program card display position in the desktop interface, and the first program card display position is located in the first sub-interface of the desktop interface. If the final display position of the icon of the first application in the window view is located in the second sub-area of ​​the window view, then the program card of the first application is displayed at the first program card display position in the desktop interface, and the first program card display position is located in the second sub-interface of the desktop interface. Wherein, the first sub-region is the sub-region corresponding to the first sub-interface, the second sub-region is the sub-region corresponding to the second sub-interface, and the second sub-region is another sub-region different from the first sub-region.

12. The method according to claim 10 or 11, characterized in that, The method further includes: In response to displaying the program card of the first application at the first program card display position in the desktop interface, the display position of the program cards of other applications besides the first application in the desktop interface is adjusted. Adjust the display position of the icons of the other applications in the window view based on the display position of their application cards; The display position of the program card of the other application corresponds to the display position of the icon of the other application.

13. The method according to any one of claims 1 to 12, characterized in that, The method further includes: In response to a second control operation on the icon of the second application among the n applications, the icon of the second application is switched to the application card of the second application; following the second control operation, the application card of the second application is moved. Based on the end position of the second control operation, adjust the display position of the program card of the second application in the desktop interface.

14. The method according to claim 13, characterized in that, In response to a second control operation targeting the icon of a second application among the n applications, the icon of the second application is switched to the application card of the second application; Following the second control operation, move the application card of the second application, including: Upon detecting the second control operation targeting the icon of the second application, the icon of the second application is switched to the application card of the second application; Move the application card of the second application by following the drag path of the second control operation.

15. The method according to claim 14, characterized in that, The step of switching the icon of the second application to the application card of the second application upon detecting a second control operation targeting the icon of the second application includes: Upon detecting the second control operation targeting the icon of the second application, a preset card is displayed, and the icon of the second application is displayed in the preset card; If the second control operation satisfies the second condition, the preset card is switched to the program card of the second application.

16. The method according to claim 15, characterized in that, The method further includes: During the dragging process of the second control operation, the display size of the preset card is gradually increased.

17. The method according to any one of claims 13 to 16, characterized in that, Adjusting the display position of the application card of the second application on the desktop interface based on the end position of the second control operation includes: If the end position of the second control operation is located within the desktop interface, the program card of the second application is displayed at the second program card display position in the desktop interface. The second program card display position is the program card display position corresponding to the end position of the second control operation.

18. The method according to any one of claims 13 to 17, characterized in that, The method further includes: In response to adjusting the display position of the program card of the second application in the desktop interface, the final display position of the program card of the second application in the desktop interface is determined, and the icon of the second application is displayed at the third icon display position in the window view; The third icon display position is the icon display position that corresponds to the final display position of the program card of the second application on the desktop interface.

19. The method according to any one of claims 1 to 18, characterized in that, The method further includes: In response to a first operation on the application card of a third application among the n applications, the application cards of the n applications arranged according to the first layout are controlled to be adjusted to application cards of m applications arranged according to the second layout; and the icons of the n applications arranged according to the first thumbnail layout are controlled to be adjusted to icons of the m applications arranged according to the second thumbnail layout, the second thumbnail layout corresponding to the second layout, where m is a positive integer; and / or, In response to a second operation on the icon of a third application among the n applications, the icons of the n applications arranged according to the first thumbnail layout are adjusted to the icons of t applications arranged according to the third thumbnail layout; and the application cards of the n applications arranged according to the first layout are adjusted to the application cards of the t applications arranged according to the third layout, the third thumbnail layout corresponding to the third layout, where t is a positive integer.

20. The method according to claim 19, characterized in that, The first operation includes a first movement operation; The first operation in response to the program card of the third application among the n applications, controlling the program cards of the n applications arranged according to the first layout to be adjusted to the program cards of the m applications arranged according to the second layout; and controlling the icons of the n applications arranged according to the first thumbnail layout to be adjusted to the icons of the m applications arranged according to the second thumbnail layout, includes: In response to a first movement operation on the program card of a third application among the n applications, in the desktop interface, the program card of the third application is controlled to move from a first position to a second position, and the program cards of the n applications arranged according to the first layout are controlled to move in the opposite direction of the movement direction of the first movement operation, thereby obtaining the program cards of the m applications arranged according to the second layout; and, In the window view, the icon of the third application is moved from the third position to the fourth position, and the icons of the n applications arranged according to the first thumbnail layout are moved in the opposite direction of the first movement operation to obtain the icons of the m applications arranged according to the second thumbnail layout; wherein, the first position corresponds to the third position, and the second position corresponds to the fourth position.

21. The method according to claim 19, characterized in that, The second operation includes a second movement operation; In response to the second operation on the icon of the third application among the n applications, the icons of the n applications arranged according to the first thumbnail layout are adjusted to the icons of the t applications arranged according to the third thumbnail layout. And, controlling the program cards of the n applications arranged according to the first layout to be adjusted to the program cards of the t applications arranged according to the third layout, including: In response to a second movement operation targeting the icon of a third application among the n applications, in the window view, the icon of the third application is controlled to move from a fifth position to a sixth position, and the icons of the n applications arranged according to the first thumbnail layout are controlled to move in the opposite direction to the movement direction of the second movement operation, resulting in icons of the t applications arranged according to the third thumbnail layout; and, In the desktop interface, the program card of the third application is controlled to move from the seventh position to the eighth position, and the program cards of the n applications arranged according to the first layout are controlled to move in the opposite direction of the second movement operation, so as to obtain the program cards of the t applications arranged according to the third layout; wherein, the fifth position corresponds to the seventh position, and the sixth position corresponds to the eighth position.

22. The method according to any one of claims 1 to 21, characterized in that, In the desktop interface, the program cards of the n applications include a first type of program card with a first size and a second type of program card with a second size, wherein the first size is different from the second size; In the window view, the icons of the n applications include a first type of icon with a third size and a second type of icon with a fourth size, wherein the third size is different from the fourth size.

23. The method according to any one of claims 1 to 22, characterized in that, The first condition includes one or more of the following: The first control operation was detected; The first control operation is a movement operation; The first control operation is a drag-and-drop operation; A click operation on the first button has been detected; A preset gesture operation was detected; Preset voice was detected.

24. The method according to any one of claims 1 to 23, characterized in that, The method is applied to at least one of the following in the vehicle cabin: central control display screen, passenger entertainment screen, front integrated screen, rear entertainment screen, control screen below the central control, instrument panel screen, head-up display, steering wheel display screen, electronic exterior rearview mirror display screen, armrest display screen, window display screen, door touch screen, roof-mounted screen, front seat back screen, rear central control screen, and safe driving interaction screen.

25. A human-computer interaction device for a cockpit display screen, characterized in that, The apparatus includes modules for implementing the method steps as described in any one of claims 1 to 24.

26. A human-computer interaction device for a cockpit display screen, characterized in that, The human-computer interaction device for the cockpit display screen includes: A processor; a memory for storing executable instructions of the processor; wherein the processor is configured to implement the steps of the method as claimed in any one of claims 1 to 24.

27. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method as described in any one of claims 1 to 24.

28. A computer program product, characterized in that, The computer program product includes computer instructions that, when executed by a processor, implement the steps of the method as described in any one of claims 1 to 24.

Images