Human-machine interaction method, device, equipment and program product for cockpit display screen

Abstract

The application discloses a man-machine interaction method and device for a cockpit display screen, equipment, a medium and a program product, and belongs to the field of man-machine interaction. The method supports an intelligent cockpit applied to a vehicle or an aircraft, is executed by a cockpit system, and comprises the following steps: displaying a first desktop, wherein the first desktop comprises a plurality of program cards; and in response to a locking operation on at least one program card in the plurality of program cards and / or a scenario triggering condition being met, locking the at least one program card in a preset area of the first desktop. The application can improve man-machine interaction efficiency.

Description

Technical Field

[0001] This application relates to the field of human-computer interaction, and the method supports smart cockpits for use in vehicles or aircraft. In particular, it relates to a human-computer interaction method, device, equipment, medium, and program product for cockpit displays. Background Technology

[0002] The display screen in a smart cockpit is the core human-computer interaction medium. Interaction methods such as multi-desktop partitioning and program card-based displays directly impact the operational efficiency of drivers and passengers. The ease of use of its desktop content display function directly affects the user experience.

[0003] Under the current desktop content display mechanism, all program cards move with the desktop as a whole. The method of fixing the cards is relatively simple. The system can forcibly fix certain programs or require clicking to switch icons or using voice commands to trigger the process. The steps are cumbersome and there are issues such as response delays and accidental touches.

[0004] Therefore, the relevant technologies cannot achieve permanent display across multiple desktops after a specified card is locked. When frequently switching desktops, high-frequency applications are repeatedly searched for and re-fixed, which greatly reduces the convenience and intuitiveness of switching between multiple desktops, resulting in a poor driving and riding experience. Summary of the Invention

[0005] This application provides a human-computer interaction method, apparatus, device, medium, and program product for a cockpit display screen, the technical solution of which includes at least: According to one aspect of the embodiments of this application, a human-computer interaction method for a cockpit display screen is provided, the method comprising: Display a first desktop, which includes multiple application cards; in response to a locking operation on at least one of the multiple application cards and / or the fulfillment of a scene trigger condition, lock at least one application card in a preset area of ​​the first desktop.

[0006] Locking at least one program card in a preset area of ​​the first desktop includes: removing at least one program card from its original position and inserting it into the preset area of ​​the first desktop; and sequentially moving other program cards in the first desktop, excluding at least one program card, to other areas other than the preset area and / or other desktops other than the first desktop for display.

[0007] Optionally, in response to a locking operation on at least one of a plurality of program cards and / or the fulfillment of a scene trigger condition, locking at least one program card in a preset area of ​​the first desktop includes at least one of the following: locking at least one program card in response to a locking operation on at least one of a plurality of program cards; locking at least one program card in the preset area of ​​the first desktop when a scene trigger condition is met; displaying information about the at least one program card recommended to be locked when a scene trigger condition is met; and locking at least one program card in response to a locking operation on the recommended at least one program card in the preset area of ​​the first desktop.

[0008] Optionally, in response to a locking operation on at least one of a plurality of program cards, locking at least one program card in a preset area of ​​the first desktop includes: in response to a trigger operation on at least one program card, displaying a pop-up window overlaid on at least one program card, the pop-up window including a locking control; in response to a trigger operation on the locking control, locking at least one program card in a preset area of ​​the first desktop; wherein the trigger operation includes at least one of long press, click, performing a preset gesture, and receiving a voice command.

[0009] Optionally, the scenario triggering conditions include at least one of the following: the vehicle is in motion and the touch operation is detected to originate from touch data in an area other than the preset area on the first desktop; the real-time vehicle speed is greater than a preset threshold and the number of desktop swipe operations within a unit time period is greater than a first quantity threshold; or the driver switches from manual driving mode to assisted driving mode or preset driving mode.

[0010] According to one aspect of the embodiments of this application, a human-computer interaction method for a cockpit display screen is provided, the method comprising: In response to a switching command, at least one program card locked in a preset area remains unchanged, while the remaining program cards (excluding the at least one program card) are switched to the program cards corresponding to the second desktop; wherein, the switching command is a user operation command used to trigger a change in desktop content or a page swiping.

[0011] Optionally, keeping at least one program card locked in a preset area unchanged includes: setting the visual hierarchy of at least one program card to be higher than the desktop layer, and locking the position of at least one program card in the absolute coordinate position of the preset area unchanged during the duration of the desktop content update animation triggered in response to the switching command.

[0012] According to one aspect of the embodiments of this application, a human-computer interaction method for a cockpit display screen is provided, the method comprising: When the switching command continues to be executed, at least one program card locked in the preset area remains unchanged, and the other program cards besides the at least one program card are switched to the program cards corresponding to the third desktop. Optionally, the multiple program cards include a first program card and a second program card; in response to a locking operation on the first program card, the first program card is locked at a first position in the preset area of ​​the first desktop; in response to a locking operation on the second program card, the second program card is locked at a second position in the preset area of ​​the first desktop. According to one aspect of the embodiments of this application, a human-computer interaction method for a cockpit display screen is provided, the method comprising: displaying a first mark on at least one program card locked in the preset area, the first mark being used to indicate that at least one program card is in a locked state. The first mark includes one or more of the following: a badge, a color change, a highlighted border, a semi-transparent overlay, an icon change, and an animation effect.

[0013] According to one aspect of the embodiments of this application, a human-computer interaction method for a cockpit display screen is provided, the method comprising: When it is detected that there is a program card in the first desktop that is locked and its current display size is the first size, the other unlocked program cards in the first desktop are automatically traversed and their display sizes are set to the second size; wherein the first size is not less than the second size, the first size is the display size of the program card in the locked state, and the second size is the display size of the program card in the unlocked state.

[0014] According to one aspect of the embodiments of this application, a human-computer interaction method for a cockpit display screen is provided, the method comprising: In response to an unlock operation on at least one application card locked in a preset area, the locking state of at least one application card is released; in response to a switching command, the at least one unlocked application card moves synchronously with other application cards; wherein the switching command is a user operation command used to trigger a change of desktop content or page swiping. Optionally, the unlock operation includes at least one of the following: long-pressing a locked application card, clicking the unlock control on at least one application card, performing a preset swipe gesture, or receiving a voice unlock command.

[0015] According to one aspect of the embodiments of this application, a human-computer interaction method for a cockpit display screen is provided, the method comprising: In response to a batch unlock command, the lock status of all currently locked application cards is unlocked at once.

[0016] According to one aspect of the embodiments of this application, a human-computer interaction method for a cockpit display screen is provided, the method comprising: After unlocking at least one application card, remove the first mark on at least one application card.

[0017] According to another aspect of the embodiments of this application, a human-computer interaction device for a cockpit display screen is provided, which is used to implement the above-described human-computer interaction method for a cockpit display screen.

[0018] According to another aspect of the embodiments of this application, an in-vehicle device or vehicle is provided, the in-vehicle device or vehicle including: a processor; a transceiver connected to the processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to load and execute the executable instructions to implement the human-machine interaction method for a cockpit display screen as described in the various aspects above.

[0019] According to another aspect of the embodiments of this application, a computer-readable storage medium is provided, which stores at least one program that is loaded and executed by a processor to implement the human-computer interaction method for a cockpit display screen as described in the various aspects above.

[0020] According to another aspect of the embodiments of this application, a chip is provided, the chip including programmable logic circuitry and / or program instructions, which, when the chip is run on a computer device, are used to implement the human-computer interaction methods for cockpit displays described in the above aspects.

[0021] According to another aspect of the embodiments of this application, a computer program product or computer program is provided, the computer program product or computer program including computer instructions stored in a computer-readable storage medium, a processor retrieving the computer instructions from the computer-readable storage medium, and the processor executing the computer instructions to implement the human-computer interaction method for a cockpit display screen as described in the various aspects above.

[0022] The technical solutions provided in this application embodiment may include the following beneficial effects: This application optimizes the human-computer interaction of the cockpit display screen by combining two methods of program card fixing: user-initiated locking and scenario-based locking. On the one hand, users can manually initiate locking as needed; on the other hand, the system can automatically trigger the locking when it recognizes that the vehicle status meets the preset scenario. This simplifies manual operation steps during driving and reduces safety hazards caused by driver and passenger distraction. Attached Figure Description

[0023] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0024] Figure 1 An architectural diagram of an in-vehicle display provided in an exemplary embodiment of this application is shown; Figure 2 An architectural diagram of an in-vehicle display provided in an exemplary embodiment of this application is shown; Figure 3 A schematic diagram of a program card locking operation provided in an exemplary embodiment of this application is shown; Figure 4 A flowchart illustrating a human-computer interaction method for a cockpit display screen provided in an exemplary embodiment of this application is shown; Figure 5 A flowchart illustrating a program card locking operation provided in an exemplary embodiment of this application is shown; Figure 6 A schematic diagram illustrating scene triggering conditions provided in an exemplary embodiment of this application is shown; Figure 7 This illustration shows a schematic diagram of desktop content changes provided in an exemplary embodiment of this application; Figure 8 This illustration shows a schematic diagram of desktop layout negotiation provided in an exemplary embodiment of this application; Figure 9 This illustration shows a schematic diagram of a scene triggering program card locking provided in an exemplary embodiment of this application; Figure 10 This illustration shows a schematic diagram of a scene triggering program card locking provided in an exemplary embodiment of this application; Figure 11 This illustration shows a schematic diagram of a scene triggering program card locking provided in an exemplary embodiment of this application; Figure 12 This illustration shows a schematic diagram of desktop content changes provided in an exemplary embodiment of this application; Figure 13 This illustration shows a schematic diagram of the hierarchical relationship in the desktop content change process provided by an exemplary embodiment of this application; Figure 14 This illustration shows a schematic diagram of a program card layout adjustment provided in an exemplary embodiment of this application; Figure 15 A flowchart illustrating a program card unlocking process provided in an exemplary embodiment of this application is shown; Figure 16A schematic diagram of a program card unlocking process provided in an exemplary embodiment of this application is shown; Figure 17 A schematic diagram illustrating a method for changing desktop content after unlocking, provided in an exemplary embodiment of this application, is shown. Figure 18 This invention illustrates a schematic diagram of a system module for program card locking provided in an exemplary embodiment of this application; Figure 19 A block diagram of a human-computer interaction device provided in an exemplary embodiment of this application is shown; Figure 20 A schematic diagram of the structure of a human-computer interaction device provided in an exemplary embodiment of this application is shown. Detailed Implementation

[0025] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be further described in detail below with reference to the accompanying drawings. Exemplary embodiments will be described in detail here, examples of which are illustrated in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0026] The terminology used in this disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The singular forms “a,” “the,” and “the” as used in this disclosure and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.

[0027] It should be understood that although the terms first, second, third, etc., may be used in this disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of this disclosure, a first threshold may also be referred to as a second threshold, and similarly, a second threshold may also be referred to as a first threshold. Depending on the context, the word "if" as used herein may be interpreted as "when," "when," or "in response to determination."

[0028] First, a brief introduction to the terms used in the embodiments of this application: Screens: The in-vehicle screens applicable to this application can be any one or a combination of multiple types, including central control screens, passenger entertainment screens, rear entertainment screens, sliding screens, smart screens, and central touch screens. The central control screen, located in the center of the dashboard, is the core of the vehicle's interaction, integrating commonly used functions such as navigation route planning, audio / video playback, and air conditioning and seat parameter adjustments. Many models also support smartphone connectivity and application downloads. Besides handling basic vehicle controls, the central control screen can also collaborate with other screens in the vehicle and is the most frequently used display for passengers. The passenger entertainment screen is specifically designed for the front passenger, capable of independently playing audio / video, browsing news, or running casual games without interfering with the driver's driving. It also supports smartphone screen mirroring, effectively enriching the passenger's travel experience. Rear entertainment screens are mostly installed in the headrests or roof, primarily serving rear passengers. These screens are generally larger and, in addition to high-definition viewing, connecting external gaming devices, and simple mobile office functions, some products also include rear air conditioning and seat adjustment controls. The sliding screen is an innovative screen that can be moved and changed in installation position and tilt angle along a preset track, making it convenient for rear passengers to watch movies or temporarily work in the car. When not in use, it can be folded up and stored without taking up sunroof space.

[0029] Desktop: The desktop typically includes shortcuts to functions, real-time information displays, and personalized settings; it serves as the interface between the user and the in-vehicle system. It can be used directly upon opening the screen without requiring additional page redirection.

[0030] Icons: Icons are small, visual identifiers on the desktop that represent applications. They are typically presented as simple graphics (with a minimal text name) and serve as quick access points to launch applications. They are small in size, have fixed styles or support customization, and are associated with the launch command of the corresponding application. Icons intuitively distinguish different applications, allowing users to quickly launch programs with a single click, eliminating the need to search through complex menus and simplifying the operation path.

[0031] Application cards: Application cards are interactive cards or controls used to display real-time information about the application and to implement all or part of the application's functions. They have real-time information preview capabilities and can be dynamically adjusted in real time.

[0032] The features of the application cards include at least one of the following: containing visual identifiers of the application, such as application icons and application names; some application cards can also display real-time status information of the application, such as music playback progress and navigation trip prompts; having a fixed size and style, supporting arrangement on different desktops of the in-vehicle central control screen according to preset layout rules; supporting user touch operation; and adjusting the spacing or display position of the application cards synchronously according to the desktop switching during desktop dragging, switching, or bounce.

[0033] Optionally, it may appear as a navigation preview, music playback controls, or air conditioning settings panel; in the virtual space of VR / AR glasses, it may appear as a floating, spatially positioned stereoscopic information panel; on a head-up display (HUD), it may be integrated with the real field of view and displayed as a transparent layer for navigation or safety prompts.

[0034] The program card can be presented and interacted with as a unified information module across device forms, such as in-vehicle screens, virtual reality (VR) or augmented reality (AR) spaces, and HUDs. This application does not limit this.

[0035] Secondly, the relevant content involved in this application will be introduced.

[0036] This application can be applied to smart terminal devices with multiple desktops, such as smart tablets, laptops, all-in-one smart PCs, desktop touch monitors, aircraft, and smart cockpits. The terminal is equipped with a touch interaction module, an interface rendering module, a touch command recognition module, and a dynamic animation calculation module. It can collect user touch operations in real time, parse operation commands, dynamically calculate the spacing parameters of interface elements, and complete real-time interface rendering and refresh. The terminal system sets up multiple independent desktop pages, such as a first desktop, a second desktop, a third desktop, etc. Each desktop page arranges multiple independent program cards. These program cards correspond to shortcuts to different applications such as office software, social software, audio-visual software, and utility software. The program cards will not be scaled, stretched, or deformed during desktop switching interactions.

[0037] When the cockpit display screen is in its initial state, the first desktop is displayed by default. The first desktop has several program cards evenly arranged horizontally or vertically. A fixed distance is preset between any two adjacent program cards as the first spacing, which is the system's default static arrangement spacing.

[0038] When a user needs to lock certain application cards, the locking operation can be performed by manually touching the screen or by voice command. The locking operation includes at least one of the following: long press, tap, perform preset gesture, or receive voice command. The system listens for and captures the switching operation command triggered by the user in real time.

[0039] After a valid lock operation is detected on an application card on the first desktop, the locked application card is fixed to a preset area on the first desktop. Subsequent desktop switching or application card switching operations on the first desktop will keep the fixed application card in the preset area.

[0040] This application uses the cockpit display screen as an example of an in-vehicle display screen, but this application is not limited to this single scenario.

[0041] Figure 1 and Figure 2 The image shows an in-vehicle display screen 100. In different embodiments, multiple other in-vehicle displays (such as a passenger-side screen or a rear-seat entertainment screen) may be connected to the in-vehicle control system. The screen of the in-vehicle display screen 100 displays a desktop, on which one or more program cards are arranged in different layouts. Different program cards correspond to different functions, and each program card corresponds to a different in-vehicle function module. The in-vehicle control system is an electronic control unit integrated into the vehicle, responsible for real-time monitoring and management of various vehicle functions. Users issue control commands to the in-vehicle control system through interaction, thereby controlling the vehicle components.

[0042] The vehicle display screen 100 is connected to other vehicle display screens or other terminals in the vehicle via the vehicle's internal communication bus, such as the Ethernet vehicle bus or the Controller Area Network (CAN) bus; the various display program cards in the vehicle display screen 100 are implemented through the corresponding service function modules in the screen interface.

[0043] The display content of the vehicle display screen 100 includes a first desktop, which includes program cards 101, 102, and 103. This application solution supports locking selected program cards in a preset area of ​​the first desktop when triggered by a user locking operation or when conditions such as vehicle operating conditions or driver status are met. During desktop content changes, locked cards remain displayed in the preset area, while unlocked cards are switched to program cards from other desktops.

[0044] like Figure 1 As shown, the first desktop displays program cards 101, 102, and 103. Figure 2 As shown, the program card 102 on the first desktop is fixed, and... Figure 1 The position of the program card in the first desktop shown has changed; program card 102 has become the first program card on the left.

[0045] The program card 101 is associated with a first application, which may be a navigation program, a music program, a vehicle control program, a communication program, or any other application that can run in a vehicle environment, and this application does not limit this.

[0046] The program card 101 dynamically displays the real-time content of the first application and / or, one or more operation / function entry points. For example, when the first application is a navigation program, the program card 101 can display the current route, the next turn prompt, and the estimated arrival time in real time, and integrate operation buttons for starting navigation, ending navigation, or muting; when the first application is a music program, it can display information about the song being played, the album cover, and provide operation buttons for play / pause and skipping tracks.

[0047] Program card 102 is associated with a second application. The second application can also be any applicable in-vehicle application, and its type may be the same as or different from the first application. Program card 102 dynamically displays the content and operation of the second application in a manner similar to program card 101. For example, program card 102 is associated with an air conditioning control program, displaying the in-vehicle temperature and fan speed mode in real time, and providing one or more touch areas for temperature adjustment and mode switching; this application does not limit this.

[0048] Optionally, Figure 1 and Figure 2 The image shown only shows the first desktop, which includes program cards 101, 102, and 103. In actual deployment, the vehicle display screen 100 can have multiple switchable or displayable desktops, and each desktop can simultaneously display programs such as... Figure 1 or Figure 2 The program card layout shown is similar to or similar to... Figure 1 and Figure 2 The program cards shown have different layouts.

[0049] In some embodiments, the in-vehicle display screen 100 is mounted on the dashboard in the center of the cockpit, in the area to the right of the steering wheel and between the driver and passenger seats. Optionally, the in-vehicle display screen 100 can also be mounted behind the steering wheel to display vehicle status, navigation information, and driver assistance information to the driver; and / or, the in-vehicle display screen 100 can also be mounted directly in front of the passenger seat, on the back of the front seats, behind the center armrest, or tilted down from the roof to provide passengers with audio-visual entertainment, independent navigation, games, and vehicle environmental control functions; and / or, the in-vehicle display screen 100 can also be mounted via a robotic arm or sliding rail, and its height and angle can be adjusted within a certain range to adapt to different driver seating positions or usage scenarios. This application does not limit this.

[0050] Optionally, the vehicle display 100 is not limited to a single physical screen; it may be composed of multiple physical screens or multiple display areas seamlessly spliced ​​together to form a continuous wide display area.

[0051] In some embodiments, the vehicle display screen 100 is connected to other vehicle display screens or other terminals in the vehicle via an internal vehicle communication bus, such as an Ethernet vehicle bus or a Controller Area Network (CAN) bus; the first program card 101, the second program card 102, the third program card 103 and other application program cards in the first desktop displayed on the vehicle display screen 100 are implemented through corresponding service function modules in the screen interface.

[0052] Figure 3 This illustration shows a schematic diagram of a program card fixing method provided in an exemplary embodiment of this application, the method comprising: like Figure 3 As shown in part (A), the first desktop is displayed in its initial state. In this initial state, the spacing between adjacent application cards is the same, and the distance is the first spacing. The current display is the first desktop, and the layout of the first desktop shown in the figure is a first layout with equal screen division. The central area is divided by the application cards of three applications, and the application types can be navigation, vehicle condition detection, and movie entertainment, etc. The three applications can be three different applications or different interfaces of the same application, which is not limited in this application. In the initial state, all application cards are in an unlocked free state, and the menu bar at the top of the card is hidden by default. The user can trigger the top area of ​​the application card 102 by clicking or long-pressing to perform a lock-on operation and bring up the function list hidden above the application card.

[0053] like Figure 3 As shown in section (B), in response to the trigger operation on the list, the display screen overlays a selection pop-up window on the screen of the current program card 102. The pop-up window displays two types of optional interactive options: "Open Full Screen" and "Lock Window". When the user clicks the "Lock Window" option in the pop-up window, the system completes the lock confirmation command for the program card 102 and marks the program card 102 as locked.

[0054] Figure 3 As shown in part (C), the cockpit system responds to the locking command and rearranges the desktop layout. The locked original middle program card is automatically moved to the preset area on the left side of the first desktop and fixed for display. The remaining unlocked left and right program cards are then redistributed evenly across the remaining display area of ​​the original desktop. The fixed position on the left side can be pre-configured at the factory or dynamically adjusted according to the driver's cockpit posture and the driver's field of vision. This application does not limit the specific preset position of the card. When changing the desktop content later, the program card locked on the left side will maintain its position, size, and content, and only the unlocked program cards will be switched.

[0055] Simultaneously, a first identifier is displayed in the hidden list above program card 102. In this embodiment, the first identifier is a lock icon. In some embodiments, the first identifier may also be one or more of the following: a badge, a color change, a highlighted border, a semi-transparent overlay, an icon change, or an animation effect.

[0056] In summary, the locking method proposed in this application can fix frequently used cards in a preset area on the desktop after locking, allowing for synchronous switching without being on the desktop. When switching between multiple desktops, frequently used cards such as navigation cards will not disappear with the page, eliminating the need for users to repeatedly search for and re-add cards, thus significantly improving the efficiency of human-computer interaction in the cockpit. Furthermore, the fixed position of the locked cards can be dynamically adjusted by preset fixed points or associated with the driver's position, adapting to the line of sight and touch habits of drivers of different sizes.

[0057] Figure 4 A flowchart of a human-computer interaction method for a cockpit display screen provided in an exemplary embodiment of this application is shown, the method comprising: Step 410: Display the first desktop, which includes multiple program cards.

[0058] The primary desktop is an interactive interface with specific functions and layout in an in-vehicle system. It can be deployed on various in-vehicle screens, including one or more screen carriers such as the central control screen, passenger entertainment screen, rear entertainment screen, sliding screen, magic control screen, and central touch screen. The primary desktop can take many forms, including one or more of the following: The platform offers various desktop options, including 3D car model control desktop, widget desktop, card-style desktop, immersive entertainment desktop, minimalist wallpaper desktop, interactive desktop, and quick control desktop. These different desktop styles cater to users' diverse needs whether the vehicle is in motion or parked.

[0059] In some embodiments, the first desktop displays program cards of a first number of applications arranged in a first layout.

[0060] The first desktop displays application cards, which differ from traditional application icons. Application icons generally serve as static or dynamic identifiers for applications and have a fixed size. Application cards, on the other hand, are visual interactive units used to carry core application information and dynamic states. They represent the application's display format on the in-vehicle desktop and are essentially card-style display components that integrate dynamic application content and interactive functions.

[0061] In some embodiments, an application card is a visual interactive module associated with a specified application, and the application card includes one or more of the following features: • Dynamically display real-time information for a specified application; • Integrates one or more entry points for operations / functions, enabling multiple functions without launching the full interface of the application; • At least one of the following: size, position, and display format can be flexibly adjusted by the user or system.

[0062] In some embodiments, the form of the first layout may include a variety of cases.

[0063] In some embodiments, the n program cards are evenly distributed across the desktop space.

[0064] In some embodiments, a mixed layout is provided where m program cards are displayed at a first size and p program cards are displayed at a second size, where n, m, and p are all positive integers, and the first size and the second size can be set to be the same or different according to design requirements.

[0065] In some embodiments, the first dimension is larger than the second dimension.

[0066] Step 420: In response to a locking operation on at least one of the multiple program cards and / or the fulfillment of a scene trigger condition, lock at least one program card in a preset area of ​​the first desktop.

[0067] In some embodiments, locking at least one program card in a preset area of ​​a first desktop includes the following steps: removing at least one program card from its original position and inserting it into the preset area of ​​the first desktop; and sequentially moving other program cards in the first desktop, excluding at least one program card, to other areas outside the preset area and / or other desktops outside the first desktop for display.

[0068] In some embodiments, in response to a locking operation on at least one of a plurality of program cards and / or the fulfillment of a scene triggering preset condition, locking at least one program card in a preset area of ​​a first desktop includes at least one of the following: in response to a locking operation on at least one of a plurality of program cards in a preset area of ​​the first desktop; when a scene triggering condition is met, locking at least one program card in a preset area of ​​the first desktop; when a scene triggering condition is met, displaying information about the at least one program card recommended for locking; in response to a locking operation on the at least one recommended program card, locking at least one program card in a preset area of ​​the first desktop.

[0069] Optionally, in response to a locking operation on at least one of a plurality of program cards, locking at least one program card in a preset area of ​​the first desktop includes: In response to a trigger operation on at least one application card, a pop-up window is overlaid on at least one application card, the pop-up window including a lock control; In response to a trigger action on the lock control, lock at least one application card in a preset area of ​​the first desktop; The triggering operation includes at least one of long press, tap, executing a preset gesture, and receiving a voice command.

[0070] Figure 5 A flowchart illustrating a program card locking operation is shown. Figure 5 As shown, the first desktop displays a 2x3 layout of application cards. When no locking action is triggered, all application cards are displayed in their initial arrangement. Figure 5 As shown in section (a), the first desktop is initially locked. A click on the three-dot menu is triggered on the map navigation program card. (See section (a) for details.) Figure 5 As shown in section (b), when the user clicks... Figure 5 After the three-dot menu in the map navigation card shown in (a) of the initial state, the interface jumps to Figure 5 (b) The display involves a pop-up window appearing above the target map navigation card, containing two operation options: "Open Full Screen" and "Lock Window". Clicking the "Lock Window" option indicates the issuance of a lock command. Optionally, the pop-up window can be displayed superimposed above the locked program card, in the center of the desktop, superimposed above other program cards, or within the operator's reach; this application does not limit the location of the pop-up window.

[0071] As the pop-up window appears, the system background begins layout calculations. Following the arrangement rule of "moving the target card out of its original position and inserting it into a preset empty space, with the remaining cards moving sequentially," the top left corner of the first desktop (its original position on the map interface) is selected as the preset locked empty space. The target map navigation card is to be forcibly moved from its original position in the second row and third column to the empty space in the first row and first column. The remaining desktop cards remain in their original positions and will not be adjusted temporarily, awaiting confirmation of the lock before being batch rearranged. Figure 5 As shown in part (c) of the document.

[0072] Figure 5 The process of status identifier change is also shown. Upon clicking the lock control, the system card status switches from normal (unlocked) to locked, and the card icon is simultaneously replaced by a lock icon instead of a three-dot menu. After performing an unlock operation, the status returns to normal. Optionally, the locking operation can be triggered manually by the user or automatically recommended based on preset scenarios.

[0073] In summary, the locking method proposed in this application transforms the locking steps into a visual interface change logic for the in-vehicle desktop. This not only standardizes the card locking interaction process but also enables high-frequency applications to remain on the desktop by fixing preset areas, thereby optimizing the efficiency of in-vehicle desktop usage.

[0074] In some embodiments, the scene triggering conditions include one or more of the following: The vehicle is in motion and the touch operation detected originates from touch data in an area other than the preset area on the first desktop. The real-time vehicle speed is greater than a preset threshold and the number of desktop swipe operations within a unit time period is greater than the first quantity threshold. Switch from manual driving mode to assisted driving mode or preset driving mode.

[0075] like Figure 6 As shown, when the anti-interference recommendation triggering conditions in Scenario A are met, the vehicle is in motion, the passenger seat is occupied, and touch operations on the display screen originate from the right half of the screen. The system automatically recommends locking the "Map Navigation" program card and displays a prompt: "The passenger is operating the system; should we lock the map for you?". When the highway safety recommendation triggering conditions in Scenario B are met, the vehicle is in motion and the real-time speed measurement exceeds a preset threshold, or the number of desktop swipes within a unit of time exceeds a threshold. The system automatically recommends locking the "Intelligent Driving Status" card and displays a prompt: "Driving at high speed; should we lock the intelligent driving status?". When the driving mode switching triggering conditions in Scenario C are met, the vehicle detects a driving mode switching time, switching from manual driving to assisted driving or preset driving. The system automatically recommends locking the "Intelligent Driving Status" card and displays a prompt: "Switched to assisted driving; should we lock the intelligent driving status for you?". Under the above scenario triggering conditions, Figure 6 The response mechanism of the recommendation pop-up is also illustrated. When the scene triggering conditions or rules are met, a recommendation pop-up is overlaid on the target card. In some embodiments, the pop-up requires user confirmation before the locking operation can be performed. In some embodiments, the pop-up does not require user response and automatically locks after a preset condition or preset time is reached.

[0076] In some embodiments, the method proposed in this application further includes a desktop content modification process, which includes: In response to a switching command, at least one program card locked in a preset area remains unchanged, while the remaining program cards (excluding the at least one program card) are switched to the program cards corresponding to the second desktop; wherein, the switching command is a user operation command used to trigger a change in desktop content or a page swiping.

[0077] Optionally, at least one program card locked in a preset area remains unchanged, including: Set the visual hierarchy of at least one application card to be higher than the desktop layer, and lock the position of at least one application card to the absolute coordinate position of a preset area during the duration of the desktop content update animation triggered in response to the switching command.

[0078] Optionally, the method further includes: when continuing to execute the switching instruction, keeping at least one program card locked in the preset area unchanged, and switching the other program cards besides the at least one program card to the program card corresponding to the third desktop.

[0079] In some embodiments, the plurality of program cards includes a first program card and a second program card.

[0080] In response to a locking operation on a first program card, the first program card is locked at a first position in a preset area of ​​the first desktop; in response to a locking operation on a second program card, the second program card is locked at a second position in a preset area of ​​the first desktop.

[0081] like Figure 7 As shown, when a user initiates a change to the desktop content, the system activates the program card differentiation switching response mechanism. Figure 7 Part (a) shows the initial desktop layout before adjustment. The desktop contains six application cards: Map Navigation, Smart Driving Status, Music, Phone, Settings, and Photo Album. Map Navigation and Smart Driving Status are locked, while Music, Phone, Settings, and Photo Album are unlocked. The user enters the interface after a three-finger horizontal swipe. Figure 7 In part (b) of the switching state, the system iterates through and identifies the locking markers of all cards. Locked cards are placed at the top of the hierarchy and their coordinates are fixed, keeping their screen position stationary. Unlocked cards move horizontally synchronously with the desktop platform according to a preset animation curve. Once the sliding action ends, the adjustment is complete, and the system enters [the next state]. Figure 7 In the second desktop layout of (c), the locked cards (map navigation, intelligent driving status) are completely retained in the original display area, and the screen is not shifted or changed; all the original unlocked cards are replaced with new application cards for videos, weather, calendar, and memos on the second desktop, thus completing the change of desktop content.

[0082] The differentiated response processing mechanism for desktop content changes includes: when the system detects a switching command, it iterates through the status identifiers of all cards; the visual hierarchy of locked cards is set to the highest, and their positions are fixed at their absolute coordinates; and unlocked cards move horizontally with the desktop according to a preset sliding animation curve. As a result, locked cards are always within the driver's field of vision, while unlocked cards are replaced by program cards on the second desktop after the switching command is completed.

[0083] In some embodiments, a first mark is displayed on at least one program card in a locked and preset area, the first mark indicating that at least one program card is in a locked state.

[0084] Optionally, the first marker may include one or more of the following: a badge, a color change, a highlighted border, a semi-transparent overlay, an icon change, and an animation effect.

[0085] In some embodiments, this application also relates to program card size adjustment logic, the method further comprising: when it is detected that there is a program card in the first desktop that is in a locked state and whose current display size is a first size, automatically traversing other program cards in the first desktop that are in an unlocked state and setting their display size to a second size; wherein, the first size is larger than the second size, the first size is the display size of the program card in the locked state, and the second size is the display size of the program card in the unlocked state.

[0086] Figure 8 A schematic diagram showing the dimensions before and after the layout adjustment is provided. Figure 8 Part (a) shows the desktop interface before layout negotiation. The map navigation is a locked card displayed in the largest size, occupying approximately 2 / 3 of the screen width. The two unlocked cards, Smart Driving Status and Music, also use the largest size layout. Due to the limitation of the total screen width, placing multiple large cards simultaneously causes insufficient desktop space and layout conflicts, making it impossible to arrange all application cards neatly. After triggering the layout negotiation process, the following is obtained: Figure 8 The display effect after the layout negotiation in part (b) is that the map navigation card with the locked attribute retains its original first largest size, and the display position and size parameters are not changed. All unlocked cards such as intelligent driving status, music, telephone, and settings are automatically compressed and switched to the second smallest size, which accounts for about 1 / 3 of the screen width, and are arranged compactly and orderly in the remaining screen area, completely eliminating layout space conflicts.

[0087] In summary, when the first desktop contains a locked application card configured as the largest size, the layout manager automatically traverses all unlocked application cards on the current page and uniformly forces the display specifications of the unlocked cards to be adjusted to the second smallest size. This prioritizes the large-size display effect of the locked cards, achieving a neat and orderly arrangement of all cards within the limited screen space.

[0088] Figure 9 A flowchart of a human-computer interaction method for a cockpit display screen provided in an exemplary embodiment of this application is shown, the method comprising: Step 910: In response to an unlocking operation on at least one application card locked in a preset area, unlock at least one application card.

[0089] Optionally, the unlocking operation includes at least one of the following: Long press the locked app card, tap the unlock control on at least one app card, perform a preset swipe gesture, or receive a voice unlock command.

[0090] Step 920: In response to the switching command, at least one unlocked program card moves synchronously with the other program cards.

[0091] Among them, the switching command is a user operation command used to trigger the change of desktop content or page swiping.

[0092] In some embodiments, the method further includes: in response to a batch unlock command, unlocking the current locked program cards all at once.

[0093] Optionally, after unlocking at least one application card, the first mark on at least one application card is removed.

[0094] The following describes exemplary embodiments related to this application.

[0095] 1. User manually triggers the locking of the program card. Figure 3 This diagram illustrates the process of locking a program card manually by the user. Figure 3 As shown in section (A), the user can click the three-dot menu bar above the target program card 102 that they want to lock. Figure 3 As shown in section (B), in response to a triggering operation of the expandable function menu entry or the three-dot menu bar, the cockpit display shows a pop-up window overlaid above the target program card 102, displaying two options: "Open Fullscreen" and "Lock Window". When the user clicks the lock window control, the system begins executing the locking logic. Figure 3 As shown in section (C), program card 102 moves to the first position on the left, and the remaining unlocked program cards are arranged to the right in sequence, or the program card originally located in the first position on the left swaps positions with the locked target program card. A first mark is displayed on the expandable function menu entry or three-dot menu bar above program card 102. In this embodiment, the first mark is a lock icon, indicating that the program card has been locked. It should be noted that when the program card is identified as locked, regardless of which screen page or position the program card is currently located in, the system immediately removes it from its original position and places it in a preset position. If there are other program cards in the preset position, a layout calculation is performed, and the original program cards are shifted to the right in sequence.

[0096] In summary, this embodiment introduces a user-defined trigger lock for layout adjustments, enabling dynamic optimization of screen space.

[0097] 2. Scene-aware automatic locking of application cards In some embodiments, the system runs a scene perception module in the background and continuously receives and analyzes data from the vehicle bus (such as vehicle speed and driving mode), in-cabin sensors (such as seat occupancy status), and interaction time (such as touch operation originating from a partition).

[0098] Optionally, when the system detects that at least one of the following conditions is met, it will automatically lock the corresponding application card without requiring user confirmation: When the vehicle is in motion and the passenger seat is occupied, and a touch operation is detected originating from the right half of the screen (passenger side), the "Map Navigation Card" is locked. When the real-time speed exceeds a preset threshold and frequent desktop swipe operations are detected recently, the "Intelligent Driving Status Card" is locked. When the vehicle switches from manual driving mode to advanced driver assistance mode, the intelligent driving status card is locked to facilitate continuous monitoring of the system status by the driver.

[0099] In summary, this embodiment can proactively lock relevant program cards when automatically recognizing high-load scenarios such as high-speed driving, complex intersections, or driving mode switching, and realize dynamic changes in interface layout according to the scenario defense line to achieve proactive safety intervention.

[0100] 3. After scene matching, a pop-up recommendation window appears, and the application card is locked after user confirmation. In some embodiments, when the system recognizes that the above conditions are met, it will pop up a lock recommendation for the user to confirm, and then perform the desktop lock operation after confirmation.

[0101] like Figure 10 As shown, when it is detected that the vehicle is in motion, the passenger seat is occupied, and the touch operation originates from the right half of the screen (passenger side), a lock recommendation for the "map navigation card" is triggered. A pop-up window "Can lock the map window for the driver" is displayed on the program card, and the lock control "OK" is displayed.

[0102] like Figure 11 As shown, when the real-time speed measurement is greater than the preset threshold and frequent desktop swiping operations are detected recently, the "Intelligent Driving Status Card" is locked and recommended. A pop-up window "Intelligent driving status can be locked when driving at high speed" is displayed on the program card and the lock control "OK" is displayed.

[0103] like Figure 12 As shown, when the system detects that the vehicle has switched from manual driving mode to advanced driver assistance or preset driver assistance mode, it is recommended to lock the intelligent driving status card to facilitate continuous monitoring of the system status by the driver. A pop-up window will be displayed on the program card stating "Driver assistance is enabled; you can lock the intelligent driving window," along with the lock control "OK."

[0104] In summary, this embodiment, while ensuring the system automatically detects and triggers locking scenarios, adds a user confirmation step, increasing user autonomy while maintaining intelligence, thus enhancing the flexibility of interaction. Furthermore, the pop-up prompts are intuitive and simple, reducing operational costs while driving and optimizing driving safety.

[0105] 4. Cross-desktop content adjustment with locked cards like Figure 13 The diagram illustrates a desktop content change involving pinned application cards, the method of which includes: Figure 13 As shown in section (A), the first desktop is displayed in its initial layout state. In this initial state, the in-vehicle central control screen adopts a display style with three equally divided sections. From left to right, the screen displays navigation cards, vehicle intelligent driving status cards, and multimedia application cards. The three program cards are of the same size and evenly divide the horizontal display space of the screen. All program cards are in an unlocked and swiping state by default, and the content of each card is fully displayed. The bottom quick control bar and playback controls remain in their normal display state. Among them, the left navigation card is marked as a locked card, while the middle intelligent driving card and the right multimedia card are unlocked cards. The applications corresponding to the cards can be selected as map navigation, vehicle perception status, and audio-visual entertainment programs, respectively. This application does not specifically limit the types of applications. Users can trigger the layout switching logic through gesture swiping, desktop page turning, and other commands.

[0106] like Figure 13 As shown in section (B), after receiving the switching command, the system identifies the locking attributes of each program card. The navigation card locked on the left maintains its original size, position, and screen content, remaining fixed in the left area of ​​the screen. The originally centered intelligent driving status card slides from its original centered area to the right side of the screen, while the unlocked cards gradually complete the position transition as the desktop moves.

[0107] like Figure 13 As shown in section (C), the desktop content change or page swiping action corresponding to the switching command is completed. The locked navigation card remains fixed on the far left of the screen, with no changes to its size, displayed content, or screen coordinates; the original intelligent driving status card slides completely out of the visible area with the desktop, the original right-side multimedia card is split to the middle partition, and the new application card fills the far right partition, completing the desktop page content change. Simultaneously, the locked navigation card is distinguished by an identifier at the top of the card; in this embodiment, the first identifier is a lock-shaped icon at the top of the card. In some embodiments, the first identifier may also be one or more of the following: border highlighting, corner mark, background color change, top layer mark, or icon animation prompt.

[0108] Figure 14 This diagram illustrates the hierarchical relationship between the first desktop, unlocked application cards, and locked application cards during desktop content changes. As shown, the locked application cards remain fixed and unobstructed throughout the desktop content changes, thus occupying the top layer. The unlocked application cards, which can be slid along with switching commands, are located in the middle layer, while fixed controls in the first desktop are located at the bottom layer, remaining unchanged regardless of any operation.

[0109] In summary, the card-locking layout scheme proposed in this application keeps the locked cards permanently stationary in a fixed area of ​​the screen during desktop content changes, while the unlocked cards follow the desktop page to complete the sliding replacement. This ensures that high-frequency, essential applications such as navigation remain within the driver's field of vision throughout the entire process, eliminating the need to repeatedly open the navigation program when desktop content changes. This optimizes the in-vehicle cockpit desktop interaction experience and reduces the operational costs and driving distraction hazards caused by repeatedly accessing applications while driving.

[0110] 5. Desktop card layout automatically adjusts when locked cards are present. like Figure 15 This diagram illustrates a scenario where a locked card prioritizes occupying a larger layout. (See diagram for example.) Figure 15 As shown in section (A), the initial layout of the vehicle's central control desktop is displayed. The central control screen adopts a left-right dual-card layout, with the desktop containing locked program cards on the left and unlocked program cards on the right.

[0111] like Figure 15 As shown in section (B), when a 1 / 3 or 2 / 3 layout is detected and the locked application card is small, the system proactively adjusts the layout, implementing the logic that the locked navigation card should occupy a larger display area. The sizes of both are adjusted so that the locked navigation application card is large.

[0112] In summary, this application implements layout priority control based on card locking status. When two cards are on the same screen, the locked card is given priority in allocating a large display space, while the unlocked card is adapted to the remaining screen area. When the desktop content changes, the layout specifications of the locked card do not change with the page. This ensures that high-frequency applications such as navigation can reside on the screen in a large size for easy reading by the driver, while also standardizing the size arrangement of the unlocked card to prevent the unlocked application from crowding out the navigation display area, thereby improving the regularity of the in-vehicle desktop layout and driving safety.

[0113] 6. The target program card performs an unlock operation. Figure 16 A diagram illustrating the unlocking of a program card is shown. (Example) Figure 16 As shown in section (A), the initial desktop of the vehicle's central control system adopts a three-part layout. The navigation card on the left is currently locked. By long-pressing or clicking the three-dot menu bar of the navigation card, the user can overlay an operation pop-up window above the card. The pop-up window displays two types of interactive options: "Open Full Screen" and "Unlock Window". In response to triggering the unlock option in the pop-up window, a card unlock command is sent to the cockpit system.

[0114] like Figure 16As shown in section (B), upon receiving the unlock command, the in-vehicle system cancels the lock mark and fixed layout priority of the navigation card, no longer forcibly occupying the large fixed area on the left. The desktop card arrangement is automatically readjusted, with the previously locked navigation card moving from the far left to the center of the desktop. The three cards still maintain the rule of dividing the screen into three equal parts. All cards can subsequently move synchronously with the horizontal swipe operation on the desktop and switch pages, no longer fixed to the screen. At the same time, the navigation card can be distinguished by its attributes through the first indicator at the top of the card when locked, and this first indicator disappears synchronously after unlocking.

[0115] In summary, this application enables convenient unlocking of locked cards through pop-up interaction. After unlocking, the layout priority and fixed position restriction of the target card are removed, and the card returns to a free layout mode where it is arranged equally with other applications. It can achieve both permanent fixed display of navigation during the locked phase and one-click unlocking to restore the normal desktop layout as needed, flexibly adapting to the desktop layout needs of drivers in different driving scenarios and improving the flexibility of cockpit desktop customization.

[0116] 7. After all cards are unlocked, the regular desktop content for unlocked cards changes. like Figure 17 As shown in section (A), the first desktop has unlocked program cards. When a desktop content change operation is performed, all program cards move along with the switching operation.

[0117] like Figure 17 As shown in section (B), after the desktop content is changed, the previously unlocked program cards are moved off the display screen along with the original desktop page and no longer remain on the screen. All program cards on the first desktop are replaced, and all program cards on the second desktop are currently displayed. Simultaneously, during the card locking phase, the locking attribute can be distinguished by a lock-shaped icon; this lock icon is simultaneously removed after unlocking. In some embodiments, the lock icon may also be one or more of the following: border highlight, corner mark, layer on top, background color change, or icon animation tooltip.

[0118] In summary, after unlocking, this application cancels the card's layout privileges, and the card reverts to its regular unlocked attribute. When turning pages on the desktop, the card will slide and change synchronously with the entire page content. This not only meets the essential need for a persistent display of driving navigation, but also restores the native desktop logic of full card linkage switching when fixed cards are not required, flexibly adapting to different usage needs of drivers.

[0119] The following is a schematic diagram of the module architecture of the program card locking system described in this application.

[0120] like Figure 18As shown, the system includes a multi-source data input link, a scene perception module, a recommendation pop-up generation module, a card status manager, and a desktop rendering engine. It is divided into two parallel locking execution paths: scene intelligent recommendation locking and user manual locking. The specific working logic is as follows: First, the system sends perception information to the scene perception module through three data sources: vehicle bus data provides real-time vehicle speed and overall driving mode information; in-cabin sensor data reflects seat occupancy status to identify whether the front passenger is seated; and interaction event data records the screen partition source of touch operations, distinguishing between the driver's and front passenger's operating areas. These three types of data are aggregated in the scene perception module, where the multi-source data fusion and status recognition unit performs data parsing before sending it to the recommendation rule engine.

[0121] The recommendation rule engine includes three preset judgment logics: Rule A: When the vehicle is in motion, the passenger seat is occupied, or the touch operation originates from the right side of the screen, the map navigation card recommendation will be locked. Rule B: If the vehicle's real-time speed exceeds a preset threshold, or the number of swipes on the desktop exceeds the limit per unit time, the intelligent driving status card will be locked and recommended. Rule C: When the vehicle switches from manual driving to assisted / preset driving mode, the intelligent driving status card lock recommendation is triggered.

[0122] When any rule is met, a recommendation pop-up is generated, along with a scene description text. After user confirmation or automatic confirmation within a preset time limit, a lock command is sent to the card status manager.

[0123] In addition, the system also supports independent manual locking paths. Users can click the lock option in the card's three-dot menu to directly issue the first locking operation to the card status manager, forming a manual trigger chain; the automatic locking after confirmation in the aforementioned recommendation pop-up is the second locking operation, and both paths ultimately converge to the card status manager.

[0124] Upon receiving a lock command, the card state manager updates the lock status identifier of the corresponding application card. The identifier parameter is then sent to the desktop rendering engine, which performs differentiation based on the lock identifier.

[0125] In some embodiments, the pop-up window requires the user to manually click to confirm before locking.

[0126] In other embodiments, the pop-up window does not require manual operation and automatically locks the program card after a preset time.

[0127] In summary, the method provided in this application can achieve automatic locking through a rules engine, while also supporting users to manually customize the locking operation, thus balancing the needs of intelligent protection for driving safety and the user's need to manually customize the desktop.

[0128] The above-mentioned human-computer interaction method for cockpit displays, including "1. User manually triggers locking of program cards", and / or "2. Scene-aware automatic locking of program cards", and / or "3. Pop-up recommendation after scene matching, and user confirmation to lock program cards", and / or "4. Change of cross-desktop page containing locked cards", and / or "5. Adaptive adjustment of desktop card layout when locked cards exist", and / or "6. Target program card performs unlocking operation", and / or "7. Change of normal desktop content without locked cards after all cards are unlocked", can be implemented independently as an embodiment, or can be combined in pairs, in groups of three, or in combination of multiple features to implement an embodiment. This application does not limit this.

[0129] Optionally, the combination includes at least one of the following: combining "1. User manually triggers locking of program cards" with "2. Scene-aware automatic locking of program cards"; combining "1. User manually triggers locking of program cards" with "3. Pop-up recommendation after scene matching, and user confirmation to lock program cards"; combining "1. User manually triggers locking of program cards" with "4. Change of cross-desktop page content containing locked cards"; combining "1. User manually triggers locking of program cards" with "5. Desktop card layout adaptive adjustment when locked cards exist"; combining "2. Scene-aware automatic locking of program cards" with "7. Regular desktop content change when no locked cards are unlocked"; combining "3. Pop-up recommendation after scene matching, and user confirmation to lock program cards" with "4. Change of cross-desktop page content containing locked cards"; combining "3. Pop-up recommendation after scene matching, and user confirmation to lock program cards" with "5. Desktop card layout adaptive adjustment when locked cards exist"; The following combinations are possible: "Adaptive adjustment of card layout"; "3. Pop-up recommendation after scene matching, locking program card after user confirmation" and "6. Target program card performs unlock operation"; "3. Pop-up recommendation after scene matching, locking program card after user confirmation" and "7. Change of normal desktop content for unlocked cards after all cards are unlocked"; "4. Change of cross-desktop page content containing locked cards" and "5. Adaptive adjustment of desktop card layout when locked cards exist"; "4. Change of cross-desktop page content containing locked cards" and "6. Target program card performs unlock operation"; "6. Target program card performs unlock operation" and "7. Change of normal desktop content for unlocked cards after all cards are unlocked"; Three, four, or even all seven technical features can be selected and combined, for example: combining "1, 2, 3", combining "1, 4, 5, 6", or combining all seven features to achieve the entire interaction process.

[0130] All of the above combinations are based on the card differentiation locking and desktop rendering logic of this application. The execution order of the steps in each combination can be flexibly adjusted according to the actual interaction needs of the vehicle central control screen. This application does not limit this.

[0131] Figure 19 A block diagram of a human-machine interface device 1900 for a cockpit display screen provided in an exemplary embodiment of this application is shown. The human-machine interface device 1900 includes a display module 1910 and a control module 1920.

[0132] Display module 1910 is used to display the first desktop, which includes multiple program cards.

[0133] The control module 1920 is configured to lock at least one program card in a preset area of ​​the first desktop in response to a locking operation for at least one program card among a plurality of program cards and / or the fulfillment of a scene trigger condition.

[0134] The control module 1920 is also used to remove at least one program card from its original position and insert it into a preset area of ​​the first desktop; and to sequentially move other program cards in the first desktop, excluding at least one program card, to other areas other than the preset area and / or other desktops other than the first desktop for display.

[0135] Optionally, the control module 1920 is configured to, in response to a locking operation on at least one of a plurality of program cards, lock at least one program card in a preset area of ​​the first desktop; lock at least one program card in the preset area of ​​the first desktop when a scene trigger condition is met; display information about the recommended locked at least one program card when the scene trigger condition is met; and lock at least one program card in the preset area of ​​the first desktop in response to a locking operation on the recommended at least one program card.

[0136] Optionally, the control module 1920, in response to a trigger operation on at least one program card, displays a pop-up window overlaid on at least one program card, the pop-up window including a locking control; in response to a trigger operation on the locking control, locks at least one program card in a preset area of ​​the first desktop; wherein the trigger operation includes at least one of long press, click, performing a preset gesture, and receiving a voice command.

[0137] In some embodiments, the scenario triggering conditions include at least one of the following: the vehicle is in motion and the touch operation is detected to originate from touch data in an area other than a preset area on the first desktop; the real-time vehicle speed is greater than a preset threshold and the number of desktop swipe operations within a unit time period is greater than a first quantity threshold; or the driver switches from manual driving mode to assisted driving mode or preset driving mode.

[0138] The control module 1920 is also used to respond to adjustment commands, keep at least one program card locked in the preset area unchanged, and switch the remaining program cards other than the at least one program card to the program cards corresponding to the second desktop; wherein, the switching command is a user operation command used to trigger desktop content change or page swiping.

[0139] The control module 1920 is also configured to set the visual hierarchy of at least one program card to be higher than the desktop layer, and to lock the position of at least one program card at the absolute coordinate position of a preset area during the duration of the desktop content update animation triggered in response to the switching command.

[0140] The control module 1920 is used to keep the at least one program card locked in the preset area unchanged when the switching instruction continues to be executed, and to switch other program cards other than the at least one program card to the program card corresponding to the third desktop.

[0141] Optionally, the control module 1920 is further configured to lock the first program card at a first position in a preset area of ​​the first desktop in response to a locking operation on the first program card; and to lock the second program card at a second position in a preset area of ​​the first desktop in response to a locking operation on the second program card.

[0142] Display module 1910 is used to display a first mark on at least one program card locked in a preset area. The first mark indicates that at least one program card is in a locked state. The first mark includes one or more of the following: a badge, a color change, a highlighted border, a semi-transparent overlay, an icon change, and an animation effect.

[0143] The control module 1920 is used to automatically traverse other unlocked program cards in the first desktop and set their display size to the second size when it detects that there is a program card in the first desktop that is locked and whose current display size is the first size; wherein the first size is not less than the second size, the first size is the display size of the program card in the locked state, and the second size is the display size of the program card in the unlocked state.

[0144] The control module 1920 further responds to an unlocking operation on at least one program card locked in a preset area by releasing the locked state of at least one program card; and responds to a switching command by moving the at least one unlocked program card synchronously with other program cards; wherein the switching command is a user operation command used to trigger a change of desktop content or page swiping. Optionally, the unlocking operation includes at least one of the following: long-pressing a locked program card, clicking the unlock control on at least one program card, performing a preset swipe gesture, or receiving a voice unlock command.

[0145] The control module 1920 is also used to respond to batch unlock commands, releasing the lock status of all currently locked program cards at once. After releasing the lock status of at least one program card, the first mark on at least one program card is removed.

[0146] It should be noted that the specific limitations of the embodiments of the human-computer interaction device for the cockpit display screen provided above can be found in the limitations of the human-computer interaction method for the cockpit display screen above, and will not be repeated here. Each module of the above device can be implemented entirely or partially by software, hardware, or a combination thereof. Each module can be embedded in the processor of the computer device in hardware form or independent of the processor of the computer device, or it can be stored in the memory of the computer device in software form, so that the processor can call and execute the corresponding operations of each module.

[0147] Figure 20 A schematic diagram of a human-machine interface device for a cockpit display screen provided in an exemplary embodiment of this application is shown. The human-machine interface device 2000 for the cockpit display screen can be used to perform the method steps in the above embodiments. The human-machine interface device 2000 for the cockpit display screen includes: a processor 2001, an input / output device 2002, a memory 2003, and a touchscreen 2004.

[0148] The processor 2001 includes one or more processing cores, and the processor 2001 executes various functional applications and information processing by running software programs and modules.

[0149] The memory 2003 can be connected to the processor 2001 and the input / output device 2002.

[0150] The memory 2003 can be used to store a computer program executed by the processor, and the processor 2001 is used to execute the computer program to implement the various steps in the above method embodiments.

[0151] Furthermore, the memory 2003 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, including but not limited to: magnetic disks or optical disks, electrically erasable programmable read-only memory, erasable programmable read-only memory, static on-demand memory, read-only memory, magnetic memory, flash memory, and programmable read-only memory.

[0152] For details not described in this embodiment, please refer to the method-side embodiment above, which will not be repeated here.

[0153] This application also provides a computer-readable storage medium storing a computer program for execution by a processor to implement the desktop switching method performed by the aforementioned computer device. In some embodiments, the computer-readable storage medium may include ROM (Read-Only Memory), RAM (Random-Access Memory), SSD (Solid State Drives), or optical disc, etc. The random access memory may include ReRAM (Resistance Random Access Memory) and DRAM (Dynamic Random Access Memory).

[0154] This application also provides a chip, which includes programmable logic circuits and / or program instructions, and when the chip is running, it is used to implement the above-described human-machine interaction method for cockpit displays.

[0155] This application also provides a computer program product, which includes a computer program stored in a computer-readable storage medium. A processor reads from the computer-readable storage medium and executes the computer program to implement the above-described human-computer interaction method for a cockpit display screen.

[0156] It should be understood that the term "instruction" mentioned in the embodiments of this application can be a direct instruction, an indirect instruction, or an indication of a relationship. For example, A instructing B can mean that A directly instructs B, such as B being able to obtain information through A; it can also mean that A indirectly instructs B, such as A instructing C, so B can obtain information through C; or it can mean that there is a relationship between A and B.

[0157] In the description of the embodiments of this application, the term "correspondence" may indicate that there is a direct or indirect correspondence between two things, or that there is an association between two things, or that there is a relationship of instruction and being instructed, configuration and being configured, etc.

[0158] In some embodiments of this application, "predefined" can be achieved by pre-storing corresponding codes, tables, or other means of indicating relevant information in the device (e.g., including sensing signal receiving nodes and sensing signal transmitting nodes). This application does not limit the illustrative implementation method. For example, "predefined" can refer to what is defined in the protocol.

[0159] In some embodiments of this application, "protocol" may refer to a standard protocol in the field of communications, such as Long Term Evolution (LTE). This application does not limit the scope of the Long Term Evolution (LTE) protocol, the New Radio (NR) protocol, and related protocols to be used in future communication systems.

[0160] In this article, "multiple" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship.

[0161] In this article, "greater than or equal to" can mean greater than or equal to, and "less than or equal to" can mean less than or equal to.

[0162] Furthermore, the step numbers described herein are merely illustrative of one possible execution order between steps. In some other embodiments, the steps may not be executed in the order of their numbers, such as two steps with different numbers being executed simultaneously, or two steps with different numbers being executed in the reverse order of the illustration. This application does not limit this.

[0163] Those skilled in the art will recognize that the functions described in the embodiments of this application in one or more of the above examples can be implemented using hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any medium that facilitates the transfer of a computer program from one place to another. Storage media can be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0164] The above are merely exemplary embodiments of this application and are not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application shall be included within the protection scope of this application.

Claims

1. A human-computer interaction method for a cockpit display screen, characterized in that, The method is performed by the cockpit system, and the method includes: Display a first desktop, which includes multiple application cards; In response to a locking operation on at least one of the plurality of program cards and / or the fulfillment of a scene trigger condition, the at least one program card is locked in a preset area of ​​the first desktop.

2. The method according to claim 1, characterized in that, Locking the at least one program card in a preset area of ​​the first desktop includes: Remove the at least one program card from its original position and insert it into a preset area of ​​the first desktop; The program cards in the first desktop, excluding the at least one program card, are sequentially moved to other areas other than the preset area and / or other desktops other than the first desktop for display.

3. The method according to claim 1 or 2, characterized in that, The step of locking the at least one program card in a preset area of ​​the first desktop in response to a locking operation on at least one of the plurality of program cards and / or the fulfillment of a scene trigger condition includes at least one of the following: In response to a locking operation on at least one of the plurality of program cards, the at least one program card is locked in a preset area of ​​the first desktop; When the scene triggering conditions are met, the at least one program card is locked in a preset area of ​​the first desktop; If the scenario triggering conditions are met, information about at least one recommended locked program card will be displayed; In response to a locking operation on the recommended at least one program card, the at least one program card is locked in a preset area of ​​the first desktop.

4. The method according to claim 3, characterized in that, The step of locking the at least one program card in a preset area of ​​the first desktop in response to a locking operation on at least one of the plurality of program cards includes: In response to a trigger operation on the at least one application card, a pop-up window is overlaid on the at least one application card, the pop-up window including a lock control; In response to a trigger operation on the locking control, the at least one program card is locked in a preset area of ​​the first desktop; The triggering operation includes at least one of long press, tap, executing a preset gesture, and receiving a voice command.

5. The method according to claim 3, characterized in that, The scenario triggering conditions include at least one of the following: The vehicle is in motion and a touch operation is detected originating from touch data in an area of ​​the first desktop other than the preset area; The real-time vehicle speed is greater than a preset threshold and the number of desktop swipe operations within a unit time period is greater than the first quantity threshold. Switch from manual driving mode to assisted driving mode or preset driving mode.

6. The method according to claim 1 or 2, characterized in that, The method further includes: In response to a switching command, while keeping at least one program card locked in the preset area unchanged, other program cards besides the at least one program card are switched to the program cards corresponding to the second desktop. The switching command is a user operation command used to trigger a change in desktop content or a page swipe.

7. The method according to claim 6, characterized in that, The step of keeping at least one program card locked in the preset area unchanged includes: The visual hierarchy of the at least one program card is set to be higher than the desktop layer, and the position of the at least one program card is locked in the absolute coordinate position of the preset area during the duration of the desktop content update animation triggered in response to the switching command.

8. The method according to claim 6 or 7, characterized in that, The method further includes: When the switching instruction is executed, the at least one program card locked in the preset area remains unchanged, and the other program cards besides the at least one program card are switched to the program cards corresponding to the third desktop.

9. The method according to claim 2, characterized in that, The plurality of program cards includes a first program card and a second program card; In response to a locking operation on the first application card, the first application card is locked in a first position within a preset area of ​​the first desktop. In response to a locking operation on the second application card, the second application card is locked in a second position within a preset area of ​​the first desktop.

10. The method according to claim 1 or 2, characterized in that, The method further includes: A first mark is displayed on at least one program card locked in the preset area, the first mark being used to indicate that the at least one program card is in a locked state.

11. The method according to claim 10, characterized in that, The first marker includes one or more of the following: a badge, a color change, a highlighted border, a semi-transparent overlay, an icon change, and an animation effect.

12. The method according to claim 2, characterized in that, The method further includes: When it is detected that there is an application card in the first desktop that is locked and currently displayed at the first size, the other application cards in the first desktop that are unlocked are automatically traversed and their display sizes are set to the second size. Wherein, the first size is not smaller than the second size, the first size is the display size of the program card in the locked state, and the second size is the display size of the program card in the unlocked state.

13. The method according to claim 1 or 2, characterized in that, The method further includes: In response to an unlocking operation on at least one application card locked in the preset area, the locked state of the at least one application card is released; In response to a switching command, the at least one unlocked program card moves synchronously with the other program cards; The switching command is a user operation command used to trigger a change in desktop content or a page swipe.

14. The method according to claim 13, characterized in that, The unlocking operation includes at least one of the following: Long press the locked app card, tap the unlock control on at least one app card, perform a preset swipe gesture, or receive a voice unlock command.

15. The method according to claim 13 or 14, characterized in that, The method further includes: In response to a batch unlock command, the lock status of all currently locked application cards is unlocked at once.

16. The method according to claim 10, characterized in that, The method further includes: After unlocking the at least one program card, remove the first mark on the at least one program card.

17. A human-computer interaction device for a cockpit display screen, characterized in that, The device includes a module for implementing the human-computer interaction method for a cockpit display screen as described in any one of claims 1 to 16.

18. A vehicle-mounted device or vehicle, characterized in that, The vehicle equipment or vehicle includes: a processor and a memory, the memory storing a computer program, the computer program being loaded and executed by the processor to implement the human-machine interaction method for a cockpit display screen as described in any one of claims 1 to 16.

19. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that is loaded and executed by a processor to implement the human-computer interaction method for a cockpit display screen as described in any one of claims 1 to 16.

20. A computer program product, characterized in that, The computer program product stores a computer program that is loaded and executed by a processor to implement the human-computer interaction method for a cockpit display screen as described in any one of claims 1 to 16.

Images