Human-machine interaction method, device, equipment and program product for cockpit display screen

Abstract

The application discloses a man-machine interaction method and device for a cockpit display screen, equipment, a medium and a program product, and belongs to the field of man-machine interaction. The method supports an intelligent cockpit applied to a vehicle or an aircraft, is executed by a cockpit system, and comprises the following steps: a first desktop is displayed, the first desktop corresponds to a first scene; the first desktop is switched to a second desktop under the condition that a first trigger condition is met and / or in response to a first trigger operation on a first scene desktop tab, the second desktop corresponds to a second scene.

Description

Technical Field

[0001] This application relates to the field of human-computer interaction, and the method supports smart cockpits for use in vehicles or aircraft. In particular, it relates to a human-computer interaction method, apparatus, device, medium, and program product for cockpit displays. Background Technology

[0002] The display screen in a smart cockpit is the core human-machine interface. Interaction methods such as multi-desktop partitioning and card-based applications directly impact the operational efficiency of drivers and passengers. Personalized and proactive interaction can be achieved by editing the in-vehicle desktop on the display or using the desktop corresponding to a preset driving mode, thus improving safety and comfort.

[0003] When editing the in-vehicle desktop, only the theme color or a few controls can be changed. The sorting and layout of the in-vehicle desktop corresponding to the preset driving mode are relatively limited, and can only be simple application sorting or addition and deletion.

[0004] Therefore, the in-vehicle desktop cannot present key information and control entry points according to the differences in actual driving scenarios. Moreover, the editing function is relatively limited and lacks flexibility. Users need to actively and frequently change the in-vehicle desktop, which increases the number of operation levels during driving and poses a risk of distraction. Summary of the Invention

[0005] This application provides a human-computer interaction method, apparatus, device, medium, and program product for a cockpit display screen, the technical solution of which includes at least: According to one aspect of the embodiments of this application, a human-computer interaction method for a cockpit display screen is provided, the method comprising: Display the first desktop, which corresponds to the first scene; If the first triggering condition is met and / or in response to the first triggering operation on the first scene desktop tab, the first desktop is switched to the second desktop, which corresponds to the second scene; The first desktop and / or the second desktop includes at least one program card. The layout of the at least one program card in the first desktop is different from that in the second desktop. The first desktop and / or the second desktop are related to the current driving scenario and / or driving state of the vehicle. The first scenario desktop tab is used to display the layout of the at least one program card in the second desktop.

[0006] Optionally, in response to a first trigger operation on a first scene desktop tab, switching the first desktop to the second desktop includes: In response to a first click operation on a first scene desktop tab, the first desktop is switched to a second desktop, the second desktop including at least one program card arranged in the layout shown by the first scene desktop tab.

[0007] Optionally, if the first triggering condition is met, the first desktop is switched to the second desktop, including at least one of the following: if the first triggering condition is met, displaying text corresponding to the first triggering condition in the form of a pop-up window or banner on the first desktop; or switching the first desktop to the second desktop in response to a second click operation on the pop-up window or banner.

[0008] Optionally, if the first triggering condition is met, the first desktop is switched to the second desktop, including: automatically switching the first desktop to the second desktop when the first triggering condition is detected.

[0009] Optionally, the first triggering condition is met, including at least one of the following: The current time is detected to be a preset time and the vehicle's current location is on a preset route; and / or, the vehicle's driving scenario is a commuting scenario; The current vehicle speed has been continuously higher than the preset speed for more than a first preset time; and / or the vehicle's driving scenario is a long-distance scenario. The vehicle is detected to be connected to a charging station and is currently parked; and / or the vehicle's driving scenario is a charging / rest scenario. The current weather is detected to be within the preset weather conditions and the vehicle is currently in motion; and / or, the vehicle's driving scenario is a safety escort scenario; The system detects that there is an occupant in the current front passenger seat and the vehicle is currently in motion; and / or, the vehicle's driving scenario is a front passenger entertainment scenario; The system detects a meeting schedule on the calendar and the vehicle has been stationary for more than a second preset duration; and / or the vehicle's driving scenario is a mobile office scenario.

[0010] Optionally, the first desktop includes a first control; in response to a third click operation on the first control and / or a preset gesture detected in a first preset area, at least one scene desktop tab is displayed, the at least one scene desktop tab including the first scene desktop tab.

[0011] Optionally, in response to a third click operation on the first control and / or detection of a preset gesture in the first preset area, the size of at least one program card included in the first desktop is reduced, and at least one scene desktop tab is displayed in a blank area on the first desktop; Among them, at least one scene desktop tab does not overlap with at least one program card.

[0012] Optionally, in response to a custom action on a scene desktop tab, the first desktop displays one or more of a second, third, and fourth preset area, and creates a new scene desktop tab, which is in edit mode.

[0013] Optionally, the second preset area is used to delete at least one program card included in the new scene desktop tab; the third preset area is used to preview and / or adjust the layout of at least one program card included in the new scene desktop tab; and the fourth preset area displays one or more icons.

[0014] Optionally, when the second preset area is displayed on the first desktop, in response to a first drag operation of at least one program card included in the new scene desktop tab, at least one program card is deleted if at least one program card is detected to be located in the second preset area.

[0015] Optionally, when the third and fourth preset areas are displayed on the first desktop, in response to a second drag operation on one or more icons in the fourth preset area, if one or more icons are detected to be located in the third preset area, at least one program card corresponding to one or more icons is added to a new scene desktop tab according to a preset layout.

[0016] Optionally, when the third preset area is displayed on the first desktop, in response to a third drag operation on at least one program card within the third preset area, the layout of at least one program card included in the new scene desktop tab is adjusted.

[0017] Optionally, in response to a confirmation action for the new scene desktop tab, the first desktop is switched to the desktop corresponding to the new scene desktop tab.

[0018] Optionally, in response to a confirmation action for a new scene desktop tab, the fourth preset area is de-displayed, and at least one program card included in the new scene desktop tab in the third preset area is enlarged.

[0019] According to another aspect of the embodiments of this application, a human-machine interaction device for a cockpit display screen is provided, the device comprising: The display module is used to display the first desktop, which corresponds to the first scene. The switching module switches the first desktop to the second desktop when the first trigger condition is met and / or in response to the first trigger operation on the desktop tab of the first scene is met. The second desktop corresponds to the second scene. The first desktop and / or the second desktop includes at least one program card. The layout of the at least one program card in the first desktop is different from that in the second desktop. The first desktop and / or the second desktop are related to the current driving scenario and / or driving state of the vehicle. The first scenario desktop tab is used to display the layout of the at least one program card in the second desktop.

[0020] Optionally, the switching module is also configured to switch the first desktop to a second desktop in response to a first click operation on the first scene desktop tab, wherein the second desktop includes at least one program card arranged in the layout shown by the first scene desktop tab.

[0021] Optionally, the switching module is also used to display text corresponding to the first trigger condition in the form of a pop-up or banner on the first desktop when the first trigger condition is met; and to switch the first desktop to the second desktop in response to a second click operation on the pop-up or banner.

[0022] Optionally, the switching module is also used to automatically switch the first desktop to the second desktop when the first trigger condition is detected.

[0023] Optionally, the first triggering condition is met, including at least one of the following: The current time is detected to be a preset time and the vehicle's current location is on a preset route; and / or, the vehicle's driving scenario is a commuting scenario; The current vehicle speed has been continuously higher than the preset speed for more than a first preset time; and / or the vehicle's driving scenario is a long-distance scenario. The vehicle is detected to be connected to a charging station and is currently parked; and / or the vehicle's driving scenario is a charging / rest scenario. The current weather is detected to be within the preset weather conditions and the vehicle is currently in motion; and / or, the vehicle's driving scenario is a safety escort scenario; The system detects that there is an occupant in the current front passenger seat and the vehicle is currently in motion; and / or, the vehicle's driving scenario is a front passenger entertainment scenario; The system detects a meeting schedule on the calendar and the vehicle has been stationary for more than a second preset duration; and / or the vehicle's driving scenario is a mobile office scenario.

[0024] Optionally, the first desktop includes the first control.

[0025] Optionally, the switching module is also configured to display at least one scene desktop tab in response to a third click operation on the first control and / or in the event of a preset gesture detected in the first preset area, wherein the at least one scene desktop tab includes the first scene desktop tab.

[0026] Optionally, the switching module is also configured to, in response to a third click operation on the first control and / or a preset gesture detected in the first preset area, reduce the size of at least one program card included in the first desktop and display at least one scene desktop tab in a blank area on the first desktop; Among them, at least one scene desktop tab does not overlap with at least one program card.

[0027] Optionally, the display module is also used to display one or more of a second, third, and fourth preset areas on the first desktop in response to custom operations on scene desktop tabs. The device also includes a creation module for creating new scene desktop tabs, which are in an editable state.

[0028] Optionally, the second preset area is used to delete at least one program card included in the new scene desktop tab; the third preset area is used to preview and / or adjust the layout of at least one program card included in the new scene desktop tab; and the fourth preset area displays one or more icons.

[0029] Optionally, when the second preset area is displayed on the first desktop, the device further includes a deletion module for deleting at least one program card in response to a first drag operation of at least one program card included in a new scene desktop tab, upon detecting that at least one program card is located in the second preset area.

[0030] Optionally, when the first desktop displays a third preset area and a fourth preset area, the device further includes an adding module for adding at least one program card corresponding to one or more icons to a new scene desktop tab in a preset layout manner, in response to a second drag operation on one or more icons in the fourth preset area.

[0031] Optionally, when the third preset area is displayed on the first desktop, the device further includes an adjustment module for adjusting the layout of at least one program card included in the new scene desktop tab in response to a third drag operation targeting a preset position of at least one program card within the third preset area.

[0032] Optionally, the switching module is also used to switch the first desktop to the desktop corresponding to the new scene desktop tab in response to a confirmation operation for the new scene desktop tab.

[0033] Optionally, the switching module is also configured to, in response to a confirmation operation for a new scene desktop tab, cancel the display of the fourth preset area and enlarge at least one program card included in the new scene desktop tab in the third preset area.

[0034] According to another aspect of the embodiments of this application, an in-vehicle device or vehicle is provided, the in-vehicle device or vehicle including: a processor; a transceiver connected to the processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to load and execute the executable instructions to implement the human-machine interaction method for a cockpit display screen as described in the various aspects above.

[0035] According to another aspect of the embodiments of this application, a computer-readable storage medium is provided, which stores at least one program that is loaded and executed by a processor to implement the human-computer interaction method for a cockpit display screen as described in the various aspects above.

[0036] According to another aspect of the embodiments of this application, a chip is provided, the chip including programmable logic circuitry and / or program instructions, which, when the chip is run on a computer device, are used to implement the human-computer interaction methods for cockpit displays described in the above aspects.

[0037] According to another aspect of the embodiments of this application, a computer program product or computer program is provided, the computer program product or computer program including computer instructions stored in a computer-readable storage medium, a processor retrieving the computer instructions from the computer-readable storage medium, and the processor executing the computer instructions to implement the human-computer interaction method for a cockpit display screen as described in the various aspects above.

[0038] The technical solutions provided in this application embodiment may include the following beneficial effects: This application switches the first desktop to the second desktop when the first triggering condition is met and / or in response to the first triggering operation on the first scene desktop tab. By customizing the combination and layout of program cards, it achieves the matching of information presentation with scene requirements, reduces the user's extra operations, and improves operation efficiency and ease of use. Attached Figure Description

[0039] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0040] Figure 1 An architectural diagram of an in-vehicle display provided in an exemplary embodiment of this application is shown; Figure 2 An architecture diagram of a scene desktop switching system provided in an exemplary embodiment of this application is shown; Figure 3This illustration shows a comparison of desktop card layouts in different scenarios provided by an exemplary embodiment of this application; Figure 4 A schematic diagram of a desktop editing interface provided in an exemplary embodiment of this application is shown; Figure 5 A schematic diagram of the data flow of an intelligent scene recommendation engine provided in an exemplary embodiment of this application is shown; Figure 6 This illustration shows a schematic diagram of the correspondence between triggering conditions and scene desktop provided in an exemplary embodiment of this application; Figure 7 A flowchart illustrating a human-computer interaction method for a cockpit display screen provided in an exemplary embodiment of this application is shown; Figure 8 This illustration shows a schematic diagram of a thumbnail streaming preview of all current desktop pages and a scene desktop tab area provided in an exemplary embodiment of this application; Figure 9 This illustration shows a schematic diagram of a thumbnail of a scene desktop tab switching method provided in an exemplary embodiment of this application; Figure 10 A schematic diagram illustrating desktop switching provided in an exemplary embodiment of this application is shown; Figure 11 This illustration shows a schematic diagram of a text corresponding to a first triggering condition displayed in the form of a pop-up window or banner, provided by an exemplary embodiment of this application. Figure 12 This illustration shows a schematic diagram of adding a new scene desktop tab according to an exemplary embodiment of this application; Figure 13 This illustration shows a schematic diagram of at least one program card in a scene desktop tab, provided in an exemplary embodiment of this application. Figure 14 This illustration shows a schematic diagram of adding at least one program card to a scene desktop tab, provided by an exemplary embodiment of this application; Figure 15 This illustration shows a schematic diagram of a desktop tab for saving a new scene, provided in an exemplary embodiment of this application. Figure 16 This illustration shows a schematic diagram of a first desktop provided in an exemplary embodiment of this application; Figure 17 This illustration shows a schematic diagram of entering desktop editing mode according to an exemplary embodiment of this application; Figure 18 A block diagram of a human-computer interaction device provided in an exemplary embodiment of this application is shown; Figure 19 A schematic diagram of the structure of a human-computer interaction device provided in an exemplary embodiment of this application is shown. Detailed Implementation

[0041] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be further described in detail below with reference to the accompanying drawings. Exemplary embodiments will be described in detail here, examples of which are illustrated in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0042] The terminology used in this disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The singular forms “a,” “the,” and “the” as used in this disclosure and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.

[0043] It should be understood that although the terms first, second, third, etc., may be used in this disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of this disclosure, a first threshold may also be referred to as a second threshold, and similarly, a second threshold may also be referred to as a first threshold. Depending on the context, the word "if" as used herein may be interpreted as "when," "when," or "in response to determination."

[0044] First, a brief introduction to the terms used in the embodiments of this application: Screens: The in-vehicle screens applicable to this application can be any one or a combination of several types, including central control screens, passenger entertainment screens, rear entertainment screens, sliding screens, smart screens, central touch screens, and head-up displays. The central control screen, located in the center of the dashboard, is the core of the vehicle's interaction, integrating commonly used functions such as navigation route planning, audio / video playback, and air conditioning and seat parameter adjustments. Many models also support smartphone connectivity and application downloads. Besides handling basic vehicle controls, the central control screen can also collaborate with other screens in the vehicle and is the most frequently used display for passengers. The passenger entertainment screen is specifically designed for the front passenger, capable of independently playing audio / video, browsing information, or running casual games without interfering with the driver's driving. It also supports smartphone screen mirroring, effectively enriching the passenger's travel experience. Rear entertainment screens are mostly installed in the seat headrests or roof, primarily serving rear passengers. These screens are generally large and, in addition to high-definition viewing, connecting external gaming devices, and simple mobile office functions, some products also include rear air conditioning and seat adjustment controls. The sliding screen is an innovative screen that can be moved and changed in installation position and tilt angle along a preset track, making it convenient for rear passengers to watch movies or temporarily work in the car. When not in use, it can be folded up and stored without taking up sunroof space.

[0045] Desktop: The desktop generally includes quick access to functions, real-time information display, and personalized settings, and serves as the interaction medium between the user and the vehicle system.

[0046] Icons: Icons are small, visual identifiers on the desktop that represent applications. They are typically presented as simple graphics (with a minimal text name) and serve as quick access points to launch applications. They are small in size, have fixed styles or support customization, and are associated with the launch command of the corresponding application. Icons intuitively distinguish different applications, allowing users to quickly launch programs with a single click, eliminating the need to search through complex menus and simplifying the operation path.

[0047] Application cards: Application cards are interactive cards or controls used to display real-time information about the application and to implement all or part of the application's functions. They have real-time information preview capabilities and can be dynamically adjusted in real time.

[0048] The features of the application cards include at least one of the following: containing visual identifiers of the application, such as application icons and application names; some application cards can also display real-time status information of the application, such as music playback progress and navigation trip prompts; having a fixed size and style, supporting arrangement on different desktops of the in-vehicle central control screen according to preset layout rules; supporting user touch operation; and adjusting the spacing or display position of the application cards synchronously according to the desktop switching during desktop dragging, switching, or bounce.

[0049] Optionally, it may appear as a navigation preview, music playback controls, or air conditioning settings panel; in the virtual space of Virtual Reality (VR) / Augmented Reality (AR), it may appear as a floating, spatially positioned stereoscopic information panel; on a head-up display, it may be integrated with the real field of view and displayed as a transparent layer for navigation or safety prompts.

[0050] The program card can be presented and interacted with as a unified information module across device forms, such as in-vehicle screens, VR or AR spaces, and head-up displays. This application does not limit this.

[0051] Secondly, the relevant content involved in this application will be introduced.

[0052] This application can be applied to smart terminal devices with multiple desktops, such as smart tablets, laptops, all-in-one smart PCs, desktop touch monitors, aircraft, and smart cockpits. The terminal is equipped with a touch interaction module, an interface rendering module, a touch command recognition module, and a dynamic animation calculation module. It can collect user touch operations in real time, parse operation commands, dynamically calculate the spacing parameters of interface elements, and complete real-time interface rendering and refresh. The terminal system sets up multiple independent desktop pages, such as a first desktop, a second desktop, a third desktop, etc. Each desktop page arranges multiple independent program cards. These program cards correspond to shortcuts to different applications such as office software, social software, audio-visual software, and utility software. The program cards will not be scaled, stretched, or deformed during desktop switching interactions.

[0053] This application uses the cockpit display screen as an example of an in-vehicle display screen, but this application is not limited to this single scenario.

[0054] Figure 1 An in-vehicle display screen 100 is shown. In different embodiments, multiple other in-vehicle displays (such as a passenger-side screen or a rear-seat entertainment screen) may be connected to the in-vehicle control system. The screen of the in-vehicle display screen 100 displays a desktop, on which one or more program cards are arranged in different layouts. Different program cards correspond to different functions, and each program card corresponds to a different in-vehicle function module. The in-vehicle control system is an electronic control unit integrated in the vehicle, responsible for real-time monitoring and management of various vehicle functions. Users issue control commands to the in-vehicle control system through interaction, thereby controlling the vehicle components.

[0055] The vehicle display screen 100 is connected to other vehicle display screens or other terminals in the vehicle via the vehicle's internal communication bus, such as the Ethernet vehicle bus or the Controller Area Network (CAN) bus; the various display program cards in the vehicle display screen 100 are implemented through the corresponding service function modules in the screen interface.

[0056] The display content on the in-vehicle display screen 100 includes a first desktop, which includes a first program card 101, a second program card 102, and a third program card 103. This application solution supports the linkage between the scene desktop tab and the first desktop, allowing for the switching of one or more of the layout, size, and type of the first program card 101, second program card 102, and third program card 103 on the first desktop according to scene requirements.

[0057] like Figure 1 As shown, the first desktop 110 displays the first program card 101, the second program card 102, and the third program card 103.

[0058] The first program card 101 is associated with a first application program, which may be a navigation program, a music program, a vehicle control program, a communication program, or any other application that can run in a vehicle environment. This application does not limit the scope of the application.

[0059] The first program card 101 dynamically displays the real-time content of the first application and / or, one or more operation / function entry points. For example, when the first application is a navigation program, the first program card 101 can display the current route, next turn prompts, and estimated arrival time in real time, and integrate operation buttons for starting navigation, ending navigation, or muting; when the first application is a music program, it can display information about the song being played, album art, and provide operation buttons for play / pause and skipping tracks.

[0060] The second program card 102 is associated with a second application. The second application can also be any applicable in-vehicle application, and its type may be the same as or different from the first application. The second program card 102 dynamically displays the content and operation of the second application in a manner similar to the first program card 101. For example, the second program card 102 may be associated with an air conditioning control program, displaying the in-vehicle temperature and fan speed mode in real time, and providing one or more touch areas for temperature adjustment and mode switching; this application does not limit this.

[0061] Optional, Figure 1The diagram shows only the first desktop, which includes a first program card 101, a second program card 102, and a third program card 103. In actual deployment, the vehicle display screen 100 can have multiple switchable or displayable desktops, and each desktop can simultaneously display, such as... Figure 1 The program card layout shown is similar to or similar to... Figure 1 The program cards shown have different layouts.

[0062] In some embodiments, the in-vehicle display screen 100 is mounted on the dashboard in the center of the cockpit, in the area to the right of the steering wheel and between the driver and passenger seats. Optionally, the in-vehicle display screen 100 can also be mounted behind the steering wheel to display vehicle status, navigation information, and driver assistance information to the driver; and / or, the in-vehicle display screen 100 can also be mounted directly in front of the passenger seat, on the back of the front seats, behind the center armrest, or tilted down from the roof to provide passengers with audio-visual entertainment, independent navigation, games, and vehicle environmental control functions; and / or, the in-vehicle display screen 100 can also be mounted via a robotic arm or sliding rail, and its height and angle can be adjusted within a certain range to adapt to different driver seating positions or usage scenarios. This application does not limit this.

[0063] Optionally, the in-vehicle display 100 is not limited to a single physical screen; it may be composed of multiple physical screens or multiple display areas seamlessly spliced ​​together to form a continuous wide display area.

[0064] In some embodiments, the vehicle display screen 100 is connected to other vehicle display screens or other terminals in the vehicle via an internal vehicle communication bus, such as an Ethernet vehicle bus or a Controller Area Network (CAN) bus; the first program card 101, the second program card 102, the third program card 103 and other application program cards in the first desktop displayed on the vehicle display screen 100 are implemented through corresponding service function modules in the screen interface.

[0065] In related technologies, human-computer interaction in smart cockpits is transforming from functional integration to scenario-based intelligence. The interaction paradigm is evolving from mechanical buttons and large touchscreens to multimodal fusion, including but not limited to voice, gestures, and gaze; information presentation is shifting from application list stacking to dynamic card-based aggregation and proactive services based on one or more scenarios, including navigation and driving.

[0066] In the process of shifting from hardware computing power to driver-centric experience optimization, we are committed to achieving intuitive and accurate information and high ease of operation in complex driving environments, and to achieving personalized and proactive interaction by sensing passenger status and vehicle environment, so as to comprehensively improve safety and comfort.

[0067] In related technologies, the operation of users creating multiple in-vehicle desktops or using one or more preset driving modes, including but not limited to Sport and Energy Saving, has at least one of the following shortcomings: The preset driving modes of related technologies only change the theme color or a few controls, and the layout is fixed, making it impossible to adjust the layout of the in-vehicle desktop for different driving scenarios. Therefore, it cannot achieve deep adaptation to different driving scenarios.

[0068] The custom desktops in related technologies are simply for sorting or adding / deleting applications, with weak customization capabilities and limited editing freedom. They cannot achieve the functionality of this application, which allows users to arbitrarily adjust the size and position of cards in edit mode by dragging and dropping, thereby creating personalized scene layouts.

[0069] In related technologies, switching scene desktops or preset driving modes relies on manual switching by the user. This passive configuration lacks proactive intelligence and cannot achieve the ability to automatically perceive and recommend suitable scene desktops to the user based on one or more conditions, including time, location, and driving status.

[0070] For example, in related technologies, the vehicle presets a driving mode, mainly adjusting the power and suspension. The desktop on the display screen only undergoes simple theme switching, without reconstructing or adjusting the layout of the desktop on the display screen, including the program cards.

[0071] For example, related technologies allow users to manually arrange application icons to achieve simple application grouping or desktop pages, but do not have the function of dragging and dropping to edit application cards, or matching the edited desktop to the driving scenario and saving it as a new desktop.

[0072] For example, the desktop layout corresponding to the preset driving mode is full screen or simple split screen, lacking multiple layout options based on one or more scenarios including commuting and long-distance driving, and does not support users to customize and extend the in-vehicle desktop according to their own needs.

[0073] In response to one or more problems in related technologies, such as insufficient flexibility, low editing freedom, and lack of proactive intelligence, this application achieves the matching of information presentation with scene requirements through one or more functions, including switching desktops based on driving status or driving scenario, preset scene desktop tabs, freely designing scene desktops, and recommending scene desktops triggered by the current scene.

[0074] The embodiments of this application include at least one of the following: In some embodiments, such as Figure 2 As shown, the cockpit system of this application sets up a scenario desktop tab area, which includes different scenario desktop tabs corresponding to different driving states and / or driving scenarios, and is used to display the layout of program cards corresponding to different scenarios.

[0075] In some embodiments, different driving states and / or driving scenarios include one or more of the following: commuting scenario, long-distance scenario, charging and rest scenario, safety escort scenario, co-pilot entertainment scenario, and mobile office scenario.

[0076] In some embodiments, each scene desktop tab is associated with an independent scene layout configuration file, which is used to indicate one or more pieces of information, including the application type, location coordinates, and size of each screen desktop card in different scenes.

[0077] In some embodiments, when it is detected that the current desktop needs to be changed, the program cards of the current desktop are reconstructed according to the information corresponding to the scene layout configuration file, and the current desktop is switched to the desktop corresponding to the scene layout configuration file.

[0078] For example, when the current desktop corresponds to a long-distance scenario, the current desktop includes a map navigation card occupying two-thirds of the current desktop and a music playback card occupying one-third of the current desktop. After switching the current desktop to a desktop corresponding to a commuting scenario, the switched desktop includes a map navigation card, a smart driving card, and a music playback card, each occupying one-third of the current desktop.

[0079] For example, such as Figure 3 As shown, the desktop can be switched in the event of changes in the scene and / or user needs.

[0080] For example, the layout of map navigation cards, intelligent driving cards, and music playback cards corresponding to commuting scenarios can be changed to a layout where map navigation occupies two-thirds and music playback cards occupy one-third, corresponding to long-distance scenarios.

[0081] By pre-setting scene desktop tabs, driving scenarios are matched with scene desktop tabs, and the desktop is switched based on the scene desktop tabs corresponding to different driving scenarios, which solves the problem of insufficient scene adaptation. By reading and applying predefined layout methods, scene-based interface reconstruction is achieved.

[0082] In some embodiments, in response to a second click operation on the second control, a new scene desktop tab is created. The scene desktop tab is in an editable state. The second control is used to create the new scene desktop tab. By customizing the scene desktop tab, the degree of editing freedom is increased, and the user's personalized needs are met.

[0083] For example, such as Figure 4As shown, in edit mode, a preview area and an editing canvas are displayed. The preview area is used to show the layout of the program cards corresponding to the current scene desktop tabs; the editing canvas is used to edit newly created scene desktop tabs. The preview area corresponds to the editing canvas, and the adjustments made to the new scene desktop tabs on the editing canvas will be updated synchronously in the preview area.

[0084] Optionally, in edit mode, an application icon area and an editing canvas are displayed. The application icon area includes one or more icons. When one or more icons are detected being dragged to a preset addition area in the editing canvas, the program card corresponding to the one or more icons is added to a new scene desktop tab, thereby realizing the function of customizing the addition of program cards.

[0085] Optionally, in edit mode, when a program card in a new scene desktop tab is detected to be dragged outside the deletion area of ​​the editing canvas, the program card is deleted from the new scene desktop tab. The remaining program cards on the editing canvas are then adjusted in layout and / or size according to a preset method, thus enabling the function of customizing the deletion of program cards. By allowing users to freely adjust the size and position of each card and save it as a custom scene, personalized configuration can be achieved.

[0086] For example, such as Figure 5 As shown, by continuously monitoring one or more of the following: vehicle bus (vehicle speed, gear, charging status), location information (Global Positioning System (GPS), Point of Interest (POI)), environmental data (weather, time), and in-cabin sensors (seat occupancy, calendar synchronization), the system proactively recommends a scenario desktop that matches the current recommendation rules when trigger conditions are met.

[0087] For example, when it is detected that the current weather is a rainstorm and the vehicle is in motion, a safety escort desktop corresponding to the current scenario is actively recommended on the first desktop in the form of a pop-up window or banner. In response to the click operation on the pop-up window or banner, the first desktop is switched to the safety escort desktop.

[0088] By sensing one or more factors, including time, location, and driving status, the system proactively recommends suitable desktops for specific scenarios, achieving an intelligent transformation from manually switching to a suitable desktop to proactively recommending a suitable desktop.

[0089] For example, such as Figure 6 As shown, the triggering condition includes switching the current desktop to the scene desktop corresponding to the triggering condition when a state and / or scene that meets the rule is detected.

[0090] For example, the current triggering condition and the corresponding scenario desktop include at least one of the following: The system detects that the current time is the preset time and the vehicle's current location is on the preset route, corresponding to the commuting desktop. The system detects that the current vehicle speed has been continuously higher than the preset speed for a period exceeding the first preset time, corresponding to the long-distance desktop. The system detects that the current vehicle is connected to the charging station and is currently parked, corresponding to the charging rest desktop. The current weather is detected to be within the preset weather conditions and the vehicle is currently in motion, corresponding to the safety escort desktop. A passenger has been detected in the current front passenger seat and the vehicle is currently in motion. (Corresponds to the front passenger entertainment screen.) The mobile office desktop is detected when a meeting is scheduled on the calendar and the vehicle has been stationary for more than the second preset duration.

[0091] Figure 7 A flowchart of a human-computer interaction method for a cockpit display screen provided in an exemplary embodiment of this application is shown, the method comprising: Step 710: Display the first desktop, which corresponds to the first scene.

[0092] The first desktop is an interactive interface with specified functions and layout in the in-vehicle system, deployed on one or more screen carriers, including the central control screen, passenger entertainment screen, rear entertainment screen, sliding screen, magic control screen, and central touch screen. The first desktop can take various forms, including one or more of the following: The platform offers various desktop options, including 3D car model control desktop, widget desktop, card-style desktop, immersive entertainment desktop, minimalist wallpaper desktop, interactive desktop, and quick control desktop. These different desktop styles cater to users' diverse needs whether the vehicle is in motion or parked.

[0093] In some embodiments, the first desktop displays program cards of a first number of applications arranged in a first layout.

[0094] The first desktop displays application cards, which differ from traditional application icons. Application icons generally serve as static or dynamic identifiers for applications and have a fixed size. Application cards, on the other hand, are visual interactive units used to carry core application information and dynamic states. They represent the application's display format on the in-vehicle desktop and are essentially card-style display components that integrate dynamic application content and interactive functions.

[0095] In some embodiments, an application card is a visual interactive module associated with a specified application, and the application card includes one or more of the following features: • Dynamically display real-time information for a specified application; • Integrates one or more entry points for operations / functions, enabling multiple functions without launching the full interface of the application; • At least one of the following: size, position, and display format can be flexibly adjusted by the user or system.

[0096] In some embodiments, the form of the first layout may include a variety of cases.

[0097] Optional, a uniform layout of n program cards evenly distributing desktop space.

[0098] Optionally, a mixed layout is used where m program cards are displayed at the first size and p program cards are displayed at the second size, where n, m, and p are all positive integers, and the first size and the second size can be set to be the same or different according to design requirements.

[0099] The first scenario includes at least one of the following: commuting scenario, long-distance scenario, charging and rest scenario, safety escort scenario, co-pilot entertainment scenario, and mobile office scenario.

[0100] In some embodiments, the scene desktop tabs corresponding to the commuting scenario include map navigation cards, intelligent driving cards, and music playback cards that occupy the same area; The desktop tabs corresponding to the long-distance scenario include a map navigation card and a music playback card, with the map navigation card taking up more space than the music playback card; The desktop tabs corresponding to the charging and resting scenarios include a media playback interface and a charging information card, with the media playback interface card occupying a larger area than the charging information card. The desktop tabs corresponding to the security escort scenario include map cards and security control cards, with map cards taking up more space than security control cards; The desktop tabs corresponding to the passenger entertainment scene include a media playback card and an instant messaging card; the media playback card occupies a larger area than the instant messaging card. The desktop tabs corresponding to mobile office scenarios include document usage cards and video conferencing cards; the document usage cards take up more space than the video conferencing cards.

[0101] For example, the first desktop corresponding to the commuting scenario includes a map navigation card, a smart driving card, and a music playback card, each occupying one-third of the first desktop. The first desktop corresponding to the long-distance scenario includes a map navigation card that occupies two-thirds of the first desktop and a music playback card that occupies one-third of the first desktop; The first desktop corresponding to the charging and resting scenario includes a media playback interface that occupies two-thirds of the first desktop and a charging information card that occupies one-third of the first desktop. The first desktop corresponding to the security escort scenario includes map cards that occupy two-thirds of the first desktop and security control cards that occupy one-third of the first desktop; The first desktop corresponding to the passenger entertainment scene includes media playback cards that occupy two-thirds of the first desktop and instant messaging cards that occupy one-third of the first desktop; The primary desktop corresponding to the mobile office scenario includes document usage cards occupying two-thirds of the primary desktop and video conferencing cards occupying one-third of the primary desktop.

[0102] Step 720: If the first triggering condition is met and / or in response to the first triggering operation on the first scene desktop tab, switch the first desktop to the second desktop, which corresponds to the second scene.

[0103] The first desktop and / or the second desktop include at least one program card. The layout of the at least one program card in the first desktop is different from that in the second desktop. The first desktop and / or the second desktop are related to the current driving scenario and / or driving state of the vehicle. The first scenario desktop tab is used to display the layout of the at least one program card in the second desktop.

[0104] The second scenario includes at least one of the following: commuting scenario, long-distance scenario, charging and rest scenario, safety escort scenario, co-pilot entertainment scenario, and mobile office scenario.

[0105] Optionally, if the layout of the first desktop and the second desktop are different, the first desktop can be switched to the second state based on the current driving scenario and / or driving state of the vehicle, so as to provide an adapted layout and content focus for different drivers and / or different driving scenarios and / or driving states.

[0106] For example, in long-distance scenarios, users have limited attention resources. By reducing card types, enlarging the size of information related to map navigation, and reconstructing the layout, the cognitive load of users receiving the necessary information from the desktop can be reduced, thereby avoiding unnecessary information from interfering with the driver's vision, ensuring driving safety, and also bringing a personalized experience to users.

[0107] For example, satisfying the first trigger condition means that, based on the driving scenario and / or driving state, when the first trigger operation is satisfied, the desktop tabs that are adapted to the driving scenario and / or driving state are actively recommended, and the desktop is automatically switched, or the desktop is switched when the user's confirmation operation is recognized.

[0108] For example, responding to a first trigger operation for a first scene desktop tab means that when a user has a need to switch desktops, the first desktop is switched to the second desktop corresponding to the first scene desktop tab selected by the user by detecting the first scene desktop tab selected by the user.

[0109] In summary, when the first triggering condition is met and / or in response to the first triggering operation on the first scenario desktop tab, the first desktop is switched to the second desktop. By customizing the combination and layout of program cards, the information presentation is matched with the needs of the scenario, reducing the user's extra operations and improving operational efficiency and ease of use.

[0110] The following sections will explain the features from two main perspectives: "Switch Desktop" and "Create and / or Edit Scene Desktop Tabs".

[0111] The following section explains how to switch desktops.

[0112] In some embodiments, the desktop is switched if at least one of the following conditions is met: User-initiated trigger; first trigger condition is met.

[0113] Among them, switching the desktop when actively triggered by the user includes: switching the first desktop to the second desktop in response to a first trigger operation on the first scenario desktop tab.

[0114] Desktop switching triggered by user In some embodiments, switching from a first desktop to a second desktop in response to a first trigger operation on a first scene desktop tab includes: In response to a first click operation on a first scene desktop tab, the first desktop is switched to a second desktop, the second desktop including at least one program card arranged in the layout shown by the first scene desktop tab.

[0115] For example, such as Figure 8 As shown, the current desktop page displays a thumbnail streaming preview and a scene desktop tab area. The thumbnails of the first desktop correspond to the scene desktop tabs of the commuting scene. The first desktop includes a map navigation card, a smart driving card, and a music playback card, each occupying one-third of the space on the first desktop.

[0116] For example, map navigation cards display one or more of the following: a next turn arrow or a zoomed-in view of an intersection, remaining distance and time, color-coded road conditions, electronic eye warnings, and the current road name. Intelligent driving cards display one or more of the following: the current operating status of the driver assistance system, automatic following distance, lane line recognition, lane keeping status, blind spot warnings for adjacent lanes, and the need for manual intervention. Music playback cards display one or more of the following: an icon for the current audio source type, an album cover thumbnail, song title and artist / radio station name, a playback progress bar, a lyrics scrolling area, and a playback mode switching option.

[0117] For example, such as Figure 9 As shown, in response to the first click operation of the scene desktop tab for the long-distance scenario, the thumbnail of the first desktop corresponding to the commuting scenario is switched to the thumbnail of the second desktop switched to the long-distance scenario. The second desktop includes a map navigation card occupying two-thirds of the second desktop on the left and a music playback card occupying one-third of the second desktop on the right.

[0118] For example, such as Figure 10 As shown, the first desktop thumbnail is switched to the second desktop thumbnail at the same time as the first desktop thumbnail is switched to the second desktop thumbnail, or after the first desktop thumbnail is switched to the second desktop thumbnail, the first desktop is switched to the second desktop.

[0119] In some embodiments, the first click operation on the desktop tab of the first scenario is an interactive action actively performed by the user and recognizable by the system, which is the triggering method for the user to actively switch desktops.

[0120] Optionally, in addition to the first click operation on the desktop tab of the first scene, there are at least one of the following triggering methods, including but not limited to: performing a specified gesture operation, voice recognition, clicking the steering wheel shortcut key, sliding the arrow keys or scroll wheel, and using a custom physical button. It should be noted that the above is only an exemplary description of switching desktops, and this application does not limit it.

[0121] In some embodiments, the conditions for switching desktops are automatically detected by the system and conform to preset rules.

[0122] Optionally, the scenario desktop tab area can be displayed directly in one or more of the following situations: the vehicle is powered on for the first time, the user account logs into the vehicle system for the first time, or the desktop is accessed for the first time after restoring factory settings.

[0123] Optionally, when switching driving scenarios or driving states, for example, when changing from daily commuting to long-distance highway travel, the user can actively change the layout and combination of the program cards bound to the current driving scenario; optionally, when the display screen is used by different drivers or passengers, or when multiple driver accounts are switched, different users have different preferences for information on the desktop, so they will actively readjust one or more of the content, including the type, size, and layout of the program cards.

[0124] In this application, differentiated card layouts are preset for different driving scenarios, ensuring that key information is presented at an appropriate size and position within the specified context. This reduces the difficulty for drivers and passengers to obtain information in different driving scenarios, decreases information search and cognitive load, and improves driving safety.

[0125] Desktop switching is triggered when the first condition is met. In some embodiments, switching from the first desktop to the second desktop upon meeting a first triggering condition includes at least one of the following: If the first triggering condition is met, the text corresponding to the first triggering condition will be displayed on the first desktop in the form of a pop-up window or banner. In response to a second click on a pop-up or banner, switch the first desktop to the second desktop.

[0126] Optionally, the pop-up window or banner may be displayed above the first desktop, in the center of the desktop, above other program cards, or near the operator's hand; this application does not limit the display position.

[0127] like Figure 11 As shown, in the case of a long-distance scenario, the text corresponding to the first trigger condition is displayed on the first desktop in the form of a pop-up window or banner.

[0128] The text corresponding to the first trigger condition is used to suggest switching to the scene desktop corresponding to the first trigger condition.

[0129] In some embodiments, satisfying the first triggering condition includes at least one of the following: The current time is detected to be a preset time and the vehicle's current location is on a preset route; and / or, the vehicle's driving scenario is a commuting scenario; The current vehicle speed has been continuously higher than the preset speed for more than a first preset time; and / or the vehicle's driving scenario is a long-distance scenario. The vehicle is detected to be connected to a charging station and is currently parked; and / or the vehicle's driving scenario is a charging / rest scenario. The current weather is detected to be within the preset weather conditions and the vehicle is currently in motion; and / or, the vehicle's driving scenario is a safety escort scenario; The system detects that there is an occupant in the current front passenger seat and the vehicle is currently in motion; and / or, the vehicle's driving scenario is a front passenger entertainment scenario; The system detects a meeting schedule on the calendar and the vehicle has been stationary for more than a second preset duration; and / or the vehicle's driving scenario is a mobile office scenario.

[0130] Optionally, the current driving scenario and / or driving state of the vehicle may also include at least one of the following: urban congestion scenario, night driving scenario, complex road scenario, outdoor scenario, pet travel scenario, anti-theft scenario, and refueling scenario.

[0131] In some embodiments, in response to a second click on a pop-up or banner, the first desktop is switched to a second desktop corresponding to the long-distance scenario.

[0132] In some embodiments, switching the first desktop to the second desktop when a first triggering condition is met includes: automatically switching the first desktop to the second desktop when the first triggering condition is detected.

[0133] By proactively pushing desktop layouts adapted to different scenarios and / or automatically switching desktops, users are no longer required to manually search for and / or switch desktops. This reduces the time spent looking away from the road and using their hands, improving driving safety. It also automatically prioritizes key information for the current scenario, preventing irrelevant information from interfering with driving decisions and reducing cognitive burden.

[0134] Next, we will explain the desktop tabs for creating and / or editing scenes.

[0135] In some embodiments, the creation and / or editing of scene desktop tabs includes at least one of the following: Delete at least one program card in the Scene Desktop tab; add at least one program card in the Scene Desktop tab; adjust the position and / or layout of at least one program card in the Scene Desktop tab.

[0136] In some embodiments, in response to a custom operation on a scene desktop tab, the first desktop displays one or more of a second preset area, a third preset area, and a fourth preset area, and creates a new scene desktop tab, which is in an edit state.

[0137] For example, a custom operation refers to an operation that triggers the scene desktop to enter the edit mode, including one or more of the following: long press on a blank area of ​​the scene desktop, double-click on a scene desktop tab, click the edit button, or pinch with two fingers.

[0138] In some embodiments, the second preset area is used to delete at least one program card included in the new scene desktop tab; the third preset area is used to preview and / or adjust the layout of at least one program card included in the new scene desktop tab; and the fourth preset area displays one or more icons.

[0139] For example, such as Figure 12 As shown, in response to a click on the Add button, a new scene desktop tab is added, and / or a thumbnail of the new scene desktop tab is displayed.

[0140] Delete at least one program card from the Scene Desktop tab. In some embodiments, such as Figure 13 As shown, when the second preset area is displayed on the first desktop, in response to a first drag operation of at least one program card included in the new scene desktop tab, at least one program card is deleted when at least one program card is detected to be located in the second preset area.

[0141] The second preset area can be the delete icon area at the bottom center of the screen, the preset strip area at the edge of the screen, or any area outside the scene desktop tabs.

[0142] Optionally, when the first desktop enters edit mode, a delete control appears in the upper right or upper left corner of at least one program card included in the new scene desktop tab, and at least one program card is deleted in response to a click operation on the delete control.

[0143] Optionally, the first drag operation refers to the user's action of long-pressing and dragging the program card via touch. After detecting that the user has long-pressed at least one program card in the new scene desktop tab for a preset time, the system enters a custom editing state.

[0144] Optionally, while the user is dragging the app card, the system acquires the coordinates of the app card's center point or the coordinates of its covered area in real time and compares them with the coordinate range of a second preset area. When at least a portion of the app card is detected to have entered the second preset area, the second preset area displays one or more visual feedback mechanisms, including highlighting, color changes, and magnification effects, to prompt the user to release the app card, which will trigger a deletion operation.

[0145] Optionally, when it is detected that a user releases a program card and the release location is within the second preset area, a deletion operation is performed to remove the program card from the display interface of the new scene desktop tab. At the same time, the relevant configuration information of the program card is deleted from the card configuration data corresponding to the new scene desktop tab, and the remaining program cards are automatically rearranged to fill the empty positions.

[0146] Optionally, after deleting an application card, an undo prompt can be displayed within a preset time, allowing users to restore the deleted application card by clicking the undo button, thus preventing accidental deletion.

[0147] In summary, users can quickly delete program cards from the scene desktop tabs through intuitive drag-and-drop operations, shortening the operation path and reducing the probability of accidental touches.

[0148] Add at least one program card to the Scene Desktop tab. In some embodiments, such as Figure 14 As shown, when the third and fourth preset areas are displayed on the first desktop, one or more icons are displayed in response to custom operations on the scene desktop tabs; In response to a second drag operation targeting one or more icons within a fourth preset area, if one or more icons are detected to be located in a third preset area, at least one program card corresponding to one or more icons is added to a new scene desktop tab according to a preset layout.

[0149] For example, in response to this custom action, the scene desktop tab enters edit mode, and one or more addable icons are displayed in a preset area of ​​the screen.

[0150] The third preset area is an added area, located at the bottom, side, pop-up layer, or any other location on the display screen.

[0151] Optionally, one or more icons may be icons of installed applications, or one or more thumbnails including service cards, shortcuts, and widgets.

[0152] In some embodiments, the user drags the target icon from the candidate area to the editing canvas area that displays a thumbnail of the new scene desktop tab via a second drag operation.

[0153] Optionally, the third preset area is the display area of ​​the new scene desktop tab, or the editing canvas area.

[0154] Optionally, when an icon enters the third preset area, the preview program card corresponding to the icon is previewed in the editing canvas, and the user is prompted to indicate the position where the program card corresponding to the icon will be placed after the icon is released; if the icon is released before entering the third preset area, the addition operation is canceled, and the icon bounces back to its original candidate position.

[0155] Optionally, after detecting that the user has released an icon in the third preset area, the system performs an add operation and rearranges the program cards on the editing canvas according to the preset layout.

[0156] For example, the preset layout includes, but is not limited to, at least one of the following: arranged in rows and columns with equal spacing and uniform card size; automatically wrapped according to card size; grouped by function category with separators or titles between groups; and placed in a more prominent or earlier position based on usage frequency or user settings.

[0157] After adding, the configuration data of the scene desktop tab will be updated synchronously, and one or more pieces of information, including the program card's identifier, position, and size, will be written into the configuration file.

[0158] Optionally, when multiple icons are selected in batches and then dragged, the icons can be added sequentially according to the selection order or preset priority.

[0159] In summary, users can select an icon from at least one set of icons and add the corresponding program card to the scene desktop tab through intuitive drag-and-drop operations, reducing the learning curve and improving the efficiency and user experience of custom editing the scene desktop tab.

[0160] Adjust the position and / or layout of at least one program card in the Scene Desktop tab. In some embodiments, adjusting the position and / or layout of at least one application card in the Scene Desktop tab includes at least one of the following: adjusting the size of at least one application card; adjusting the position of at least one application card.

[0161] In some embodiments, when a third preset area is displayed on the first desktop, in response to a third drag operation targeting a preset position of at least one program card within the third preset area, the layout of at least one program card included in the new scene desktop tab is adjusted.

[0162] Optionally, in response to a third drag operation targeting the edge control point of the program card, the size parameters of the program card are updated based on the drag distance of the third drag operation to adjust the size of the program card.

[0163] Optionally, in response to a third drag operation targeting the main area of ​​the program card, the position parameters of the program card are updated according to the drag trajectory of the third drag operation to change the position of the program card in the scene desktop tab.

[0164] For example, the layout parameters of the at least one program card are adjusted, the layout parameters including at least one of the following position parameters and / or size parameters: horizontal position, vertical position, width, height, rotation angle, and stacking order.

[0165] In some embodiments, in response to a confirmation operation for a new scene desktop tab, the first desktop is switched to the desktop corresponding to the new scene desktop tab.

[0166] In some embodiments, in response to a confirmation operation for a new scene desktop tab, the fourth preset area is de-displayed, and at least one program card included in the new scene desktop tab in the third preset area is enlarged.

[0167] like Figure 15 As shown, in response to a click on the "Complete" button, editing is complete and a new scene desktop tab is saved.

[0168] In summary, the system adjusts the position and / or layout of at least one program card in the scene desktop tab, flexibly allocates display space according to the information display needs of different program cards, improves information display efficiency and desktop space utilization, and supports diverse desktop layout styles to meet the usage habits of different users.

[0169] In addition to the above-mentioned human-computer interaction methods, the following steps may also be selected: In some embodiments, the first desktop includes a first control; in response to a third click operation on the first control and / or a preset gesture detected in a first preset area, at least one scene desktop tab is displayed, the at least one scene desktop tab including the first scene desktop tab.

[0170] Optionally, the preset gesture can be a contact gesture and / or a non-contact gesture, the non-contact gesture being recognized by the camera.

[0171] The first control includes physical or virtual buttons; for example, the first control includes a home button.

[0172] Optionally, the first preset area is at least one of the touch display area of ​​the first desktop, the blank area of ​​the desktop, or the edge area of ​​the screen; the preset gesture includes at least one of the five-finger pinch gesture, two-finger pinch gesture, long press gesture, and multi-finger swipe gesture.

[0173] For example, such as Figure 16 As shown, the first desktop includes the first control, such as... Figure 17 As shown, detecting one or more preset gestures, including five fingers clasped together, or clicking on the physical or virtual home button will serve as the trigger condition for entering the desktop editing mode.

[0174] When entering desktop editing mode, at least one scene desktop tab is displayed. The layout of at least one program card in the first desktop and / or the second desktop corresponds to the at least one scene desktop tab. By detecting the scene desktop tab selected by the user, the first desktop is switched to the second desktop.

[0175] It should be noted that this application does not limit the number of program cards included in the first desktop for different application scenarios, nor the layout of the number of program cards. The relevant implementation methods described in this application are only examples, and those skilled in the art can make various modifications according to actual needs.

[0176] The following is a schematic diagram of the module architecture for switching desktops as described in this application.

[0177] In some embodiments, this application includes one or more modules, including a scene awareness module, a scene desktop engine, a layout configuration management module, a desktop editing module, an intelligent recommendation module, and a storage module.

[0178] Optionally, the scene awareness module is used to detect user operations, including one or more operations such as physical or virtual button detection, touch operation detection, and gesture recognition, so as to respond to one or more interactive operations such as editing triggers and card dragging, and realize the functions of switching scenes and / or customizing program card layout.

[0179] Optionally, the scene awareness module can identify one or more specified gestures, including five fingers clenched, using a visual sensor or touch sensor as a trigger condition for entering the desktop editing mode.

[0180] Optionally, the scene perception module is used to detect one or more types of data, including access vehicle bus data, positioning data, environmental data, and in-cabin sensor data, to perceive the current driving scene and / or vehicle status.

[0181] Optionally, when the scene perception module detects scene switching conditions or user editing intent, the scene desktop engine calls the layout configuration management module to read the configuration, calls the interface rendering module to update the display, coordinates the desktop editing module to enter the editing state, and performs one or more functions including the creation, switching, and deletion of multiple scene desktop tabs.

[0182] Optionally, each scene desktop tab is associated with an independent scene layout configuration file. This file stores one or more layout parameters, including the application type, location coordinates, size information, and hierarchical relationship of each application card within that scene. When switching scene desktops, the layout configuration management module reads the corresponding configuration file from the storage module based on the scene identifier and provides the parsed layout parameters to the scene desktop engine. After the user completes custom editing, the layout configuration management module serializes the card layout state on the current editing canvas, generates a new configuration file, and persists it for storage.

[0183] Optionally, when a user triggers the "add desktop" operation, the desktop editing module enters a custom editing state, providing an interactive editing canvas in the upper area and a list of available applications in the lower or side areas. Users can add and remove application cards on the canvas by dragging, and / or adjust the position by dragging the card body and the size by dragging the edge control points. After editing, the desktop editing module submits the final layout result to the layout configuration management module for saving.

[0184] Optionally, the intelligent recommendation module has a built-in recommendation rule library containing multiple IF-THEN-formatted scene matching rules. Examples include one or more rules such as commuting rules, long-distance travel rules, charging / rest rules, safety escort rules, passenger entertainment rules, and mobile office rules. When the data collected by the scene perception module meets the triggering conditions of preset rules, the intelligent recommendation module generates scene switching suggestions and pushes them to the user via an unobstructed pop-up window or banner. After user confirmation, the scene desktop engine executes the corresponding scene desktop switch, thereby achieving an intelligent upgrade from passive to proactive adaptation.

[0185] Optionally, the storage module is used to store various types of data required for system operation, including but not limited to one or more of the following: layout configuration files for each scenario, recommendation rule base, application resource data, and user preference settings.

[0186] The above-mentioned human-computer interaction method for cockpit displays, including "switching desktops based on user-initiated trigger", and / or "switching desktops when the first trigger condition is met", and / or "deleting at least one program card in the scene desktop tab", and / or "adding at least one program card in the scene desktop tab", and / or "adjusting the position and / or layout of at least one program card in the scene desktop tab", can be implemented independently as an embodiment, or can be combined in pairs, in groups of three, or in combination of multiple features to implement an embodiment. This application does not limit this.

[0187] Figure 18 A block diagram of a human-machine interface device 1800 for a cockpit display screen provided in an exemplary embodiment of this application is shown. The human-machine interface device 1800 includes a display module 1810 and a switching module 1820.

[0188] Display module 1810 is used to display the first desktop, which corresponds to the first scene; The switching module 1820 switches the first desktop to the second desktop when the first trigger condition is met and / or in response to the first trigger operation on the desktop tab of the first scene, and the second desktop corresponds to the second scene; The first desktop and / or the second desktop includes at least one program card. The layout of the at least one program card in the first desktop is different from that in the second desktop. The first desktop and / or the second desktop are related to the current driving scenario and / or driving state of the vehicle. The first scenario desktop tab is used to display the layout of the at least one program card in the second desktop.

[0189] Optionally, the switching module 1820 is also configured to switch the first desktop to a second desktop in response to a first click operation on the first scene desktop tab, wherein the second desktop includes at least one program card arranged in the layout shown by the first scene desktop tab.

[0190] Optionally, the switching module 1820 is further configured to, when the first triggering condition is met, display text corresponding to the first triggering condition in the form of a pop-up window or banner on the first desktop; and, in response to a second click operation on the pop-up window or banner, switch the first desktop to the second desktop.

[0191] Optionally, the switching module 1820 is also used to automatically switch the first desktop to the second desktop when the first trigger condition is detected.

[0192] Optionally, the first triggering condition is met, including at least one of the following: The current time is detected to be a preset time and the vehicle's current location is on a preset route; and / or, the vehicle's driving scenario is a commuting scenario; The current vehicle speed has been continuously higher than the preset speed for more than a first preset time; and / or the vehicle's driving scenario is a long-distance scenario. The vehicle is detected to be connected to a charging station and is currently parked; and / or the vehicle's driving scenario is a charging / rest scenario. The current weather is detected to be within the preset weather conditions and the vehicle is currently in motion; and / or, the vehicle's driving scenario is a safety escort scenario; The system detects that there is an occupant in the current front passenger seat and the vehicle is currently in motion; and / or, the vehicle's driving scenario is a front passenger entertainment scenario; The system detects a meeting schedule on the calendar and the vehicle has been stationary for more than a second preset duration; and / or the vehicle's driving scenario is a mobile office scenario.

[0193] Optionally, the first desktop includes the first control.

[0194] Optionally, the switching module 1820 is further configured to display at least one scene desktop tab in response to a third click operation on the first control and / or in the event of a preset gesture detected in a first preset area, wherein the at least one scene desktop tab includes the first scene desktop tab.

[0195] Optionally, the switching module 1820 is further configured to, in response to a third click operation on the first control and / or a preset gesture detected in the first preset area, reduce the size of at least one program card included in the first desktop, and the display module 1810 is further configured to display at least one scene desktop tab in a blank area on the first desktop. At least one scene desktop tab does not overlap with at least one program card.

[0196] Optionally, the display module 1810 is also configured to display one or more of a second, third, and fourth preset areas on the first desktop in response to a custom operation on a scene desktop tab. The device also includes a creation module 1830 for creating a new scene desktop tab, which is in an edit state.

[0197] Optionally, the second preset area is used to delete at least one program card included in the new scene desktop tab; the third preset area is used to preview and / or adjust the layout of at least one program card included in the new scene desktop tab; and the fourth preset area displays one or more icons.

[0198] Optionally, when the second preset area is displayed on the first desktop, the device further includes a deletion module 1840 for deleting at least one program card in response to a first drag operation of at least one program card included in a new scene desktop tab, upon detecting that at least one program card is located in the second preset area.

[0199] Optionally, when the first desktop displays a third preset area and a fourth preset area, the device further includes an adding module 1850, which, in response to a second drag operation on one or more icons in the fourth preset area, adds at least one program card corresponding to one or more icons to a new scene desktop tab according to a preset layout when one or more icons are detected to be located in the third preset area.

[0200] Optionally, the device also includes an adjustment module 1860 for adjusting the layout of at least one program card included in the new scene desktop tab in response to a third drag operation for a preset position of at least one program card included in the new scene desktop tab.

[0201] Optionally, the switching module 1820 is also configured to switch the first desktop to the desktop corresponding to the new scene desktop tab in response to a confirmation operation for the new scene desktop tab.

[0202] Optionally, the switching module 1820 is also configured to, in response to a confirmation operation for a new scene desktop tab, cancel the display of the fourth preset area and enlarge at least one program card included in the new scene desktop tab in the third preset area.

[0203] This application switches the first desktop to the second desktop when the first triggering condition is met and / or in response to the first triggering operation on the first scene desktop tab. By customizing the combination and layout of program cards, it achieves the matching of information presentation with scene requirements, reduces the user's extra operations, and improves operation efficiency and ease of use.

[0204] It should be noted that the specific limitations of the embodiments of the human-computer interaction device for the cockpit display screen provided above can be found in the limitations of the human-computer interaction method for the cockpit display screen above, and will not be repeated here. Each module of the above device can be implemented entirely or partially by software, hardware, or a combination thereof. Each module can be embedded in the processor of the computer device in hardware form or independent of the processor of the computer device, or it can be stored in the memory of the computer device in software form, so that the processor can call and execute the corresponding operations of each module.

[0205] Figure 19 A schematic diagram of a human-machine interface device for a cockpit display screen provided in an exemplary embodiment of this application is shown. The human-machine interface device 1900 for the cockpit display screen can be used to perform the method steps in the above embodiments. The human-machine interface device 1900 for the cockpit display screen includes: a processor 1901, an input / output device 1902, a memory 1903, and a touchscreen 1904.

[0206] The processor 1901 includes one or more processing cores, and the processor 1901 executes various functional applications and information processing by running software programs and modules.

[0207] The memory 1903 can be connected to the processor 1901 and the input / output device 1902.

[0208] The memory 1903 can be used to store a computer program executed by the processor, and the processor 1901 is used to execute the computer program to implement the various steps in the above method embodiments.

[0209] Furthermore, the memory 1903 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, including but not limited to: magnetic disks or optical disks, electrically erasable programmable read-only memory, erasable programmable read-only memory, static on-demand memory, read-only memory, magnetic memory, flash memory, and programmable read-only memory.

[0210] For details not described in this embodiment, please refer to the method-side embodiment above, which will not be repeated here.

[0211] This application also provides a computer-readable storage medium storing a computer program, which is executed by a processor to implement the human-computer interaction method of the cockpit display screen executed by the computer device described above.

[0212] In some embodiments, the computer-readable storage medium may include: read-only memory (ROM), random-access memory (RAM), solid-state drives (SSDs), or optical discs, etc. The random-access memory may include resistive random-access memory (ReRAM) and dynamic random-access memory (DRAM).

[0213] This application also provides a chip, which includes programmable logic circuits and / or program instructions, and when the chip is running, it is used to implement the above-described human-machine interaction method for cockpit displays.

[0214] This application also provides a computer program product, which includes a computer program stored in a computer-readable storage medium. A processor reads from the computer-readable storage medium and executes the computer program to implement the above-described human-computer interaction method for a cockpit display screen.

[0215] It should be understood that the term "instruction" mentioned in the embodiments of this application can be a direct instruction, an indirect instruction, or an indication of a relationship. For example, A instructing B can mean that A directly instructs B, such as B being able to obtain information through A; it can also mean that A indirectly instructs B, such as A instructing C, so B can obtain information through C; or it can mean that there is a relationship between A and B.

[0216] In the description of the embodiments of this application, the term "correspondence" may indicate that there is a direct or indirect correspondence between two things, or that there is an association between two things, or that there is a relationship of instruction and being instructed, configuration and being configured, etc.

[0217] In some embodiments of this application, "predefined" can be achieved by pre-storing corresponding codes, tables, or other means of indicating relevant information in the device (e.g., including sensing signal receiving nodes and sensing signal transmitting nodes). This application does not limit the illustrative implementation method. For example, "predefined" can refer to what is defined in the protocol.

[0218] In some embodiments of this application, "protocol" may refer to standard protocols in the field of communications, such as the LTE protocol and related protocols applied in future communication systems, and this application does not limit it.

[0219] In this article, "multiple" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship.

[0220] In this article, "greater than or equal to" can mean greater than or equal to, and "less than or equal to" can mean less than or equal to.

[0221] Furthermore, the step numbers described herein are merely illustrative of one possible execution order between steps. In some other embodiments, the steps may not be executed in the order of their numbers, such as two steps with different numbers being executed simultaneously, or two steps with different numbers being executed in the reverse order of the illustration. This application does not limit this.

[0222] Those skilled in the art will recognize that the functions described in the embodiments of this application in one or more of the above examples can be implemented using hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any medium that facilitates the transfer of a computer program from one place to another. Storage media can be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0223] The above are merely exemplary embodiments of this application and are not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application shall be included within the protection scope of this application.

Claims

1. A human-computer interaction method for a cockpit display screen, characterized in that, The method is performed by the cockpit system, and the method includes: Display the first desktop, which corresponds to the first scene; If the first triggering condition is met and / or in response to the first triggering operation on the first scene desktop tab, the first desktop is switched to the second desktop, which corresponds to the second scene; The first desktop and / or the second desktop includes at least one program card. The layout of the at least one program card in the first desktop is different from that in the second desktop. The first desktop and / or the second desktop are related to the current driving scenario and / or driving state of the vehicle. The first scenario desktop tab is used to display the layout of the at least one program card in the second desktop.

2. The method according to claim 1, characterized in that, The step of switching the first desktop to the second desktop in response to a first trigger operation on a first scene desktop tab includes: In response to a first click operation on the first scene desktop tab, the first desktop is switched to the second desktop, wherein the at least one program card included in the second desktop is arranged in the layout manner displayed by the first scene desktop tab.

3. The method according to claim 1, characterized in that, The step of switching the first desktop to the second desktop when the first triggering condition is met includes at least one of the following: If the first triggering condition is met, the text corresponding to the first triggering condition is displayed on the first desktop in the form of a pop-up window or a banner. In response to a second click on the pop-up or banner, the first desktop is switched to the second desktop.

4. The method according to claim 1, characterized in that, The step of switching the first desktop to the second desktop when the first triggering condition is met includes: When the first trigger condition is detected, the first desktop is automatically switched to the second desktop.

5. The method according to claim 3 or 4, characterized in that, The satisfaction of the first triggering condition includes at least one of the following: The current time is detected to be a preset time and the current location of the vehicle is on a preset route; and / or, the driving scenario of the vehicle is the commuting scenario; The current vehicle speed has been detected to be continuously higher than the preset speed for a period of time exceeding the first preset time. And / or, the driving scenario of the vehicle is the long-distance scenario; The vehicle is detected to be connected to the charging station and is currently parked; and / or the vehicle's driving scenario is the charging rest scenario. The current weather is detected to be within the preset weather conditions and the vehicle is currently in motion. And / or, the driving scenario of the vehicle is the safety escort scenario; An occupant has been detected in the current front passenger seat and the vehicle is currently in the aforementioned driving state; And / or, the driving scenario of the vehicle is the passenger-side entertainment scenario; The system detects a meeting scheduled on the calendar and that the vehicle has been stationary for more than the second preset duration. And / or, the driving scenario of the vehicle is the mobile office scenario.

6. The method according to any one of claims 1 to 5, characterized in that, The method further includes: The first desktop includes a first control; In response to a third click operation on the first control and / or the detection of a preset gesture within a first preset area, at least one scene desktop tab is displayed, the at least one scene desktop tab including the first scene desktop tab.

7. The method according to claim 6, characterized in that, The step of displaying at least one scene desktop tab in response to a third click operation on the first control and / or the detection of a preset gesture within a first preset area includes: In response to a third click operation on the first control and / or a preset gesture detected in a first preset area, the size of the at least one program card included in the first desktop is reduced, and the at least one scene desktop tab is displayed in a blank area on the first desktop; Wherein, the at least one scene desktop tab does not overlap with the at least one program card.

8. The method according to claim 1, characterized in that, The method further includes: In response to a custom operation on the scene desktop tab, the first desktop displays one or more of a second preset area, a third preset area, and a fourth preset area, and creates a new scene desktop tab, which is in an edit state.

9. The method according to claim 8, characterized in that, The second preset area is used to delete at least one program card included in the new scene desktop tab; the third preset area is used to preview and / or adjust the layout of at least one program card included in the new scene desktop tab; the fourth preset area displays one or more icons.

10. The method according to claim 8 or 9, characterized in that, When the second preset area is displayed on the first desktop, the method further includes: In response to a first drag operation on at least one program card included in the new scene desktop tab, the at least one program card is deleted if the at least one program card is detected to be located in the second preset area.

11. The method according to claim 9, characterized in that, When the third preset area and the fourth preset area are displayed on the first desktop, the method further includes: In response to a second drag operation on one or more icons within the fourth preset area, if the one or more icons are detected to be located in the third preset area, at least one program card corresponding to the one or more icons is added to the new scene desktop tab according to a preset layout.

12. The method according to claim 8 or 9, characterized in that, When the third preset area is displayed on the first desktop, the method further includes: In response to a third drag operation on at least one program card within the third preset area, the layout of at least one program card included in the new scene desktop tab is adjusted.

13. The method according to any one of claims 8 to 12, characterized in that, The method further includes: In response to the confirmation operation for the new scene desktop tab, the first desktop is switched to the desktop corresponding to the new scene desktop tab.

14. The method according to claim 13, characterized in that, The step of switching the first desktop to the desktop corresponding to the new scene desktop tab in response to a confirmation operation includes: In response to a confirmation operation for the new scene desktop tab, the fourth preset area is de-displayed, and at least one program card included in the new scene desktop tab in the third preset area is enlarged.

15. A human-computer interaction device for a cockpit display screen, characterized in that, The apparatus includes modules for implementing the method according to any one of claims 1 to 14.

16. A vehicle device or vehicle, characterized in that, The vehicle equipment or vehicle includes: a processor and a memory, the memory storing a computer program, the computer program being loaded and executed by the processor to implement the human-machine interaction method for a cockpit display screen as described in any one of claims 1 to 14.

17. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that is loaded and executed by a processor to implement the human-computer interaction method for a cockpit display screen as described in any one of claims 1 to 14.

18. A computer program product, characterized in that, The computer program product stores a computer program that is loaded and executed by a processor to implement the human-computer interaction method for a cockpit display screen as described in any one of claims 1 to 14.

Images