Interface display method, storage medium, program product, electronic device, and vehicle

Abstract

An interface display method, a storage medium, a program product, an electronic device, and a vehicle. The method comprises: on the basis of a driving mode of a vehicle, by means of a display policy corresponding to the driving mode, displaying an application interface of a second application and / or auxiliary prompt information of the second application on an application interface of a first application.

Description

Interface display methods, storage media, program products, electronic devices and vehicles

[0001] This application claims priority to Chinese Patent Application No. 202510093101.6, filed on January 20, 2025, entitled "Interface Display Method, Storage Medium, Program Product, Electronic Device and Vehicle", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to, but is not limited to, the field of intelligent terminal control technology, specifically to an interface display method, storage medium, program product, electronic device, and vehicle. Background Technology

[0003] Currently, intelligent driving technology is divided into multiple levels based on the degree of automation. For example, from no automation (L0) to full automation (L5), different levels of autonomous driving systems place different demands on the driver. Most current vehicle interfaces are designed based on manufacturers' assumptions about driving scenarios, relying on fixed interface layouts and information display logic. This makes it difficult for drivers to understand the current vehicle status and when they should take over vehicle control, affecting not only the user experience but also potentially causing safety issues due to misunderstandings or misoperations. Technical solutions

[0004] This application provides an interface display method, storage medium, program product, electronic device, and vehicle to optimize interface display information and improve intelligent driving safety. The following is an overview of the subject matter described in detail herein. This overview is not intended to limit the scope of the claims.

[0005] To achieve the above objectives, according to a first aspect of this application, a method for displaying an interface is provided, the method comprising:

[0006] Based on the vehicle's driving mode, and using a display strategy corresponding to the driving mode, the application interface of the second application and / or the auxiliary prompt information of the second application are displayed on the application interface of the first application.

[0007] Optionally, displaying the application interface of the second application and / or the auxiliary prompt information of the second application on the application interface of the first application using a display strategy corresponding to the driving mode includes:

[0008] In response to the driving mode being the first driving mode, the application interface of the second application and the auxiliary prompts of the second application are displayed on the application interface of the first application; and

[0009] In response to the driving mode being a second driving mode, or in response to the driving mode being a third driving mode, auxiliary prompts from the second application are displayed on the application interface of the first application.

[0010] Optionally, in response to the driving mode being a first driving mode, displaying the application interface of a second application and the auxiliary prompt information of the second application on the application interface of the first application includes:

[0011] In response to the driving mode being a first driving mode, the application interface of the second application is displayed on the application interface of the first application in a first display mode, and the auxiliary prompt information of the second application is displayed in a second display mode.

[0012] Optionally, in response to the driving mode being a second driving mode, displaying assistance prompts from the second application on the application interface of the first application includes:

[0013] In response to the driving mode being the second driving mode, auxiliary prompts of the second application are displayed on the application interface of the first application in a second display mode.

[0014] Optionally, in response to the driving mode being a third driving mode, displaying assistance prompts from the second application on the application interface of the first application includes:

[0015] In response to the driving mode being the third driving mode, the auxiliary prompts of the second application are displayed on the application interface of the first application in a first display mode.

[0016] Optionally, the auxiliary prompts of the second application displayed in the first display mode are generated by the second application and displayed through pass-through, while the auxiliary prompts of the second application displayed in the second display mode are drawn and displayed by the first application.

[0017] Optionally, the method for generating the auxiliary prompt information of the second application displayed in the second display mode includes:

[0018] It is generated by the first application by listening to the auxiliary prompts from the second application and drawing them.

[0019] Optionally, the method further includes:

[0020] In response to a triggering operation on the application interface or auxiliary prompts of the second application, the application interface of the second application is displayed in full screen.

[0021] Optionally, the method further includes:

[0022] On the full-screen application interface of the second application, the application interface of the first application and / or the auxiliary prompts of the first application are displayed.

[0023] Optionally, displaying the application interface of the first application and / or the auxiliary prompts of the first application includes:

[0024] The application interface of the first application is displayed in a first display mode, and the auxiliary prompts of the second application are displayed in a second display mode.

[0025] Optionally, the method further includes:

[0026] In response to the application interface or auxiliary prompts of the second application being displayed in a first display mode, the step of performing the trigger operation that responds to the application interface or auxiliary prompts of the second application and displaying the application interface of the second application in full screen is executed.

[0027] Optionally, the first display mode is either a non-full-screen display mode or a floating window display mode.

[0028] Optionally, the second display method includes a modular information display method.

[0029] Optionally, the modular information is displayed in a card-like manner.

[0030] Optionally, the automation level of the first driving mode is higher than that of the second driving mode, and the automation level of the second driving mode is higher than that of the third driving mode.

[0031] Optionally, the first driving mode is lane navigation mode, the second driving mode is lane tracing mode, and the third driving mode is adaptive cruise control mode.

[0032] Optionally, the application interfaces of the first application and the second application are related to the driving process of the vehicle.

[0033] Optionally, the application interfaces of the first application and the second application are used to display different auxiliary prompts for the vehicle during driving.

[0034] Optionally, the application interface of the first application is used to display the navigation information of the vehicle, and the application interface of the second application is used to display the simulated driving environment information of the vehicle; or, the application interface of the first application is used to display the simulated driving environment information of the vehicle, and the application interface of the second application is used to display the navigation information of the vehicle.

[0035] Optionally, the method further includes:

[0036] Upon detecting an operation to switch the application interface of a third application, the application interfaces of the first application and the second application are displayed on the application interface of the third application.

[0037] Optionally, the application interface of the first application also displays interactive controls, and the method further includes:

[0038] Upon receiving a trigger operation on the interactive control, the application interface of the second application and / or the auxiliary prompt information of the second application are canceled on the application interface of the first application.

[0039] Optionally, the method further includes:

[0040] The system detects the user's selection of a driving mode and determines the vehicle's driving mode.

[0041] According to a second aspect of this application, embodiments of this application also provide an interface display device, which includes:

[0042] The display unit is used to display the application interface of the second application and / or the auxiliary prompt information of the second application on the application interface of the first application, based on the vehicle's driving mode and using a display strategy corresponding to the driving mode.

[0043] According to a third aspect of this application, embodiments of this application also provide a computer-readable storage medium storing instructions that, when executed by a computer, cause the computer to implement any of the interface display methods described in the embodiments of this application.

[0044] According to a fourth aspect of this application, embodiments of this application also provide a computer program product, the computer program product storing instructions that, when executed by a computer, cause the computer to implement any of the interface display methods provided in the embodiments of this application.

[0045] According to a fifth aspect of this application, embodiments of this application also provide an electronic device, comprising:

[0046] Memory, on which computer instructions are stored;

[0047] A processor is configured to execute the computer instructions in the memory to implement any of the interface display methods provided in the embodiments of this application.

[0048] According to a sixth aspect of this application, embodiments of this application also provide a vehicle, including the aforementioned interface display device or the aforementioned electronic device.

[0049] Some embodiments in this specification include at least the following beneficial effects: By providing realistic key information, such as road conditions ahead, speed limits, and the positions of other vehicles, in different driving modes, it can help drivers better monitor vehicle status and the surrounding environment, thereby improving safety. At the same time, reducing the interference of redundant information helps maintain driver focus and reduces the probability of errors; dynamically adjusting the amount of driving-related information displayed according to different driving modes enhances the overall driving experience.

[0050] Other features and advantages of this application will be described in detail in the following detailed description section. Attached Figure Description

[0051] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0052] To gain a more complete understanding of this application and its beneficial effects, the following description will be provided in conjunction with the accompanying drawings, wherein the same reference numerals in the following description denote the same parts.

[0053] Figure 1 is a schematic diagram of the interface display system according to some embodiments of this specification;

[0054] Figure 2 is an exemplary flowchart of an interface display method according to some embodiments of this specification;

[0055] Figure 3 is an exemplary schematic diagram of the interface of a map navigation application according to some embodiments of this specification;

[0056] Figure 4 is an exemplary schematic diagram of the interface of another map navigation application according to some embodiments of this specification;

[0057] Figure 5 is an exemplary schematic diagram of the interface of another map navigation application according to some embodiments of this specification;

[0058] Figure 6 is an exemplary schematic diagram of the interface of an SR application according to some embodiments of this specification;

[0059] Figure 7 is an exemplary schematic diagram of the interface of yet another SR application according to some embodiments of this specification;

[0060] Figure 8 is an exemplary schematic diagram of the interface of yet another SR application according to some embodiments of this specification;

[0061] Figure 9 is an exemplary schematic diagram of the interface of a map navigation application shown in different intelligent driving states according to some embodiments of this specification;

[0062] Figure 10 is an exemplary schematic diagram of the interface of the SR application shown in different intelligent driving states according to some embodiments of this specification;

[0063] Figure 11 is an exemplary schematic diagram of a floating window displaying the interface of an SR application map navigation application according to some embodiments of this specification;

[0064] Figure 12 is an exemplary schematic diagram of a floating window of the SR application, showing the interface of a map navigation application according to some embodiments of this specification;

[0065] Figure 13 is an exemplary schematic diagram showing the interaction between the interface of an SR application and the interface of a map navigation application according to some embodiments of this specification.

[0066] Figure 14 is a schematic diagram of the structure of an electronic device according to some embodiments of this specification.

[0067] Implementation methods of this application

[0068] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the protection scope of this application.

[0069] To facilitate understanding of the implementation schemes provided in this application, the relevant application background of the interface display method provided in this application will be explained first.

[0070] Currently, Surrounding Reality (SR) applications provide users with high-precision 3D environment models, multi-target tracking, and detailed lane information, while map navigation applications provide users with directional guidance, estimated driving time, and distance. With the development of electronic devices, users have increasingly higher demands for in-vehicle devices. For example, in certain scenarios, users hope to simultaneously use both SR and map navigation applications on their in-vehicle devices to achieve multiple functions.

[0071] The in-vehicle infotainment system's central control screen uses a default landscape split-screen configuration: either 1 / 3 for the SR application and 2 / 3 for the map navigation application, or 1 / 3 for the map navigation application and 2 / 3 for the SR application. Drivers can freely adjust the SR display ratio, position, and other parameters according to their personal preferences or driving needs.

[0072] In the page presentation of related technologies, the SR application's display window shows fragmented information such as speed limits, vehicle speed, and navigation prompts, as well as environmental perception information such as lane rendering, vehicle-side information, and guide lines; the map navigation application's display window shows information such as direction, driving time, and distance on guide cards, and road condition information such as routes on the base map. It also has a set of buttons to enable functions such as exiting navigation, adjusting volume, panoramic view, and entering settings.

[0073] However, this method uses a fixed information display pattern and cannot dynamically adjust the amount of information displayed according to different driving modes. This information display method has many shortcomings in different driving scenarios. For example, in LNP (Lane Navigation Pilot), the driver may not be able to react in time due to insufficient information; in ACC (Adaptive Cruise Control), too much information may distract the driver and increase driving risks.

[0074] In summary, existing technologies have significant shortcomings in flexibly displaying relevant information during driving, failing to effectively help drivers monitor vehicle status and the surrounding environment, and also failing to maintain driver concentration, resulting in a high probability of errors.

[0075] In view of this, some embodiments of this specification provide an interface display method and system that, by providing key information that is consistent with reality in different driving modes, helps drivers better monitor vehicle status and the surrounding environment, thereby improving safety, while reducing interference from redundant information and enhancing the overall driving experience.

[0076] Figure 1 is a schematic diagram of the interface display system according to some embodiments of this specification.

[0077] As shown in Figure 1, the interface display system 100 may include a vehicle 120 and an electronic device 110. The electronic device 110 is mounted on the vehicle 120, for example, the electronic device 110 is mounted (or fixed) on the vehicle 120 by a bracket.

[0078] In some embodiments, vehicle 120 is communicatively connected to electronic device 110. Vehicle 120 can send information to or receive information from electronic device 110. For example, vehicle 120 and electronic device 110 are connected via wired or wireless means, and voice, music, and other data from electronic device 110 can be transmitted to vehicle 120 and played through vehicle 120's speakers.

[0079] In some embodiments, the system 100 may further include one or more application cloud service platforms. In this embodiment, the electronic device 110 may install one or more applications (APPs), and each application may correspond to an application cloud service platform. As shown in Figure 1, the electronic device 110 can receive information from the application cloud service platform and can also transfer acquired information to the application cloud service platform.

[0080] The application cloud service platform involved in the embodiments of this application can be a cloud service center, a cloud server, a cloud-side computing device, or a cloud-side storage device, etc. In some embodiments, the application cloud service platform in FIG1 can also be replaced by a server, such as a load balancing server group including multiple computers.

[0081] Vehicle 120 can be a gasoline-powered vehicle, a natural gas-powered vehicle, or a new energy vehicle. New energy vehicles can be pure electric vehicles, hybrid electric vehicles, or range-extended electric vehicles, etc. As an example and not a limitation, vehicle 120 can be a sedan, truck, motorcycle, bus, recreational vehicle, amusement park vehicle, construction equipment, tram, golf cart, train, etc., and this application embodiment does not impose any particular limitation on this.

[0082] Electronic device 110 can be a mobile phone, tablet computer, wearable device, in-vehicle device, or other electronic device with display function. This application embodiment does not impose any limitation on the specific type of electronic device 110.

[0083] It should be noted that the above description of the interface display system 100 and its components is for convenience only and should not be construed as limiting this specification to the scope of the embodiments described. It is understood that those skilled in the art, after understanding the principles of the system, may arbitrarily combine the various parts or construct subsystems connected to other parts without departing from these principles. For example, the various parts may share a single storage device, or each component may have its own separate storage device. Such modifications are all within the scope of this specification.

[0084] Figure 2 is an exemplary flowchart of an interface display method according to some embodiments of this specification. In some embodiments, process 200 may be performed on an electronic device. As shown in Figure 2, process 200 includes the following steps.

[0085] Step 210: Based on the vehicle's driving mode, and using a display strategy corresponding to the driving mode, display the application interface of the second application and / or the auxiliary prompt information of the second application on the application interface of the first application.

[0086] In some embodiments, the application interface of the first application and the application interface of the second application are derived from different applications.

[0087] Driving mode indicates the current driving mode of a vehicle connected to electronic devices. Driving modes, through different electronic control settings (such as real-time monitoring and adjustment of various vehicle performance parameters using electronic control systems), enable the vehicle to exhibit different handling characteristics to adapt to different road conditions and driving needs. A vehicle must include at least two driving modes, with different display strategies corresponding to each mode.

[0088] In some embodiments, the vehicle's driving mode may include: the vehicle being in Sport mode; and / or the vehicle being switched from Run mode to Eco mode; and / or the vehicle being in Normal mode.

[0089] In some embodiments, the vehicle's driving mode may include: the vehicle being in a specific intelligent driving state.

[0090] The application interface of the first application refers to the interface of the first application that interacts with the user. For example, the application interface of the first application can be the main screen of an application or system built into the vehicle that is related to the vehicle's driving process, or any other initial interface provided to the user for operation and viewing information.

[0091] The second application's interface is optimized for the driving mode. The second application's interface can display information related to the driving mode or provide related function options.

[0092] In some embodiments, the first application and the second application can be any in-vehicle application, and this specification does not limit them.

[0093] Assistive prompts are used to remind or notify drivers of important information. For example, assistive prompts may include traffic warnings, upcoming vehicle maneuvers (such as turns), and driving mode updates.

[0094] In some embodiments, when a vehicle is detected to have entered a preset driving mode, the application interface of the second application and / or the auxiliary prompt information of the second application are displayed on the application interface of the first application using a display strategy corresponding to the driving mode.

[0095] Display strategy refers to dynamically adjusting and optimizing the way information is presented on the interface based on the current driving mode. Display strategy ensures that drivers can obtain the most relevant and useful information in different situations, while maintaining ease of operation and safety.

[0096] In some embodiments, the priority of information can be determined according to different driving modes (such as lane tracing assist, adaptive cruise control, etc.), and information with higher priority can be displayed first.

[0097] In some embodiments, navigation information can be used as a background layer, while auxiliary prompts are overlaid on top of it as semi-transparent windows or fixed-position widgets, ensuring that each auxiliary prompt is clearly visible and does not obscure the others.

[0098] In some embodiments, specific interface areas can be assigned to different types of accessibility prompts. For example, prompts for the first application can be displayed in the status bar at the bottom of the screen, while prompts for the second application can be displayed in widgets at the top or side of the screen.

[0099] In some embodiments of this specification, by displaying relevant information about the first and second applications, the amount of information displayed for different applications can be tailored to different driving modes, making the user's driving process safer.

[0100] In some embodiments, the application interfaces of the first application and the second application are related to the driving process of the vehicle.

[0101] The driving process refers to the entire time from the start of the vehicle to its final stop, during which the driver operates the vehicle and interacts with other objects (such as other vehicles, pedestrians, bicycles, etc.) and the road environment.

[0102] In some embodiments, the driving process can be an actual driving process or a simulated driving process.

[0103] In some embodiments, the application interface of the first application and / or the application interface of the second application display different auxiliary prompts for the vehicle during driving.

[0104] In some embodiments, the auxiliary prompt information may include, but is not limited to, vehicle speed information, engine speed information, fuel quantity information, information related to the driving path, and information related to the driving road.

[0105] Route-related information refers to navigation data related to the vehicle's planned route or actual driving trajectory. Route-related information may include, but is not limited to: navigation guidance (such as turn prompts, next intersection signs, distance to the destination, etc.), real-time traffic conditions, estimated arrival time, points of interest, etc.

[0106] Information related to the road being traveled refers to the specific characteristics and status of the road segment the vehicle is traveling on. This information may include, but is not limited to: road type, road conditions, speed limits, lane information, traffic signs and signals, environmental factors, and obstacle information.

[0107] In some embodiments of this specification, different auxiliary prompts are displayed in different driving modes to ensure that the driver can obtain relevant information without additional operation.

[0108] In some embodiments, the application interface of the first application is used to display the vehicle's navigation information, and the application interface of the second application is used to display the vehicle's simulated driving environment information; or, the application interface of the first application is used to display the vehicle's simulated driving environment information, and the application interface of the second application is used to display the vehicle's navigation information.

[0109] Navigation information is information related to the driving route.

[0110] Simulated driving environment information is driving assistance information provided through virtualization or augmented reality technologies.

[0111] In some embodiments, the switching between the application interfaces of the first application and the second application can be implemented through the software logic of the electronic devices inside the vehicle. When the user selects a specific function or the electronic devices connected to the vehicle detect that a specific condition is met, the in-vehicle infotainment system or instrument panel display screen is controlled to change the displayed content accordingly.

[0112] The switching can be triggered manually by the user (e.g., via a button on a touchscreen or a voice command) or automatically by electronic devices (e.g., when the vehicle enters a preset driving mode).

[0113] In some embodiments, the application displaying vehicle navigation information may be a map navigation application; the application displaying simulated driving environment information may be a simulated driving environment application.

[0114] In some embodiments, the first application may include a vehicle-built navigation system, third-party navigation software, etc., and the second application may include a panoramic imaging system, a driver assistance system, etc.

[0115] In some embodiments of this specification, presenting these two types of information allows drivers to flexibly switch their focus according to their current needs, thereby optimizing the driving experience while ensuring safety. For example, when driving in the city, drivers may be more concerned with accurate navigation guidance; while on a racetrack or when driving off-road, they may focus more on the immersive and assistive effects provided by simulated driving environment information.

[0116] In some embodiments, the method further includes:

[0117] An operation to switch to the application interface of a third application was detected. The application interfaces of the first application and the second application were then displayed on the application interface of the third application.

[0118] The application interface of a third application refers to an application interface that is different from the first and second applications, such as the homepage interface, multimedia playback, telephone connection, etc.

[0119] In some embodiments, when the electronic device detects that the user performs an operation to switch to the application interface of a third application, such as clicking an icon, using voice commands, or using gesture control; the main content of the third application is loaded, such as the control panel of a multimedia player, a phone contact list, etc., and the loaded main content of the third application occupies the main area of ​​the screen; two semi-transparent floating windows are created for the first application and the second application respectively. The floating windows can be placed in the corners or edges of the screen to ensure that they do not interfere with the main content of the third application while maintaining visibility.

[0120] In some embodiments, the first and second applications update their respective content in real time and pass this information to the corresponding floating windows. For example, the floating window of a map navigation application may display a simplified map and next turn prompts; the floating window of a simulated driving environment application may display vehicle speed, distance to the vehicle in front, and lane keeping status.

[0121] When the user switches to the third application interface, the electronic device loads the content of the third application and displays the first and second applications simultaneously as a floating window on the same interface. This ensures that the driver can focus on the third application while checking key navigation information and driving assistance status at any time without having to frequently switch interfaces.

[0122] In some embodiments, the user presses a dedicated button on the steering wheel, speaks the voice command "Switch to the multimedia entertainment interface," or makes a specific gesture. Upon detecting the switching operation, the electronic device immediately switches to the interface of the third application. For example, the electronic device can smoothly transition from the current application interface to the third application interface through a smooth transition animation. The electronic device can also display visual confirmation information "Entering the multimedia entertainment interface," accompanied by a voice prompt "Entering the multimedia entertainment interface."

[0123] In some embodiments, the electronic device may divide the screen into two or three areas according to preset rules: main area: displaying the main content of the third application; first floating window: displaying key information of the first application (navigation system) superimposed on the interface of the third application; second floating window: displaying key prompts of the second application superimposed on the interface of the third application.

[0124] In some embodiments of this specification, a quick-response switching operation can ensure that information from the first and second applications is displayed appropriately on the third application interface without distracting the driver.

[0125] In some embodiments, the application interface of the first application also displays interactive controls, and the method further includes:

[0126] Receive a trigger operation for the interactive control, and on the application interface of the first application, cancel the display of the application interface of the second application and / or the auxiliary prompt information of the second application.

[0127] In some embodiments, when a user clicks an interactive control on the interface of the first application (navigation system), or speaks the voice command "hide driving assistance information," or makes a specific gesture, the electronic device detects the trigger operation and immediately adjusts the screen display content to cancel the display of the application interface and / or assistance prompt information of the second application.

[0128] In some embodiments, the interaction space is a set of virtual buttons that allow users to exit, adjust volume, view the entire screen, and access settings.

[0129] In some embodiments, the exit button is used to exit the current interface and return to the main menu or default interface. When the user clicks the exit button, the electronic device can return to the main menu or default interface of the first application and provide visual confirmation information, such as a "Exited" icon accompanied by a brief text description.

[0130] In some embodiments, the volume control buttons include two buttons for increasing and decreasing the volume respectively.

[0131] When a user clicks the volume adjustment button, the electronic device controls the volume increase or decrease and displays the current volume through a progress bar or numbers on the screen.

[0132] In some embodiments, the panorama button is used to switch to panorama mode, displaying all available application interfaces or a panoramic view.

[0133] In some embodiments, the settings button is used to switch to the settings interface, which allows users to adjust various system parameters, such as brightness, sound settings, connection options, etc.

[0134] In some embodiments, interactive controls are set in a map navigation application.

[0135] In some embodiments of this specification, interactive controls are used to ensure that drivers can use them safely and conveniently while driving, thereby improving user-friendliness.

[0136] In some embodiments, the method further includes:

[0137] The system detects the user's selection of driving mode and determines the vehicle's driving mode.

[0138] In some embodiments, the vehicle's driving mode can be determined manually by the user or automatically by electronic devices based on messages from the driving environment. For example, the electronic devices can continuously monitor user input from touchscreens, steering wheel buttons, voice assistants, etc., to capture the user's selection of the driving mode. For instance, the user may tap an icon on the interface or speak a preset voice command; when a selection is detected, the pre-written driving mode switching logic is immediately executed to determine and switch the vehicle's driving mode.

[0139] In some embodiments, using a display strategy corresponding to the driving mode, the application interface of the second application and / or the auxiliary prompt information of the second application are displayed on the application interface of the first application, including:

[0140] When the driving mode is set to the first driving mode, the application interface of the second application and the auxiliary prompt information of the second application are displayed on the application interface of the first application.

[0141] When the driving mode is set to the second driving mode, or when the driving mode is set to the third driving mode, the auxiliary prompts of the second application are displayed on the application interface of the first application.

[0142] In some embodiments, in the first driving mode, the application interface of the second application and auxiliary prompt information are simultaneously displayed on the application interface of the first application.

[0143] In some embodiments, in non-first driving mode (e.g., second or third driving mode), auxiliary prompts from the second application are displayed on the application interface of the first application.

[0144] In some embodiments of this specification, by dynamically adjusting the content displayed on the application interface of the first application according to different driving modes, not only is the convenience and comfort of driving improved, but the driver is also ensured to obtain the most relevant and useful information in different situations.

[0145] In some embodiments, when the driving mode is a first driving mode, the application interface of the second application and the auxiliary prompt information of the second application are displayed on the application interface of the first application, including:

[0146] When the driving mode is the first driving mode, the application interface of the second application is displayed on the application interface of the first application in a first display mode, and the auxiliary prompt information of the second application is displayed in a second display mode.

[0147] The first display mode refers to directly displaying the main interface content of the second application on the interface of the first application. The first display mode can be used to display driving information that requires frequent reference or interaction by the driver.

[0148] The second display mode refers to displaying simplified auxiliary prompts from the second application on the interface of the first application, instead of the full application interface. The second display mode can be used to display information that does not require frequent interaction but needs timely reminders, such as warnings and prompts.

[0149] In some embodiments of this specification, the first display method and the second display method are two different information presentation strategies used to display the content of the second application in different forms on the application interface of the first application. This approach ensures that the driver can obtain the most relevant and useful information in different situations, while maintaining ease of operation and safety.

[0150] In some embodiments, when the driving mode is the second driving mode, auxiliary prompts from the second application are displayed on the application interface of the first application, including:

[0151] When the driving mode is set to the second driving mode, the auxiliary prompts of the second application are displayed on the application interface of the first application in a second display manner.

[0152] In some embodiments, when the driving mode is the second driving mode, a simplified status of the driving assistance system can be displayed at the top or side of the screen, and assistance prompts can be updated in real time to reflect the current driving mode and environmental changes, such as "Please fine-tune the direction" and "Lane departure warning".

[0153] When the driving mode is set to the second driving mode, the auxiliary prompts of the second application are displayed on the application interface of the first application in a second display method. That is, simplified auxiliary prompts are displayed instead of the full application interface. This method ensures that the driver can quickly obtain important driving information and advice without being overwhelmed by excessive information.

[0154] In some embodiments, when the driving mode is the third driving mode, auxiliary prompts from the second application are displayed on the application interface of the first application, including:

[0155] When the driving mode is set to the third driving mode, the auxiliary prompts of the second application are displayed on the application interface of the first application in the first display mode.

[0156] When the driving mode is set to the third driving mode, the auxiliary prompts of the second application are displayed on the application interface of the first application in the first display mode. Not only will simplified auxiliary prompts be displayed, but they can also be displayed floating above all applications, which is suitable for displaying urgent or important information and providing a richer interactive experience.

[0157] In some embodiments, the auxiliary prompts of the second application displayed in the first display mode are generated by the second application and displayed through pass-through, while the auxiliary prompts of the second application displayed in the second display mode are drawn and displayed by the first application.

[0158] Pass-through refers to the auxiliary prompts generated by the second application being directly displayed on the interface of the first application in the form of a floating window or other forms through a preset mechanism.

[0159] Drawing refers to the process by which a first application receives auxiliary prompts generated by a second application based on the received data or other relevant information, and then draws and displays simplified auxiliary prompts from the second application.

[0160] In some embodiments, the second application generates assistance prompts based on sensor data and data from other driver assistance systems, and displays them on the application interface of the first application. For example, the assistance prompts may include lane line position, vehicle deviation, distance to the vehicle in front, current vehicle speed, etc.

[0161] In some embodiments, the second application generates assistance prompts based on received sensor data or data from other driving assistance systems and sends them to the first application. For example, the first application receives and updates real-time assistance prompts from the second application via an internal communication mechanism; based on the received assistance prompts, the first application converts the assistance prompts from the second application into visual interface elements according to preset rules.

[0162] In some embodiments, the first application receives sensor data or other driver assistance system data sent by the second application and generates assistance prompts. For example, the first application receives and updates real-time information from the second application through an internal communication mechanism; based on the received information, it generates assistance prompts and converts the assistance prompts from the second application into visual interface elements based on preset rules.

[0163] In some embodiments of this specification, the information is generated by a second application, which helps ensure the real-time nature and accuracy of the prompts and is suitable for situations requiring detailed information; the information is generated by the first application itself based on received data or other relevant information, which helps provide more comprehensive and personalized guidance and is suitable for situations requiring simplified information.

[0164] In some embodiments, the generation method of the auxiliary prompt information of the second application displayed in the second display mode includes:

[0165] It is generated by the first application by listening to the auxiliary prompts from the second application and drawing them.

[0166] In some embodiments, the first application may use methods such as message queues, event-driven architecture, or API interfaces to listen to information sent by the second application in real time. After receiving the information from the second application, the first application parses it to extract key information, such as lane line position, vehicle deviation, and distance to the vehicle in front. Based on the key information, the key information is converted into visual auxiliary prompts.

[0167] For example: if lane departure is detected, a prompt "Please make minor adjustments to the direction" is generated, or if adaptive cruise control is activated, a prompt "ACC Activated" is generated.

[0168] In some embodiments of this specification, by listening to and generating auxiliary prompts from the second application through the first application, the information presentation method can be flexibly adjusted in different driving modes to ensure that the driver obtains the most relevant and useful information.

[0169] In some embodiments, when the first application is a map navigation application, the auxiliary prompts of the first application may include traffic warning information, route update information, and point-of-interest (POI) reminders; when the second application is a driving simulation application, the auxiliary prompts of the second application may include obstacle warning information, speed reminders, or status update information of the driver assistance system. Alternatively, when the first application is a driving simulation application, the auxiliary prompts of the first application may include obstacle warning information, speed reminders, or status update information of the Advanced Driver Assistance System (ASDS); when the second application is a map navigation application, the auxiliary prompts of the second application may include traffic warning information, route update information, and point-of-interest (POI) reminders.

[0170] In some embodiments, in a higher level of driving mode, the electronic device can fix the display of the card of the first application's auxiliary prompt information on the application interface of the first application, and control the display of the card of the second application's auxiliary prompt information according to the vehicle's driving mode.

[0171] In some embodiments of this specification, auxiliary prompts allow drivers to receive key reminders about their surroundings while focusing on navigation, thus enabling them to better control the driving situation.

[0172] In some embodiments, the first application can monitor and receive data or events from the second application in real time; based on the received data or events from the second application, the first application creates a card with corresponding auxiliary prompt information from the second application and displays it on the interface of the first application.

[0173] In some embodiments, a second application running in the background can generate auxiliary prompts for the second application and display the auxiliary prompts for the second application on top of the first application in the form of a floating window.

[0174] In some embodiments of this specification, a flexible and efficient method is provided to transmit key information from a simulated driving environment or from navigation in two ways, thereby enhancing driving safety and convenience.

[0175] In some embodiments, the method further includes:

[0176] In response to a trigger action applied to the application interface or auxiliary prompts of the second application, the application interface of the second application is displayed in full screen.

[0177] A trigger action is one or a series of actions performed by the user. Trigger actions can include, but are not limited to, taps on a touchscreen, gesture controls, physical button presses, or voice commands.

[0178] In some embodiments, the electronic device can continuously monitor user input from touchscreens, gesture controls, physical button presses, or voice commands to capture triggering operations. For example, a user may tap an icon on the application interface or auxiliary prompts of a second application or speak a preset voice command; when a triggering operation is detected, pre-written interface switching logic is immediately executed to expand the application interface of the second application to full screen.

[0179] Full-screen display is achieved by responding to the application interface or auxiliary prompts of the second application, which not only improves the efficiency and depth of information acquisition, but also enhances the user's sense of control over the in-vehicle infotainment system.

[0180] In some embodiments, when the driving mode is the first driving mode, the electronic device can recognize the user's trigger operation on the application interface of the second application through various means such as physical buttons, touch screen, voice commands or gesture control, and display the application interface of the second application in full screen; when the driving mode is the third driving mode, the electronic device can recognize the user's trigger operation on the auxiliary prompt information of the second application through various means such as physical buttons, touch screen, voice commands or gesture control, and display the application interface of the second application in full screen.

[0181] In some embodiments of this specification, the application interface of the second application is displayed in full screen in response to a trigger operation of the application interface of the second application, thereby providing users with more flexible and richer interface display content.

[0182] In some embodiments, the method further includes:

[0183] On the full-screen interface of the second application, the interface of the first application and / or the auxiliary prompts of the first application are displayed.

[0184] In some embodiments, based on the vehicle's driving mode, a display strategy corresponding to the driving mode is used to display the application interface of the first application and / or the auxiliary prompt information of the first application on the application interface of the second application.

[0185] In some embodiments, key information from the first application's interface can be displayed on the second application's interface as a small floating window or a fixed-position widget. For example, a simplified map view or route instructions can be displayed in a corner of the simulated driving environment's interface, or a simplified version of the simulated driving environment's information can be displayed in a corner of the map navigation interface.

[0186] In some embodiments, the screen can be divided into multiple areas, each of which can independently display different application interfaces. For example, one side displays simulated driving environment information, while the other side displays vehicle navigation information.

[0187] For example, when a driver parks in a complex urban environment, the current interface displays simulated driving environment information to help locate surrounding obstacles. At this time, by embedding simplified navigation information (such as the direction and distance of the next turn) on the current interface, the driver can obtain the necessary driving assistance information and navigation guidance without frequently switching interfaces, thereby improving efficiency and safety.

[0188] By displaying the interface of the first application on the interface of the second application, two different types of information can be presented simultaneously, enhancing driving safety and convenience.

[0189] In some embodiments of this specification, by simultaneously displaying the application interface of the first application and / or the auxiliary prompts of the first application on the application interface of the second application displayed in full screen, it helps users to quickly switch their focus at critical moments.

[0190] In some embodiments, displaying the application interface of the first application and / or the auxiliary prompts of the first application includes:

[0191] The application interface of the first application is displayed in a first display mode, and the auxiliary prompts of the second application are displayed in a second display mode.

[0192] In some embodiments, when the driving mode is a first driving mode, the application interface of the first application is displayed in a first display mode, and the auxiliary prompt information of the second application is displayed in a second display mode.

[0193] In some embodiments of this specification, after the operation is triggered, the information of the two applications is seamlessly integrated by simultaneously displaying the application interface of the second application and the auxiliary prompt information, ensuring that the driver receives comprehensive and timely driving assistance.

[0194] In some embodiments, when the application interface or auxiliary prompts of the second application are displayed through a first display method, the step of performing a trigger operation that responds to the application interface or auxiliary prompts of the second application and displaying the application interface of the second application in full screen is executed.

[0195] In some embodiments, when the application interface or auxiliary prompts of the second application are displayed in a first display mode, that is, in the first driving mode, the application interface of the second application is displayed in full screen in response to a trigger operation applied to the application interface of the second application; that is, in the third driving mode, the application interface of the second application is displayed in full screen in response to a trigger operation applied to the auxiliary prompts of the second application.

[0196] In some embodiments of this specification, the application interface and auxiliary prompts of the second application displayed in the first display mode can be displayed on top of any application, which can increase user attention and avoid obscuring key information.

[0197] In some embodiments, the first display mode includes either a non-full-screen display mode or a floating window display mode.

[0198] Non-full-screen display refers to overlaying the interface of another application (such as simulated driving environment information) onto a full-screen application interface (such as a navigation interface) without completely covering the content of the original interface.

[0199] In some embodiments, non-full-screen display methods may include picture-in-picture, split-screen, floating ball, and / or cards.

[0200] Non-fullscreen display, as opposed to fullscreen display, refers to newly displayed content that does not occupy the entire screen, but exists in the form of a window, widget, or split screen.

[0201] A floating window, also known as a floating window, is a small window that floats above the application interface. For example, it could be a window of application B floating above application A. A floating window will obscure the application area displayed at the bottom. The content of the floating window and the content of the bottom interface can be refreshed and interactively accessed separately. The system can control the displayed area and position of the floating window, and users can move its position.

[0202] Split-screen mode divides the display area of ​​a screen into multiple window areas. Different window areas can display the interface content of different applications and can be refreshed and interacted with independently. Each window area can be called a split-screen window. Split-screen windows will not obscure or overlap each other, and the system can control the window size changes. When one window area increases, other window areas will automatically shrink.

[0203] Overlay display refers to one interface being superimposed on another, with the content of the superimposed interface being distinguished by adjusting the transparency or defining the border.

[0204] In some instances, the screen can be divided into different areas, each of which can independently display a different application interface. For example, the left side displays the first application, and the right side displays the second application.

[0205] In some instances, the interface of the second application can be displayed as a small floating window. This floating window can be movable, resizable, and has high transparency so as not to affect the reading of the content of the first application's interface.

[0206] In some instances, users can customize the information layout on the display screen according to their personal preferences. For example, a corner of the display screen can be fixed to show the interface of a second application (such as simulated driving environment information or navigation information).

[0207] In some embodiments of this specification, by displaying the application interface of the second application on the application interface of the first application in a non-full-screen manner, the efficiency of driver information acquisition can be improved, and two different types of information can be presented simultaneously, thereby enhancing driving safety and convenience.

[0208] In some embodiments, the second display method includes a modular information display method.

[0209] Modular information display is an interface design approach that presents information or functions in independent functional areas. Each functional area can contain various elements such as text, images, icons, and buttons, and supports different interaction methods, such as clicking, swiping, and expanding.

[0210] In some instances, modular information is displayed in ways including but not limited to pop-ups, bubbles, cards, and lists.

[0211] In some instances, auxiliary prompts can be displayed on the application interface of the first application in the form of cards or floating windows. The cards involved in this application are containers for components in a page layout used to display a set of related information. This information may include: images, text, videos, lists, stars, icons, links, music, input boxes, buttons, other interactive controls, or combinations of the above elements. Cards can hold different types of content, and the information contained within is unrestricted. Generally, a card can be a rectangular block containing certain images and text information, serving as an entry point to more detailed information.

[0212] In some embodiments, each card in the at least one card corresponds to one or more applications. Each card is used to display key information about the corresponding application and can serve as an entry point to the corresponding application.

[0213] In this embodiment of the application, the at least one card can be displayed side by side and / or switched between display modes.

[0214] Side-by-side display means that one or more cards from the at least one card are displayed to the user at the same time. For example, two cards can be displayed to the user at the same time, such as card 1 and card 2. In the interface, the user can see card 1 and card 2 at the same time. Card 1 and card 2 are arranged in a vertical order, one is directly above or below card 2, or they are displayed side by side.

[0215] In some embodiments, the number of cards that can be displayed simultaneously can be determined based on the screen size.

[0216] In some embodiments, a prompt message may be displayed as a small window in a corner or edge of the screen, or the prompt message may be overlaid on the application interface of the first application in a semi-transparent manner.

[0217] For example, when the vehicle is in the process of navigation and receives the first instruction to enter lane navigation mode, if traffic congestion is detected ahead, the following information will be displayed simultaneously on the application interface of the first application: the main view of the map navigation application, a card for the first auxiliary prompt information, and a card for the second auxiliary prompt information. At this time, the card for the first auxiliary prompt information (hereinafter referred to as the guidance card) is used to display key information related to the vehicle's navigation information, and the card for the second auxiliary prompt information (hereinafter referred to as the intelligent driving card) is used to display key information related to intelligent driving.

[0218] For example, a primary auxiliary prompt message could be displayed as a card above the screen, stating "Traffic congestion ahead, please slow down." This card could include a brief text description and a prominent icon (such as a red warning sign) to attract the driver's attention.

[0219] In some embodiments, the card for the first auxiliary prompt information may also include real-time updated traffic condition details, such as congestion length and estimated transit time.

[0220] For example, second assistance prompts related to the intelligent driving message can also be displayed in the form of cards at the top or side of the screen, such as the driving mode of lane tracing assist or the current setting of adaptive cruise control.

[0221] In some embodiments, the card for the second auxiliary prompt information may include displaying information such as “LTA Activated”, “ACC Activated and Maintaining Speed: 60km / h”, and providing real-time updates on the distance to the vehicle ahead and speed adjustments.

[0222] For example, when the vehicle is in a simulated driving environment and receives a first command to enter lane navigation mode, if a complex intersection or potential obstacle is detected ahead, the following information will be simultaneously displayed on the first interface: the main view of the simulated driving environment application, a card for first auxiliary prompt information, and a card for second auxiliary prompt information. At this time, the card for first auxiliary prompt information is used to display key information corresponding to the simulated driving environment information, and the card for second auxiliary prompt information is used to display key information corresponding to the vehicle's navigation information.

[0223] For example, a simplified second-aid prompt card, such as "Turn left in 50 meters," can be displayed in the status bar at the corner or top of the screen. This second-aid prompt can help drivers stay focused on their surroundings without missing important route guidance.

[0224] For example, display cards containing auxiliary prompts related to intelligent driving messages, such as automatic lane change suggestions or emergency braking preparation status, on the top or side of the screen.

[0225] In some embodiments of this specification, by implementing a modular information display method on the application interface of the first application, important information can be transmitted in a timely manner, thereby enhancing driving safety and convenience.

[0226] In some embodiments, the modular information is displayed in a card-like manner.

[0227] In some embodiments, the automation level of the first driving mode is higher than that of the second driving mode, and the automation level of the second driving mode is higher than that of the third driving mode.

[0228] In some embodiments, the first driving mode has the highest level of automation, such as fully autonomous driving or highly automated driving assistance mode.

[0229] In some embodiments, the second driving mode has a lower level of automation, such as a partially automated driving mode.

[0230] In some embodiments, the third driving mode has the lowest level of automation, such as manual driving mode or basic level of driver assistance features.

[0231] In some embodiments, in the first driving mode, the vehicle can handle most driving tasks almost entirely autonomously, and the driver only needs to keep an eye on things as needed; due to the high degree of automation, the interface needs to provide the driver with detailed information on driving status and environmental changes.

[0232] In some embodiments, in the second driving mode, the vehicle can autonomously handle some driving tasks under certain conditions, but the driver still needs to maintain a certain level of control and attention. The interface needs to provide simplified auxiliary prompts to help the driver understand the current driving status.

[0233] In some embodiments, in the third driving mode, the driver is primarily responsible for driving, the vehicle provides limited assistance functions, and the interface needs to provide the most basic safety prompts to help the driver make decisions.

[0234] In the third driving mode, multiple in-vehicle applications may need to be displayed simultaneously, and vehicle takeover scenarios are more frequent. Floating windows have higher priority and can be displayed on top of any application, not just the current screen. Therefore, cards drawn by the currently active application cannot meet the requirements. A secondary background application draws the auxiliary prompts in a floating window to reduce transmission latency. For example, a second application can be responsible for creating and managing one or more independent floating windows, which can be displayed on top of any currently active application screen.

[0235] In some embodiments of this specification, through the different levels of automation and corresponding implementation methods described above, the system can flexibly adjust the information presentation method in different driving modes to ensure that the driver obtains the most relevant and useful information.

[0236] In some embodiments, the first driving mode is Lane Navigation Pilot (LNP), the second driving mode is Lane Keeping Assist (LKA), and the third driving mode is Adaptive Cruise Control (ACC).

[0237] Lane navigation mode is an intelligent driving mode that uses high-precision map data and sensor fusion technology to provide lane-level navigation guidance. For example, lane navigation mode may include functions such as lane keeping assist, automatic lane change suggestion, and navigation at complex intersections.

[0238] In some embodiments, when a user selects to switch to lane navigation mode and / or an electronic device connected to the vehicle receives a communication message indicating an upgrade to lane navigation mode, it instructs the user to switch to lane navigation assist mode, determines that a target instruction for the vehicle to enter driving mode has been detected, and enters lane navigation mode.

[0239] In some embodiments, after entering lane navigation mode, the driving environment simulation interface displays a small window of the map navigation application, showing the vehicle's direction markers, navigation route, map base map, etc. Clicking on this window will take you to the map application interface. Alternatively, after entering lane navigation mode, a rendered driving environment simulation window will be displayed on the map navigation application interface, showing the vehicle's status, surrounding environment, and other rendered content. Clicking on this window will take you to the driving environment simulation page.

[0240] In some embodiments of this specification, two different interface layouts are selected to simultaneously display driving environment simulation and map navigation information, ensuring that the driver can obtain the most relevant and useful information while maintaining ease of operation and safety.

[0241] In some embodiments, lane tracing mode is an intelligent driving state that uses cameras and other sensors to keep the vehicle centered in the lane and automatically corrects minor directional deviations.

[0242] Lane tracing mode can be determined based on manual operation by the user or by instructions issued by electronic devices based on the driving environment. Lane tracing mode can also be determined by receiving messages in a specific format.

[0243] Adaptive cruise control is an intelligent driving mode that allows the vehicle to automatically adjust its speed to maintain a safe distance from the vehicle in front.

[0244] Adaptive cruise control can be determined based on manual operation by the user or by instructions issued by the electronic device based on the driving environment. It can also be determined by receiving messages in a specific format.

[0245] In some embodiments, in lane navigation mode, the vehicle has the highest level of automation, and can autonomously handle most driving tasks under certain conditions, including automatic steering, acceleration and deceleration, while the driver only needs to keep an eye on complex road conditions or emergencies.

[0246] In some embodiments, in lane tracing mode, the vehicle has a moderate level of automation and can automatically maintain its position within the lane, but the driver still needs to maintain control and attention to deal with situations such as steering.

[0247] In some embodiments, in the third driving mode, the vehicle has a minimum level of automation, and the vehicle can automatically adjust its speed to maintain a safe distance from the vehicle in front, but the driver needs to manually control the steering wheel.

[0248] For example, while driving on a highway, the driver presses a specific button on the steering wheel to issue a second command, instructing the vehicle to enter lane-keeping assist mode. The map navigation application running in the foreground continues to display the normal map and route guidance. The simulated driving environment application runs in the background, providing lane-keeping assist functionality and sending real-time data to the map navigation application via an internal communication mechanism. Based on the received data, the map navigation application displays a "LTA Activated" icon and the text "Lane-keeping assist activated" in a card format at a preset location on the map navigation application's interface screen, and dynamically displays the lane line position and vehicle deviation status.

[0249] For example, a driver is driving on a highway and sets a target speed via the touchscreen, issuing a third command to put the vehicle into adaptive cruise control mode. The map navigation app continues to display the normal map and route guidance. The simulated driving environment app runs in the background, activating the adaptive cruise control function. Based on real-time data, the simulated driving environment app creates a semi-transparent floating window that displays the "ACC Activated" icon and the text "Adaptive Cruise Control Activated" at a preset position at the top of the map navigation app screen, and dynamically displays the current vehicle speed and the distance to the vehicle ahead.

[0250] In some embodiments of this specification, in lane navigation mode, user operations are less, but the user's attention is higher, and more information is displayed on the interactive interface to avoid the user not being able to react in time if there is a problem with intelligent driving; in adaptive cruise control mode, user operations are more, and the probability of problems is relatively small, so less information is displayed on the interactive interface. By ensuring that the driver receives key information in a timely manner in different driving modes, the overall driving experience is improved, while avoiding too much information from distracting the driver's attention.

[0251] For ease of explanation, the following description uses the scenarios of the first application being a map navigation application and the second application being an SR application, respectively, as examples.

[0252] Figure 3 is an exemplary schematic diagram of the interface of a map navigation application according to some embodiments of this specification.

[0253] For example, as shown in Figure 3, when the map navigation application is running in the foreground and receives a communication message indicating an upgrade to LNP, a floating window of the SR application is displayed in the upper right corner of the map navigation application interface. The floating window of the SR application displays the 3D rendering scene of lane-level navigation in real time. Users can click on the floating window of the SR application to jump to the interface of the SR application to view the complete 3D rendering information. When the driving mode is not in LNP, such as in LTA, the map navigation application interface obtains relevant information about intelligent driving through the interface and displays intelligent driving prompts (such as intelligent driving-related information) in the upper left corner, prompting the driver to indicate the current driving mode and promptly reminding the driver to take over the vehicle, brake, or perform other operations. If the driving mode is in ACC, a floating window drawn by the SR application running in the background (such as intelligent driving card-related information) is displayed below the guide card on the map navigation application interface. The intelligent driving card displays intelligent driving-related information, such as the vehicle's driving mode, suggestion information, or warning information.

[0254] Figure 4 is an exemplary schematic diagram of the interface of another map navigation application according to some embodiments of this specification.

[0255] For example, as shown in Figure 4, when the map navigation application is running in the foreground, if the driving mode is in LTA, the map navigation application obtains information such as the vehicle's driving mode, suggestion information or warning information through the interface, draws a smart driving card in the map navigation application interface, and displays it above the guide card in the map navigation application interface. The smart driving card displays key information related to smart driving.

[0256] Figure 5 is an exemplary schematic diagram of the interface of another map navigation application according to some embodiments of this specification.

[0257] For example, as shown in Figure 5, when the map navigation application is running in the foreground and the driving mode is ACC, the SR application draws a floating window (e.g., information related to the guide card) and displays it above the guide card on the map navigation application's interface to display key information related to intelligent driving.

[0258] Figure 6 is an exemplary schematic diagram of the interface of an SR application according to some embodiments of this specification.

[0259] For example, as shown in Figure 5, when the SR application is running in the foreground, if it receives a communication message to upgrade to LNP, a floating window of the map navigation application (e.g., information about the guide card) is displayed in the upper right corner of the 3D application's rendering interface, showing the route mode of normal navigation and the road conditions along the way. The user can click on the floating window to jump to the map navigation interface to view the complete route information.

[0260] Figure 7 is an exemplary schematic diagram of the interface of another SR application according to some embodiments of this specification.

[0261] For example, as shown in Figure 7, when the SR application is running in the foreground, if the driving mode is in LTA, the SR application obtains information such as route, road name, and lane lines through the interface, draws a guide card in the SR application interface, and displays it below the intelligent driving card in the SR application interface.

[0262] Figure 8 is an exemplary schematic diagram of the interface of another SR application according to some embodiments of this specification.

[0263] For example, as shown in Figure 8, when the SR application is running in the foreground and the driving mode is ACC, a floating window (e.g., information related to the guide card) is drawn by the map navigation application and displayed below the intelligent driving card on the SR application interface. The guide card displays key information in the navigation information to prevent the driver from not seeing the navigation guidance for the next route.

[0264] Figure 9 is an exemplary schematic diagram of the application interface of a map navigation application shown in different driving modes according to some embodiments of this specification.

[0265] Figure 10 is an exemplary schematic diagram of the application interface of the SR application shown in different driving modes according to some embodiments of this specification.

[0266] Figures 9 and 10 are schematic diagrams illustrating the prompts displayed by the map navigation application and the SR application in different driving modes. As shown in Figures 9 and 10, the map navigation application and the SR application determine the vehicle's driving mode (e.g., the current driving mode of the vehicle) based on the sent messages to display the corresponding auxiliary prompts in real time. For example, when the map navigation application is running in the foreground: when the driving mode is ACC, a floating window displaying the auxiliary prompts from the SR application is displayed; when the driving mode is LNP, the floating window of the SR application and a guidance card are displayed; when the driving mode is LTA, a smart driving card is displayed. For example, when the SR application is running in the foreground: when the driving mode is ACC, a floating window displaying the auxiliary prompts from the map navigation application is displayed; when the driving mode is LNP, the floating window of the map navigation application and a guidance card are displayed; when the driving mode is LTA, a guidance card is displayed.

[0267] In some embodiments of this specification, by monitoring data from the driving assistance system in real time and dynamically generating and displaying prompts related to lane tracing assistance based on this data, the driver can ensure that important driving assistance information is obtained in a timely manner while focusing on navigation.

[0268] Figure 11 is an exemplary schematic diagram showing the application interface of the SR application according to some embodiments of this specification, displaying a floating window of the map navigation application.

[0269] In some embodiments, within an intelligent vehicle system, to ensure driving safety and provide a convenient navigation experience, another interface display method includes:

[0270] When the vehicle's driving mode is LNP, the simulated driving environment application is running in the foreground, and the map navigation application running in the background is in navigation mode, a floating window of the map navigation application will be displayed in the upper right corner of the simulated driving environment application's interface. The floating window can provide the driver with an instant overview of navigation information without affecting the driver's line of sight, displaying the vehicle's direction marks, navigation route, map base map, and other content, ensuring that the driver can obtain key navigation information at a glance. Clicking on this window will take you to the Gaode customized map navigation page.

[0271] For example, as shown in Figure 11, the SR application runs in the foreground and the map navigation application runs in the background. The electronic device registers to listen for various messages (such as AutoDevice messages). When a callback operation of an LNP message is detected, a floating window of the map navigation application is displayed on the interface of the SR application, allowing the driver to seamlessly switch to the full-screen navigation page of the map navigation application with a simple click operation and enjoy more detailed and richer navigation services.

[0272] Figure 12 is an exemplary schematic diagram of a floating window of a map navigation application, showing an interface of the SR application according to some embodiments of this specification.

[0273] In some embodiments, another interface display method includes:

[0274] When the vehicle's driving mode is LNP, and the map navigation application is running in the foreground while the SR application is running in the background, a floating window of the simulated driving environment application will be displayed in the upper right corner of the map navigation application. The floating window reveals an overview of the surrounding environment, such as nearby vehicles and pedestrian dynamics, helping the driver to obtain information about the surrounding environment while focusing on the navigation route, thereby improving driving safety and situational awareness.

[0275] For example, as shown in Figure 12, the map navigation application runs in the foreground, while the SR application runs in the background. The electronic device registers to listen for various messages (such as AutoDevice messages). When a callback operation of an LNP message is detected, a rendered floating window of the SR application is displayed in the upper right corner of the map navigation application's interface. The driver can quickly switch back to the driving environment simulation page by clicking the floating window of the SR application, realizing one-click switching between navigation information and the overall driving environment view, greatly improving the continuity of the user experience and the smoothness of operation.

[0276] Figure 13 is an exemplary schematic diagram illustrating the interaction between the interface of an SR application and the interface of a map navigation application according to some embodiments of this specification.

[0277] As shown in Figure 13, when the vehicle's driving mode is LNP, the interface of the SR application and the map navigation application display the content and relative position of the information, as well as the interactive operation between the two. This approach not only ensures the efficiency of information acquisition during driving but also helps to meet the actual needs of the driver. Through the arrangement of interface elements and interaction logic, it effectively improves the safety and convenience of the driving process.

[0278] In some embodiments, a highly integrated information display and real-time feedback mechanism is beneficial to improving the driving experience in the user interface design of the interface display method. Therefore, the following display strategy is adopted to ensure that the driver can promptly perceive the status updates and related prompts of the intelligent driving assistance system:

[0279] In some embodiments, smart cards are fixed interface elements displayed in the SR application interface.

[0280] In the SR application interface, when the intelligent driving system begins to issue intelligent driving messages (such as vehicle intelligent driving status, suggestion information, or warning information), the relevant information is displayed on the intelligent driving card in the SR interface, reflecting the latest message content in real time. This ensures that the driver can be informed of the various instructions and status changes of the intelligent driving system in a timely manner, which helps to improve decision-making efficiency and safety during driving.

[0281] The map navigation application interface automatically adjusts the display strategy of intelligent driving cards based on the status of the intelligent driving system. When the driving mode is LTA or LNP, the map navigation application itself is responsible for listening to relevant information in the intelligent driving messages and drawing the corresponding intelligent driving cards on the map navigation application interface, displaying relevant prompts in real time, and seamlessly integrating with navigation information. This allows drivers to intuitively obtain real-time feedback on the driving mode while focusing on the route.

[0282] In the map navigation application interface, when the driving mode is ACC and the SR application is in the background, the task of drawing the intelligent driving card is completed by the SR application. The SR application displays the relevant information of the intelligent driving message in a floating window above the guide card in the map application interface. This method ensures the visibility of intelligent driving information even when the SR application interface is not displayed in the main window, preventing important information from being overlooked.

[0283] The interface design strategy of the aforementioned intelligent driving card demonstrates the efficiency and flexibility of the intelligent driving system in information transmission. By dynamically adjusting the information display method, it ensures that drivers can obtain timely and accurate intelligent driving information in various usage scenarios, thereby improving the intelligence and safety of the driving experience.

[0284] In some embodiments, similar to the smart driving card, the guide card is the information that is always displayed in the interface of a map navigation application, regardless of the driving mode or interface.

[0285] In map navigation applications, guidance cards are a fixed display element and an indispensable part of driving information. When the application detects driving information such as turn icons, road information ahead, and estimated arrival time, it displays this information on the guidance card, reflecting the latest driving information in real time. The guidance card updates in real-time with key driving information including turn icons, road information ahead, and estimated arrival time, providing drivers with intuitive navigation guidance and ensuring clear and accurate direction during driving.

[0286] In the SR application interface, when the vehicle's driving mode is in LTA or LNP, the SR application listens to the interface provided by the map navigation application, captures the information required for the guidance card in real time, and integrates this information to draw the guidance card, which is then displayed below the intelligent driving card. This method allows drivers to simultaneously grasp navigation instructions while experiencing the simulated driving environment, without having to frequently switch interfaces.

[0287] In the SR app interface, when the driving mode is changed to ACC, the SR interface no longer directly displays the guidance card. At this time, if the map navigation app continues to run in the background, the map navigation app will display relevant driving information as a floating window below the intelligent driving card in the SR app interface, ensuring that the driver can easily obtain navigation guidance while enjoying the convenience of adaptive cruise control.

[0288] When the driver returns to the central control desktop or launches other third-party applications, causing both the map navigation application and the SR application to run in the background, the floating windows of the map navigation application and the SR application are merged and displayed in a designated area of ​​the screen. This ensures that the driver can keep track of key navigation information and various intelligent driving status information at any time in multi-tasking scenarios.

[0289] It is important to note that the above description of the process is for illustrative purposes only and does not limit the scope of this specification. Those skilled in the art can make various modifications and changes to the process under the guidance of this specification. However, these modifications and changes remain within the scope of this specification.

[0290] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0291] Figure 14 is a schematic diagram of the structure of an electronic device according to some embodiments of this specification. As shown in Figure 14, the electronic device 1400 includes a processor 1401 with one or more processing cores, a memory 1402 with one or more computer-readable storage media, and computer instructions stored in the memory 1402 and executable on the processor. The processor 1401 is electrically connected to the memory 1402.

[0292] The processor 1401 is the control center of the electronic device 1400. It connects various parts of the electronic device 1400 via various interfaces and lines. By running or loading software programs and / or units stored in the memory 1402, and by calling data stored in the memory 1402, it executes various functions and processes data of the electronic device 1400, thereby providing overall monitoring of the electronic device 1400. The processor 1401 can be a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a Network Processor (NP), etc., and can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application.

[0293] In this embodiment of the application, the processor 1401 in the electronic device 1400 will load the computer instructions corresponding to the process of one or more applications into the memory 1402 according to the method or steps described in the above embodiment, and the processor 1401 will run the applications stored in the memory 1402 to execute the interface display method.

[0294] Optionally, as shown in FIG14, the electronic device 1400 further includes: a touch display screen 1403, a radio frequency circuit 1404, an audio circuit 1405, an input unit 1406, and a power supply 1407. The processor 1401 is electrically connected to the touch display screen 1403, the radio frequency circuit 1404, the audio circuit 1405, the input unit 1406, and the power supply 1407. Those skilled in the art will understand that the structure shown in FIG14 does not constitute a limitation on the electronic device, and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0295] The touch display screen 1403 can be used to display a graphical user interface (GUI) and receive operation commands generated by the user interacting with the GUI. The touch display screen 1403 may include a display panel and a touch panel. The display panel can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces of the vehicle. These graphical user interfaces can be composed of graphics, text, icons, video, and any combination thereof. Optionally, the display panel can be configured using a liquid crystal display (LCD), organic light-emitting diode (OLED), or other similar technologies. The touch panel can be used to collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near the touch panel), generate corresponding operation commands, and execute the corresponding program according to the operation commands. Optionally, the touch panel may include two parts: a touch detection device and a touch controller. The touch detection device detects the user's touch location and the signal generated by the touch operation, transmitting the signal to the touch controller. The touch controller receives touch information from the touch detection device, converts it into touch point coordinates, and sends it to the processor 1401. It can also receive and execute commands from the processor 1401. The touch panel can cover the display panel. When the touch panel detects a touch operation on or near it, it transmits the information to the processor 1401 to determine the type of touch event. Subsequently, the processor 1401 provides corresponding visual output on the display panel based on the type of touch event. In this embodiment, the touch panel and the display panel can be integrated into the touch display screen 1403 to achieve input and output functions. However, in some embodiments, the touch panel and the touch display screen 1403 can be implemented as two independent components to achieve input and output functions. That is, the touch display screen 1403 can also be used as part of the input unit 1406 to achieve input functions.

[0296] The radio frequency circuit 1404 can be used to transmit and receive radio frequency signals to establish wireless communication with network devices or other vehicles, and to transmit and receive signals with network devices or other vehicles.

[0297] Audio circuitry 1405 can be used to provide an audio interface between a user and a vehicle via a speaker and a microphone. Audio circuitry 1405 converts received audio data into electrical signals, transmits them to the speaker, and the speaker converts them into sound signals for output. Conversely, the microphone converts collected sound signals into electrical signals, which are then received by audio circuitry 1405, converted back into audio data, processed by processor 1401, and then transmitted via radio frequency circuitry 1404 to, for example, another vehicle, or output to memory 1402 for further processing. Audio circuitry 1405 may also include an earphone jack to provide communication between external headphones and the vehicle.

[0298] The input unit 1406 can be used to receive input numbers, character information or user feature information (such as fingerprints, iris, facial information, etc.), and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

[0299] Power supply 1407 is used to supply power to various components of electronic device 1400. Optionally, power supply 1407 can be logically connected to processor 1401 through a power management device, thereby enabling functions such as charging, discharging, and power consumption management through the power management device. Power supply 1407 may also include one or more DC or AC power supplies, recharging devices, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0300] Although not shown in Figure 14, the electronic device 1400 may also include a camera, sensor, wireless fidelity, Bluetooth, etc., which will not be described in detail here.

[0301] In another exemplary embodiment, a computer-readable storage medium including computer instructions is also provided, which, when executed by a processor, implement the steps of the interface display method described above. For example, the computer-readable storage medium may be the memory 1402 including computer instructions, which may be executed by the processor 1401 of the electronic device 1400 to implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application.

[0302] Alternatively, when the instructions are executed by a computer, they may implement or execute the methods, steps, and logic diagrams disclosed in the embodiments of this application.

[0303] The application embodiment also provides an interface display device, including: a display unit, used to display the application interface of a second application and / or auxiliary prompt information of the second application on the application interface of a first application based on the vehicle's driving mode and using a display strategy corresponding to the driving mode.

[0304] The display unit is used to execute the steps in the embodiments of the above-mentioned interface display method. For the specific implementation methods of these parts and more details, please refer to the corresponding method section, which will not be elaborated here.

[0305] This application also provides a vehicle equipped with the electronic device provided in any of the above embodiments, the electronic device being used to execute the interface display method provided in any of the above embodiments. The vehicle may be a gasoline-powered vehicle, a plug-in hybrid electric vehicle, or a new energy vehicle, etc., and this specification does not specifically limit it.

[0306] In one embodiment, the vehicle can be configured to a full or partial driving mode. For example, the vehicle can control itself while in driving mode, and can determine the current state of the vehicle and its surrounding environment through human intervention, determine the possible behaviors of at least one other vehicle in the surrounding environment, and determine the confidence level corresponding to the probability of that other vehicle performing the possible behavior, and control the vehicle based on the determined information. When the vehicle is in driving mode, it can be set to operate without human interaction.

[0307] In the description of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more features. In the description of this application, "multiple" means two or more, unless otherwise explicitly specified.

[0308] The embodiments, implementation methods, and related technical features of this application can be combined and substituted for each other without conflict.

[0309] The above are merely preferred embodiments of this application and are not intended to limit this application in any way. Although the descriptions of each embodiment in this application have different focuses, and the parts not described in detail in a certain embodiment can be referred to the relevant embodiments of other embodiments, any simple modifications, equivalent changes and modifications made to the above embodiments based on the technical essence of this application without departing from the content of the technical solution of this application shall still fall within the scope of the technical solution of this application.

Claims

1. A method for displaying an interface, wherein, The method includes: Based on the vehicle's driving mode, and using a display strategy corresponding to the driving mode, the application interface of the second application and / or the auxiliary prompt information of the second application are displayed on the application interface of the first application.

2. The method according to claim 1, wherein, The step of displaying the application interface of the second application and / or the auxiliary prompt information of the second application on the application interface of the first application using a display strategy corresponding to the driving mode includes: In response to the driving mode being the first driving mode, the application interface of the second application and the auxiliary prompts of the second application are displayed on the application interface of the first application; and In response to the driving mode being a second driving mode, or in response to the driving mode being a third driving mode, auxiliary prompts from the second application are displayed on the application interface of the first application.

3. The method according to claim 2, wherein, In response to the driving mode being the first driving mode, the application interface of the second application and the auxiliary prompt information of the second application are displayed on the application interface of the first application, including: In response to the driving mode being a first driving mode, the application interface of the second application is displayed on the application interface of the first application in a first display mode, and the auxiliary prompt information of the second application is displayed in a second display mode.

4. The method according to any one of claims 2 to 3, wherein, In response to the driving mode being the second driving mode, the auxiliary prompts of the second application are displayed on the application interface of the first application, including: In response to the driving mode being the second driving mode, auxiliary prompts of the second application are displayed on the application interface of the first application in a second display mode.

5. The method according to any one of claims 2 to 4, wherein, In response to the driving mode being the third driving mode, the auxiliary prompts of the second application are displayed on the application interface of the first application, including: In response to the driving mode being the third driving mode, the auxiliary prompts of the second application are displayed on the application interface of the first application in a first display mode.

6. The method according to any one of claims 3 to 5, wherein, The auxiliary prompts of the second application displayed in the first display mode are generated by the second application and displayed through pass-through, while the auxiliary prompts of the second application displayed in the second display mode are drawn and displayed by the first application.

7. The method according to claim 6, wherein, The method for generating the auxiliary prompt information of the second application displayed in the second display mode includes: It is generated by the first application by listening to the auxiliary prompts from the second application and drawing them.

8. The method according to any one of claims 2 to 7, wherein, The method further includes: In response to a triggering operation on the application interface or auxiliary prompts of the second application, the application interface of the second application is displayed in full screen.

9. The method according to claim 8, wherein, The method further includes: On the full-screen application interface of the second application, the application interface of the first application and / or the auxiliary prompts of the first application are displayed.

10. The method according to claim 9, wherein, The display of the application interface of the first application and / or the auxiliary prompts of the first application includes: The application interface of the first application is displayed in a first display mode, and the auxiliary prompts of the second application are displayed in a second display mode.

11. The method according to any one of claims 8 to 10, wherein, The method further includes: In response to the application interface or auxiliary prompts of the second application being displayed in a first display mode, the step of performing the trigger operation that responds to the application interface or auxiliary prompts of the second application and displaying the application interface of the second application in full screen is executed.

12. The method according to any one of claims 3 to 11, wherein, The first display method is either a non-full-screen display method or a floating window display method.

13. The method according to any one of claims 3 to 11, wherein, The second display method includes a modular information display method.

14. The method according to claim 13, wherein, The modular information is displayed in a card-like manner.

15. The method according to any one of claims 2 to 14, wherein, The automation level of the first driving mode is higher than that of the second driving mode, and the automation level of the second driving mode is higher than that of the third driving mode.

16. The method according to any one of claims 2 to 15, wherein, The first driving mode is lane navigation mode, the second driving mode is lane tracing mode, and the third driving mode is adaptive cruise control mode.

17. The method according to any one of claims 1 to 16, wherein, The application interfaces of the first application and the second application are related to the driving process of the vehicle.

18. The method according to any one of claims 1 to 16, wherein, The application interfaces of the first application and the second application are used to display different auxiliary prompts for the vehicle during driving.

19. The method according to any one of claims 1 to 16, wherein, The application interface of the first application is used to display the navigation information of the vehicle, and the application interface of the second application is used to display the simulated driving environment information of the vehicle; or, the application interface of the first application is used to display the simulated driving environment information of the vehicle, and the application interface of the second application is used to display the navigation information of the vehicle.

20. The method according to any one of claims 1 to 19, wherein, The method further includes: Upon detecting an operation to switch the application interface of a third application, the application interfaces of the first application and the second application are displayed on the application interface of the third application.

21. The method according to any one of claims 1 to 19, wherein, The application interface of the first application also displays interactive controls, and the method further includes: Upon receiving a trigger operation for the interactive control, the application interface of the second application and / or the auxiliary prompt information of the second application are canceled on the application interface of the first application.

22. The method according to any one of claims 1 to 21, wherein, The method further includes: The system detects the user's selection of a driving mode and determines the vehicle's driving mode.

23. An interface display device, wherein, include: The display unit is used to display the application interface of the second application and / or the auxiliary prompt information of the second application on the application interface of the first application, based on the vehicle's driving mode and using a display strategy corresponding to the driving mode.

24. A computer-readable storage medium, wherein, The computer-readable storage medium stores instructions that, when executed by a computer, cause the computer to perform the interface display method according to any one of claims 1 to 22.

25. A computer program product, wherein, The computer program product stores instructions that, when executed by a computer, cause the computer to implement the interface display method according to any one of claims 1 to 22.

26. An electronic device, wherein, include: Memory, on which computer instructions are stored; A processor for executing the computer instructions in the memory to implement the interface display method according to any one of claims 1 to 22.

27. A vehicle, wherein, Includes the interface display device as described in claim 23, or the electronic device as described in claim 26.

Images