Display control method and computer program product for a smart interface of a vehicle

Abstract

The application relates to a display control method of an intelligent driving interface for a vehicle, wherein the display control method comprises at least the following steps: dividing vehicle display information into a plurality of information modules, the information modules being capable of being presented in a thumbnail mode or an expanded mode respectively; when an application program of the vehicle is running, at least one first information module in the information modules is displayed on the intelligent driving interface in the thumbnail mode, wherein the first information module can be switched from the thumbnail mode to the expanded mode according to the interactive behavior of a user and is displayed at a local part of the intelligent driving interface in the form of being suspended on a display page of the application program, and the application program remains normal running. The application also relates to a corresponding computer program product. The user can more conveniently query and call different vehicle display information and implement quick operation without affecting the normal running of the application program, so that the riding experience and safety of the user are improved.

Description

Technical Field

[0001] This invention relates to the technical field of vehicle driver assistance systems, and more particularly to a display and control method for an intelligent driving interface for vehicles. The invention also relates to a corresponding computer program product. Background Technology

[0002] In recent years, with the development of technology and the improvement of living standards, the level of intelligence and multi-functionality of vehicles has been continuously improving.

[0003] Intelligent driving refers to vehicle driving systems based on environmental perception, decision-making, planning, and execution control. It encompasses Advanced Driver Assistance Systems (ADAS) and Automatic Driving Systems (ADS), used to support or replace drivers in completing dynamic driving tasks at different levels of automation. The intelligent driving interface is used to present the vehicle's intelligent driving status, functional information, and takeover requests to the driver during the operation of ADAS and ADS, and to receive driver input or confirmation. Through the intelligent driving interface, which provides information on the vehicle's perception of the surrounding environment, the current operational status of driver assistance functions, and warning information when potential hazards are detected, users can quickly and intuitively understand the vehicle's status and environmental risks, and take timely measures to ensure driving safety.

[0004] In actual driving, users often need to query different vehicle information or change configurations. However, this usually requires exiting the currently running application (such as an in-car navigation program) or returning to the intelligent driving interface to obtain the required information. This not only increases the complexity of information retrieval but may also interrupt the normal operation of the current application, thereby affecting the user experience and even adversely impacting driving safety. Summary of the Invention

[0005] Therefore, the purpose of this invention is to propose an improved display control method for a vehicle's intelligent driving interface. This method allows users to more easily query and access different vehicle display information and perform quick operations, while reducing the impact on normally operating applications, thereby improving the user's driving experience and safety.

[0006] Another objective of this invention is to provide a corresponding computer program product.

[0007] According to a first aspect of the present invention, a display control method for a vehicle's intelligent driving interface is provided, wherein the display control method includes at least the following steps: S1: Divide the vehicle display information into multiple information modules, each of which can be presented in either a thumbnail or an expanded mode. S2: When the vehicle's application is running, at least one first information module among the information modules is displayed on the intelligent driving interface in the thumbnail mode, wherein the first information module can switch from the thumbnail mode to the expanded mode according to the user's interaction behavior and be displayed in a part of the intelligent driving interface in the form of floating on the display page of the application, while the application continues to operate normally.

[0008] Within the framework of this invention, "intelligent driving interface" should be understood as the user interface of a vehicle during the operation of the driver assistance system (ADAS) and the automatic driving system (ADS) to present vehicle information to the driver and receive input commands from the driver, wherein the display page of the running application can be presented on the user interface.

[0009] Compared to existing technologies, in the display control method for a vehicle's intelligent driving interface according to the present invention, the vehicle display information is divided into multiple information modules that can be presented in either a thumbnail or expanded mode. These information modules occupy a small space in the thumbnail mode and a larger space in the expanded mode, where the information they contain is clearly visible. When the vehicle's application is running, at least one first information module is displayed in thumbnail mode on the intelligent driving interface. This first information module can switch from thumbnail mode to expanded mode based on user interaction and is displayed as a floating element in a portion of the intelligent driving interface, while the application continues to run normally. This allows the user to easily switch the first information module from thumbnail mode to expanded mode without exiting the currently running application or returning to the main page. This allows users to clearly query the required display information and perform quick operations while using the application normally, thereby improving the user's driving experience and safety.

[0010] For example, the vehicle display information is adaptively categorized into corresponding information modules based on category and / or usage frequency and / or driving stage; and / or, the vehicle display information is manually categorized into different information modules by the user.

[0011] For example, the vehicle display information is selected from the following group: vehicle status information, navigation and map information, multimedia entertainment information, communication and interaction information, safety and driver assistance information; and / or, the application is selected from the following group: in-vehicle navigation program, multimedia program, driving settings program, in-vehicle atmosphere adjustment program, third-party application.

[0012] For example, when the application is running, at least one second information module among the information modules is automatically displayed on the display page in the expanded mode, wherein the second information module maintains the expanded mode during the operation of the application.

[0013] For example, the information module is presented as a selectable icon in the thumbnail mode, the icon having a color and / or symbol and / or shape corresponding to the information category or user-defined; and / or, the information module has a preset transparency in the thumbnail mode; and / or, the information module can be dragged to change its position in the thumbnail mode.

[0014] For example, the information module is presented as a floating window in the expanded mode, and the size of the floating window can be changed by the user by dragging the edges; the information module has sub-information modules, and in the expanded mode, the sub-information modules can be selectively further expanded; and / or, when multiple application display pages exist simultaneously on the intelligent driving interface, the first information module switched to the expanded mode can be dragged between different display pages; and / or, the information module cannot be stacked on a preset area related to driving safety in the expanded mode and / or the thumbnail mode.

[0015] For example, in a specific driving state and / or external environment and / or occupant state of the vehicle, the first information module associated with it in the thumbnail mode flashes or jumps or automatically switches from the thumbnail mode to the expanded mode. Wherein, when the number of times the user actively switches the first information module to the expanded mode in the specific driving state and / or external environment and / or occupant state exceeds a set threshold, the specific driving state and / or external environment and / or occupant state is associated with the first information module.

[0016] For example, in step S2, when the application is running, multiple first information modules are displayed on the display page in the thumbnail mode, wherein when one first information module is switched from the thumbnail mode to the expanded mode, the other first information modules become blurred or transparent; and / or, in step S2, the user inputs the interactive behavior by touching the first information module in the intelligent driving interface, or by physical buttons, or by voice input.

[0017] For example, the display control method additionally includes step S3: when the user touches an area of ​​the intelligent driving interface outside the first information module or when the time for which the first information module switches to the expanded mode exceeds a set time, the first information module switches back from the expanded mode to the thumbnail mode.

[0018] For example, the display control method additionally includes step S4: obtaining the display level of the intelligent driving interface, wherein the higher the display level, the more information the information module can display in the expanded mode.

[0019] For example, the display control method additionally includes step S5: detecting the user's viewing angle, and when the viewing angle is directed toward the intelligent driving interface, highlighting the information module, especially the information module in the unfolded mode.

[0020] According to a second aspect of the present invention, a computer program product is provided, comprising a computer program, wherein when the computer program is executed by one or more processors, the processors are capable of executing the display control method according to the present invention. Attached Figure Description

[0021] The invention will now be described in more detail with reference to the accompanying drawings, which will provide a better understanding of its principles, features, and advantages. The drawings include: Figure 1 A schematic flowchart of a display control method according to an exemplary embodiment of the present invention is shown; Figures 2a to 2c The diagrams show display schematics of intelligent driving interfaces according to different exemplary embodiments of the present invention. Detailed Implementation

[0022] To make the technical problems to be solved, the technical solutions, and the beneficial technical effects of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and several exemplary embodiments. It should be understood that the specific embodiments described herein are for illustrative purposes only and are not intended to limit the scope of protection of this invention.

[0023] It should be understood that the terms "first," "second," etc., used herein are for descriptive purposes only and should not be construed as indicating or implying relative importance, nor should they be construed as implicitly specifying the number of technical features indicated. Features specified as "first" or "second" may expressly or implicitly indicate that at least one of those features is included.

[0024] This specification provides the operational steps for the methods described in the embodiments or flowcharts, but based on conventional or non-inventive labor, more or fewer operational steps may be included. The order of steps listed in the embodiments is merely one possible execution order among many and does not represent the only possible execution order.

[0025] Figure 1 A schematic flowchart of a display control method according to an exemplary embodiment of the present invention is shown. Figures 2a to 2c Schematic diagrams of intelligent driving interfaces 100 according to different exemplary embodiments of the present invention are shown. Here, the intelligent driving interface 100 is particularly the display interface of a vehicle's in-vehicle display screen.

[0026] like Figure 1 As shown, the display control method for the intelligent driving interface 100 for a vehicle according to the present invention includes at least the following steps: S1: Divide the vehicle display information into multiple information modules 10. The information modules can be presented on the intelligent driving interface 100 in either a thumbnail mode or an expanded mode. In the thumbnail mode, the information module 10 occupies a relatively small position and does not significantly affect the display of other areas. In the expanded mode, it occupies a relatively large position and allows users to clearly see the information contained therein or perform corresponding operations. S2: When the vehicle's application is running, the application's display page 20 is displayed on the intelligent driving interface 100. At least one first information module 11 in the information module 10 is displayed in a thumbnail mode on the intelligent driving interface 100 or the display page 20. The first information module 11 can switch from the thumbnail mode to the expanded mode according to the user's interaction behavior and be displayed in a part of the intelligent driving interface 100 in the form of floating on the display page 20, while the application continues to run normally. This allows the user to read the required information or perform quick operations from the first information module 11 in the expanded mode without closing or minimizing the application's display page 20. This significantly simplifies the user's information query operation and improves the user's riding experience.

[0027] Within the framework of this invention, "interactive behavior" can include direct user operation commands, such as button operations or touch screen operations, or it can include specific user actions or voice, based on which corresponding instructions are generated.

[0028] For example, the vehicle display information in step S1 can be selected from the following group: vehicle status information, navigation and map information, multimedia entertainment information, communication and interaction information, and safety and driver assistance information.

[0029] Here, vehicle status information can include basic driving information (such as vehicle speed, motor speed, gear position, total mileage, fuel / electricity consumption, and driving range), powertrain status information (such as engine coolant temperature, battery charge, motor power, and battery temperature), surrounding environmental information (such as outside temperature, weather conditions, and PM2.5 concentration), and in-vehicle atmosphere information (such as in-vehicle air quality, in-vehicle temperature, seat heating status, in-vehicle air conditioning information, and ambient lighting status). Navigation and map information can include real-time navigation information (such as vehicle location information, route planning information, and real-time traffic information), prediction information on the behavior of other road users (such as route prediction information for other vehicles and collision warning information), and point-of-interest information (such as gas stations, parking lots, charging stations, and service areas). The information may include augmented reality navigation information; multimedia entertainment information may include audio and video playback information (such as lyrics, video information, online streaming media information, etc.), connectivity information, game and application information; communication and interaction information may include telephone function information, voice assistant information, notification messages from communication programs (such as SMS or WeChat, etc.); safety and driver assistance information may include active safety reminders (such as lane departure warning, blind spot monitoring prompts, driver fatigue warning, etc.), sensor information (such as tire pressure monitoring, reversing camera, 360° surround view), and status information of driver assistance systems or autonomous driving systems (such as single-lane driving control function information, multi-lane driving control function information, cruise control function information, conditional autonomous driving function information, highly autonomous driving function information, etc.). Other display information that a person skilled in the art deems meaningful may also be considered.

[0030] For example, vehicle display information is adaptively categorized into corresponding information modules 10 based on category and / or frequency of use and / or driving phase. However, it is also possible that vehicle display information is manually categorized into different information modules 10 by the user, thereby enabling personalized division of display information.

[0031] For example, the application in step S2 can be selected from the following group: in-vehicle navigation program, multimedia program, driving settings program, in-vehicle atmosphere adjustment program, and third-party application. The multimedia program can be a music player or video player; the driving settings program can be a driving mode setting program, a rearview mirror adjustment program, a steering wheel power steering adjustment program, etc.; the in-vehicle atmosphere adjustment program can be an air conditioning adjustment program, a seat heating / ventilation program, an ambient lighting adjustment program, etc.; and the third-party application can be a game program or an entertainment platform program, etc. The display page 20 of different applications can have different page layouts. Of course, other applications that those skilled in the art deem meaningful can also be considered.

[0032] For example, such as Figure 2aAs shown, when the vehicle's application, such as an in-vehicle navigation program, is running, at least one, for example, three first information modules 11 are displayed in thumbnail mode on the application's display page 20. These three first information modules 11, for example, respectively contain vehicle driving status information, in-vehicle atmosphere information, and vehicle control information. The first information modules 11 are presented as selectable icons, which have colors and / or symbols and / or shapes corresponding to the information category or user-defined, so that the user can easily identify the corresponding information category by observing the icon and switch the first information module 11 from the thumbnail state to the expanded state by touching the icon.

[0033] For example, the first information module 11 has a preset transparency in thumbnail mode to minimize its impact on the display page 20. Here, the icon of the first information module 11 in thumbnail mode is located at the bottom of the intelligent driving interface 100, but the user can change the position of the first information module 11 by dragging, thereby achieving a personalized layout.

[0034] For example, such as Figure 2b As shown, based on the user's interaction behavior, a first information module 11 switches from a thumbnail mode to an expanded mode, that is, from a smaller icon at the bottom to a larger window at the top (the dotted line between the two only indicates the correspondence and does not exist in actual use). In the expanded mode, the first information module 11 is presented as a floating window, which can clearly display the divided information. The size of the floating window can be changed by the user by dragging the edge. Relevant information can be displayed in the floating window through text or images, and the user can perform quick operations in the floating window.

[0035] For example, the information module 10 cannot be superimposed on a pre-defined area related to driving safety in the expanded mode and / or the thumbnail mode, such as the navigation information area, thereby preventing the information module 10 from hindering the user from obtaining key information related to driving safety.

[0036] For example, a user can directly change the air conditioning temperature through the floating window of the first information module 11, which contains in-vehicle ambient information. Here, in step S2, the user can input an interactive action by touching the thumbnail icon of the first information module 11 in the intelligent driving interface 100, causing the first information module 11 to switch from thumbnail mode to expanded mode. Alternatively, the user can input the corresponding interactive action via physical buttons or voice input.

[0037] For example, such as Figure 2a and Figure 2bAs shown, when the application runs, at least one second information module 12 in information module 10 is automatically displayed in expanded mode on display page 20. The information displayed in the second information module 12 is important to the application and is generated by the application. For example, the application is a car navigation program and the second information module 12 contains car navigation information. In particular, during the operation of the application, the second information module 12 must remain in expanded mode to allow the user to view relevant information at any time.

[0038] For example, such as Figure 2b As shown, in step S2, when the application is running, multiple first information modules 11 are displayed on the display page 20 in thumbnail mode. When one first information module is switched from thumbnail mode to expanded mode, the other first information modules become blurred or transparent (indicated by light-colored dotted lines). This allows the user to clearly see which information module has switched to expanded mode and improves the visual effect.

[0039] For example, such as Figure 2b As shown, information module 10, especially the first information module 11, can have at least one, and especially multiple, sub-information modules 13. Each sub-information module 13 includes information belonging to different subcategories of the same category. In the expanded mode of information module 10, these sub-information modules 13 are presented in a thumbnail mode in a floating window, and any sub-information module 13 can be selectively expanded further. This allows users to easily and flexibly retrieve the corresponding information as needed and avoids displaying too much information simultaneously in the floating window. For example, information module 10 corresponding to vehicle status information can have multiple sub-information modules 13, which respectively include basic driving information, powertrain status information, surrounding environment information, and in-vehicle atmosphere information. In the expanded mode, the user can further expand any sub-information module 13 as needed.

[0040] For example, such as Figure 2c As shown, when multiple application display pages 20 exist simultaneously on the intelligent driving interface 100, the first information module 11, switched to expanded mode, can be dragged between different display pages 20. For example, if the intelligent driving interface 100 simultaneously displays display pages 20 for a car navigation program and a video playback program, and the car navigation program's display page 20 also contains a second information module 12 containing vehicle navigation information, when a user switches a first information module 11 from thumbnail mode to expanded mode, the user can drag the floating window of the first information module 11 between the car navigation program and the video playback program's display pages 20 as needed.

[0041] For example, in a specific driving state of the vehicle and / or external environment and / or occupant state, the associated first information module 11, which is in thumbnail mode, flashes or jumps or automatically switches from thumbnail mode to expanded mode to further assist the user in viewing information. For instance, when singing by an occupant is detected, the first information module 11 containing multimedia entertainment information flashes or jumps or automatically switches from thumbnail mode to expanded mode.

[0042] For example, the driving status of the vehicle may include the status of the vehicle's autonomous driving function, which is a Level 3 (L3) or higher autonomous driving function. When the autonomous driving function is activated, the user of the vehicle does not need to pay much attention to the driving process, causing the first information module 11 containing multimedia entertainment information or communication and interaction information to flash or jump or automatically switch from the thumbnail mode to the expanded mode.

[0043] For example, when the number of times a user actively switches the first information module 11 to the unfolded mode in a specific driving state and / or external environment and / or occupant state exceeds a set threshold, the specific driving state and / or external environment and / or occupant state is associated with the first information module 11.

[0044] For example, when the vehicle is in a narrow external environment, if the user actively switches the first information module 11 containing surrounding environment information from thumbnail mode to expanded mode more than 5 times, then the narrow external environment and the first information module 11 containing surrounding environment information are associated. When the vehicle is in a narrow external environment again, the thumbnail icon of the first information module 11 containing surrounding environment information flashes or jumps to prompt the user to switch the first information module 11 to expanded mode, or the first information module 11 containing surrounding environment information automatically switches from thumbnail mode to expanded mode, which greatly simplifies the user's operation.

[0045] For example, such as Figure 1 As shown, the display control method according to the present invention additionally includes step S3: when the first information module 11 is in the expanded mode, when the user touches an area of ​​the intelligent driving interface 100 outside the first information module 11, or when the time for the first information module 11 to switch to the expanded mode exceeds a set duration, for example, 20 seconds, the first information module 11 is switched back from the expanded mode to the minimized mode. Here, the set duration can be adjusted by the user.

[0046] For example, such as Figure 1As shown, the display control method according to the present invention additionally includes step S4: obtaining the display level of the intelligent driving interface 100, wherein the higher the display level, the more information the information module 10 can display in the expanded mode. This applies to both the first information module 11 and the second information module 12. Taking the information module 10 containing vehicle navigation information as an example, the first display level simply displays destination information and forward turning information, the second display level can further display forward congestion information and lane change suggestions, and the third display level can further display road segment marking information and information on gas stations along the way, etc.

[0047] For example, the display level of the intelligent driving interface 100 is set by the user. However, it is also possible to consider that the display level of the intelligent driving interface 100 is adaptively adjusted according to the vehicle's driving status and / or the external environment and / or the occupant status. For example, when the vehicle is in autonomous driving mode or on a road that it usually travels on, the display level of the intelligent driving interface 100 can be reduced.

[0048] For example, such as Figure 1 As shown, the display control method according to the present invention additionally includes step S5: detecting the user's gaze angle, and when the gaze angle is towards the intelligent driving interface 100, highlighting the information module 10, especially the information module 10 in unfolded mode, which allows the user to obtain the required information more clearly. Conversely, when the user's gaze angle moves away from the intelligent driving interface 100, reducing the brightness of the intelligent driving interface 10, including the information module 10. Here, the user's gaze angle can be detected by an in-vehicle camera.

[0049] Here, the display control method according to the invention can be implemented by a vehicle infotainment unit having a computer program product according to the invention, which includes a computer program that, when executed by one or more processors, enables the processor to execute the display control method according to the invention.

[0050] The foregoing description of the embodiments is limited to the framework of the examples given. Of course, the various features of the embodiments can be freely combined with each other without departing from the framework of the invention, as long as it is technically meaningful.

[0051] Other advantages and alternative embodiments of the present invention will be apparent to those skilled in the art. Therefore, the present invention is not, in its broader sense, limited to the specific details, representative structures, and exemplary embodiments shown and described. Rather, those skilled in the art can make various modifications and substitutions without departing from the basic spirit and scope of the invention.

Claims

1. A display control method for a vehicle's intelligent driving interface (100), characterized in that, The display control method includes at least the following steps: S1: Divide the vehicle display information into multiple information modules (10), and each information module (10) can be presented in either a thumbnail mode or an expanded mode. S2: When the vehicle's application is running, at least one first information module (11) in the information module (10) is displayed on the intelligent driving interface (100) in the thumbnail mode, wherein the first information module (11) can switch from the thumbnail mode to the expanded mode according to the user's interaction behavior and be displayed in a part of the intelligent driving interface (100) in the form of floating on the display page (20) of the application, while the application continues to operate normally.

2. The display control method according to claim 1, characterized in that, The vehicle display information is adaptively categorized into the corresponding information modules (10) based on category and / or usage frequency and / or driving phase; and / or The vehicle display information is manually categorized by the user into different information modules (10); and / or The vehicle display information is selected from the following group: vehicle status information, navigation and map information, multimedia entertainment information, communication and interaction information, safety and driver assistance information; and / or The application is selected from the following group: in-vehicle navigation program, multimedia program, driving settings program, in-vehicle atmosphere adjustment program, and third-party application.

3. The display control method according to any one of the preceding claims, characterized in that, When the application runs, at least one second information module (12) of the information module (10) is automatically displayed on the display page (20) in the expanded mode, wherein, During the operation of the application, the second information module (12) maintains the expanded mode.

4. The display control method according to any one of the preceding claims, characterized in that, The information module (10) is presented as a selectable icon in the thumbnail mode, the icon having colors and / or symbols and / or shapes corresponding to the information category or user-defined; and / or The information module (10) has a preset transparency in the thumbnail mode; and / or The information module (10) can change its position by dragging in the thumbnail mode; and / or The information module (10) is presented as a floating window in the expanded mode, and the size of the floating window can be changed by the user by dragging the edges; and / or The information module (10) has a sub-information module (13), which, in the expanded mode, can be selectively further expanded; and / or When multiple application display pages (20) exist simultaneously on the intelligent driving interface (100), the first information module (11) switched to the expanded mode can be dragged between different display pages (20); and / or The information module (10) cannot be superimposed on a preset area related to driving safety in the expanded mode and / or the thumbnail mode.

5. The display control method according to any one of the preceding claims, characterized in that, In a specific driving state of the vehicle and / or external environment and / or occupant state, the associated first information module (11) in the thumbnail mode flashes or jumps or automatically switches from the thumbnail mode to the expanded mode, wherein, When the number of times the user actively switches the first information module (11) to the unfolded mode in the specific driving state and / or external environment and / or occupant state exceeds a set threshold, the specific driving state and / or external environment and / or occupant state is associated with the first information module (11).

6. The display control method according to any one of the preceding claims, characterized in that, In step S2, when the application is running, a plurality of the first information modules (11) are displayed on the display page (20) in the thumbnail mode, wherein when one of the first information modules is switched from the thumbnail mode to the expanded mode, the other first information modules become blurred or transparent; and / or In step S2, the user inputs the interactive behavior by touching the first information module (11) in the intelligent driving interface (100), or by physical buttons or voice input.

7. The display control method according to any one of the preceding claims, characterized in that, The display control method additionally includes step S3: when the user touches an area of ​​the intelligent driving interface (100) outside the first information module (11) or when the time for the first information module (11) to switch to the expanded mode exceeds a set time, the first information module (11) is switched back from the expanded mode to the thumbnail mode.

8. The display control method according to any one of the preceding claims, characterized in that, The display control method additionally includes step S4: obtaining the display level of the intelligent driving interface (100), wherein the higher the display level, the more information the information module (10) can display in the unfolded mode.

9. The display control method according to any one of the preceding claims, characterized in that, The display control method additionally includes step S5: detecting the user's gaze angle, and when the gaze angle is directed toward the intelligent driving interface (100), highlighting the information module (10), especially the information module (10) in the unfolded mode.

10. A computer program product comprising a computer program, characterized in that, When the computer program is executed by one or more processors, the processors are capable of performing the display control method according to any one of claims 1 to 9.

Images