A navigation menu display method, system, and vehicle
By detecting the user's hand position, the display position of the navigation menu is intelligently adjusted, solving the problem of inconvenient user operation caused by the fixed display of the navigation menu in the existing technology, and improving the user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- ZHEJIANG GEELY HLDG GRP CO LTD
- Filing Date
- 2024-02-07
- Publication Date
- 2026-06-30
AI Technical Summary
Existing vehicle navigation menus are usually displayed in a fixed area of the center console, which makes it inconvenient for users on the other side to operate and affects the user experience.
By detecting the user's hand position, the navigation menu is intelligently adjusted to make it easier for both driver and passenger to operate.
It enables dynamic adjustment of the navigation menu's display position based on the user's location, improving the convenience and experience of user operation.
Smart Images

Figure CN118163609B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of vehicle technology, and more specifically, to a navigation menu display method, system, and vehicle. Background Technology
[0002] The vehicle's central control system typically includes a navigation menu, which is used to manage and control various vehicle functions, such as the entertainment system, map navigation, communication, and vehicle settings. These control functions can be operated via touchscreen, physical buttons, and voice control.
[0003] Because existing navigation menus are usually displayed in a fixed area of the center console, they can only cater to one side of the driver or passenger in the same scenario, making it inconvenient for the other side to operate and affecting the user experience. Summary of the Invention
[0004] The problem solved by this invention is how to intelligently display the location of the navigation menu.
[0005] To address the above problems, the present invention provides a navigation menu display method, system, and vehicle.
[0006] In a first aspect, the present invention provides a navigation menu display method, comprising:
[0007] Obtain the location of the target object;
[0008] The location of the navigation menu is determined based on the location of the target object.
[0009] Optionally, obtaining the location of the target object includes:
[0010] The position of the user's hands is detected by a detection device installed on the central control panel.
[0011] Optionally, determining the location of the navigation menu based on the location of the target object includes:
[0012] When the target object is moved to the central control panel, it is determined whether there are other target objects on the central control panel;
[0013] If the other target objects are present, the position of the navigation menu on the central control panel remains unchanged;
[0014] If no other target object exists, the position of the navigation menu is maintained or adjusted according to the relative position of the set target object and the navigation menu.
[0015] Optionally, maintaining or adjusting the position of the navigation menu based on the relative position of the set target object and the navigation menu includes:
[0016] When the target object and the navigation menu are located on the same side of the central control panel, the position of the navigation menu on the central control panel remains unchanged;
[0017] When the target object and the navigation menu are located on opposite sides of the central control panel, adjust the position of the navigation menu on the central control panel to be on the same side as the target object.
[0018] Optionally, the navigation menu display method further includes:
[0019] When the target object and the navigation menu are located on the same side of the central control panel, if the target object moves to the opposite side of the navigation menu within a first preset time period, the position of the navigation menu on the central control panel remains unchanged.
[0020] Optionally, the navigation menu display method further includes:
[0021] The navigation menu is hidden after the target object has been moved for more than a second preset time.
[0022] Optionally, the navigation menu display method further includes:
[0023] When the navigation menu is hidden, if the set target object is detected, the navigation menu is displayed according to the position of the set target object on the central control panel.
[0024] Optionally, the navigation menu display method further includes:
[0025] The navigation menu is displayed in a fixed area.
[0026] Secondly, the present invention provides a navigation menu display system, including a computer-readable storage medium storing a computer program and a processor, wherein the computer program is read and executed by the processor to implement the navigation menu display method described above.
[0027] Thirdly, the present invention provides a vehicle including the above-described navigation menu display system.
[0028] This invention obtains the location of a target object and determines the location of the navigation menu based on that location. For example, if the center console is divided into left and right display areas, and the navigation menu is originally located on the left side of the center console in a left-hand drive vehicle, but the passenger wants to move the navigation menu to the right side, the location can be adjusted according to the passenger's hand position to facilitate clicking and other operations. This allows users to adjust the location of the navigation menu according to the actual situation, taking into account both the driver and passenger, and improving the user experience. Attached Figure Description
[0029] Figure 1 This is a flowchart illustrating the navigation menu display method according to an embodiment of the present invention;
[0030] Figure 2 This is a schematic diagram of the navigation menu homepage interaction according to an embodiment of the present invention;
[0031] Figure 3 This is a schematic diagram of the in-application interaction of the navigation menu in an embodiment of the present invention. Detailed Implementation
[0032] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
[0033] like Figure 1 As shown, an embodiment of the present invention provides a navigation menu display method, including:
[0034] Obtain the location of the target object.
[0035] Specifically, the first step is to obtain the location of the target object, such as the location of the user's hand, or the location of the stylus, etc.
[0036] The location of the navigation menu is determined based on the location of the target object.
[0037] Specifically, the location of the navigation menu is then determined based on the location of the target object. For example, the center console can be divided into the middle, left, right, upper, and lower sections. When the navigation menu is located on the left side of the center console, if the user's hand is detected to move to the right side of the center console, the navigation menu will be displayed on the right side of the center console. If the user's hand is detected to move to the upper part of the center console, the navigation menu will be displayed on the upper part of the center console. The same applies to the lower part. If the user's hand is detected to move to the middle of the center console, the navigation menu display position will remain unchanged.
[0038] Common application scenarios include:
[0039] (1) After the song is played on the driver's side, the multimedia navigation menu remains on the left (driver's side). If the passenger wants to switch their playlist, the multimedia navigation menu will automatically appear on the right (passenger's side) when the passenger leans forward and moves their finger to the top of the screen.
[0040] (2) When the driver is driving, the home navigation menu is on the left (driver's side). When the passenger helps the driver adjust the vehicle settings, the home navigation menu will automatically appear on the right (passenger's side) when the passenger leans forward and moves his finger to the top of the screen.
[0041] The navigation menu is part of the vehicle's internal control system, and common functions include:
[0042] (1) Navigation system: Provides real-time navigation functions, including map display, route planning, voice navigation, etc. Users can enter their destination, and the system will provide the best driving route.
[0043] (2) Audio and entertainment: Control the vehicle’s in-vehicle audio system, including adjusting the volume, switching channels, and selecting media sources.
[0044] (3) Bluetooth and mobile phone connection: Manage the connection with the mobile phone, including Bluetooth calls, music playback, message notifications, etc.
[0045] (4) Vehicle information: Provides information about vehicle status, such as fuel consumption, mileage, tire pressure monitoring, and battery status and charging information for electric vehicles.
[0046] (5) Air conditioning and seat heating: Control the temperature inside the vehicle and the air conditioning system, including adjusting the air conditioning fan speed, temperature, seat heating, etc.
[0047] (6) Driving mode selection: such as sport mode, economy mode, etc., can be selected through the central control navigation menu.
[0048] (7) Settings and personalization options: Allows users to personalize settings, such as adjusting seat position, changing dashboard display style, language selection, etc.
[0049] (8) Vehicle diagnostics: Provides information on the health status of the vehicle, such as engine fault codes and maintenance reminders.
[0050] Optionally, obtaining the location of the target object includes:
[0051] The position of the user's hands is detected by a detection device installed on the central control panel.
[0052] Specifically, detection devices such as OMS cameras, infrared cameras, or millimeter-wave radars are installed on the central control panel to detect the position of the user's hands. The detection devices can be installed above the central control panel or other locations to detect the position of the user's hands relatively accurately.
[0053] Among them, the OMS (Occupancy Monitoring System) camera is a camera system used to monitor the behavior of occupants inside a vehicle. It typically uses computer vision and image recognition technology to analyze images or video streams inside the vehicle to detect and identify occupant behavior. Common functions and applications include:
[0054] (1) Seat belt detection: The camera can monitor whether the occupants in the vehicle are wearing seat belts and issue a warning or reminder if seat belts are not worn.
[0055] (2) Driver status monitoring: By analyzing the driver's eye movements, head posture, etc., the system can detect whether the driver is distracted, fatigued or inattentive, and take corresponding safety measures.
[0056] (3) Occupant count: The camera can identify the number of occupants in the vehicle.
[0057] (4) Child left in car alert: The system can detect whether a child or pet is left in the car after the vehicle is parked and issue an alert to prevent accidents.
[0058] (5) Abnormal behavior detection: The camera can detect abnormal behavior of passengers, such as conflicts between passengers, whispering, etc., to improve in-vehicle safety.
[0059] (6) Emotion recognition: Cameras may attempt to identify occupants’ emotions by analyzing their facial expressions in order to provide better service or improve the in-vehicle environment.
[0060] In this embodiment, the OMS camera is mainly used to monitor the user's body posture and finger movement trajectory to determine the position of the user's hand. The OMS camera in the vehicle can be reused without adding additional hardware or sensors, which helps to reduce system complexity and cost.
[0061] Optionally, determining the location of the navigation menu based on the location of the target object includes:
[0062] When the target object is moved to the central control panel, it is determined whether there are other target objects on the central control panel.
[0063] Specifically, when the target object (such as the passenger's finger) moves to the center console, it is determined whether there are other target objects (such as the driver's finger) on the center console.
[0064] If the other target objects are present, the position of the navigation menu on the central control panel remains unchanged.
[0065] Specifically, if other targets exist, it means that the users corresponding to those other targets are still operating them, and in this case, the position of the navigation menu on the central control panel remains unchanged.
[0066] If no other target object exists, the position of the navigation menu is maintained or adjusted according to the relative position of the set target object and the navigation menu.
[0067] Specifically, if there are no other targets, it means that only the user corresponding to the set target is operating. In this case, the position of the navigation menu is maintained (the set target and the navigation menu are on the same side of the central control panel) or adjusted (the set target and the navigation menu are on opposite sides of the central control panel) according to the relative position of the set target and the navigation menu.
[0068] Optionally, maintaining or adjusting the position of the navigation menu based on the relative position of the set target object and the navigation menu includes:
[0069] When the target object and the navigation menu are located on the same side of the central control panel, the position of the navigation menu on the central control panel remains unchanged.
[0070] Specifically, if the target object and the navigation menu are located on the same side of the central control panel, then there is no need to adjust the position of the navigation menu, so the position of the navigation menu remains unchanged.
[0071] When the target object and the navigation menu are located on opposite sides of the central control panel, adjust the position of the navigation menu on the central control panel to be on the same side as the target object.
[0072] Specifically, if the target object and the navigation menu are located on opposite sides of the central control panel, the position of the navigation menu needs to be adjusted. Therefore, the position of the navigation menu should be adjusted to be on the same side as the target object to facilitate user operation.
[0073] Combination Figure 2 and Figure 3 As shown, the position of the navigation menu can be adjusted by the target object. The navigation menu includes sub-menus, etc., and relevant content can be displayed in the content area through the corresponding options.
[0074] Optionally, the navigation menu display method further includes:
[0075] When the target object and the navigation menu are located on the same side of the central control panel, if the target object moves to the opposite side of the navigation menu within a first preset time period, the position of the navigation menu on the central control panel remains unchanged.
[0076] Specifically, to improve the stability of the navigation menu display, this embodiment adds an "anti-accidental touch" function. When the navigation menu is displayed on one side of the central control panel, it will remain unchanged for a first preset time regardless of any external command received. For example, when the target object and the navigation menu are both located on the left side of the central control panel, if the target object moves to the right side of the central control panel within 3 seconds (the first preset time, the specific time can be adjusted), the anti-accidental touch function will be activated. At this time, even if the hand moves to the right side, the navigation menu will not move to the right side.
[0077] The identification results of the target object are input into the HMI (Human-Machine Interface) system for corresponding control. The features and functions of the HMI system include:
[0078] (1) Touchscreen interface: Allows users to interact with the vehicle system through gestures such as clicking and swiping. Touchscreens are typically used for functions such as navigation, audio control, and settings adjustment.
[0079] (2) Voice recognition: Provides voice activation and voice control functions, allowing drivers to use voice commands to control navigation, telephone, audio and other functions, improving driver safety and convenience.
[0080] (3) Physical buttons and knobs: used to control basic functions such as volume, air conditioning, and seat heating.
[0081] (4) Digital instrument panel: It replaces the traditional mechanical instrument panel and can display vehicle speed, fuel consumption, navigation information, etc. It can be customized according to driving mode or personal preference.
[0082] (5) HUD (Head-Up Display): The head-up display system projects driving information onto the windshield in front of the driver, including vehicle speed, navigation instructions, etc., reducing the need for the driver to look down at the instrument panel and improving driving safety.
[0083] (6) Gesture control: Drivers can perform some control operations through gestures, such as adjusting the volume and answering the phone.
[0084] (7) Connect to smartphones: Supports connection to smartphones, enabling integration of the phone and vehicle system, allowing drivers to use mobile applications more conveniently.
[0085] Optionally, the navigation menu display method further includes:
[0086] The navigation menu is hidden after the target object has been moved for more than a second preset time.
[0087] Specifically, when the target object moves out of the second preset time (e.g., 5 to 10 seconds), it means that the user no longer needs to operate the navigation menu. In order to allow the user to see the content displayed on the screen, the navigation menu is hidden.
[0088] The navigation menu includes the system navigation menu (system navigation bar, vehicle settings menu, multimedia, telephone, etc.) and the navigation menu of third-party applications (software applications that are not directly provided or pre-installed by the operating system or equipment manufacturer). The system navigation menu can be hidden or displayed throughout. Due to the poor compatibility of third-party applications with the system, the third-party applications will be displayed in full screen on the center console, and the navigation menu of the third-party applications will be hidden accordingly.
[0089] Optionally, the navigation menu display method further includes:
[0090] When the navigation menu is hidden, if the set target object is detected, the navigation menu is displayed according to the position of the set target object on the central control panel.
[0091] Specifically, when the navigation menu is hidden, if a target object is detected, the navigation menu will be woken up again. The display position of the navigation menu is determined by the position of the target object on the center console panel. For example, if the user's hand is detected to be on the right side of the center console panel, the navigation menu will be displayed on the right side of the center console panel.
[0092] Optionally, the navigation menu display method further includes:
[0093] The navigation menu is displayed in a fixed area.
[0094] Specifically, a navigation menu display position setting option has been added, including displaying the navigation menu on the left side of the screen, the right side of the screen, and intelligent display. The navigation menu is displayed in a fixed position on the left and right sides of the screen to meet the needs of scenarios where the passenger seat is often unattended or the driver's area is operated less while the passenger seat is operated more. The intelligent display can adjust the position of the navigation menu according to the location of the target object.
[0095] Another embodiment of the present invention provides a navigation menu display system, including a computer-readable storage medium storing a computer program and a processor, wherein the computer program is read and executed by the processor to implement the navigation menu display method described above.
[0096] Another embodiment of the present invention provides a vehicle including the above-described navigation menu display system.
[0097] While the present invention has been disclosed above, its scope of protection is not limited thereto. Those skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention, and all such changes and modifications will fall within the scope of protection of the present invention.
Claims
1. A method of displaying a navigation menu, characterized by, include: Obtain the location of the target object; The location of the navigation menu is determined based on the location of the target object; The step of determining the location of the navigation menu based on the location of the target object includes: When the target object is moved to the central control panel, it is determined whether there are other target objects on the central control panel; If the other target objects are present, the position of the navigation menu on the central control panel remains unchanged; If no other target object exists, the position of the navigation menu is maintained or adjusted according to the relative position of the set target object and the navigation menu; The navigation menu display method further includes: When the target object and the navigation menu are located on the same side of the central control panel, if the target object moves to the opposite side of the navigation menu within a first preset time period, the position of the navigation menu on the central control panel remains unchanged.
2. The navigation menu display method according to claim 1, characterized by, The acquisition of the target location includes: The position of the user's hands is detected by a detection device installed on the central control panel.
3. The navigation menu display method of claim 1, wherein, Maintaining or adjusting the position of the navigation menu based on the relative position of the set target object and the navigation menu includes: When the target object and the navigation menu are located on the same side of the central control panel, the position of the navigation menu on the central control panel remains unchanged; When the target object and the navigation menu are located on opposite sides of the central control panel, adjust the position of the navigation menu on the central control panel to be on the same side as the target object.
4. The navigation menu display method of claim 1, characterized by, Also includes: The navigation menu is hidden after the target object has been moved for more than a second preset time.
5. The navigation menu display method according to claim 4, characterized in that, Also includes: When the navigation menu is hidden, if the set target object is detected, the navigation menu is displayed according to the position of the set target object on the central control panel.
6. The navigation menu display method according to claim 1, characterized in that, Also includes: The navigation menu is displayed in a fixed area.
7. A navigation menu display system, characterized in that, The method includes a computer-readable storage medium storing a computer program and a processor, wherein the computer program is read and executed by the processor to implement the navigation menu display method as described in any one of claims 1 to 6.
8. A vehicle, characterized in that, Includes the navigation menu display system as described in claim 7.