Method for operating a touch-sensitive control display of a vehicle while driving the vehicle, computer-readable medium, system, and vehicle

The method uses an interior camera to detect hand approach and adjust touch-sensitive display information in vehicles, preventing accidental activation and ensuring accurate operation during motion by adapting to seating position and relevance.

DE102024126745B3Active Publication Date: 2026-03-05BAYERISCHE MOTOREN WERKE AG
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
DE102024126745
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-09-17
Publication Date
2026-03-05
Estimated Expiration
2044-09-17

AI Technical Summary

Technical Problem

Existing touch-sensitive control displays in vehicles are inefficient in preventing accidental activation during motion, leading to potential incorrect operations.

Method used

A method utilizing an interior camera to detect the approach of a hand to the control display, adjusting information display accordingly, and suppressing or shifting information based on seating position and relevance, thereby preventing accidental activation.

Benefits of technology

Efficiently prevents incorrect operations on touch-sensitive displays during vehicle motion by detecting hand approach within milliseconds, adapting information display, and ensuring accurate interaction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

The invention relates to a method for operating a touch-sensitive control display of a vehicle during a journey with the vehicle, the method comprising: detecting an approach of a hand to the touch-sensitive control display of the vehicle by an interior camera of the vehicle; and adjusting a display of information on the touch-sensitive control display during the detected approach of the hand to the touch-sensitive control display of the vehicle.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The invention relates to a method for operating a touch-sensitive control display of a vehicle while the vehicle is in motion. The invention further relates to a computer-readable medium for operating a touch-sensitive control display of a vehicle while the vehicle is in motion, a system for operating a touch-sensitive control display of a vehicle while the vehicle is in motion, and a vehicle comprising the system for operating a touch-sensitive control display of a vehicle while the vehicle is in motion.

[0002] Touch-sensitive control displays in a vehicle are known from the prior art. Cameras in the vehicle's interior that can monitor a vehicle occupant are also known from the prior art. Furthermore, display systems are known that switch on a light when someone approaches.

[0003] DE 10 2006 028 046 A1 describes a combined display and control device for a motor vehicle, comprising a touch-sensitive screen for displaying and selecting operating functions, wherein a device for detecting an operating means, in particular a hand or a finger, is provided, wherein the screen can be switched from an information mode to an operating mode in which the selection of operating functions is possible when an operating means is detected in a predetermined area around the screen.

[0004] DE 10 2017 128 641 A1 describes a vehicle user input device control system and method comprising a user input device arranged in a vehicle, a plurality of proximity sensors arranged near the user input device, and a controller that processes signals generated by the proximity sensors to detect at least one of a trajectory and orientation of a hand near the user input device, and specifies that the hand is assigned to a driver and a passenger of the vehicle.

[0005] DE 10 2016 201 704 A1 describes a method for recognizing a gesture of a vehicle occupant, comprising the following steps: capturing the interior of the vehicle using an imaging sensor system with a first frame rate and a first illumination setting to generate a first series of images; searching for the occupant's hand; if the occupant's hand is detected in the first series of images, capturing the interior of the vehicle using the imaging sensor system with a second frame rate and a second illumination setting to generate a second series of images; and evaluating the second series of images to recognize a gesture of the occupant.

[0006] It is therefore an object of the invention to operate a touch-sensitive control display of the vehicle more efficiently during a journey. In particular, an object of the invention is to efficiently improve the prevention of incorrect operation of a touch-sensitive control display of a vehicle during a journey.

[0007] This problem is solved by the features of the independent claims. Advantageous embodiments and further developments of the invention result from the dependent claims.

[0008] According to a first aspect, the invention is characterized by a method for operating a touch-sensitive control display of a vehicle while the vehicle is in motion. The method can be a computer-implemented method and / or a control unit-implemented method. The vehicle can be a motor vehicle. The method comprises detecting the approach of a hand to the vehicle's touch-sensitive control display by an interior camera of the vehicle, and adjusting the display of information on the touch-sensitive control display during the detected approach of the hand to the vehicle's touch-sensitive control display.

[0009] Advantageously, this method can efficiently control the display of information when a hand approaches a touch-sensitive control panel. This effectively prevents the accidental activation of a briefly displayed control element.

[0010] According to an advantageous embodiment, the method can further include determining the seating position of an occupant corresponding to the hand of the detected approach, and adjusting the display of information on the touch-sensitive control panel during the detected approach of the hand to the vehicle's touch-sensitive control panel, depending on the determined seating position. This allows a hand to be efficiently assigned to a vehicle occupant.

[0011] According to a further advantageous embodiment, the approach of the hand to the vehicle's touch-sensitive control display can be detected by the interior camera within a time window of less than approximately 500 milliseconds. This allows for efficient control of the display of information.

[0012] According to a further advantageous embodiment, the approach of the hand to the vehicle's touch-sensitive control display can be detected by the interior camera within a specific time window, the time window being determined based on the speed of the hand's approach. This allows for efficient control of the display of information.

[0013] According to a further advantageous embodiment, the display of information on the touch-sensitive control panel during the detected approach of the hand to the vehicle's touch-sensitive control panel can be adapted depending on the seating position of the occupant whose hand was detected and / or the relevance of the information to that seating position. This allows for efficient control of the information display.

[0014] According to a further advantageous embodiment, adjusting the display of information on the touch-sensitive control panel during the detected approach of the hand to the vehicle's touch-sensitive control panel can include suppressing the information, preferably until the detected hand interacts with a button on the touch-sensitive control panel. This allows for efficient control of the information display adjustment.

[0015] According to a further advantageous embodiment, adjusting the display of information on the touch-sensitive control panel during the detected approach of the hand to the vehicle's touch-sensitive control panel can include suppressing the information in an area of ​​the hand during the detected approach, wherein the information is preferably suppressed until the hand interacts with a button on the touch-sensitive control panel in that area. This allows for efficient control of the information display adjustment.

[0016] According to a further advantageous embodiment, suppressing the information can include suppressing any layout changes to the touch-sensitive control display in the area of ​​the hand during the detected approach. This allows for efficient control over adjusting the display of the information.

[0017] According to a further advantageous embodiment, adjusting the display of information on the touch-sensitive control panel during the detected approach of the hand to the vehicle's touch-sensitive control panel can include shifting the information display from the touch-sensitive control panel to a display or control panel of another vehicle occupant, depending on the relevance of the information to that other occupant. This allows for efficient control of the information display adjustment.

[0018] According to another aspect, the invention is characterized by a computer-readable medium for operating a touch-sensitive control display of a vehicle during a journey with the vehicle, wherein the computer-readable medium comprises instructions which, when executed on a computer or a control unit, execute the method described above.

[0019] According to another aspect, the invention is characterized by a system for operating a touch-sensitive control display of a vehicle during a journey with the vehicle, wherein the system is configured to perform the method described above.

[0020] According to another aspect, the invention is characterized by a vehicle comprising the system described above for operating a touch-sensitive control display of a vehicle during a journey with the vehicle.

[0021] Further features of the invention will become apparent from the claims, the figures, and the description of the figures. All features and combinations of features mentioned above in the description, as well as those subsequently mentioned in the description of the figures and / or shown in the figures alone, are usable not only in the combinations specified, but also in other combinations or individually.

[0022] A preferred embodiment of the invention is described below with reference to the accompanying drawings. Further details, preferred configurations, and further developments of the invention will be derived from these drawings. Specifically, the drawings schematically illustrate... Fig. 1. An exemplary method for operating a touch-sensitive control display of a vehicle while driving the vehicle, and Fig. 2 An example of an operating display during a journey with the vehicle.

[0023] In detail, it shows Fig. 1 An exemplary method 100 for operating a touch-sensitive control display of a vehicle while the vehicle is in motion. The touch-sensitive control display can provide various controls, for example, media control controls and / or climate control controls, which can be operated by a vehicle occupant, for example, the driver and / or a passenger. Furthermore, a navigation function of the vehicle can be active while the vehicle is in motion. During a navigation event, a navigation control can at least partially overlay one or more controls displayed on the touch-sensitive control display.

[0024] Method 100 can detect the approach of a hand to the vehicle's touchscreen control panel using an interior camera of the vehicle 102. Furthermore, Method 100 can adjust the display of information on the touchscreen control panel during the detected approach of the hand to the vehicle's touchscreen control panel 104. The displayed information could, for example, be information about a navigation event, which can be displayed using a control element on the touchscreen control panel.

[0025] For example, the method can detect, using an interior camera, a passenger's hand approaching the vehicle's touchscreen while driving. The vehicle's navigation function is active. As the passenger's hand approaches, a navigation event occurs, which attempts to display information, such as a turn instruction, on the vehicle's touchscreen. Method 100 can suppress the display of the information, such as the turn instruction, if the passenger's hand approach is detected. If the passenger's hand approach is detected by the interior camera and the information is a navigation instruction, the method can assume that the navigation information is not intended for the passenger.In this example, the information is suppressed for the duration of the passenger's hand operation. Additionally, the information can be moved to a display visible to the driver.

[0026] Additionally, the method 100 can detect an operating movement and its direction by sensing the approach of the hand. The touch-sensitive operating display can suppress any changes to information in a predefined area in the direction of the hand during the detected approach. Changes to information can include content changes and / or layout changes. Furthermore, the method can temporarily store changes to information during the detected approach of the hand and apply them with a time delay after the hand has performed an operating action.

[0027] In detail, it shows Fig.2 An exemplary control display 200 during a journey in a vehicle. At one point in time, a touch-sensitive control display 202 shows three controls 204 for controlling media content. An interior camera can detect a hand 206 approaching the touch-sensitive control display 202. Information about the navigation event is suppressed and not displayed on the touch-sensitive control display 202. At a second point in time, the touch-sensitive control display 202 can show three controls 204 for controlling media content and information about a navigation event 208. The hand 206 has performed a control action and moves away from the touch-sensitive control display 202 again. The information about a navigation event 208 is displayed.

[0028] Advantageously, this method can efficiently prevent incorrect operation of controls on the vehicle's touch-sensitive control display 202 while driving. During a period of less than 500 milliseconds when a hand is near the touch-sensitive control display 202, for example, the method can suppress the display of information. Manual operation can then be carried out reliably. Reference symbol list 100 procedures 102 Detecting the approach of a hand 104 Customizing an information display 200 operating display 202 Operating display 204 Control element 206 Hand 208 Information

Claims

[1] Method for operating a touch-sensitive control display of a vehicle while driving the vehicle, the method comprising: Detecting the approach of a hand to the vehicle's touch-sensitive control panel using an interior camera in the vehicle; and Adjusting the display of information on the touch-sensitive control panel during the detected approach of the hand to the vehicle's touch-sensitive control panel, wherein adjusting the display of information on the touch-sensitive control panel during the detected approach of the hand to the touch-sensitive control panel of the vehicle includes suppressing the information in an area of ​​the hand of the detected approach. [2] The method of claim 1, further comprising: Determining the seating position of an occupant belonging to the hand of the detected approach; and Adjusting the display of information on the touch-sensitive control panel during the detected approach of the hand to the vehicle's touch-sensitive control panel, depending on the determined seating position. [3] Method according to one of the preceding claims, wherein the approach of the hand to the touch-sensitive control display of the vehicle is detected by the interior camera in a time window of less than approximately 500 milliseconds. [4] Method according to one of the preceding claims, wherein the approach of the hand to the touch-sensitive control display of the vehicle is detected by the interior camera within a time window, the time window being determined as a function of the speed of approach of the hand. [5] Method according to one of the preceding claims, wherein the display of the information on the touch-sensitive control display during the detected approach of the hand to the touch-sensitive control display of the vehicle is adapted depending on the seating position of the occupant of the detected hand and / or the relevance of the information to the seating position of the occupant of the detected hand. [6] Method according to one of the preceding claims, wherein adjusting the display of the information on the touch-sensitive control display during the detected approach of the hand to the touch-sensitive control display of the vehicle comprises suppressing the information, wherein the information is preferably suppressed until an operating interaction of the detected hand with a button on the touch-sensitive control display has taken place. [7] Method according to claim 1, wherein the information is suppressed until an operating interaction of the hand with a button of the touch-sensitive operating display has taken place in the area of ​​the hand of the detected approach. [8] Method according to claim 1, 6 or 7, wherein suppressing the information comprises suppressing a layout change of the touch-sensitive control display in the area of ​​the hand of the detected approach. [9] Method according to one of the preceding claims, wherein adjusting the display of the information on the touch-sensitive control display during the detected approach of the hand to the touch-sensitive control display of the vehicle comprises moving a display of the information from the touch-sensitive control display to a display or control display of another occupant of the vehicle depending on the relevance of the information to the other occupant of the vehicle. [10] Computer-readable medium for operating a touch-sensitive control display of a vehicle during a journey with the vehicle, wherein the computer-readable medium comprises instructions which, when executed on a computer or a control unit, execute the method according to any one of claims 1 to 9. [11] System for operating a touch-sensitive control display of a vehicle during a journey with the vehicle, wherein the system is configured to perform the method according to any one of claims 1 to 9. [12] Vehicle comprising the system for operating a touch-sensitive control display of a vehicle during a journey with the vehicle according to claim 11.

Citation Information

Patent Citations

  • Combined display and control device for motor vehicle, has screen for displaying and selecting functions, and detecting device detecting control unit, where screen is switchable from information mode into control mode by control unit

    DE102006028046A1

  • Gesture recognition device and method for recognizing a gesture of an occupant of a vehicle

    DE102016201704A1

  • vehicle user input device control system and method

    DE102017128641A1