Innovative center console

Abstract

The present invention relates to an in-vehicle center console solution developed to enhance driving safety and provide ease of use in next-generation vehicles by improving driving control interfaces and modern human-machine interface (HMI) scenarios. In particular, the invention enables a driver to communicate with the vehicle via a touch surface without reaching toward front displays or searching for a function on the center console, to control vehicle multimedia functions through contactless hand gestures performed in mid-air above the console, and to receive feedback through an LED matrix unit that allows an abstract visual interaction between the driver and the vehicle. The invention provides all of these features together on the center console.

Description

[0001] INNOVATIVE CENTER CONSOLE

[0002] Technical Field

[0003] The present invention relates to an in-vehicle center console solution developed to enhance driving safety and provide ease of use in next-generation vehicles by improving driving control interfaces and modern human-machine interface (HMI) scenarios.

[0004] In particular, the invention enables a driver to communicate with the vehicle via a touch surface without reaching toward front displays or searching for a function on the center console, to control vehicle multimedia functions through contactless hand gestures performed in mid-air above the console, and to receive feedback through an LED matrix unit that allows an abstract visual interaction between the driver and the vehicle. The invention provides all of these features together on the center console.

[0005] Prior Art

[0006] Human-machine interface controls within a vehicle aim to enhance safety, comfort, and user experience by enabling drivers and passengers to control the vehicle, obtain information, and interact with vehicle systems. These interfaces operate through a combination of hardware and software components to optimize information flow and control mechanisms.

[0007] Ensuring that users can control the vehicle easily, quickly, and safely and access information is of critical importance. An intuitive human-machine interface allows the driver to interact with the system naturally and instinctively without requiring effort to understand or learn the interface. This is critical not only for driving safety but also for improving overall user experience. A non-intuitive human-machine interface may cause the driver’s attention to be diverted away from the road. For example, a complex touch-screen menu may require the driver to keep their eyes on the screen for an extended period in order to perform a control operation. By contrast, an intuitive human-machine interface allows the driver to perform operations quickly and easily, thereby minimizing distraction.Another important feature of an intuitive human-machine interface is its placement such that it is easily accessible and visible to the user. For example, control buttons positioned on the steering wheel are designed to meet this requirement. In this way, the user can easily access control elements while maintaining a natural driving posture. Providing ergonomic placement plays a critical role in both driving safety and user comfort.

[0008] With the development of modern interface systems, the use of touch screens, voice assistants, artificial intelligence, and learning systems has become increasingly widespread. However, sufficient diversity and usability have not yet been achieved for the combined use of these systems.

[0009] For example, in the prior art, systems incorporating radar-based gesture-controlled interfaces are known. However, in such systems, the sensing radar sensors are typically positioned in overhead modules, and gesture detection is activated around the front display area by requiring the driver to raise their hand forward toward the front displays. This configuration does not provide an ergonomic solution for the user and may compromise driving safety.

[0010] Numerous examples also exist regarding the use of tactile surfaces in vehicles, with usage functions varying according to the objectives defined by different manufacturers. In certain vehicles, tactile surfaces are provided on a control knob without any tactile or visual feedback mechanism. In another example, a surface resembling a mousepad-type control is defined, enabling front display control within a limited area and without visual feedback.

[0011] Providing feedback as a result of user interaction is particularly important when physical buttons are not used, as it gives the user a sense that the performed operation has been successfully completed. In another example, a touch-sensitive liquid crystal display (LCD) screen capable of providing visual feedback is introduced in the center console. Although such examples provide user feedback, these types of displays may distract the driver due to detailed and vivid visual content.

[0012] In the prior art, Korean Patent Application with No. KR20220062165A discloses a user interface device, a vehicle comprising such a device, and a method for controlling the vehicle. In that system, images from the user are acquired using an image-capturing unit such as a camera or sensor. Physical gestures, including hand movements and the number of fingers, are recognized. These gestures are analyzed based on how one or more fingersare positioned or moved on a screen or within a holographic image. However, the use of cameras or similar sensors in this system reduces image accuracy under low-light conditions. This makes gesture detection more difficult and reduces sensor reliability.

[0013] U.S. Patent Application with No: US2015097798A1 describes methods and systems for a vehicle ecosystem. In that system, a touch screen detects movements of the user on the screen surface, while a motion detection region defined outside the screen detects gestures performed outside the screen. Users may define new gestures and record the effects of these gestures. The application does not disclose the position of the motion detection region within the vehicle interior. Furthermore, since learning-based systems are not employed for gestures performed on the touch screen and in the motion detection region, the detection of complex gestures becomes difficult.

[0014] U.S. Patent Application with No: US10509479B2 discloses an apparatus and a method for motion detection and recognition. The device includes a processing element, a radar sensor, a depth sensor, and an optical sensor. Data obtained from the sensors are transmitted to a DNN model to identify which motion has been performed.

[0015] In conclusion, the prior art does not disclose an in-vehicle human-machine interface that enables intuitive interaction with the vehicle without requiring focused attention from the user, reduces the risk of driver distraction, and provides an ergonomically positioned interface.

[0016] Brief Description of the Invention

[0017] The primary objective of the in-vehicle center console according to the invention is to provide contactless gesture control, a touch-sensing interface, and an illuminated feedback module together in an integrated manner.

[0018] One of the most important advantages provided by the invention is enabling the driver to control vehicle displays and functions easily and quickly without distraction. This is designed both to enhance driving safety and to improve the user experience. The system detects user interactions performed in a contact-based and / or contactless manner and provides rapid access to in-vehicle functions.Another significant advantage of the invention is that it provides an intuitive user experience, allowing the driver to easily control vehicle displays and other functions without diverting attention from driving.

[0019] A further advantage of the invention is that, by means of a radar sensor, the driver’s gestures are detected and specific commands can be executed without requiring physical touch. Examples include changing music tracks by a hand movement and increasing or decreasing volume by an upward or downward gesture. The invention allows the driver to perform gestures on or near the console, thereby reducing distraction and increasing driving safety during vehicle control.

[0020] Another advantage of the invention is that it comprises a capacitive pad including multitouch and shape-recognition capabilities in combination with touch-based interactions. This facilitates the execution of various functions. For example:

[0021] • increasing or decreasing volume by a two-finger sliding gesture,

[0022] • switching to a specific menu on the vehicle display by drawing a predefined shape, • converting shapes drawn with a single finger into characters in a keyboard mode.

[0023] With these features, the invention offers greater functionality and flexibility compared to standard touch surfaces available in the market.

[0024] Another advantage of the invention is that user data detected by the capacitive sensor and the radar sensor provide visual feedback to the driver via an LED matrix. This allows the driver to quickly verify that their actions have been correctly detected, thereby improving the user experience. In addition, the driver’s gestures are visualized to provide feedback to the driver.

[0025] Another advantage of the invention is that an infrastructure trained with machine-learning algorithms ensures accurate detection of gestures and touch inputs, thereby preventing incorrect commands. Two separate machine-learning models are used independently for the radar sensor and the capacitive sensor. Defined gestures and shapes are detected using models generated based on feature information specifically extracted from data obtained from these sensors.

[0026] Another advantage of the invention is that movements performed by the driver’s hand are monitored within a suitable interaction area defined for the radar sensor. This prevents otheractions performed by the driver inside the vehicle from being incorrectly interpreted as gestures. In addition, false detections caused by movements originating from the front passenger seat are also prevented.

[0027] Another advantage of the invention is that all components (capacitive pad, radar sensor, LED matrix) are arranged in a compact structure, thereby providing ease of installation and saving space. Unlike modular systems available on the market, the integrated operation of all units increases coordination and ensures more stable system performance. The invention is suitable for installation in a wide range of vehicles.

[0028] A further advantage of the invention is that it can easily adapt to different functions through features such as multi-touch and shape recognition, thereby enabling customization according to user needs and facilitating the integration of new functions.

[0029] In view of the above-mentioned advantages, the invention provides a practical and safe in-vehicle console by preventing driver distraction.

[0030] For a better understanding of the system according to the invention, reference will be made to the accompanying figures described below.

[0031] Brief Description of the Drawings

[0032] Figure 1 is a side elevational view of the in-vehicle center console according to the invention.

[0033] Figure 2 is a top perspective view of the in-vehicle center console according to the invention.

[0034] Figure 3 is a perspective view of integrated human-machine interface hardware arranged within the in-vehicle center console according to the invention.

[0035] Figure 4 is another perspective view of the integrated human-machine interface hardware arranged within the in-vehicle center console according to the invention.

[0036] Figure 5 is a side elevational view of the integrated human-machine interface hardware arranged within the in-vehicle center console according to the invention.

[0037] Figure 6 is an exploded view of the integrated human-machine interface hardware arranged within the in-vehicle center console according to the invention.Reference Numerals

[0038] 1 - In-vehicle center console

[0039] 2 - Armrest

[0040] 3 - Cup holder

[0041] 4 - Integrated interface module

[0042] 5 - Semi-transparent surface

[0043] 6 - Gesture detection region

[0044] 7 - Touch surface

[0045] 8 - Capacitive sensor connector strip

[0046] 9 - LED matrix

[0047] 10 - Gesture reading module

[0048] 11 - Radar sensor mainboard

[0049] 12 - Integrated mainboard

[0050] 13 - Processor

[0051] Detailed Description of the Invention

[0052] The innovative in-vehicle center console (1) according to the invention enables the driver, by means of an integrated interface module (4), to interact with the vehicle without the need to reach toward front displays or search for a function on the center console. The invention allows the driver to communicate with the vehicle via a touch surface (7) and to control vehicle multimedia functions through hand gestures performed in mid-air within a gesture detection region (6) arranged on the console. Furthermore, a feedback module (9) arranged within said integrated interface module (4) enables the driver to receive feedback through an abstract visual interaction with the vehicle. It should be noted that the diagrams and figures used herein are provided solely for better understanding of the subject matter and are not limiting.

[0053] A side elevational view of the in-vehicle center console according to the invention is shown in Figure 1. A top perspective view of the in-vehicle center console is shown in Figure 2. A perspective view of integrated human-machine interface hardware arranged within the in-vehicle center console is shown in Figure 3. Another perspective view of said integrated human-machine interface hardware is shown in Figure 4. A side elevational view of the integrated human-machine interface hardware is shown in Figure 5. An exploded view ofthe integrated human-machine interface hardware arranged within the in-vehicle center console is shown in Figure 6.

[0054] The invention relates to an in-vehicle center console (1) developed to implement modern human-machine interface scenarios within a vehicle, comprising:

[0055] • at least one integrated interface module (4) positioned at a front end of said in- vehicle center console (1),

[0056] • at least one capacitive touch surface (7) arranged within said integrated interface module (4) and configured to detect multi-touch commands,

[0057] • at least one gesture reading module (10) arranged within said integrated interface module (4), comprising a radar sensor and configured to transmit electromagnetic waves into a gesture detection region (6) and to detect reflected electromagnetic waves,

[0058] • at least one LED matrix (9) arranged within said integrated interface module (4) and located beneath said touch surface,

[0059] • at least one processor (13) arranged within said integrated interface module (4) and configured to detect shapes or letters drawn on said touch surface (7) and gestures performed in said gesture detection region (6) using machine-learning methods, • the in-vehicle center console (1), wherein said touch surface (7) and said gesture reading module (10) are provided together.

[0060] The in-vehicle center console (1) according to the invention is generally arranged between the front two seats of the vehicle and is ergonomically designed to be easily accessible to the driver. The console may be manufactured using different materials, such as leather, plastic, metal, or wood coverings. The console is functionally extensible and may include, for example, cup holders (3), an armrest (2), charging and connection ports, and storage compartments.

[0061] The integrated interface module (4) positioned at the front end of the in-vehicle center console (1) comprises at least one touch surface (7) controlled by the user and at least one gesture reading module (10). By means of said touch surface (7) and gesture reading module (10), the user can perform various control operations within the vehicle. The integrated interface module (4) further includes an LED matrix (9) configured to provide feedback to the user, thereby enhancing the user experience.The gesture reading module (10) comprises a millimeter- wave radar sensor capable of detecting multiple objects and determining distance, speed, direction, and shape. The radar sensor provides particular advantages under low-visibility conditions such as dark environments. The gesture reading module (10) preferably comprises a frequency-modulated continuous-wave (FMCW) radar, providing high sensitivity and resolution. Preferably, the radar operates at a center frequency of 62 GHz and has a bandwidth of 4 GHz to obtain high-resolution data, thereby enabling precise short-range detection. The gesture reading module (10) has a gesture detection region (6) extending from 0 to 2 m with an angular coverage of 120° in the horizontal axis and 120° in the vertical axis, and a resolution of less than 5 cm. The gesture detection region (6) of the gesture reading module (10) is schematically illustrated in Figure 1.

[0062] The touch surface (7) arranged on the integrated interface module (4) enables the user to perform various control operations within the vehicle. The touch surface (7) preferably comprises a capacitive sensor having a sensing area of approximately 192 mm x 96 mm x 12 mm. The large touch area allows the user to freely perform drawing and marking operations. By means of the capacitive sensor, the touch surface (7) is capable of detecting up to 10 simultaneous touch points with high sensitivity. The touch resolution is approximately 0.1 mm, and the response time is less than 10 ms. The capacitive touch surface (7) comprises a semi-transparent surface (5) and can operate reliably beneath glass, plastic, or other insulating surfaces having a thickness of up to 2 mm. Data obtained from the touch surface (7) are transmitted to the integrated mainboard (12) via a capacitive sensor connector strip (8).

[0063] The in-vehicle center console (1) further comprises an LED matrix (9) arranged beneath the touch surface (7) to provide feedback to users. The LED matrix (9) preferably has a 32 x 64 RGB configuration. Adjustable brightness and RGB color levels can be personalized according to user preferences. The LED matrix (9) provides visual feedback as a result of the user’s interaction with the touch surface (7) or the gesture reading module (10), thereby enabling the driver to confirm that inputs have been correctly detected and improving the overall user experience.

[0064] The LED matrix (9) does not display attention-demanding images; instead, feedback is provided only through intermittent LEDs visible through the semi-transparent surface, such that the feedback does not require focused visual attention from the driver. The LED matrix(9) is configured to confirm and illuminate executed commands without requiring direct eye contact, thereby minimizing driver distraction.

[0065] Data obtained from the gesture reading module (10) and the touch surface (7) arranged in the in-vehicle center console (1) are processed on the integrated mainboard (12) to perform operations such as gesture detection, motion detection, and character recognition.

[0066] Raw data obtained from the gesture reading module (10) are transmitted from the radar sensor mainboard (11) to the integrated mainboard (12). Through signal pre-processing, noise is removed from the raw data and the data are normalized. The data obtained from the gesture reading module (10) include:

[0067] • Amplitude: representing the strength of the radar signal reflected from an object, • Frequency shift: representing the change in frequency due to the Doppler effect as a function of target velocity,

[0068] • Time of flight: representing the distance between the sensor and the detected target, • Angle of arrival: representing the direction of the target relative to the sensor.

[0069] The integrated mainboard (12) comprises a processor (13) configured to perform feature extraction based on the amplitude, frequency shift, time-of-flight, and angle-of-arrival data. By means of the processor (13), the following features are extracted from the data:

[0070] • Motion speed: determining the speed of hand movement,

[0071] • Trajectory: analyzing whether the hand movement is linear or curved, whereby gestures are initially classified into two categories as discrete and continuous, • Range: representing the relative position of the hand with respect to the sensor, • Number of detected points: representing the number of points detected on a Range- Doppler heatmap using a target detection algorithm,

[0072] • Azimuth (horizontal) angle: representing the horizontal angle of the target measured relative to a reference point of the radar, determined based on phase delays of electromagnetic signals reflected from the target and received by radar antennas in a multiple-input multiple-output (MIMO) antenna configuration,

[0073] • Elevation angle: representing the vertical angle of the target measured relative to the radar reference point,

[0074] • Gesture shape: recognizing specific patterns such as sliding or waving motions.Based on the information obtained through feature extraction, the processor (13) ensures accurate classification of gestures. The processor (13) performs gesture classification using an LSTM (Long Short-Term Memory) algorithm of the recurrent neural network (RNN) type, thereby generating gesture predictions with high accuracy. Examples of accurately recognized gestures include directional swiping, circular movements, pointing, and a stop gesture performed by approaching the gesture reading module (10) with an open palm. These examples are provided solely for explanatory purposes and are not limiting; a wider range of gestures can be recognized when the system is trained with different data sets.

[0075] The processor (13) is further configured to perform character recognition using machine-learning-assisted algorithms. Data comprising x- and y-coordinates obtained from the touch surface (7) are transmitted to the integrated mainboard (12) via the capacitive sensor connector strip (8). The processor (13) arranged on the integrated mainboard (12) is configured to interpret letters and shapes drawn on the touch surface (7) using a convolutional neural network (CNN) model. By applying pre-processing steps to images used as input to the machine-learning model, letters written by different users on different regions of the touch surface (7) can be accurately recognized regardless of size variations.

[0076] A key advantage of using machine-learning models in the processor (13) is the ability to distinguish between random hand movements and intentional gestures. Random hand movements may affect model accuracy; therefore, such movements may also be included as training data to improve the model’s ability to detect incorrect cases. By learning from such data, the model reduces misclassification and provides more reliable results.

[0077] The processor (13) configured to use machine-learning algorithms adapts over time to individual user behaviors, thereby increasing detection accuracy. In addition, the processor (13) adapts to varying lighting, temperature, and signal-noise conditions over time, ensuring reliable system operation under different environmental conditions.

[0078] Industrial Applicability

[0079] The in-vehicle center console according to the invention can be installed in a wide range of vehicles by virtue of its integrated structure. The invention can be connected to the vehicle’s LIART and / or CAN bus, thereby enabling convenient control of in-vehicle functions by the user.

Claims

CLAIMS1. An in-vehicle center console (1) developed to implement modern human-machine interface scenarios within a vehicle, characterized by comprising:• at least one integrated interface module (4) positioned at a front end of said in- vehicle center console (1),• at least one capacitive touch surface (7) arranged within said integrated interface module (4) and configured to detect multi-touch commands,• at least one gesture reading module (10) arranged within said integrated interface module (4), comprising a radar sensor and configured to transmit electromagnetic waves into a gesture detection region (6) and to detect reflected electromagnetic waves,• at least one LED matrix (9) arranged within said integrated interface module (4) and located beneath said touch surface,• at least one processor (13) arranged within said integrated interface module (4) and configured to detect shapes or letters drawn on said touch surface (7) and gestures performed in said gesture detection region (6) by using machinelearning methods,• the in-vehicle center console (1), wherein said touch surface (7) and said gesture reading module (10) are provided together.

2. The in-vehicle center console (1) according to claim 1, characterized in that it comprises at least one gesture reading module (10) consisting of a frequency- modulated continuous-wave (FMCW) radar.

3. The in-vehicle center console (1) according to claim 1 or 2, characterized by comprising at least one gesture reading module (10) having a gesture detection region (6) with an angular coverage of 120° in the horizontal direction and 120° in the vertical direction.

4. The in-vehicle center console (1) according to any one of the preceding claims, characterized by comprising at least one touch surface (7) formed of a capacitive sensor.

5. The in-vehicle center console (1) according to any one of the preceding claims, characterized by comprising at least one touch surface (7) capable of detecting multi-touch input.

6. The in-vehicle center console (1) according to any one of the preceding claims, characterized by comprising at least one LED matrix (9) configured to provide visual feedback as a result of a user’s interaction with said touch surface (7) or said gesture reading module (10).

7. The in-vehicle center console (1) according to any one of the preceding claims, characterized by comprising at least one processor (13) configured to perform feature extraction using preprocessing algorithms based on amplitude, frequency shift, time-of-flight, and angle-of-arrival data obtained from said gesture reading module (10), and to perform classification using machine-learning models.

8. The in-vehicle center console (1) according to any one of the preceding claims, characterized by comprising at least one processor (13) configured to classify gestures obtained from said gesture reading module (10) using an LSTM (Long Short-Term Memory) model of the RNN (Recurrent Neural Network) type.

9. The in-vehicle center console (1) according to any one of the preceding claims, characterized by comprising at least one processor (13) configured to interpret letters and shapes drawn on said touch surface (7) by using a convolutional neural network (CNN) model.

Images