Testing system and procedure for the automated validation of touch-sensitive control elements in motor vehicles
The system addresses imprecision and unreliability in conventional touch-sensitive control testing by simulating environmental conditions and interference, ensuring precise and reproducible validation with reduced costs.
Patent Information
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- BAYERISCHE MOTOREN WERKE AG
- Filing Date
- 2025-05-06
- Publication Date
- 2026-05-13
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The invention relates to a testing system and a method for the automated validation of touch-sensitive control elements in motor vehicles. In particular, the invention relates to a system and a method that enables precise and reproducible testing of input units under various environmental conditions.
[0002] Modern vehicles are increasingly equipped with touch-sensitive controls that enable intuitive interaction between driver and vehicle. These controls, often in the form of touchscreens or capacitive touch surfaces, must function reliably under a wide variety of conditions. Ensuring the reliability of these components presents a particular challenge, as many factors such as ambient temperature, humidity, electromagnetic interference, and contamination can affect their functionality.
[0003] Conventional testing procedures for various environmental conditions are often based on empirical tests, in which a tester manually operates the controls and notes their subjective impressions. However, this method is neither precise nor reproducible. Automated systems previously used for such tests are often expensive, inflexible, and unable to comprehensively account for the various influencing factors affecting touch-sensitive controls.
[0004] Therefore, there is a need for a testing system and a procedure that enables precise and reproducible validation of touch-sensitive controls in motor vehicles under various environmental conditions.
[0005] The object of the invention is therefore to provide such a testing system.
[0006] The problem is solved by a testing system and a method according to the independent claims. Advantageous embodiments are the subject of the dependent claims.
[0007] According to a first aspect of the invention, a test system for the automated verification of an input unit with touch-sensitive controls in motor vehicles is provided. The system comprises a tool unit for controlling at least one test finger and a camera system for optically detecting the controls. A control unit of the test system is configured to perform a comparison between a position value of the test finger and bus data of a data bus of the input unit during actuation of the controls by the at least one test finger, particularly in real time. Based on this comparison, the control unit is configured to adjust the test parameters.
[0008] In an advantageous embodiment, the testing system includes a tool-changing unit that allows the at least one test finger to be exchanged for at least one second test finger. This enables the simulation of different finger states and different operating modes.
[0009] The test system can also include a climate chamber to simulate various environmental conditions of the input unit. This allows the effects of temperature and humidity on the functionality of the controls to be investigated.
[0010] In another embodiment, the test system includes at least one EMC antenna unit configured to generate electromagnetic fields acting on the input unit. This enables the investigation of the control elements' immunity to electromagnetic interference.
[0011] The control unit can be configured to position at least one test finger on the controls based on optical detection and / or mechanical zero-point determination. This ensures precise and reproducible positioning of the test finger.
[0012] At least one test finger can be heated, wettable with fluids and / or dryable to simulate different environmental and usage conditions.
[0013] The test system may include a device for automatically soiling and / or cleaning the controls in order to investigate the influence of soiling on functionality.
[0014] The control unit can be configured to process a sequence of events that defines the communication between the climate chamber, CNC portal, EMC antenna unit, and / or the automotive component under test. This enables a reproducible test run and flexible configuration of the test system.
[0015] In another embodiment, the control unit includes a pattern recognition system that is configured to evaluate test data and, based on this, to make automatic changes to the process plan.
[0016] According to a further aspect of the invention, a method for the automated validation of an input unit with touch-sensitive controls in motor vehicles is provided by means of a test system according to one of the preceding claims. The method comprises the steps of optically detecting the controls using the camera system, positioning a test finger on a control element, actuating the control element with the test finger, comparing the position values of the test finger and bus data of the input unit's data bus during actuation, adjusting the test parameters based on the comparison, and repeating these steps with varied test parameters.
[0017] The method can include further steps, such as mechanical zero point determination, changing the test finger, altering the environmental conditions in a climate chamber, changing the electromagnetic fields by means of an EMC antenna unit, automatically soiling and / or cleaning the controls between test cycles, and continuously changing the test parameters to automatically determine conditions under which the input unit deviates from its specification. The invention also includes a computer program product with program code for carrying out the method when the program is executed on a computer.
[0018] In a first embodiment, the test system according to the invention is used to validate an input unit in a vehicle infotainment system. The test system is installed in a climate-controlled test chamber, which makes it possible to simulate various environmental conditions. The tool unit is, in particular, part of a CNC machine tool, e.g., a CNC gantry machine, which enables three-dimensional movement with a high accuracy of, for example, 0.1 mm. A tool changing unit, equipped with various test fingers, can be attached to the machine tool. These test fingers simulate particularly different usage situations on the input unit, e.g., a touchscreen: One test finger can be coated with a soft, conductive silicone layer to mimic a dry human finger. Another test finger has, for example, a textured surface.It features an integrated fluid supply that allows the surface to be wetted with water and / or oil to simulate damp or dirty conditions. A third test finger, for example, is equipped with a hard, conductive tip to mimic operation with a touchscreen stylus.
[0019] The camera system can be a high-resolution industrial camera with a macro lens, mounted above the touch-sensitive controls being tested. The camera captures the touch-sensitive controls and enables position determination of the displayed controls. The control unit of the testing system processes the image data in real time and controls the movements of the machine tool accordingly.
[0020] During the testing process, the system can perform a series of test sequences. First, for example, the touch-sensitive controls are optically detected and their position determined. Then, the machine tool positions a selected test finger over a control element to be tested. The control unit then initiates a touch or swipe movement and compares, in particular, the position of the test finger with the data sent from the input unit via a data bus.
[0021] In parallel, the test system can, for example, vary the environmental conditions in the climate chamber. Specifically, temperatures from approximately -20°C to approximately +80°C and / or a relative humidity of, for example, approximately 10% to approximately 95% can be simulated. Additionally, the EMC antenna unit can generate electromagnetic fields of varying strength and frequency to investigate potential interference with the input unit.
[0022] The control unit can evaluate the collected data and dynamically adjust the test parameters. For example, if a discrepancy is detected between the finger position and the received data, the system can automatically repeat the number of test repetitions in that specific area, finely varying the environmental parameters to determine the exact conditions under which the discrepancy occurs.
[0023] In a second embodiment, the test system is used to safeguard a complex control panel in a vehicle center console. This panel includes both capacitive touch surfaces and physical buttons and rotary controls.
[0024] The tool unit of the testing system consists, for example, of a robot arm with multiple degrees of freedom, enabling positioning and movement in virtually all spatial directions. The tool unit, which can accommodate various test fingers, can be mounted on the robot arm.
[0025] For testing the capacitive touch surfaces, similar test fingers are used as in the first embodiment. Additionally or alternatively, the system can include tools for actuating the physical controls, such as actuators with variable force settings for pushbuttons and / or grippers with torque sensors for rotary controls. These tools can exert forces and torques while simultaneously measuring the required actuation forces. The camera system in this embodiment can consist of one or more cameras that capture the input unit from different angles.
[0026] The test sequences in this embodiment can include the actuation of multiple controls in defined sequences. For example, a test sequence could involve the simultaneous actuation of a capacitive slider and a physical rotary control to verify the correct function of combined operating gestures.
[0027] The climate chamber allows for variations in temperature and / or humidity, as well as the simulation of vibrations and shocks that can occur during driving. The EMC antenna unit can not only generate electromagnetic fields, but also simulate specific interference signals that can occur in a vehicle, such as those from mobile phones or vehicle electronics.
[0028] The control unit in this embodiment, for example, has a pattern recognition function that can not only detect individual deviations but also analyze complex interaction patterns. It can, for instance, recognize when certain combinations of operator inputs lead to malfunctions under specific environmental conditions.
[0029] Additionally, the system can be equipped with an automatic cleaning device. This device can apply and / or remove defined contaminants from the control panel between test cycles. This allows for the systematic investigation of the influence of various types of contaminants, such as dust, grease, or liquids, on the functionality of the controls.
[0030] The test results can be stored in a database and evaluated using specialized analysis software. This software makes it possible to identify correlations between different parameters and to recognize long-term trends in the performance of the control elements. This allows potential weaknesses to be identified early and optimization suggestions for future developments to be derived.
[0031] The invention is now also described with regard to the figures. They show: Fig. 1 schematically a representation of a testing system according to the invention; and Fig. 2 a flowchart of a test method according to the invention.
[0032] Fig. Figure 1 shows a schematic representation of a testing system 100 according to the invention. The testing system 100 comprises a tool unit 110 for controlling at least one test finger 112. The tool unit 110 can be part of a CNC machine and enables precise positioning and movement of the test finger 112. A camera system 120 serves for optical detection of the operating elements 130, 131 of the input unit 132 to be tested.
[0033] A control unit 140 is connected to the tool unit 110, the camera system 120, and the input unit 132. The control unit 140 is configured to perform a real-time comparison between the position value of the test finger 112 and the bus data of the input unit 132's data bus while the operating elements 130 and 131 are being actuated by the test finger 112. The control unit 140 includes pattern recognition, which evaluates test data and makes automatic changes to the process control based on this evaluation.
[0034] The test system 100 further includes a tool changing unit 150, which makes it possible to use different test fingers 114, 116 to simulate different finger states and / or to operate different control elements. A climate chamber 160 enables the simulation of different environmental conditions for the input unit 132 and the control elements 130, 131, while an EMC antenna unit 170 can generate electromagnetic fields to investigate their influence on the input unit 132.
[0035] A device 180 for automatically soiling and cleaning the operating elements 130 enables the investigation of the influence of contamination on functionality.
[0036] Fig.Figure 2 shows a flowchart of a test method according to the invention. The method begins with the optical detection of the operating elements using the camera system in a first step S210. Subsequently, a test finger 112 is positioned on an operating element 130, 131 in a second step S220, followed by the actuation of the operating element by the test finger 112 in a third step S230.
[0037] During operation, a comparison is made between position values, pressure data and / or force measurements on the test finger 112 and the bus data of the input unit 132 in a fourth step S240. Based on this comparison, the test parameters in the control unit 140 are adjusted in a fifth step S250.
[0038] Steps 210 to 250 can be repeated with varied test parameters, with various adjustments being made between repetitions, such as changing the test finger, changing the environmental conditions in the climate chamber, changing the electromagnetic fields, or contamination or cleaning of the controls.
[0039] The testing system and method according to the invention enable reproducible validation of touch-sensitive control elements in motor vehicles, taking into account various environmental conditions and influencing factors. The combination of position data and bus data, as well as the ability to simulate various environmental conditions and disturbances, achieves a high degree of test depth and accuracy.
[0040] Adaptive control through pattern recognition also enables intelligent adjustment of the testing strategy, thereby identifying potential weaknesses or deviations from the specification. This leads to a significant improvement in product quality while simultaneously reducing assurance costs compared to conventional systems and methods.
Claims
[1] Test system (100) for automated safeguarding of an input unit (132) with touch-sensitive controls (130, 131) in motor vehicles, comprising - a tool unit (110) for controlling at least one test finger (112); - a camera system (120) for optical detection of the operating elements (130, 131); - a control unit (140) of the test system (100) which is configured to perform a comparison between a position value of the test finger (112) and bus data of a data bus of the input unit (132) during actuation of the operating elements (130, 131) by the at least one test finger (112); and wherein - the control unit (140) is set up to adjust the test parameters based on the comparison. [2] Testing system (100) according to claim 1, wherein the testing system (100) has a tool changing unit (150) which allows the at least one test finger (112) to be exchanged for at least one second test finger to simulate different finger states. [3] Test system (100) according to claim 1 or 2, wherein the test system (100) comprises a climate chamber (160) for simulating various environmental conditions of the input unit (132). [4] Test system (100) according to one of the preceding claims, wherein the test system (100) comprises at least one EMC antenna unit (170) configured to generate electromagnetic fields acting on the input unit (132). [5] Test system (100) according to one of the preceding claims, wherein the control unit (140) is configured to perform a positioning of the at least one test finger (112) on the control elements (130) based on optical detection and / or a mechanical zero point determination. [6] Test system (100) according to one of the preceding claims, wherein the at least one test finger (112) is heatable, wettable with fluids and / or dryable. [7] Test system (100) according to one of the preceding claims, wherein the test system (100) comprises a device (180) for automatically soiling and / or cleaning the operating elements (130). [8] Method for the automated safeguarding of an input unit (132) with touch-sensitive control elements (130) in motor vehicles by means of a test system (100) according to one of claims 1 to 7, comprising the steps: a. Optical detection (S210) of a control element (130) by means of the camera system (120); b. Positioning (S220) of a test finger (112) on a control element (130); c. Actuation (S230) of the control element (130) by the test finger (112); d. Comparison (S240) between position values of the test finger (112) and bus data of the data bus of the input unit (132) during actuation; e. Adjustment (S250) of the test parameters based on the comparison; [9] Computer program product comprising program code stored on a computer-readable data carrier for carrying out the method according to claim 8 when the program is executed on a computer. [10] Use of a test system (100) according to one of claims 1 to 7 for the automated safeguarding of touch-sensitive control elements (130) in motor vehicles.