Method, device, and system for controlling a display unit in a vehicle, computer program, and non-volatile machine-readable medium
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- BAYERISCHE MOTOREN WERKE AG
- Filing Date
- 2025-10-22
- Publication Date
- 2026-07-30
Smart Images

Figure EP2025080491_30072026_PF_FP_ABST
Abstract
Description
[0001] 24-3115 1
[0002] Method, device and system for controlling a display unit in a vehicle,
[0003] Computer program and non-volatile machine-readable medium
[0004] Description
[0005] Exemplary embodiments of the present invention relate to a method, a device and a system for controlling a display unit in a vehicle, a computer program and a non-volatile machine-readable medium.
[0006] In modern vehicles, the interaction between display units and mobile devices is becoming increasingly important. Display units are used to provide information such as navigation instructions, media controls, and vehicle status displays. These display units are controlled, for example, via physical controls, touchscreens, or voice-activated input methods. However, existing systems have limitations in terms of flexibility, precision, and user-friendliness. In particular, there are challenges in the seamless integration of mobile devices with vehicle display units. The transmission and processing of input data is often not sufficiently accurate, which can lead to operating errors or a limited user experience. Furthermore, broad compatibility with different device types is frequently lacking.Furthermore, seating positions in vehicles are more variable, and the distance to a vehicle display is often ergonomically far from the user, making touch operation impractical. Therefore, there is a need for solutions that enable intuitive, precise, and flexible control of display units in vehicles while simultaneously ensuring high compatibility with various mobile devices.
[0007] Exemplary embodiments relate to a method for controlling a display unit in a vehicle. The method includes activating a remote control function of the display unit on a mobile device. Furthermore, the method includes recognizing a control input via an input interface of the mobile device and transmitting control input data to the vehicle based on the recognized input. The method also includes controlling a function of the display unit in the vehicle based on the recognized control input data from the mobile device. This method eliminates the need to install an additional controller, buttons, or control displays in the vehicle, resulting in significant cost savings. Moreover, a mobile device, such as a smartwatch, is always available on the user's wrist, enabling quick and intuitive control.The method can utilize established interaction patterns, such as the trackpad, which are already familiar to the user, thereby reducing the learning curve for operation. Total 24-3115 2.
[0008] This method enhances user-friendliness and enables precise customization to individual user needs. Furthermore, the method can include triggering a command from the vehicle's display unit based on a second control input via the mobile device's input interface. This expands the control functionality and offers the user a wide range of customization options.
[0009] In another embodiment, the detection of a control input can include the detection of motion data generated by a movement on a touch-sensitive display of the mobile device.
[0010] In another embodiment, the method can include adjusting the motion data based on an adjustment parameter. Adjusting the motion data increases the precision of the control and minimizes input errors, thus enabling more effective operation.
[0011] In one embodiment, the mobile device can be at least one of the following: a wearable, a smartwatch, a smartphone, a smart ring, or virtual reality glasses. This broad compatibility significantly improves interoperability with various technologies and application environments, thus optimizing the overall user experience.
[0012] The input interface of the mobile device can include at least one of the following: a touch-sensitive display, a physical button, a gesture recognition unit, a voice-controlled input unit, a gyroscope, or an eye-tracking unit.
[0013] In another embodiment, the input interface can include a virtual control pad, which is supplemented by a selector function.
[0014] Additionally, the procedure may include automatically activating the display unit remote control function of the mobile device when the mobile device is within a predefined distance of the vehicle.
[0015] Another embodiment relates to a device for controlling a display unit in a vehicle. The device comprises a communication interface configured to receive control input data generated by an input interface of a mobile device. Furthermore, the device comprises a processor circuit configured to control a function of the display unit in the vehicle based on the received control input data and to trigger a command on the display unit in the vehicle.24-3115 3
[0016] based on a second control input. The device establishes a robust connection between mobile devices and the vehicle's display unit, improving control efficiency. The device can, for example, be integrated into the vehicle.
[0017] Further embodiments include a system comprising the device and a mobile device, which includes an input interface for recognizing control input and a communication interface for transmitting control input data to the device. In one embodiment, the mobile device can be at least one of the following: a wearable, a smartwatch, a smartphone, a smart ring, or virtual reality glasses. This system integration enables seamless interaction between the vehicle and mobile devices, thereby optimizing the user experience.
[0018] Examples of embodiments also include a computer program for carrying out one of the methods described herein, if the computer program runs on a computer, a processor or a programmable hardware component.
[0019] Further embodiments relate to a non-volatile, machine-readable medium that stores program code which, when executed on a computer, a processor, or a programmable hardware component, performs one of the methods described herein. These software solutions extend the possibilities for implementing the invention on different hardware platforms.
[0020] Examples of implementation are explained in more detail below with reference to the accompanying figures:
[0021] Fig. 1 shows a schematic representation of a method 100 for controlling a display unit in a vehicle;
[0022] Fig. 2 schematically shows a device 200 for controlling a display unit in a vehicle, comprising;
[0023] Fig. 3 schematically shows a system 300 for controlling a display unit in a vehicle 310; and
[0024] Fig. 4 schematically shows another example of a system 400 for controlling a display unit 410 in a vehicle. 24-3115 4
[0025] Several embodiments are now described in more detail with reference to the accompanying drawings, in which some of these embodiments are illustrated. For the sake of clarity, the thickness dimensions of lines, layers, and / or regions may be exaggerated in the figures.
[0026] Fig. 1 schematically shows a method 100 for controlling a display unit in a vehicle. The method includes activating a remote control function of the display unit on a mobile device. The method is implemented, for example, by a device 200 (see Fig. 1).
[0027] 2) or a mobile terminal 320 (see Fig. 3) or a system 300 (see Fig. 3).
[0028] In some examples, a mobile device refers to a portable electronic device that may have its own power supply, wireless communication interfaces, and / or input interfaces. A mobile device may be designed for mobile use and may perform various functions such as communication, control, or data acquisition. The mobile device includes an input interface that allows the user to input control information on the device. The mobile device also includes a remote control display.
[0029] In some examples, the remote control function of the display unit refers to a software-based control solution implemented on the mobile device. This function allows the vehicle's display unit to be operated remotely. It includes, for example, software components such as a mobile application (app) designed to communicate with the vehicle. The remote control function can also include system-integrated software on the mobile device, such as a pre-installed operating system feature or a dedicated remote control interface. The remote control function can also be implemented or supported by a cloud-based system that enables control via the internet.Activating the remote control function of the display unit on the mobile device involves, for example, putting the remote control function into an operational state so that it can detect control inputs and transmit them to the vehicle. This can be done in different ways, for example, by manual activation by a user via a user interface, such as launching an app on the mobile device. Activation can also occur automatically, for example, when the device detects a defined proximity to the vehicle (see below). 24-3115 5.
[0030] In some examples, the mobile device 300 can be at least one of the following: a wearable, a smartwatch, a smartphone, a smart ring, or virtual reality glasses.
[0031] A wearable device can be, for example, a portable electronic device worn on the user's body. In some cases, a wearable might include sensors, communication interfaces, and power sources that enable mobile use. Wearables can collect data and communicate with other devices such as vehicles or mobile phones. For example, a wearable could be a fitness tracker or a wearable health monitoring system that measures and transmits movement or health data.
[0032] A smartwatch (smart wristwatch) can be, for example, an intelligent wristwatch that offers functions such as notifications, control inputs, or the display of information. In some cases, a smartwatch may contain sensors such as a gyroscope or a heart rate monitor and have a touchscreen. A smartwatch can be particularly advantageous because it is worn directly on the wrist and is therefore quick and intuitively accessible. For example, it can be used in situations where the user's hands are otherwise occupied. This makes controlling vehicle functions particularly fast and efficient. Furthermore, the intuitive user interface, such as through a touchscreen or simple gestures, allows for uncomplicated interaction, even in dynamic situations such as when getting into the vehicle.
[0033] A smartphone, for example, can be a multifunctional mobile device that combines telephony, internet access, and application software. In some cases, a smartphone might include a touchscreen, a camera, and wireless communication interfaces such as Bluetooth or Wi-Fi. For instance, a smartphone can be used to control vehicle functions by transmitting control inputs to the vehicle via a mobile app.
[0034] A smart ring can be, for example, a wearable electronic device in the form of a ring worn on the finger. In some cases, a smart ring may contain sensors and communication modules such as Bluetooth to capture control inputs or transmit data. For example, a smart ring can be used for authentication or to enable simple control inputs such as starting a vehicle function.
[0035] A virtual reality headset (VR headset) can, for example, be a headset that presents an immersive virtual environment. In some examples, a VR headset can have sensors for 24-3115 6
[0036] This includes motion detection, integrated displays, and wireless communication interfaces. For example, VR glasses can be used to control vehicle functions by capturing head or hand movements and / or gaze data and converting them into control inputs.
[0037] The method further includes the detection of a control input through an input interface 310 of the mobile device 300. The input interface refers, for example, to a component of the mobile device designed to capture user input and convert it into digital signals. A control input through an input interface of the mobile device refers, for example, to the interaction of a user with a component of a mobile device designed to capture and transmit control commands.
[0038] In some examples, the input interface of the mobile device may include at least one of the following: a touch-sensitive display, a physical button, a gesture recognition unit, a voice-activated input unit, a gyroscope, or an eye-tracking unit. A touch-sensitive display, for example, is an input interface that detects user touch and processes it as control input. In some examples, a control input might be made by tapping an icon, swiping across the surface, or pressing an area of the display. These inputs could be used to operate the touch-sensitive display. For example, the input could be used to start navigation, scroll through menus, or adjust the volume. A touch-sensitive display is, for example, part of a smartphone, smartwatch, or tablet.
[0039] A physical button, for example, refers to a mechanical input interface that allows control input through pressing, holding, or multiple presses. For instance, control input via a physical button on a mobile device includes pressing to start or stop media playback, holding the button to increase the volume, or pressing it multiple times to switch between different vehicle functions. Physical buttons are found, for example, on smartwatches, smart rings, and other wearable devices.
[0040] A gesture recognition unit, for example, refers to an input interface that detects the user's movements or gestures and interprets them as control inputs. For example, control input via a gesture recognition unit in a mobile device includes waving a hand to activate the vehicle's lights, moving a hand right or left to navigate menus, or pointing at a specific function to select it. A gesture recognition unit is, for example, part of virtual reality glasses or special24-3115 7
[0041] Wearables. A voice-controlled input unit, for example, refers to an input interface that recognizes and processes spoken commands. For instance, control input via a voice-controlled input unit of a mobile device includes speaking a command such as "Start navigation," "Turn on the radio," or "Adjust the climate control." A voice-controlled input unit is, for example, part of a smartphone, a smartwatch, or virtual reality glasses.
[0042] A gyroscope, for example, is a sensor unit that detects the orientation or movement of a mobile device and interprets it as control input. For instance, control input via a mobile device's gyroscope includes tilting the device to move the cursor on a vehicle display, swiveling it to adjust the volume, or rotating it to scroll through menus. A gyroscope is found in devices such as smartphones, smartwatches, and virtual reality headsets. An eye-tracking unit, on the other hand, is an input interface that detects the user's eye movements and interprets them as control input.For example, control input via a mobile device's eye-tracking unit includes fixating on an icon on the vehicle display to activate a function, following a menu item with the eyes to select it, or looking directly at an area of the display to view information. The eye-tracking unit is, for example, part of virtual reality glasses, augmented reality (AR) glasses, and / or specialized wearables.
[0043] The procedure further includes the transmission of control input data, based on the recognized control input, from the mobile device 300 to the vehicle 100. The control input data can be generated, for example, based on the recognized control input by the input interface and / or another component of the mobile device processing the captured input. For example, in this context, recognizing the input data means that the input interface has interpreted and classified the input performed by the user in order to determine its purpose or meaning.
[0044] The transmission of control input data from the mobile device to the vehicle can be accomplished, for example, via the display unit's remote control function or other software implemented on the mobile device. This software, for instance, converts the generated control input data into a standardized format compatible with the vehicle's communication protocols.
[0045] For example, the control input data is transmitted to the vehicle via a communication interface of the mobile device. 24-3115 8
[0046] In some examples, this can be done via wireless communication protocols such as Bluetooth, WLAN, or NFC. The transmission ensures that the detected inputs are sent to the vehicle precisely and in real time, so that the vehicle display or other controlled systems can correctly process the inputs. Alternatively, the transmission can be done via a proprietary protocol specifically designed for communication between mobile devices and vehicles. In some examples, the transmission of control input data between the mobile device and the display unit in the vehicle can occur via at least one of the following communication protocols: Bluetooth, Wireless Local Area Network (WLAN), or Near Field Communication (NFC). This means the communication interface can include a Bluetooth transceiver, a WLAN module, or an NFC antenna, each designed for a specific type of wireless communication.Additionally, processors or dedicated signal processing units can be used on the mobile device to encode and optimize the control input data before transmission.
[0047] The control input data can be received and processed by various components in the vehicle, for example, by device 200 (see Fig. 2). For instance, the vehicle may have a corresponding communication interface, such as a Bluetooth receiver, an NFC antenna, or a WLAN module, which receives the transmitted data, decodes it, and forwards it to a vehicle display unit. The input data can be processed, for example, by a central control unit in the vehicle, which is responsible for coordinating and controlling several vehicle functions. In some examples, specific control units for the vehicle display, such as an infotainment control unit, could receive and forward the control input data. This control unit could analyze the data and send appropriate commands to the display unit or other vehicle components, such as the volume control or the navigation display.
[0048] The method further includes controlling a function of the display unit in the vehicle 100 based on the detected control input data from the mobile device. The display unit refers, for example, to a visual device in a vehicle designed to display information, system states, and / or user interfaces. It serves, for example, as an interface between the vehicle and the user to provide important information such as navigation instructions, vehicle status data, or media content clearly and intuitively. In some examples, the display unit may be designed as a screen in the center console, as a digital instrument cluster behind the steering wheel, or as a head-up display that projects content directly into the driver's line of sight. This device can be static24-3115 9
[0049] Display information such as battery status, or dynamic content that adapts to the current driving situation or control inputs. In some cases, the display unit can be designed as a screen within the passenger entertainment area, for example, as a screen in the rear seats or as a front passenger display. A screen in the passenger entertainment area is advantageous, for instance, because optimal ergonomic reach is not always possible there. The display unit can be connected to other vehicle components and can receive and display data from control units, sensors, or external sources. To ensure a user-friendly display, various technologies such as LCD, OLED, or projection techniques can be used, offering high resolution and readability.In some examples, the display unit may include interactive elements that can be navigated or customized by user control inputs, such as touchscreens or menu structures.
[0050] The function of the display unit refers, for example, to a command or interaction that is enabled, executed, or controlled by a vehicle's display unit. This term encompasses both direct commands executed by the display unit, such as starting a navigation route or playing media content, and the operation of the display unit itself, such as navigating menus or selecting items using a cursor or other input methods. In some examples, the function of the display unit may include adjusting vehicle parameters, such as setting the climate control or changing the display brightness. It can also involve interactive elements, such as scrolling through lists, zooming in on maps, or triggering a command to update vehicle information.The term is thus broadly defined and includes both the control of specific vehicle functions via the display and the interactive operation of the display itself.
[0051] For example, controlling the function of the display unit involves using the received control input data from the mobile device to execute, modify, or control a specific interaction or command of the display unit in the vehicle. Such commands can include navigating menus, zooming in or out on map views, adjusting brightness, or switching between different display content. Similarly, controlling the function of the display unit can mean using interactive elements such as a cursor to select options or make settings. This control is dynamic based on the detected inputs and allows for direct and precise adaptation of the display unit to the user's needs.
[0052] The function of the display unit can be controlled, for example, by the vehicle, such as by device 200 (see Fig. 2). For instance, a control unit in the vehicle can execute the control of the display unit's function based on input data. For example, the vehicle's infotainment control unit could use the input data to display a music selection or to start the navigation mode. The control unit can operate in real time to ensure that the user's actions are implemented without delay.
[0053] The use of mobile devices offers significant advantages for controlling the functions of in-vehicle displays. This method reduces the hardware complexity in the vehicle, as no additional physical control displays or controllers are required. This not only leads to cost savings in vehicle production but also to greater efficiency in the use of interior space. Using devices such as smartwatches, which are always on the user's wrist, ensures quick and intuitive access to controls, eliminating the need for users to remove their smart devices from their pockets. Furthermore, there is often a risk of losing or misplacing additional external controllers in the vehicle, a problem that can be avoided by using devices like smartwatches that are always on the user's wrist.Furthermore, the use of established interaction patterns on the mobile device simplifies operation, eliminating the need for lengthy user training. Overall, the method enhances user-friendliness and adapts flexibly to the requirements of different users.
[0054] In some examples, Procedure 100 may further include triggering a command from the vehicle's display unit based on a second control input via the mobile device's input interface. The display unit command, as described above, is a function of the display unit. For example, the (first) control input may involve navigating menus, moving a cursor, or highlighting an icon on the display, while the second control input serves to issue a command to trigger the highlighted action. This second control input could, for example, be tapping an icon, performing a specific gesture, or speaking a command such as "Confirm selection."In one example, the second control input can be implemented using a timer function, where a command is triggered after a control on the display unit remains on a specific area of the display unit for a predefined duration. The triggered command could be an action such as starting a navigation route, playing a selected music track, switching to a different view, or displaying detailed information.
[0055] Vehicle information is included. This two-stage control offers a precise and flexible way to use the display unit's functions, while simultaneously minimizing operating errors due to unintended inputs.
[0056] In some examples, recognizing a control input involves recognizing motion data generated by movement on a mobile device's touchscreen. Motion data refers, for example, to digital information derived from a user's physical movement on an input interface, such as a touchscreen. In some examples, motion data may include parameters such as the direction, speed, acceleration, or duration of a movement. For instance, motion data can be detected and captured by a sensor on the input interface or a touchscreen surface and converted into machine-readable signals to generate control input data.For example, motion data includes the user's physical movement on a touch-sensitive display of the mobile device, such as swiping, tapping, or dragging. This input can be used, for instance, to move a cursor on a display unit in the vehicle, to highlight menu items, or to control interactive elements.
[0057] In some examples, Method 100 may further include adapting the motion data based on an adaptation parameter. Method 100 may also include generating the control input based on the adapted motion data, whereby the control of the function of the display unit in the vehicle is based on the adapted motion data. For example, motion data generated by an input on an input interface of the mobile device is adapted to generate a control input for the display unit in the vehicle. The adaptation may take the form of amplification, attenuation, or other modification of the motion data. Amplification, for example, means that a smaller input, such as a short movement on the mobile device, has a greater effect on the larger display unit in the vehicle, such as scrolling extensively through content.However, attenuation can occur with precise inputs to ensure that fine movements, such as moving a cursor, are implemented just as precisely on the display unit.
[0058] The user's physical movement on the input interface is captured, for example, in the form of motion data such as the finger's position, speed, direction, or acceleration. This motion data is measured and analyzed at regular intervals by sensors on the input interface to calculate the adaptation parameter. Der24-3115 12
[0059] Adaptation parameters can be determined, for example, through mathematical evaluations such as the derivative of position (speed) or the derivative of velocity (acceleration). The adaptation parameter can be a vector and comprises, for example, one or more scaling factors that can be applied to the motion data (which can include various parameters such as position, distance, speed, acceleration, etc.). A scaling factor can be greater than 1 to amplify motion data or less than 1 to attenuate it. For example, the distance of a swipe on the input interface is multiplied by an amplification factor to achieve a larger cursor movement on the display unit. Alternatively, the factor can be chosen to more precisely translate fine, slow movements, such as when controlling a cursor for menu selection.
[0060] The size ratio between the touchscreen of the mobile device and the display unit in the vehicle can be a factor in adapting motion data. The motion data can be scaled to compensate for differences in dimensions. For example, the width and height of both displays can be compared to calculate scaling factors that adjust movements proportionally. A swipe on a small display could thus result in a larger movement on the vehicle's display unit, covering the entire width or height of the vehicle's display. In some cases, differences in the aspect ratios of the two displays can also be taken into account. For instance, if the mobile device uses a 16:9 format and the vehicle's display unit has a 4:3 format, the scaling will be adjusted both horizontally and vertically to ensure precise control.This normalization ensures that movements are implemented intuitively and consistently, regardless of the physical sizes of the two devices. This makes the controls user-friendly, without requiring the user to perform unnaturally large or small movements.
[0061] Method 100 can further obtain the adaptation parameter. For example, an external device can determine the adaptation parameter. In some examples, Method 100 includes determining the adaptation parameter. The determination of the adaptation parameter can be performed by an algorithm. For example, the algorithm can first detect the position of a finger or stylus at short intervals via the input interface of the mobile device and record the movements as digital motion data. This motion data is analyzed to determine relevant parameters such as the speed or acceleration of the movement. Subsequently, one or more scaling factors are calculated based on the size ratios between the mobile device and the display unit. The motion data is processed according to usage requirements.
[0062] The scaling factors are adjusted to optimize the controls. This allows rapid inputs to be amplified to create large jumps or movements on the display unit, such as when scrolling through long lists. Conversely, slow and precise inputs are attenuated to allow for finer and more accurate control, for example, when selecting menu items or navigating with a cursor. These adjustments are made in real time to ensure the controls are as responsive as possible. Finally, the adjusted data is transmitted to the vehicle's display unit.
[0063] Adjusting the motion data based on an adjustment parameter enables dynamic fine-tuning of the controls. By adapting and amplifying the motion data, control inputs can be interpreted and implemented more precisely. This ensures stable and reliable operation, especially during complex or rapid movements. Utilizing the adapted motion data improves the control of the vehicle's display unit, resulting in smoother and more intuitive interaction. This feature helps optimize the user experience and minimize operator errors, particularly in situations requiring precise input.
[0064] In some examples, Method 100 involves adapting motion data generated by movement on a touchscreen display of the mobile device to a defined section of the display unit in the vehicle. The method further includes normalizing the motion data to restrict control of the display unit's function to the defined section. This adaptation is based on a motion parameter, and the control of the display unit's function within the section is proportional to the input on the mobile device. The section could be, for example, a specific menu, a function, or a small part of a navigation map. The adaptation of the motion data, based on motion parameters as described above, ensures that control within the defined area is implemented precisely and effectively.Normalizing the motion data ensures that it is scaled proportionally to the size of the defined area. This allows for precise control of the display unit's function without requiring the user to make excessively fine or large inputs on the mobile device. This method increases flexibility and user-friendliness by limiting control to relevant areas of the display unit while enabling intuitive and accurate operation.
[0065] In some examples, the 310 input interface can include a virtual control pad, which is complemented by a selector function. The virtual control pad is, for example, a digital input method that is displayed on the touch-sensitive display of a mobile device.24-3115 14
[0066] It is used to enable targeted control inputs such as movements or changes of direction. The virtual directional pad, for example, consists of a central point or area surrounded by four or more directional arrows pointing up, down, left, and right. In some versions, the directional pad can support movements in clearly defined directions (fixed directional pad) or in any direction (free directional pad). It is, for example, visually highlighted to make its operation intuitive and can be shown or hidden as needed to save space on the mobile device's touchscreen. The virtual directional pad offers various interaction options depending on its configuration.A fixed directional pad, for example, allows movement in predefined directions and can be used for simple navigation, such as switching between menu items or scrolling through lists. A free directional pad, for example, allows movement in any direction and can be used to precisely control a cursor across the display or to mark elements such as symbols and destinations on a map.
[0067] The selector function, for example, refers to an input method used to select or execute a highlighted position, option, or action on a display unit. It can be activated by specific interactions such as pressing a physical button, holding down the display, or other input methods. In combination with a selector function, the directional pad can be used to activate highlighted options or execute commands.
[0068] The virtual directional pad offers a structured and precise control option, which is particularly useful on the small displays of mobile devices. It reduces the likelihood of incorrect inputs, as the control area remains clearly defined, while still allowing for flexible operation. Another advantage is the ability to transfer input from the mobile device to the vehicle's display unit, ensuring a clear separation between input and display. The directional pad also offers a familiar operating logic, as it is based on physical directional pads and / or the logic of analog, digital, and isometric joysticks (for example, with 4 / 8 arbitrary degrees of freedom for operation), and can be flexibly adapted to various applications, such as navigating menus, scrolling, or controlling a cursor.
[0069] In some examples, procedure 100 may further include activating the display unit remote control function of the mobile device when the mobile device is at a predefined distance from the vehicle. For example, the distance between the mobile device and the vehicle is detected by the mobile device or by the vehicle. Dies24-3115 15
[0070] This can be implemented using various technologies, such as Bluetooth signals, Wi-Fi-based positioning, Near-Field Communication (NFC), or GPS. With Bluetooth or Wi-Fi, signal strength (RSSI, Received Signal Strength Indicator) can be measured to estimate the distance. With NFC, close proximity within a few centimeters could trigger activation, while GPS coordinates are used for greater distances, for example, to determine whether the mobile device is near a defined geographic area. The collected distance data is analyzed by software in the mobile device or the vehicle and compared to a predefined threshold. This threshold determines the distance at which the remote control function should be activated. For example, this could mean that the function is automatically activated when the mobile device approaches within 5 meters.This analysis is performed in real time, so the function is available immediately as soon as the distance conditions are met. After successful distance verification, the vehicle sends a signal to the mobile device to activate the remote control function for the display unit, or the mobile device activates the remote control function itself, or sends the user a message requesting that they activate the remote control function. The vehicle can prepare the display unit to receive input from the mobile device.
[0071] For example, the predefined distance to the vehicle can be designed so that the display unit remote control function of the mobile device is activated as soon as the user has, or could have, the vehicle's display unit in their field of vision.
[0072] The automatic activation of the remote control function significantly increases comfort by minimizing manual intervention. This function ensures that the system is already prepared when the user enters the vehicle, making operation immediately available. This saves time and increases efficiency.
[0073] Exemplary embodiments relate to a computer program that is configured to execute method 100 when running on a processor or a programmable hardware component.
[0074] Exemplary embodiments relate to a non-volatile, machine-readable medium that stores program code configured to execute method 100.
[0075] Further details and aspects are mentioned in connection with the examples described below. The example shown in Fig. 1 may include one or more optional additional features corresponding to one or more aspects related to 24-3115 16
[0076] the proposed concept or one of the examples described below (e.g. Figs. 1 - 2).
[0077] Fig. 2 schematically shows the device 200 for controlling a display unit in a vehicle. The device 200 includes a communication interface 210. The communication interface 210 is, for example, a hardware and software unit that exchanges data between the mobile device and the device 200. The communication interface 210 can use various technologies, such as Bluetooth, NFC, or WLAN, to wirelessly receive control input data. The communication interface 210 can include a receiver module that receives and decodes the transmitted data, as well as a processing unit that forwards the data. The device includes a processor circuit 220.For example, the processor circuit 110 can be formed by a single dedicated processor, a single shared processor, or a plurality of individual processors, some or all of which can be used together, a microcontroller, an application-specific integrated circuit (ASIC), an integrated circuit (IC), a system-on-a-chip (SoC), a programmable logic element, or a field-programmable gate array (FPGA) with a microprocessor on which software for screen control runs according to the principles described herein. The processor can be, for example, a central processing unit (CPU), a graphics processing unit (GPU), a neuromorphic processor, and / or a tensor processor.The processor circuit 110 can furthermore be connected to a memory, such as a read-only memory (ROM) for storing software, a random access memory (RAM), and / or a non-volatile memory. The device 100 can, for example, include or be coupled to a memory configured to store instructions which, when executed by the processor circuit 110, cause the processor circuit 110 to perform the steps and procedures for context-dependent background generation described herein.
[0078] The communication interface 210 is configured to receive control input data generated by the input interface of a mobile device. The processor circuit 220 is configured to control a function of the display unit based on the received control input data.
[0079] In some examples, the processor circuit 220 is further configured to trigger an instruction on the display unit 200 based on a second control input. 24-3115 17
[0080] Exemplary embodiments relate to a vehicle that includes the device 200.
[0081] Further details and aspects are mentioned in connection with the examples described above or below. The example shown in Fig. 2 may include one or more optional additional features corresponding to one or more aspects mentioned in connection with the proposed concept or an example described above (e.g., Fig. 1) or below (e.g., Fig. 3).
[0082] Fig. 3 schematically shows a system 300 for controlling a display unit in a vehicle 310. The system 300 comprises the device 200 (see Fig. 2). The system 200 further comprises a mobile terminal 320. The mobile terminal 320 comprises an input interface 340 for recognizing a control input. The mobile terminal further comprises a communication interface 340 for transmitting control input data based on the control input to the device 200. The system 300 is, for example, designed to execute the method 100.
[0083] For example, the mobile device 320 can be at least one of the following: a wearable, a smartwatch, a smartphone, a smart ring, or virtual reality glasses.
[0084] Fig. 4 schematically shows an example of a system 400 for controlling a display unit 410 in a vehicle. The system 400 comprises a display unit 410 in a vehicle (not shown in Fig. 4).
[0085] (Figure 4). The system 400 further comprises a first mobile device 430, which is used by a first user. The first mobile device 430 is a smartwatch. The input interface of the smartwatch 430 is a touch-sensitive display. This touch-sensitive display of the smartwatch 430 includes a control pad with which the cursor 440 on the display unit 410 in the vehicle can be controlled. The system 400 can also include a second mobile device 432, which, for example, is used by a second user. The second mobile device 432 is a smartwatch. The input interface of the smartwatch 432 is a touch-sensitive display. This touch-sensitive display of the smartwatch 432 includes a fixed selector with which a command can be triggered and controlled on the display unit 410 in the vehicle.If the system 400 includes the first user with the first mobile device 430 and the second user with the second mobile device 432, the system 400 is configured, for example, such that only one of the two users can operate a cursor with a trackpad. In another embodiment in which the system 400 includes the first user with the first mobile device 430 and the second user with the second mobile device 432, and the mobile devices 430 and 432 are, for example, 24-3115 18.
[0086] Each unit is equipped with a physical button, allowing independent functions to be operated simultaneously by both users.
[0087] In another embodiment, the system 400 comprises only one of the two users with their respective mobile device 430 or 432.
[0088] For example, the first and second users can use their smartwatch 430, 432 as a trackpad to operate the remote display unit 410 in the vehicle. To do this, the user first activates the remote control function on the smartwatch 430, 432 as described above. The user then uses the touchscreen on their smartwatch as a trackpad, for example, by swiping their finger across it. The finger's position changes are then transmitted to the display unit 410 in the vehicle. To compensate for the size difference between the smartwatch and the display unit 410 in the vehicle, the position change can optionally be amplified by an adjustment parameter (e.g., speed and acceleration factor). For example, the x / y mapping of the cursor on the display unit 410 in the vehicle becomes more precise by factoring in slow movements less and fast movements more.To trigger a command on the display unit 410 in the vehicle, the user performs, for example, a tap or touchdown gesture on their smartwatch 430 or 432. This touch trigger (second control input) is transmitted to the display unit 410 in the vehicle and triggers the corresponding touch event there. In this way, the user can control the remote display unit 410 in the vehicle precisely, ergonomically, and freely via their smartwatch 430 or 432.
[0089] In some examples, other interaction patterns can also be integrated via the Smartwatch 430, 432. For example, control via physical buttons and / or digital buttons on the Smartwatch 430, 432 is possible. For example, the directional pad can be used together with a fixed selector, analogous to a directional pad on a classic remote control.
[0090] For example, the display unit remote control function can be automatically activated by the mobile device detecting the proximity of the vehicle and starting the display unit remote control function as soon as the user enters the vehicle or even before, so that it is immediately ready for operation. (Reference list)
[0091] 0: Procedure
[0092] 0: Activate a display unit remote control function 0: Detect a control input
[0093] 0: Transferring control input data
[0094] 0: Controlling a function of the display unit
[0095] 0: Device
[0096] 0: Communication interface
[0097] 0: Processor circuit
[0098] 0: System
[0099] 0: Vehicle / Display unit in the vehicle
[0100] 0: Mobile device
[0101] 0: Input interface
[0102] 0: Communication interface of the mobile device
[0103] 0: System for controlling a display unit
[0104] 0: Display unit in the vehicle
[0105] 0: First mobile device (first user's smartwatch) 2: Second mobile device (second user's smartwatch) 0: Cursor controlled on display unit 410
Claims
24-3115 20 Patent claims 1. Method (100) for controlling a display unit in a vehicle (310), comprising: Activating (110) a display unit remote control function on a mobile device; Recognition (120) of a control input through an input interface (330) of the mobile device; Transfer (130) control input data based on the detected control input by the mobile device to the vehicle (310); and Control (140) a function of the display unit in the vehicle (310) based on the detected control input data of the mobile device.
2. Method (100) according to claim 1, further comprising: triggering a command of the display unit in the vehicle (310) based on a second control input via the input interface (330) of the mobile device.
3. Method (100) according to any of the preceding claims, wherein the detection of a control input comprises the detection of motion data generated by a movement on a touch-sensitive display of the mobile terminal.
4. Method (100) according to claim 3, further comprising: Adjusting the motion data based on an adjustment parameter; and Generation of the control input based on the adapted motion data, wherein the control of the function of the display unit in the vehicle (310) is based on the adapted motion data 5. Method (100) according to any of the preceding claims, wherein the mobile device is at least one of the following: a wearable, a smartwatch, a smartphone, a smartring, or virtual reality glasses.
6. Method (100) according to any of the preceding claims, wherein the input interface (330) of the mobile device comprises at least one of the following embodiments: a touch-sensitive display, a physical button, a gesture recognition unit, a voice-controlled input unit, a gyroscope or an eye-tracking unit.
7. Method (100) according to any one of the preceding claims, wherein the input interface (330) comprises a virtual control pad. 24-3115 21 8. Method (100) according to any of the preceding claims, further comprising: activating the display unit remote control function of the mobile device when the mobile device is at a predefined distance to the vehicle (310).
9. Method (100) according to one of the preceding claims, wherein the transmission of the control input data between the mobile terminal and the display unit in the vehicle (310) is carried out via at least one of the following communication protocols: Bluetooth, Wireless Local Area Network, WLAN, or Near-Field Communication, NFC.
10. Device (200) for controlling a display unit in a vehicle (310), comprising: a communication interface (210) configured to receive control input data generated by an input interface (330) of a mobile device; a processor circuit (220), configured for: Control of a function of the display unit in the vehicle (310) based on the received control input data.
11. System (300) for controlling a display unit in a vehicle (310), comprising: the device (200) according to claim 10; and a mobile device (320), including: an input interface (330) for detecting a control input; and a communication interface (340) for transmitting control input data based on the control input to the device (200) according to claim 10.
12. System (300) according to claim 11, wherein the mobile device is at least one of the following: a wearable, a smartwatch, a smartphone, a smartring, or virtual reality glasses.
13. Computer program comprising program code which, when executed on a computer, a processor or a programmable hardware component, performs a method (100) according to any one of claims 1 to 9.
14. Non-volatile machine-readable medium storing program code which, when executed on a computer, processor or programmable hardware component, performs a method (100) according to any one of claims 1 to 9.