System and method for controlling electronic devices

The integration of a universal HID with OMS in a vehicle controller allows for intuitive device selection and operation adjustment, addressing the inefficiencies of multiple interaction requirements in existing systems.

DE102025101911A1Pending Publication Date: 2026-06-11GM GLOBAL TECHNOLOGY OPERATIONS LLC
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
DE102025101911
Authority / Receiving Office
DE · DE
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-12-06
Filing Date
2025-01-20
Publication Date
2026-06-11

AI Technical Summary

Technical Problem

Existing human-machine interface systems require multiple interactions to control electronic devices, leading to user inconvenience and inconsistency across different devices.

Method used

A universal human-interface device (HID) integrated with an occupant monitoring system (OMS) and vehicle controller to determine device selection based on gaze direction and user input, providing a consistent control interface through tactile, visual, and auditory feedback.

Benefits of technology

Minimizes user effort in selecting and controlling electronic devices by enabling intuitive device selection and operation adjustment through a unified interface, enhancing user convenience and consistency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

A system for controlling vehicle components is provided for a vehicle. The system can include a variety of vehicle components, a universal human-interface device (HID) capable of receiving occupant input and controlling any of the vehicle components, and a vehicle controller in electrical communication with the vehicle components and the universal HID. The vehicle controller is programmed to identify a selected component from the vehicle components. The vehicle controller is programmed to receive the occupant input using the universal HID. The vehicle controller is programmed to adjust the operation of the selected component based, at least partially, on the occupant input.
Need to check novelty before this filing date? Find Prior Art

Description

introduction

[0001] This description concerns systems and methods for human-machine interfaces for controlling electronic devices, including vehicle components.

[0002] Electronic devices are frequently used to enhance user comfort. Vehicles, for example, may have infotainment systems, ventilation systems, lighting systems, window actuators, and more. Homes, for example, may have lights, door locks, air conditioning systems, stereo systems, and more. Human-machine interfaces (HMIs) are used to allow users to interact with electronic devices. In some examples, HMIs use physical controls, such as buttons, switches, knobs, levers, and the like, to facilitate user interaction. In other examples, HMIs use digital interfaces, such as touchscreens, to facilitate user interaction. In still other examples, HMIs use acoustic interfaces, such as speech synthesis, speech recognition, and the like, to facilitate user interaction.In some examples, HMIs also provide feedback to the user, such as visual feedback (e.g., using lights or user interface elements), audible feedback (e.g., using sound), tactile feedback (e.g., using vibration), and more.

[0003] While current human-machine interface systems and methods achieve their intended purpose, there is a need for a new and improved system and method for controlling electronic devices. Description

[0004] A system for controlling vehicle components is provided for a vehicle, based on several aspects. The system can include a variety of vehicle components, a universal human-interface device (HID) capable of receiving occupant input and controlling any of the vehicle components, and a vehicle controller in electrical communication with the vehicle components and the universal HID. The vehicle controller is programmed to identify a selected component from the vehicle components. The vehicle controller is programmed to receive the occupant input using the universal HID. The vehicle controller is programmed to adjust the operation of the selected component based, at least partially, on the occupant input.

[0005] In another aspect of this description, the system may also include an occupant monitoring system (OMS) that communicates electrically with the vehicle control unit and is operational to determine the gaze direction of a vehicle occupant. To determine the selected component, the vehicle control unit is further programmed to receive an activation occupant input using the universal HID. To determine the selected component, the vehicle control unit is further programmed to determine the occupant's gaze direction using the OMS in response to receiving the activation occupant input. Finally, to determine the selected component, the vehicle control unit is further programmed to identify the selected component based, at least partially, on the gaze direction.

[0006] In another aspect of this description, to determine the selected component, the vehicle control unit is further programmed to receive an initial selection input from an occupant using the universal HID. To determine the selected component, the vehicle control unit is further programmed to display a first component from the multitude of vehicle components to a vehicle occupant. To determine the selected component, the vehicle control unit is further programmed to receive a confirmation input from an occupant using the universal HID. To determine the selected component, the vehicle control unit is further programmed to identify the first component as the selected component in response to receiving the confirmation input from the occupant.

[0007] In another aspect of this description, to determine the selected component, the vehicle control unit is further programmed to receive a second selection input from the occupant using the universal HID. To determine the selected component, the vehicle control unit is further programmed to display a second component from the multitude of vehicle components to the vehicle occupant in response to receiving this second selection input.

[0008] In another aspect of this description, the system can further include a light source in electrical communication with the vehicle control unit and located within the vehicle's interior. To display the first component, the vehicle control unit is also programmed to illuminate the light source, thus making the first component visually visible to the vehicle occupant.

[0009] In another aspect of the present description, the light source may further comprise at least one of the following: a headlight, a laser, a projector and one or more light-emitting diodes (LEDs) that are operable to selectively illuminate one or more of the multitude of vehicle components.

[0010] In a further aspect of this description, the system can also include an audio source in electrical communication with the vehicle control unit and located within the vehicle's interior. To indicate the presence of the first component, the vehicle control unit is further programmed to generate a tone using the audio source, thus making the presence of the first component audible to the vehicle occupant.

[0011] In another aspect of the present description, the universal HID has one or more tactile interfaces that are fixed within the reach of one or more vehicle occupants inside the vehicle's interior.

[0012] In another aspect of this description, to receive occupant input using the universal HID and to adjust the operation of the selected component, the vehicle control unit is further programmed to receive a control occupant input using the universal HID. To receive the occupant input using the universal HID and to adjust the operation of the selected component, the vehicle control unit is further programmed to adjust the operation of the selected component based, at least partially, on the control occupant input. To receive the occupant input using the universal HID and to adjust the operation of the selected component, the vehicle control unit is further programmed to provide haptic or force feedback using the universal HID in response to the adjustment of the operation of the selected component.

[0013] In another aspect of the present description, the multitude of vehicle components includes at least one of the following: a vehicle window, a vehicle ventilation system, a vehicle infotainment system, a vehicle door, and a vehicle seat. To adjust the operation of the selected component, the vehicle control unit is further programmed to adjust the window's position based at least partially on the control unit's occupant input in response to the determination that the selected component is the window. To further adjust the operation of the selected component, the vehicle control unit is also programmed to adjust at least one of the following: a temperature setpoint and an airflow level based at least partially on the control unit's occupant input in response to the determination that the selected component is the ventilation system.To adjust the operation of the selected component, the vehicle control unit is further programmed to adjust an audio playback volume based at least partially on the control unit's occupant input in response to the determination that the selected component is the infotainment system. To adjust the operation of the selected component, the vehicle control unit is further programmed to adjust at least one of the following: a door locking state and a door locking state based at least partially on the control unit's occupant input in response to the determination that the selected component is the door. To adjust the operation of the selected component, the vehicle control unit is further programmed to adjust a seat position based at least partially on the control unit's occupant input in response to the determination that the selected component is the seat.

[0014] A method for controlling vehicle components is provided for a vehicle, based on several aspects. The method may include determining a selected component from a multitude of vehicle components. The method may further include receiving occupant input using a universal human-interface device (HID). The method may also include adapting the operation of the selected component based, at least partially, on the occupant input.

[0015] In another aspect of this description, determining the selected component may further involve receiving an activation occupant input from a vehicle occupant using the universal HID. Determining the selected component may further involve determining the occupant's gaze direction using an occupant monitoring system (OMS) in response to receiving the activation occupant input. Determining the selected component may also involve identifying the selected component based, at least in part, on the gaze direction.

[0016] In another aspect of this description, determining the selected component can further involve receiving an initial selection input from a vehicle occupant using the universal HID. Determining the selected component can further involve displaying the first component from the multitude of vehicle components to a vehicle occupant. Determining the selected component can further involve receiving a confirmation input from a vehicle occupant using the universal HID. Determining the selected component can further involve identifying the first component in response to receiving the confirmation input as the selected component.

[0017] In another aspect of the present description, displaying the first component may further comprise illuminating a light source to visually indicate the first component to the vehicle occupant. The light source comprises at least one of the following: a headlight, a laser, a projector, and one or more light-emitting diodes (LEDs) operable to selectively illuminate one or more of the plurality of vehicle components.

[0018] In another aspect of this description, receiving occupant input using the universal HID can further involve receiving occupant input using the universal HID. The universal HID has one or more tactile interfaces that are fixed within reach of one or more vehicle occupants inside the vehicle's interior. The universal HID is operable to provide haptic feedback.

[0019] In another aspect of this description, receiving occupant input using the universal HID and adapting the operation of the selected component can further include receiving control occupant input using the universal HID. Receiving occupant input using the universal HID and adapting the operation of the selected component can further include adapting the operation of the selected component based, at least partially, on the control occupant input. Receiving occupant input using the universal HID and adapting the operation of the selected component can further include providing haptic feedback using the universal HID in response to the adaptation of the operation of the selected component.

[0020] In another aspect of this description, adjusting the operation of the selected component may further include adjusting the position of a window based at least partially on the control occupant input in response to the determination that the selected component is the window. Adjusting the operation of the selected component may further include adjusting at least one of the following: a temperature setpoint and an airflow level based at least partially on the control occupant input in response to the determination that the selected component is a ventilation system. Adjusting the operation of the selected component may further include adjusting an audio playback volume based at least partially on the control occupant input in response to the determination that the selected component is an infotainment system.Adjusting the operation of the selected component may further include adjusting at least one of the following: a door locking state and a door locking state based at least partially on the control occupant input in response to the determination that the selected component is a door. Adjusting the operation of the selected component may further include adjusting a seat position based at least partially on the control occupant input in response to the determination that the selected component is a seat.

[0021] A system for controlling electronic devices is provided according to several aspects. The system can include a variety of electronic devices, a universal human-interface device (HID) capable of receiving user input and controlling any of the variety of electronic devices, and a controller in electrical communication with the variety of electronic devices and the universal HID. The controller is programmed to determine a selected device from the variety of electronic devices using the universal HID, based at least partially on the orientation of the universal HID in three-dimensional space. The controller is further programmed to receive user input using the universal HID.The control system is also programmed to adapt the operation of the selected device based, at least partially, on user input.

[0022] In another aspect of the present description, to determine the selected device, the controller is further programmed to determine the orientation of the universal HID in three-dimensional space. To determine the selected device, the controller is further programmed to determine a pointing direction of the universal HID based at least partially on the orientation of the universal HID. To determine the selected device, the controller is further programmed to determine the selected device based at least partially on the pointing direction of the universal HID.

[0023] In another aspect of this description, to receive user input using the universal HID and to adapt the operation of the selected device, the controller is further programmed to receive control user input using the universal HID. The control user input includes at least one of the following: pressing a button on the universal HID and performing a physical gesture using the universal HID. To receive the user input using the universal HID and to adapt the operation of the selected device, the controller is further programmed to adapt the operation of the selected device based, at least partially, on the control user input.In order to receive user input using the universal HID and to adjust the operation of the selected device, the controller is further programmed to provide haptic feedback using the universal HID in response to adjustments to the operation of the selected device.

[0024] Further areas of application will become apparent from the description provided herein. It is understood that the description and specific examples serve only as illustrations and are not intended to limit the scope of this description. Brief description of the drawings

[0025] The drawings described herein serve only as illustrations and are not intended to limit the scope of the present description in any way. Fig. Figure 1 is a schematic diagram of a first exemplary embodiment for controlling electronic devices according to an exemplary embodiment; Fig. Figure 2 is a schematic diagram of a second exemplary embodiment for controlling electronic devices according to an exemplary embodiment; Fig. Figure 3 is a flowchart of a method for controlling electronic devices according to an exemplary embodiment; Fig. 4 is a flowchart of a first exemplary embodiment of a method for selecting an electronic device for the method of Fig. 3 according to an exemplary embodiment; Fig. Figure 5 is a schematic diagram of an exemplary vehicle interior, which includes a vehicle occupant, according to an exemplary embodiment; Fig. Figure 6 is a flowchart of a second exemplary embodiment of a method for selecting an electronic device for the method of Fig. 3 according to an exemplary embodiment; and Fig. 7 is a flowchart of a third exemplary embodiment of a method for selecting an electronic device for the method of Fig. 3 according to an exemplary embodiment. Detailed description

[0026] The following description is merely exemplary and is not intended to limit the present description, application or uses.

[0027] In aspects described herein, users may wish to customize the operation of electronic devices (such as vehicle components, smart home devices, and / or the like). However, in environments with many devices, users may need to interact with numerous interfaces or human-interface devices to select and control a device. Therefore, this description presents a new and improved system and method for controlling electronic devices that requires minimal effort from the user to select a device and provides a consistent control interface across multiple devices.

[0028] With reference to Fig. Figure 1 illustrates a first exemplary embodiment of a system for controlling electronic devices and is generally designated by reference numeral 10a. System 10a is described in connection with an exemplary vehicle 12 and is also referred to as a system for controlling vehicle components. Although a passenger car is illustrated, it is understood that the vehicle 12 can be any type of vehicle without deviating from the scope of this description. System 10a generally comprises a vehicle controller 14, a universal human-interface device (HID) 16, one or more display devices 18, an occupant monitoring system (OMS) 20, and a plurality of vehicle components 22.

[0029] The vehicle controller 14 is used to implement a method 100 for controlling vehicle components or electronic devices, as described below. The vehicle controller 14 comprises at least one processor 24 and a non-volatile, computer-readable memory device or non-volatile, computer-readable storage medium 26. The processor 24 can be a custom or commercially available processor, a central processing unit (CPU), a graphics processing unit (GPU), an auxiliary processor among several processors associated with the vehicle controller 14, a microprocessor-based semiconductor (in the form of a microchip or chipset), a macroprocessor, a combination thereof, or generally, an instruction-executing device.

[0030] The computer-readable storage device or computer-readable storage medium 26 can include volatile and non-volatile storage in read-only memory (ROM), random-access memory (RAM), and keep-alive memory (KAM). KAM is a persistent or non-volatile memory that can be used to store various operating variables while the processor 24 is turned off.The computer-readable storage device or computer-readable storage medium 26 may be implemented using a number of storage devices, such as PROMs (programmable read-only memory), EPROMs (electrical PROM), EEPROMs (electrically erasable PROM), flash memory, or other electrical, magnetic, optical, or combination storage devices capable of storing data, some of which may be executable instructions used by the vehicle control unit 14 to control various systems of the vehicle 12.

[0031] The vehicle control unit 14 can also have multiple vehicle control units that communicate electrically with each other. The vehicle control unit 14 can be connected to additional systems and / or vehicle control units of the vehicle 12, which allows the vehicle control unit 14 to access data such as speed, acceleration, braking, and steering angle of the vehicle 12.

[0032] The vehicle control unit 14 communicates electrically with the universal HID 16, the one or more display devices 18, the OMS 20, and the multitude of vehicle components 22. In an exemplary embodiment, the electrical communication is established, for example, using a CAN network, a FLEXRAY network, a local area network (e.g., WiFi, Ethernet, and the like), a serial peripheral interface (SPI) network, or the like. It is understood that various additional wired and wireless techniques and communication protocols for communicating with the vehicle control unit 14 are within the scope of this description. It is further understood that, within the scope of this description, the electrical communication also includes power and / or energy transfer between electrical devices (e.g.,using conductive wires and / or wireless power transmission techniques).

[0033] The universal HID 16 is used to receive occupant or user input and to control any of the multitude of vehicle components 22. In an exemplary embodiment, the universal HID 16 has one or more tactile interfaces located within an interior space of the vehicle 12 within the reach of one or more vehicle occupants 82 ( Fig. 5) of the vehicle 12. In one non-limiting example, the universal HID 16 includes one or more knobs, buttons, switches, joysticks, rotary switches, capacitive switches, and / or the like. In another non-limiting example, the universal HID 16 includes one or more touchpads, touchscreens, trackpads, and / or the like. In one non-limiting example, the universal HID 16 has capabilities to provide haptic feedback, including, for example, a vibration motor. In another non-limiting example, the universal HID 16 further includes one or more microphones for receiving speech provided by the occupant or user and for performing speech recognition to determine occupant or user input.It is understood that the universal HID 16 can have any interface device that can be operated by one or more hands of the vehicle occupant 82 (. Fig. 5) or is user-operable.

[0034] In one exemplary embodiment, the universal HID 16 is fixed within the interior of the vehicle 12, for example within a center console, an instrument panel, a dashboard, a door panel, an armrest and / or the like. In another exemplary embodiment, the universal HID 16 is a portable remote control that can be operated in three-dimensional space by the vehicle occupant 82 ( Fig. 5) or can be operated by the user. The universal HID 16 communicates electrically with the vehicle control unit 14, as discussed above. In some embodiments, the vehicle control unit 14 is contained within the universal HID 16.

[0035] The one or more display devices 18 are used to inform the vehicle occupant 82 ( Fig. 5) or provide information to the user. In an exemplary embodiment, the one or more display devices 18 are used to display one or more of the plurality of vehicle components 22 to the vehicle occupant 82 ( Fig. 5) or to highlight, announce and / or otherwise indicate to users, as discussed in more detail below with reference to Method 100. In an exemplary embodiment, the one or more display devices 18 comprise at least one of the following: a laser 30, one or more light-emitting diodes (LEDs) 32 and an audio source 34.

[0036] The laser 30 is used to point at one of the plurality of vehicle components 22 using a focused beam of light. In a non-limiting example, the laser 30 is attached to an electronically controllable and movable mounting device in electrical communication with the vehicle control unit 14, such that at least one pitch and yaw motion of the laser 30 is adjustable to direct the focused beam of light at one or more of the plurality of vehicle components 22. In another non-limiting example, the laser 30 is attached to the headliner of the vehicle 12. The laser 30 is in electrical communication with the vehicle control unit 14.

[0037] The one or more LEDs 32 are used to generate light to illuminate the vehicle occupants 82 ( Fig. 5) or to draw the user's attention to one or more of the multitude of vehicle components 22. In one exemplary embodiment, the one or more LEDs 32 are arranged in LED strips and / or strings distributed throughout the interior of the vehicle 12. In a non-limiting example, one or more LEDs 32 are arranged on or near the window 40 (discussed below). Therefore, by illuminating the one or more LEDs 32, the vehicle occupant 82 ( Fig. 5) or the user's attention is drawn to window 40 (discussed below).

[0038] In another exemplary embodiment, the one or more LEDs 32 are arranged to function as a headlight. In a non-limiting example, the one or more LEDs 32 are attached to an electronically controllable and movable mounting device in electrical communication with the vehicle control unit 14, such that at least one pitch and yaw movement of the one or more LEDs 32 is adjustable to direct the headlight onto one or more of the plurality of vehicle components 22. In a non-limiting example, the headlight is attached to the headliner of the vehicle 12.

[0039] In another exemplary embodiment, the one or more LEDs 32 are arranged in a configuration to function as a projector. In a non-limiting example, the one or more LEDs 32 are individually controllable by the vehicle controller 14 to provide a projection field within the interior of the vehicle 12. The vehicle controller 14 is configured to use the one or more LEDs 32 to display symbols, graphics, and / or text to indicate one or more of the plurality of vehicle components 22 (i.e., to the vehicle occupants 82). Fig. 5) or to draw the user's attention to it). In a non-restrictive example, the projector is attached to the headliner of the vehicle 12. The one or more LEDs 32 are in electrical communication with the vehicle control unit 14, as discussed above.

[0040] Audio source 34 is used to provide vehicle occupant 82 ( Fig. 5) or to provide the user with audible feedback. In an exemplary embodiment, the audio source 34 is a loudspeaker, such as an electroacoustic transducer, for converting electrical signals into sound waves that are perceived by the vehicle occupant 82 ( Fig. 5) or are audible to the user. In a non-restrictive example, the vehicle control unit 14 uses speech synthesis and the audio source 34 to provide natural language acoustic announcements to indicate one or more of the multitude of vehicle components 22 (i.e., to the vehicle occupants 82 ( Fig. 5) or to draw the user's attention to it). The audio source 34 is in electrical communication with the vehicle control unit 14, as discussed above.

[0041] It is understood that the one or more display devices may include 18 additional light sources, light arrangements, projector types, audio sources and / or the like, without deviating from the scope of the present description.

[0042] The occupant monitoring system (OMS) 20 is used to determine the direction of view of the vehicle occupant 82 ( Fig. 5) to determine within the vehicle 12. In an exemplary embodiment, the OMS 20 has one or more infrared (IR) cameras positioned inside the vehicle 12 to capture images of the vehicle occupant 82 ( Fig. 5) to record. The OMS further incorporates an image processor (not shown) in electrical communication with the IR cameras. The IR cameras capture high-resolution images of the occupant's face and eyes, and the image processor analyzes the images to determine the occupant's gaze direction. The OMS 20 uses reflected IR light from the eyes and surrounding facial features to track the orientation and position of the eyes, enabling the OMS 20 to calculate the gaze direction based on the processed image data. The OMS 20 is in electrical communication with the vehicle control unit 14, as discussed above.

[0043] The plurality of vehicle components 22 is used to provide various features for the occupants of the vehicle 12. In an exemplary embodiment, the plurality of vehicle components 22 comprises at least one of the following: a window 40 of the vehicle 12, a ventilation system 42 of the vehicle 12, an infotainment system 44 of the vehicle 12, a door 46 of the vehicle 12, and a seat 48 of the vehicle 12.

[0044] Window 40 is used to provide access to vehicle occupant 82 ( Fig. 5) or to provide the user with visibility and / or fresh air. In the Fig. In the exemplary embodiment shown in Figure 1, the window 40 is included as part of a sunroof of the vehicle 12. The window 40 can also be included in the door 46 of the vehicle 12. It is understood that the window 40 can be any transparent or semi-transparent component that allows the vehicle occupant 82 ( Fig. 5) or allows the user to look outside the vehicle 12. The window 40 further includes an actuation mechanism (not shown) that allows the window 40 to be opened and closed (i.e., by raising, lowering, and / or tilting the window 40). In a non-restrictive example, the actuation mechanism is electrically driven and communicates electrically with the vehicle control unit 14. Accordingly, the vehicle control unit 14 can send signals to the actuation mechanism to open and close the window 40.

[0045] The ventilation system 42 is used to control the airflow within the interior of the vehicle 12. The ventilation system 42 is used to improve occupant comfort by regulating the temperature and humidity inside the vehicle 12. In an exemplary embodiment, the ventilation system 42 comprises a blower (not shown), air guide vanes (not shown), a temperature control (not shown), ventilation outlets (not shown), and a ventilation interface 60 ( Fig. 5) on.

[0046] The blower is an electrically driven fan that generates the airflow in the ventilation system 42. The air guide vanes are electrically actuated surfaces within the ventilation system 42 that are used to direct the airflow within the ventilation system 42. By moving the air guide vanes, the ventilation system 42 can control a proportion of the total volume of airflow generated by the blower that is directed to each of the ventilation outlets. The temperature control allows the ventilation system 42 to control the temperature of the airflow throughout the entire ventilation system 42. The ventilation outlets provide the airflow for the interior of the vehicle 12. In an exemplary embodiment, the ventilation outlets are configured to provide an airflow for the occupants of the vehicle 12 to improve occupant comfort. The ventilation interface 60 ( Fig. 5) is used to make it available to the vehicle occupant 82 ( Fig. 5) to enable the control of the ventilation system 42. In a non-restrictive example, the ventilation interface 60 has one or more knobs, buttons, sliders, touchscreens or other controls that enable the vehicle occupant 82 ( Fig. 5) enable adjustment of the blower, air deflectors and temperature control of the ventilation system 42.

[0047] The ventilation system 42 is in electrical communication with the vehicle control unit 14, as described above. The blower, air guide vanes, and temperature control of the ventilation system 42 can be controlled automatically by the vehicle control unit 14 or in response to an input from the vehicle occupant 82 ( Fig. 5) be controlled into the ventilation interface 60.

[0048] The infotainment system 44 is used to provide information and entertainment for the vehicle occupant 82 ( Fig. 5) to provide and / or to enhance vehicle control capabilities for the vehicle occupant 82 ( Fig. 5) provide. In an exemplary embodiment, the infotainment system 44 includes a human-machine interface (HMI), a sound system, and a navigation system. The HMI is used to provide information to the vehicle occupant 82 ( Fig. 5) to provide. In an exemplary embodiment, the HMI is a display located within the view of the vehicle occupant 82 ( Fig. 5) is located and is capable of displaying text, graphics, and / or images. It is understood that HMI display systems, including LCD displays, LED displays, and the like, are within the scope of this description. Further exemplary embodiments in which the HMI is arranged in a rearview mirror are also within the scope of this description.

[0049] In another exemplary embodiment, the HMI features a head-up display (HUD) configured to provide information to the vehicle occupant 82 ( Fig. 5) to provide by projecting text, graphics and / or images onto the windshield of the vehicle 12. The text, graphics and / or images are reflected from the windshield of the vehicle 12 and are visible to the vehicle occupant 82 ( Fig. 5) visible without looking away from a roadway in front of the vehicle 12. In another exemplary embodiment, the HMI includes an augmented reality head-up display (AR-HUD). The AR-HUD is a type of HUD configured to enhance the occupant's view of the roadway in front of the vehicle 12 by projecting text, graphics, and / or images onto physical objects in the environment around the vehicle 12 within a field of view of the vehicle occupant 82 ( Fig. 5) are superimposed. In a non-restrictive example, the vehicle control unit 14 can control one or more operating parameters of the HMI, including, for example, display brightness, display color, display notification, and / or the like.

[0050] In an exemplary embodiment, the vehicle occupant 82 ( Fig. 5) interact with the infotainment system 44 using a human-interface device (HID), including, for example, a touchscreen, an electromechanical switch, a capacitive switch, a rotary knob, and the like. It is understood that additional systems for displaying information to the vehicle occupant 82 ( Fig. 5) also lie within the scope of the present description.

[0051] The sound system is used to provide entertainment for the vehicle occupants (82) Fig. 5) to provide within the interior of the vehicle 12. In a non-restrictive example, the sound system comprises an amplifier and one or more loudspeakers. The sound system is operable to produce sounds, such as music, for the entertainment of the vehicle occupant 82 ( Fig. 5) to play. In a non-restrictive example, the sounds are supplied to the amplifier from various sources, including, for example, a portable media device, an MP3 player, a smartphone, an internet connection, an AM / FM radio receiver, and / or the like. In an exemplary embodiment, the sound system is controlled by the vehicle occupant 82 ( Fig. 5) controllable via the infotainment system 44, for example by interaction with the HID, as discussed above. Furthermore, the vehicle control unit 14 can adjust one or more operating parameters (e.g., music playback volume, music playback genre, and / or the like) of the sound system via electrical communication with the infotainment system 44, as discussed in more detail below.

[0052] The navigation system is used to provide the vehicle occupant with 82 ( Fig. 5) To provide information about navigation routes and destinations while the vehicle 12 is in operation. In an exemplary embodiment, the navigation system includes a global navigation satellite system (GNSS). The GNSS is used to determine the geographic location of the vehicle 12. In an exemplary embodiment, the GNSS is a global positioning system (GPS). In a non-limiting example, the GPS includes a GPS receiver antenna (not shown) and a GPS controller (not shown) in electrical communication with the GPS receiver antenna. The GPS receiver antenna receives signals from a plurality of satellites, and the GPS controller calculates the geographic location of the vehicle 12 based on the signals received by the GPS receiver antenna. In an exemplary embodiment, the GNSS additionally includes a map.The map contains information about infrastructure such as municipal boundaries, roads, railways, sidewalks, buildings, and the like. Therefore, the geographic location of vehicle 12 is contextualized using the map information. In one non-restrictive example, the map is retrieved from a remote source using a wireless connection. In another non-restrictive example, the map is stored in a GNSS database. It is understood that various additional types of satellite-based radio navigation systems, such as the Global Positioning System (GPS), Galileo, GLONASS, and the BeiDou Navigation Satellite System (BDS), are within the scope of this description.

[0053] Based on the vehicle's geographic location and map information obtained from the GNSS, the navigation system calculates an optimal route to a destination chosen by the vehicle occupants. Fig. 5) is selected. In an exemplary embodiment, the navigation system is selected by the vehicle occupant 82 ( Fig. 5) The selection of destination and route parameters can be controlled via the infotainment system 44, for example by interaction with the HID, as discussed above. The infotainment system 44 communicates electrically with the vehicle control unit 14, as described above.

[0054] The door 46 is used to provide access to the interior of the vehicle 12. In an exemplary embodiment, the door 46 has a door locking and latching mechanism 46a. The door locking and latching mechanism 46a is used to lock the door 46 in a closed position and to prevent the door 46 from being unlocked and opened. In an exemplary embodiment, the door locking and latching mechanism 46a is configured to be operated both manually by the vehicle occupant 82 ( Fig. 5) as well as being operated electronically by the vehicle control unit 14, so that the vehicle control unit 14 can transmit electrical signals for both locking / unlocking and locking / unlocking the door 46. The door locking and unlocking mechanism 46a is in electrical communication with the vehicle control unit 14, as described above.

[0055] Seat 48 is used to provide a comfortable seating position for vehicle occupant 82 ( Fig. 5) provide. In a non-limiting example, the seat 48 is a driver's seat of the vehicle 12, located near a steering wheel and / or accelerator pedals of the vehicle 12. In another non-limiting example, the seat 48 is a passenger seat located next to the driver's seat and / or in a rear passenger compartment of the vehicle 12. It is understood that the seat 48 can be any seat of the vehicle 12. In an exemplary embodiment, the seat 48 is adjustable along one or more axes, such as forward, backward, up, or down, to achieve an optimal seating position. In a non-limiting example, the seat 48 has multiple actuators (not shown). Each actuator is configured to adjust a specific axis of the seating position. In a non-limiting example, the actuators are controllable by buttons, switches, and / or knobs located inside the vehicle 12.In another non-restrictive example, the actuators are in electrical communication with the vehicle control unit 14, as discussed above.

[0056] It is understood that the multitude of vehicle components 22 discussed above is merely exemplary and that the multitude of vehicle components 22 may further include any additional electronically controllable components of the vehicle 12, such as storage compartments (e.g. a glove compartment), lights, mirrors (e.g. rearview mirrors and / or side mirrors) and / or the like.

[0057] With reference to Fig. Figure 2 illustrates a second exemplary embodiment of a system for controlling electronic devices and is generally designated by reference numeral 10b. System 10b is described in connection with an exemplary room 62. Although a residential area is illustrated, it is understood that room 62 can be any type of room without altering the scope of this description. System 10b generally comprises a room controller 64, a portable universal HID 66, and a plurality of electronic devices 68.

[0058] The room control unit 64 is used to control the system 10b and to execute the method 100. In an exemplary embodiment, the room control unit 64 is essentially similar to the vehicle control unit 14 discussed above in terms of structure, components, and operation. In a non-limiting example, the room control unit 64 is integrated into one of the plurality of electronic devices 68, as shown in Fig. Figure 2 shows. In a non-limiting example, the room controller 64 further has wireless receiving capabilities to receive signals from the portable universal HID 66 and to determine an orientation of the portable universal HID 66, as discussed in more detail below. In an exemplary embodiment, the room controller 64 is configured to receive user commands from the portable universal HID 66 and to communicate with and control each of the plurality of electronic devices 68.

[0059] The room controller 64 communicates electrically with the portable universal HID 66 and the plurality of electronic devices 68. In one exemplary embodiment, the electrical communication is established, for example, using a CAN network, a FLEXRAY network, a local area network (e.g., WiFi, Ethernet, and the like), a serial peripheral interface (SPI) network, or the like. It is understood that various additional wired and wireless techniques and communication protocols for communicating with the room controller 64 are within the scope of this description. It is further understood that, within the scope of this description, the electrical communication also includes power and / or energy transfer between electrical devices (e.g., using conductive wires and / or wireless power transfer techniques).

[0060] The portable universal HID 66 is used to receive user input and control any of the plurality of electronic devices 68. In an exemplary embodiment, the portable universal HID 66 is essentially similar in structure, components, and operation to the universal HID 16 discussed above with reference to System 10a. Furthermore, the portable universal HID 66 is configured to be portable and actuated in three-dimensional space to receive user input and control any of the plurality of electronic devices 68. In a non-limiting example, the portable universal HID 66 further includes one or more position and orientation sensors, such as gyroscopes, accelerometers, and / or the like.The portable universal HID 66 may further include one or more transmitters, such as infrared (IR) transmitters, Bluetooth transceivers, wireless local area network (WLAN) transceivers, and / or the like, for transmitting control and orientation data to the room controller 64. In a non-limiting example, the portable universal HID 66 may further include one or more buttons, switches, joysticks, knobs, touchpads, touchscreens, and / or the like for receiving user input. In a non-limiting example, the portable universal HID 66 may further include capabilities to provide the user with visual, audible, haptic, and / or force feedback. The portable universal HID 66 communicates electrically with the room controller 64, as discussed above.

[0061] The plurality of electronic devices 68 is used to provide various features for occupants or users of the room 62. In an exemplary embodiment, the plurality of electronic devices 68 comprises at least one of the following: a room lamp 70, a room window lock 72, and a room ventilation system 74.

[0062] The room lamp 70 is used to provide lighting within the room 62. In an exemplary embodiment, the room lamp 70 also houses the room controller 64. It is understood that the room controller 64 can be integrated into any of the plurality of electronic devices 68, the portable universal HID 66, or as a standalone device within the scope of this description. In an exemplary embodiment, the room lamp 70 has one or more switches, relays, or other electronic circuits that allow the room lamp 70 to be electronically controlled via wired or wireless communication with the room controller 64.

[0063] The room window lock 72 is used to secure a window of room 62 to prevent the window from being opened. In an exemplary embodiment, the room window lock 72 comprises one or more switches, relays, solenoids, motors and / or other electronic circuits and / or electromechanical components that allow the room window lock 72 to be electronically controlled (i.e., locked and unlocked) via wired or wireless communication with the room controller 64.

[0064] The room ventilation system 74 is used to control the climate within the room 62. In an exemplary embodiment, the room ventilation system 74 includes an air conditioning and / or heating system. In an exemplary embodiment, the room ventilation system 74 includes one or more switches, relays, solenoids, motors, and / or other electronic circuits and / or electromechanical components that allow the room ventilation system 74 to be electronically controlled via wired or wireless communication with the room controller 64 (i.e., activating / deactivating the room ventilation system 74, changing a temperature setpoint of the room ventilation system 74, etc.).

[0065] In one exemplary embodiment, each of the plurality of electronic devices 68 is in wired or wireless electrical communication with one another. In a non-limiting example, each of the plurality of electronic devices 68 participates in a peer-to-peer network, a mesh network, a wireless local area network (WLAN), and / or the like. Therefore, the room controller 64 provides commands that control each of the plurality of electronic devices 68.

[0066] It is understood that the multitude of electronic devices 68 discussed above is merely exemplary and that the multitude of electronic devices 68 may furthermore include any additional electronically controllable devices in the room 62, such as, for example, additional light sources, door / window locks, fans, appliances (e.g. a coffee machine), entertainment devices (e.g. televisions, radios, stereo systems, etc.) and / or the like.

[0067] It is also understood that systems 10a and 10b are merely exemplary and that the present description is also applicable to various additional applications, such as entertainment (e.g., controlling a light show), heavy industry (e.g., controlling heavy machinery / equipment), logistics (e.g., controlling shipping ports and facilities), and other vehicles (e.g., aircraft, watercraft, etc.).

[0068] With reference to Fig. Section 3 provides a flowchart of procedure 100 for controlling vehicle components or electronic devices. It is understood that procedure 100 is applicable to both system 10a and system 10b. Procedure 100 begins at block 102 and proceeds to block 104.

[0069] In connection with system 10a, the vehicle control unit 14 at block 104 selects a component from the plurality of vehicle components 22, as discussed in more detail below. In connection with system 10b, the room control unit 64 at block 104 selects a device from the plurality of electronic devices 68. After block 104, the procedure 100 proceeds to block 106.

[0070] In connection with system 10a, the vehicle control unit 14 at block 106 receives an occupant input using the universal HID 16 to control the selected component. In an exemplary embodiment, the occupant input is a control occupant input. For the purposes of this description, a control occupant input is an occupant input intended to control one of the plurality of vehicle components 22. In a non-limiting example, the control occupant input includes pressing a button on the universal HID 16, turning a knob on the universal HID 16, and / or the like.

[0071] In connection with system 10b, the room controller 64 receives a user input at block 106 using the portable universal HID 66 to control the selected device. In an exemplary embodiment, the user input is a control user input. For the purposes of this description, a control user input is a user input intended to control one of the plurality of electronic devices 68. In a non-limiting example, the control user input includes pressing a button on the portable universal HID 66, turning a knob on the portable universal HID 66, a physical gesture performed using the portable universal HID 66, and / or the like. After block 106, the method 100 proceeds to block 108.

[0072] In connection with system 10a, the vehicle control unit 14 at block 108 adjusts the operation of the selected component, determined at block 104, based on the occupant input determined at block 106. In a non-restrictive example where the selected component is window 40, the vehicle control unit 14 adjusts the position of window 40 based on the occupant input (i.e., opens / closes window 40). For example, if the occupant input is a clockwise rotation of a knob, the vehicle control unit 14 closes window 40 proportionally to the amount of rotation. If the occupant input is a counterclockwise rotation of the knob, the vehicle control unit 14 opens window 40 proportionally to the amount of rotation.In a non-restrictive example where the selected component is the ventilation system 42, the vehicle control unit 14 adjusts at least one of the following: a temperature setpoint of the ventilation system 42 and an airflow level of the ventilation system 42 based on the occupant input. For example, if the occupant input is a clockwise rotation of a knob, the vehicle control unit 14 increases the temperature setpoint proportionally to the amount of rotation. If the occupant input is a counterclockwise rotation of the knob, the vehicle control unit 14 decreases the temperature setpoint proportionally to the amount of rotation.

[0073] In a non-restrictive example where the selected component is the infotainment system 44, the vehicle control 14 adjusts the audio playback volume of the infotainment system 44 based on occupant input. For example, if the occupant input is a clockwise rotation of a knob, the vehicle control 14 increases the audio playback volume proportionally to the amount of rotation. If the occupant input is a counterclockwise rotation of the knob, the vehicle control 14 decreases the audio playback volume proportionally to the amount of rotation. In a non-restrictive example where the selected component is the door 46, the vehicle control 14 adjusts at least one of the following: a door locking state (i.e., whether the door 46 is held in a closed position or not) and a door unlocking state (i.e., whether the door can be unlocked or not) based on occupant input.For example, if the occupant input involves pressing a first button, the vehicle control unit 14 unlocks the door locking and latching mechanism 46a. If the occupant input involves pressing a second button, the vehicle control unit 14 locks the door locking and latching mechanism 46a.

[0074] In a non-restrictive example where the selected component is seat 48, the vehicle control unit 14 adjusts the seat position of seat 48 based on the occupant input. For example, if the occupant input is a clockwise rotation of a knob, the vehicle control unit 14 moves seat 48 forward proportionally to the amount of rotation. If the occupant input is a counterclockwise rotation of the knob, the vehicle control unit 14 moves seat 48 backward proportionally to the amount of rotation.

[0075] In connection with system 10b, the room control unit 64 at block 108 adjusts the operation of the selected device, determined at block 104, based on the user input determined at block 106. In a non-restrictive example where the selected device is the room lamp 70, the room control unit 64 turns the room lamp 70 on or off based on the occupant input. For example, if the user input involves pressing a first button, the room control unit 64 turns the room lamp 70 on. If the user input involves pressing a second button, the room control unit 64 turns the room lamp 70 off. In a non-restrictive example where the selected device is the room window lock 72, the room control unit 64 locks or unlocks the room window lock 72 based on the user input.For example, if the user input involves pressing a first button, the room controller 64 unlocks the room window lock 72. If the user input involves pressing a second button, the room controller 64 locks the room window lock 72. In a non-restrictive example where the selected device is the room ventilation system 74, the room controller adjusts a temperature setpoint of the room ventilation system 74 based on the user input. For example, if the user input is an upward gesture, the room controller 64 increases the temperature setpoint. If the user input is a downward gesture, the room controller 64 decreases the temperature setpoint. After block 108, the procedure 100 proceeds to block 110 to enter a standby state.

[0076] In one exemplary embodiment, the method 100 repeatedly leaves the ready state 110 and restarts at block 102. In a non-restrictive example, the method 100 leaves the ready state 110 and restarts on a timer, for example, every three hundred milliseconds.

[0077] With reference to Fig. Figure 4 shows a flowchart of a first exemplary embodiment 104a of block 104. For the first exemplary embodiment 104a of block 104, the one or more display devices 18 are not required, and the OMS 20 is used, as discussed below. The first exemplary embodiment 104a of block 104 begins at block 402. At block 402, the vehicle control unit 14 receives an activation occupant input using the universal HID 16. For the purposes of this description, the activation occupant input is an input by the vehicle occupant 82 ( Fig. 5), which indicates an intention to activate gaze detection. According to block 402, the first exemplary embodiment 104a transitions from block 104 to block 404 in response to receiving the activation occupant input.

[0078] With reference to Fig. Figure 5 shows a schematic diagram of an exemplary vehicle interior 80. The exemplary vehicle interior 80 contains the vehicle occupant 82. With reference to Fig. 4 and Fig. 5 uses the vehicle control 14 at block 404 in response to receiving the activation occupant input at block 402, the OMS 20, to determine the gaze direction of the vehicle occupant 82. In a non-restrictive example, the gaze direction of the vehicle occupant 82 is defined by a gaze direction vector and a gaze origin point. Fig. 5. The direction of view of vehicle occupant 82 is indicated by a dashed line 84. With renewed reference to Fig. 4 The first exemplary embodiment 104a goes from block 104 to block 404 to block 406.

[0079] At block 406, the vehicle controller 14 identifies the selected component based at least partially on the gaze direction determined at block 404. In one exemplary embodiment, the vehicle controller 14 executes a gaze-crossing machine learning algorithm to identify the selected component. In a non-restrictive example, the gaze-crossing machine learning algorithm is a machine learning algorithm trained on a labeled dataset of gaze direction vectors and gaze origin points and corresponding selected components. In another exemplary embodiment, the vehicle controller 14 projects the gaze direction vector onto a three-dimensional model of the vehicle's interior 12 based on the gaze origin point to identify the selected component.The vehicle control unit 14 then identifies the selected component as one of the multitude of vehicle components 22 with which the projected viewing direction vector intersects. It is understood that the techniques for identifying the selected component based at least partially on the viewing direction discussed above are merely exemplary and that additional methods for identifying the selected component based at least partially on the viewing direction are within the scope of this description. According to Block 406, the first exemplary embodiment 104a is terminated by Block 104, and the method 100 proceeds as discussed above.

[0080] With reference to Fig. Figure 6 shows a flowchart of a second exemplary embodiment 104b of block 104. For the second exemplary embodiment 104b of block 104, the OMS 20 is not required, and the one or more display devices 18 are used, as discussed below. The second exemplary embodiment 104b of block 104 begins at block 602. At block 602, the vehicle control unit 14 receives a first occupant selection input using the universal HID 16. For the purposes of this description, the occupant selection input is an occupant input intended to select one of the plurality of vehicle components 22. In one non-limiting example, the occupant selection input involves rotating a knob on the universal HID 16. In another non-limiting example, the occupant selection input involves pressing a button on the universal HID 16.Following block 602, the second exemplary embodiment 104b transitions from block 104 to block 604.

[0081] At block 604, the vehicle controller 14 displays a first component of the plurality of vehicle components 22 in response to receiving the first selection occupant input at block 602. In one exemplary embodiment, the vehicle controller 14 uses one or more display devices 18 to display the first component. In a non-limiting example, the vehicle controller 14 uses the laser 30 to provide a focused light source that displays the first component. In another non-limiting example, the vehicle controller 14 uses one or more LEDs 32 to illuminate on or near the first component, to provide a spotlight that illuminates the first component, and / or to provide a projection that displays the first component.If the first component is a user interface element (UI element) displayed on the infotainment system's HMI 44, the vehicle control 14 displays a graphic on the HMI showing the UI element. In another non-restrictive example, the vehicle control 14 uses the audio source 34 to announce the selected element to the vehicle occupant 82.

[0082] When a second occupant selection input is received, the vehicle controller 14 uses the one or more display devices 18 to display a second component of the plurality of vehicle components 22. In one exemplary embodiment, the second component is determined based at least partially on the first component and the second occupant selection input. In a non-restrictive example, if the second occupant selection input involves a clockwise rotation of a knob, the second component is determined to be one of the plurality of vehicle components 22 that is located in a clockwise direction relative to the first component from the perspective of the universal HID 16.In a non-restrictive example, if the second occupant selection input involves a counterclockwise rotation of a knob, the second component is determined to be one of the plurality of vehicle components 22 located in a counterclockwise direction relative to the first component from the perspective of the universal HID 16. Following Block 604, the second exemplary embodiment 104b transitions from Block 104 to Block 606.

[0083] In Block 606, the vehicle control unit 14 uses the universal HID 16 to receive an acquiescence occupant input. For the purposes of this description, the acquiescence occupant input is an occupant input intended to indicate a wish to adjust the operation of the first component illuminated in Block 604. Therefore, upon receiving the acquiescence occupant input, the first component is determined to be the selected component, as discussed above. In a non-limiting example, the acquiescence occupant input involves pressing a predetermined button on the universal HID 16 (e.g., a "Select" or "OK" button). Following Block 606, the second exemplary embodiment 104b is completed by Block 104, and Method 100 proceeds as discussed above.

[0084] With reference to Fig. Figure 7 shows a flowchart of a third exemplary embodiment 104c of block 104. With reference to Fig. 2 and Fig. In section 7, the third exemplary embodiment 104c of block 104 uses system 10b. The third exemplary embodiment 104c of block 104 begins at block 702. At block 702, the space controller 64 determines the orientation of the portable universal HID 66 in three-dimensional space. In one exemplary embodiment, the portable universal HID 66 uses one or more position or orientation sensors to determine the orientation of the portable universal HID 66 in three-dimensional space. After block 702, the third exemplary embodiment 104c transitions from block 104 to block 704.

[0085] At block 704, the space controller 64 determines a pointing direction of the portable universal HID 66 based at least partially on the orientation of the portable universal HID 66 determined at block 702. For the purposes of this description, the pointing direction is defined as a direction along a normal vector of a plane that defines a front face of the portable universal HID 66. With reference to Fig.Figure 2 illustrates the pointing direction by a dashed line 86. In one exemplary embodiment, the pointing direction is defined by a pointing direction vector and a pointing direction origin point. In a non-restrictive example, the space controller 64 receives the orientation of the portable universal HID 66 from the portable universal HID 66 to determine the pointing direction and uses a mathematical model of the portable universal HID 66 to determine the pointing direction based on the orientation and geometry of the portable universal HID 66. Following Block 704, the third exemplary embodiment 104c transitions from Block 104 to Block 706.

[0086] At block 706, the spatial controller 64 identifies the selected device based at least partially on the pointing direction determined at block 704. In one exemplary embodiment, the spatial controller 64 executes a pointing-direction intersection machine learning algorithm to identify the selected device. In a non-restrictive example, the pointing-direction intersection machine learning algorithm is a machine learning algorithm trained on a labeled dataset of pointing-direction vectors and pointing-direction origin points and corresponding selected devices in space 62. In another exemplary embodiment, the vehicle controller 14 projects the pointing-direction vector onto a three-dimensional model of space 62 based on the pointing-direction origin point to identify the selected component.The room control 64 then identifies the selected device as one of the plurality of electronic devices 68 with which the projected pointing direction vector intersects. It is understood that the techniques for identifying the selected device based at least partially on the pointing direction discussed above are merely exemplary and that additional methods for identifying the selected device based at least partially on the pointing direction are within the scope of this description. According to Block 706, the third exemplary embodiment 104c of Block 104 is completed, and the method 100 proceeds as discussed above.

[0087] Systems 10a, 10b, and Method 100 of this description offer several advantages. Using Systems 10a and 10b, vehicle occupants or users with reduced mobility or movement capabilities can operate vehicle features or control electronic devices with minimal physical movement. Using System 10a, vehicle occupants can adjust the operation of vehicle components that would otherwise be out of reach. Furthermore, using System 10a, vehicle occupants can intuitively select vehicle components for control based on their gaze direction. Using System 10b, users can intuitively and efficiently adjust the operation of electronic devices (e.g., smart home devices).

[0088] The description provided here is merely exemplary, and variations that do not deviate from the core of the description are to be considered within its scope. Such variations should not be regarded as a departure from the spirit and scope of the description provided.

Claims

[1] System for controlling vehicle components for a vehicle, the system comprising: a large number of vehicle components; a universal human interface device (HID) that can be operated to receive occupant input and control any of the multitude of vehicle components; and A vehicle control unit in electrical communication with the multitude of vehicle components and the universal HID, wherein the vehicle control unit is programmed to: to determine a selected component from the multitude of vehicle components; to receive occupant input using the universal HID; and to adapt the operation of the selected component based at least partially on occupant input. [2] System according to claim 1, further comprising an occupant monitoring system (OMS) in electrical communication with the vehicle control system and operable to determine a direction of view of a vehicle occupant, and wherein, in order to determine the selected component, the vehicle control system is further programmed to: to receive an activation occupant input using the universal HID; to determine the direction of view of the vehicle occupant using the OMS in response to receiving the activation occupant input; and to identify the selected component based at least partially on the viewing direction. [3] System according to claim 1, wherein, in order to determine the selected component, the vehicle control system is further programmed to: to receive an initial selection of inmates using the universal HID; to display a first component of the multitude of vehicle components to a vehicle occupant; to receive an occupant confirmation input using the universal HID; and to determine the first component as the selected component in response to receiving the confirmation occupant input. [4] System according to claim 3, wherein, in order to determine the selected component, the vehicle control system is further programmed to: to receive a second selection inmate input using the universal HID; and to display a second component of the multitude of vehicle components to the vehicle occupant in response to receiving the second selection occupant input. [5] System according to claim 3, further comprising a light source in electrical communication with the vehicle control unit and arranged within an interior of the vehicle, wherein, in order to display the first component, the vehicle control unit is further programmed to: to illuminate the light source in order to visually display the first component to the vehicle occupant. [6] System according to claim 5, wherein the light source further comprises at least one of the following: a headlight, a laser, a projector and one or more light-emitting diodes (LEDs) that are operable to selectively illuminate one or more of the plurality of vehicle components. [7] System according to claim 3, further comprising an audio source in electrical communication with the vehicle control unit and arranged within an interior of the vehicle, wherein, in order to display the first component, the vehicle control unit is further programmed to: to generate a tone using the audio source in order to make the first component audible to the vehicle occupant. [8] System according to claim 1, wherein the universal HID has one or more tactile interfaces which are fixed within the reach of one or more vehicle occupants inside an interior of the vehicle. [9] System according to claim 8, wherein, in order to receive the occupant input using the universal HID and to set the operation of the selected component, the vehicle control is further programmed to: to receive a control occupant input using the universal HID; to adapt the operation of the selected component based at least partially on the control occupant input; and to provide haptic feedback or force feedback using the universal HID in response to adjustments to the operation of the selected component. [10] System according to claim 9, wherein the plurality of vehicle components includes at least one of the following: a window of the vehicle, a ventilation system of the vehicle, an infotainment system of the vehicle, a door of the vehicle and a seat of the vehicle, and wherein, in order to adjust the operation of the selected component, the vehicle control is further programmed to: to adjust the position of the window based at least partially on the control occupant input in response to the determination that the selected component is the window; to adjust at least one of the following: a temperature setpoint and an airflow level based at least partially on the control occupant input in response to the determination that the selected component is the ventilation system; to adjust the audio playback volume based at least partially on control occupant input in response to the determination that the selected component is the infotainment system; to adapt at least one of the following: a door locking state and a door locking state based at least partially on the control occupant input in response to determining that the selected component is the door; and to adjust a seating position based at least partially on the control occupant input in response to the determination that the selected component is the seat.

Citation Information

Patent Citations

  • Method and system for gaze-direction-dependent control of a plurality of functional units, as well as motor vehicles and mobile devices with such a system

    DE102013001384A1

  • Motor vehicle control device with graphical user interface, as well as motor vehicle and method

    DE102013022035A1

  • tracking system and method with associated sensory feedback

    DE102015122489A1

  • System ready switch for eye tracking human machine interaction control system

    US20120169582A1