System and method for controlling electronic devices

By using a universal human-machine interface device and occupant monitoring system, combined with indicator devices, the selected components can be automatically identified and adjusted. This solves the problem that users need to interact with and select devices multiple times in the prior art, and realizes a consistent control interface across devices, thereby improving operational efficiency and user experience.

CN122166015APending Publication Date: 2026-06-09GM GLOBAL TECHNOLOGY OPERATIONS LLC

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
GM GLOBAL TECHNOLOGY OPERATIONS LLC
Filing Date
2025-01-21
Publication Date
2026-06-09

AI Technical Summary

Technical Problem

Existing human-machine interface systems and methods require users to interact with multiple interfaces or devices to select and control electronic devices, resulting in a lack of a consistent control interface and inconvenience in operation.

Method used

It uses a universal human-machine interface (HID) device to communicate with the vehicle or space controller, and combines the occupant monitoring system (OMS) and indicator devices to automatically identify and adjust selected components in the vehicle or space through gaze direction and input confirmation, providing a unified control interface.

Benefits of technology

It enables users to control multiple devices consistently with minimal effort, improving operational efficiency and user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122166015A_ABST
    Figure CN122166015A_ABST
Patent Text Reader

Abstract

A system for controlling vehicle components of a vehicle is provided. The system can include a plurality of vehicle components, a universal human interface device (HID) operable to receive occupant input and control any of the plurality of vehicle components, and a vehicle controller in electrical communication with the plurality of vehicle components and the universal HID. The vehicle controller is programmed to determine a selected component of the plurality of vehicle components. The vehicle controller is programmed to receive occupant input using the universal HID. The vehicle controller is programmed to adjust operation of the selected component based at least in part on the occupant input.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to systems and methods for controlling human-machine interfaces for electronic devices, including vehicle components. Background Technology

[0002] Electronic devices are frequently used to enhance user convenience. For example, a vehicle may include infotainment systems, ventilation systems, lighting systems, window actuators, etc. A house may include lights, door locks, climate control systems, sound systems, etc. Human-Machine Interfaces (HMIs) are used to allow users to interact with electronic devices. In some examples, HMIs utilize physical controls (such as buttons, switches, knobs, and levers) to facilitate user interaction. In other examples, HMIs utilize digital interfaces (such as touchscreens) to facilitate user interaction. In still other examples, HMIs utilize auditory interfaces (such as speech synthesis and speech recognition) to facilitate user interaction. In some examples, HMIs also provide feedback to the user, such as visual feedback (e.g., using lights or user interface elements), auditory feedback (e.g., using sound), and tactile feedback (e.g., using vibration).

[0003] While current human-machine interface systems and methods have achieved their intended purpose, a new and improved system and method is still needed to control electronic devices. Summary of the Invention

[0004] According to several aspects, a system for controlling vehicle components of a vehicle is provided. The system may include a plurality of vehicle components, a universal human-machine interface (HID) device operable to receive occupant input and control any of the plurality of vehicle components, and a vehicle controller electrically communicating with the plurality of vehicle components and the universal HID. The vehicle controller is programmed to identify a selected component among the plurality of vehicle components. The vehicle controller is programmed to receive occupant input using the universal HID. The vehicle controller is programmed to adjust the operation of the selected component based at least in part on the occupant input.

[0005] In another aspect of this disclosure, the system may further include an Occupant Monitoring System (OMS) that is electrically in communication with the vehicle controller and operable to determine the gaze direction of a vehicle occupant. To determine a selected component, the vehicle controller is also programmed to receive active occupant input using a universal HID. To determine a selected component, the vehicle controller is also programmed to determine the gaze direction of the vehicle occupant using the OMS in response to receiving the active occupant input. To determine a selected component, the vehicle controller is also programmed to identify the selected component at least in part based on the gaze direction.

[0006] In another aspect of this disclosure, in order to determine the selected component, the vehicle controller is also programmed to receive a first selection occupant input using a universal HID. To determine the selected component, the vehicle controller is also programmed to indicate a first component among a plurality of vehicle components to the vehicle occupant. To determine the selected component, the vehicle controller is also programmed to receive a confirmation occupant input using a universal HID. To determine the selected component, the vehicle controller is also programmed to determine the first component as the selected component in response to receiving the confirmation occupant input.

[0007] In another aspect of this disclosure, in order to determine the selected component, the vehicle controller is also programmed to receive a second occupant selection input using a universal HID. In order to determine the selected component, the vehicle controller is also programmed to indicate a second component among a plurality of vehicle components to the vehicle occupant in response to receiving the second occupant selection input.

[0008] In another aspect of this disclosure, the system may also include a light source that is electrically in communication with the vehicle controller and disposed within the vehicle. To indicate the first component, the vehicle controller is also programmed to illuminate the light source to visually indicate the first component to the vehicle occupants.

[0009] In another aspect of this disclosure, the light source may also include at least one of the following: a spotlight, a laser, a projector, and one or more light-emitting diodes (LEDs) operable to selectively illuminate one or more of a plurality of vehicle components.

[0010] In another aspect of this disclosure, the system may also include an audio source that is electrically in communication with the vehicle controller and located inside the vehicle. To indicate the first component, the vehicle controller is also programmed to use the audio source to generate sound to provide an audible indication of the first component to the vehicle occupants.

[0011] In another aspect of this disclosure, a generic HID includes one or more tactile interfaces fixed within the reach of one or more vehicle occupants inside the vehicle.

[0012] In another aspect of this disclosure, in order to receive occupant input and adjust the operation of selected components using a universal HID, the vehicle controller is also programmed to receive control occupant input using a universal HID. In order to receive occupant input and adjust the operation of selected components using a universal HID, the vehicle controller is also programmed to adjust the operation of selected components at least in part based on the control occupant input. In order to receive occupant input and adjust the operation of selected components using a universal HID, the vehicle controller is also programmed to provide haptic or force feedback using a universal HID in response to the operation of adjusting the selected components.

[0013] In another aspect of this disclosure, multiple vehicle components include at least one of the following: a vehicle window, a vehicle ventilation system, a vehicle infotainment system, a vehicle door, and a vehicle seat. To adjust the operation of a selected component, the vehicle controller is also programmed to adjust the window position, at least in part based on occupant input, in response to determining that the selected component is a window. To adjust the operation of a selected component, the vehicle controller is also programmed to adjust at least one of the following, at least in part based on occupant input, a temperature setpoint and airflow level, in response to determining that the selected component is a ventilation system. To adjust the operation of a selected component, the vehicle controller is also programmed to adjust the audio playback volume, at least in part based on occupant input, in response to determining that the selected component is an infotainment system. To adjust the operation of a selected component, the vehicle controller is also programmed to adjust at least one of the following, at least in part based on occupant input, a latch state and a door lock state, in response to determining that the selected component is a door. To adjust the operation of a selected component, the vehicle controller is also programmed to adjust the seat position, at least in part based on occupant input, in response to determining that the selected component is a seat.

[0014] According to several aspects, a method for controlling vehicle components of a vehicle is provided. The method may include determining a selected component from a plurality of vehicle components. The method may further include receiving occupant input using a universal human-machine interface (HID) device. The method may also include adjusting the operation of the selected component based at least in part on the occupant input.

[0015] In another aspect of this disclosure, determining the selected component may further include receiving active occupant input from a vehicle occupant using a universal HID. Determining the selected component may also include determining the gaze direction of a vehicle occupant using an Occupant Monitoring System (OMS) in response to receiving the active occupant input. Determining the selected component may further include identifying the selected component at least in part based on the gaze direction.

[0016] In another aspect of this disclosure, determining the selected component may further include receiving a first occupant selection input using a universal HID. Determining the selected component may further include indicating a first component among a plurality of vehicle components to a vehicle occupant. Determining the selected component may further include receiving a confirmation occupant input using a universal HID. Determining the selected component may further include determining the first component as the selected component in response to receiving the confirmation occupant input.

[0017] In another aspect of this disclosure, indicating the first component may further include illuminating a light source to visually indicate the first component to vehicle occupants. The light source includes at least one of the following: a spotlight, a laser, a projector, and one or more light-emitting diodes (LEDs) operable to selectively illuminate one or more of a plurality of vehicle components.

[0018] In another aspect of this disclosure, receiving occupant input using a universal HID may also include receiving occupant input using a universal HID. The universal HID includes one or more haptic interfaces fixed within the vehicle interior and accessible to one or more vehicle occupants. The universal HID is operable to provide haptic feedback.

[0019] In another aspect of this disclosure, the operation of receiving occupant input and adjusting a selected component using a universal HID may further include receiving control occupant input using a universal HID. The operation of receiving occupant input and adjusting a selected component using a universal HID may further include adjusting the selected component at least in part based on the control occupant input. The operation of receiving occupant input and adjusting a selected component using a universal HID may further include providing haptic feedback using a universal HID in response to the adjustment of the selected component.

[0020] In another aspect of this disclosure, adjusting the selected component may further include, in response to determining that the selected component is a window, adjusting the window position based at least in part on control passenger input. Adjusting the selected component may further include, in response to determining that the selected component is a ventilation system, adjusting at least one of the following based at least in part on control occupant input: a temperature setpoint and an airflow level. Adjusting the selected component may further include, in response to determining that the selected component is an infotainment system, adjusting the audio playback volume based at least in part on control occupant input. Adjusting the selected component may further include, in response to determining that the selected component is a door, adjusting at least one of the following based at least in part on control occupant input: a latch state and a door lock state. Adjusting the selected component may further include, in response to determining that the selected component is a seat, adjusting the seat position based at least in part on control occupant input.

[0021] According to several aspects, a system for controlling electronic devices is provided. The system may include a plurality of electronic devices, a universal human-machine interface (HID) device operable to receive user input and control any one of the plurality of electronic devices, and a controller electrically communicating with the plurality of electronic devices and the universal HID. The controller is programmed to use the universal HID to determine a selected device among the plurality of electronic devices, at least in part based on the orientation of the universal HID in three-dimensional space. The controller is also programmed to receive user input using the universal HID. The controller is further programmed to adjust the operation of the selected device, at least in part based on the user input.

[0022] In another aspect of this disclosure, in order to determine the selected device, the controller is also programmed to determine the orientation of the generic HID in three-dimensional space. To determine the selected device, the controller is also programmed to determine the pointing direction of the generic HID based at least in part on the orientation of the generic HID.

[0023] In another aspect of this disclosure, in order to receive user input and adjust the operation of a selected device using a universal HID, the controller is also programmed to receive control user input using a universal HID. Control user input includes at least one of the following: a button activating the universal HID and performing a body gesture using the universal HID. In order to receive user input and adjust the operation of a selected device using a universal HID, the controller is also programmed to adjust the operation of the selected device at least in part based on the control user input. In order to receive user input and adjust the operation of a selected device using a universal HID, the controller is also programmed to provide haptic feedback using a universal HID in response to the operation of adjusting the selected device.

[0024] Further areas of application will become apparent from the description provided herein. It should be understood that these descriptions and specific examples are for illustrative purposes only and are not intended to limit the scope of this disclosure. Attached Figure Description

[0025] The accompanying drawings described herein are for illustrative purposes only and are not intended to limit the scope of this disclosure in any way.

[0026] Figure 1 This is a schematic diagram illustrating a first exemplary embodiment for controlling an electronic device, according to an exemplary embodiment.

[0027] Figure 2 This is a schematic diagram illustrating a second exemplary embodiment for controlling an electronic device, according to an exemplary embodiment.

[0028] Figure 3 This is a flowchart illustrating a method for controlling an electronic device according to an exemplary embodiment;

[0029] Figure 4 According to exemplary embodiments, for use Figure 3 A flowchart of a first exemplary embodiment of a method for selecting an electronic device;

[0030] Figure 5 This is a schematic diagram of an exemplary vehicle interior including vehicle occupants, according to an exemplary embodiment;

[0031] Figure 6 According to exemplary embodiments, for use Figure 3 A flowchart of a second exemplary embodiment of a method for selecting an electronic device; and

[0032] Figure 7 According to exemplary embodiments, for use Figure 3 A flowchart of a third exemplary embodiment of a method for selecting an electronic device. Detailed Implementation

[0033] The following description is merely exemplary in nature and is not intended to limit this disclosure, its application, or its uses.

[0034] In various aspects of this disclosure, users may wish to adjust the operation of electronic devices (e.g., vehicle components, smart home devices). However, in environments with numerous devices, users may need to interact with many different interfaces or human-machine interface devices to select and control the selected devices. Therefore, this disclosure provides a new and improved system and method for controlling electronic devices that requires minimal effort from the user to select the devices to be controlled and provides a consistent control interface across multiple devices.

[0035] refer to Figure 1 A first exemplary embodiment of a system for controlling electronic equipment is shown, and is generally indicated by reference numeral 10a. System 10a is described in the context of an exemplary vehicle 12, and is also referred to as a system for controlling vehicle components. Although a passenger vehicle is shown, it should be understood that vehicle 12 can be any type of vehicle without departing from the scope of this disclosure. System 10a generally includes a vehicle controller 14, a universal human-machine interface device (HID) 16, one or more indicator devices 18, an occupant monitoring system (OMS) 20, and a plurality of vehicle components 22.

[0036] The vehicle controller 14 is used to implement a method 100 for controlling vehicle components or electronic equipment, as described below. The vehicle controller 14 includes at least one processor 24 and a non-transitory computer-readable storage device or medium 26. The processor 24 may be a custom or commercially available processor, a central processing unit (CPU), a graphics processing unit (GPU), an auxiliary processor among a plurality of processors associated with the vehicle controller 14, a semiconductor-based microprocessor (in the form of a microchip or chipset), a macroprocessor, a combination thereof, or generally a device for executing instructions.

[0037] Computer-readable storage device or medium 26 may include volatile and non-volatile storage devices such as read-only memory (ROM), random access memory (RAM), and keep-alive memory (KAM). KAM is persistent or non-volatile memory that can be used to store various operational variables when the processor 24 is powered off. Computer-readable storage device or medium 26 may be implemented using multiple storage devices, such as programmable read-only memory (PROM), electrical PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, or other electrical, magnetic, optical, or combined storage devices capable of storing data, some of which represents executable instructions used by the vehicle controller 14 to control various systems of the vehicle 12.

[0038] Vehicle controller 14 may also include multiple vehicle controllers that are electrically communicating with each other. Vehicle controller 14 may interconnect with additional systems and / or vehicle controllers of vehicle 12, thereby allowing vehicle controller 14 to access data such as the speed, acceleration, braking and steering angle of vehicle 12.

[0039] Vehicle controller 14 communicates electrically with a general-purpose HID 16, one or more indicator devices 18, OMS 20, and multiple vehicle components 22. In exemplary embodiments, networks such as CAN networks, FLEXRAY networks, local area networks (e.g., WiFi, Ethernet), and Serial Peripheral Interface (SPI) networks are used. It should be understood that various additional wired and wireless technologies and communication protocols used for communicating with vehicle controller 14 are within the scope of this disclosure. It should also be understood that, within the scope of this disclosure, electrical communication also includes power and / or energy transfer between electronic devices (e.g., using wired and / or wireless power transfer technologies).

[0040] The universal HID 16 is used to receive occupant or user input and control any of a plurality of vehicle components 22. In an exemplary embodiment, the universal HID 16 includes components disposed inside the vehicle 12 and within one or more vehicle occupant 82s of the vehicle 12. Figure 5 One or more tactile interfaces within reach. In a non-limiting example, the generic HID 16 includes one or more knobs, buttons, switches, joysticks, rotary switches, capacitive switches, etc. In another non-limiting example, the generic HID 16 includes one or more touchpads, touchscreens, touch panels, etc. In a non-limiting example, the generic HID 16 includes the ability to provide tactile feedback, including, for example, a vibration motor. In another non-limiting example, the generic HID 16 also includes one or more microphones for receiving voice provided by an occupant or user and performing voice recognition to determine occupant or user input. It should be understood that the generic HID 16 may include available vehicle occupant 82 ( Figure 5 (or any interface device operated by one or more of the user's hands)

[0041] In an exemplary embodiment, the universal HID 16 is fixed inside the vehicle 12, such as within the center console, dashboard, instrument panel, door panels, armrests, etc. In another exemplary embodiment, the universal HID 16 is a handheld remote control that can be controlled by vehicle occupant 82. Figure 5 Alternatively, the user can manipulate it in three-dimensional space. The universal HID 16 is in electrical communication with the vehicle controller 14, as described above. In some embodiments, the vehicle controller 14 is contained within the universal HID 16.

[0042] One or more indicator devices 18 are used to indicate to vehicle occupants 82 ( Figure 5(or user) to provide information. In an exemplary embodiment, one or more indicator devices 18 are used to provide information to vehicle occupants 82 ( Figure 5 The device may highlight, notify, and / or otherwise indicate one or more of the plurality of vehicle components 22, as will be discussed in more detail below with reference to method 100. In an exemplary embodiment, one or more indicator devices 18 include at least one of the following: a laser 30, one or more light-emitting diodes (LEDs) 32, and an audio source 34.

[0043] Laser 30 is used to direct a focused beam at one of a plurality of vehicle components 22. In a non-limiting example, laser 30 is fixed to an electronically controllable and movable mounting device in electrical communication with vehicle controller 14, such that at least the pitch and yaw of laser 30 are adjustable to aim the focused beam at one or more of the plurality of vehicle components 22. In a non-limiting example, laser 30 is fixed to the roof liner of vehicle 12. Laser 30 is in electrical communication with vehicle controller 14.

[0044] One or more LEDs 32 are used to generate light to illuminate the vehicle occupants 82 ( Figure 5 The user's attention is drawn to one or more of the multiple vehicle components 22. In an exemplary embodiment, one or more LEDs 32 are arranged as LED strips and / or strings throughout the interior of the vehicle 12. In a non-limiting example, one or more LEDs 32 are positioned on or near the window 40 (discussed below). Thus, by illuminating one or more LEDs 32, the vehicle occupant 82 ( Figure 5 Or the user's attention is drawn to the car window 40 (discussed below).

[0045] In another exemplary embodiment, one or more LEDs 32 are arranged in an array to serve as a spotlight. In a non-limiting example, one or more LEDs 32 are fixed to an electronically controllable and movable mounting device in electrical communication with the vehicle controller 14, such that the pitch and deflection of at least the one or more LEDs 32 are adjustable to direct the spotlight toward one or more of a plurality of vehicle components 22. In a non-limiting example, the spotlight is fixed to the roof liner of the vehicle 12.

[0046] In another exemplary embodiment, one or more LEDs 32 are arranged in an array to function as a projector. In a non-limiting example, one or more LEDs 32 may be individually controlled by the vehicle controller 14 to provide a projection field within the vehicle 12. The vehicle controller 14 is configured to use one or more LEDs 32 to display symbols, graphics, and / or text to indicate (i.e., to the vehicle occupants 82) Figure 5(or attract the user's attention to) one or more of the multiple vehicle components 22. In a non-limiting example, the projector is fixed to the roof lining of the vehicle 12. One or more LEDs 32 are in electrical communication with the vehicle controller 14, as described above.

[0047] Audio source 34 is used to transmit audio to vehicle occupants 82 ( Figure 5 () or the user provides auditory feedback. In an exemplary embodiment, the audio source 34 is a speaker, such as an electroacoustic transducer, for converting electrical signals into signals for vehicle occupant 82 ( Figure 5 (or sound waves audible to the user.) In a non-limiting example, vehicle controller 14 uses speech synthesis and audio source 34 to provide audible natural language announcements to instruct (i.e., to move vehicle occupants 82) Figure 5 (or the user's attention is drawn to) one or more of the multiple vehicle components 22. The audio source 34 is in electrical communication with the vehicle controller 14, as described above.

[0048] It should be understood that, without departing from the scope of this disclosure, one or more indicator devices 18 may include additional light sources, light arrangements, projector types, audio sources, etc.

[0049] Occupant Monitoring System (OMS) 20 is used to identify vehicle occupants 82 inside vehicle 12. Figure 5 The OMS20 includes one or more infrared (IR) cameras located inside the vehicle 12 to capture images of the vehicle occupants 82. Figure 5 The OMS also includes an image processor (not shown) that is in electrical communication with an IR camera. The IR camera captures high-resolution images of the occupant's face and eyes, and the image processor analyzes the images to determine the occupant's gaze direction. The OMS20 uses IR light reflected from the eyes and surrounding facial features to track the direction and position of the eyes, thereby allowing the OMS20 to calculate the gaze direction based on the processed image data. The OMS20 is in electrical communication with the vehicle controller 14, as described above.

[0050] Multiple vehicle components 22 are used to provide various features to the occupants of the vehicle 12. In an exemplary embodiment, the multiple vehicle components 22 include at least one of the following: a window 40 of the vehicle 12, a ventilation system 42 of the vehicle 12, an infotainment system 44 of the vehicle 12, a door 46 of the vehicle 12, and a seat 48 of the vehicle 12.

[0051] Window 40 is used to direct the light to vehicle occupants 82 ( Figure 5 (or provide visibility and / or fresh air to the user.) Figure 1In the exemplary embodiment shown, window 40 is included as part of the sunroof of vehicle 12. Window 40 may also be included in a door 46 of vehicle 12. It should be understood that window 40 may be a means to allow vehicle occupants 82 ( Figure 5 The window 40 also includes an actuation mechanism (not shown) that allows the window 40 to be opened and closed (i.e., by raising, lowering, and / or tilting the window 40). In a non-limiting example, the actuation mechanism is electrically driven and in electrical communication with the vehicle controller 14. Thus, the vehicle controller 14 can send signals to the actuation mechanism to open and close the window 40.

[0052] Ventilation system 42 is used to control airflow inside vehicle 12. Ventilation system 42 is used to improve occupant comfort by adjusting the temperature and humidity inside vehicle 12. In an exemplary embodiment, ventilation system 42 includes a blower (not shown), an air damper (not shown), a temperature controller (not shown), a ventilation outlet (not shown), and a ventilation interface 60 (…). Figure 5 ).

[0053] The blower is an electric fan that generates airflow in the ventilation system 42. An air baffle is an electrically actuated surface within the ventilation system 42 used to guide the airflow within the ventilation system 42. By moving the air baffle, the ventilation system 42 can control the proportion of the total volume of airflow generated by the blower and directed to each ventilation outlet. Temperature control allows the ventilation system 42 to control the temperature of the airflow throughout the ventilation system 42. Ventilation outlets provide airflow to the interior of the vehicle 12. In an exemplary embodiment, the ventilation outlets are configured to provide airflow to the occupants of the vehicle 12 to improve occupant comfort. Ventilation interface 60 ( Figure 5 ) is used to allow vehicle occupants 82 ( Figure 5 ) controls the ventilation system 42. In a non-limiting example, the ventilation interface 60 includes one or more knobs, buttons, sliders, touchscreens, or other means that allow vehicle occupants 82 ( Figure 5 Adjust the blower, air damper and other controllers for temperature control of the ventilation system 42.

[0054] As described above, the ventilation system 42 is in electrical communication with the vehicle controller 14. The blower, air dampers, and temperature control of the ventilation system 42 can be automatically controlled by the vehicle controller 14, or in response to vehicle occupants 82 (…). Figure 5 The input to the ventilation interface 60 is used for control.

[0055] The infotainment system 44 is used to provide information to vehicle occupants 82 ( Figure 5 ) to provide information and entertainment and / or to vehicle occupants 82 ( Figure 5The infotainment system 44 provides vehicle control capabilities. In an exemplary embodiment, the infotainment system 44 includes a human-machine interface (HMI), a voice system, and a navigation system. The HMI is used to provide vehicle occupants 82 ( Figure 5 The HMI provides information. In an exemplary embodiment, the HMI is located at vehicle occupant 82 ( Figure 5 A display capable of displaying text, graphics, and / or images within the field of view of a rearview mirror. It should be understood that HMI display systems, including LCD displays, LED displays, etc., are within the scope of this disclosure. Other exemplary embodiments of HMI installation in a rearview mirror are also within the scope of this disclosure.

[0056] In another exemplary embodiment, the HMI includes a head-up display (HUD) configured to display text, graphics, and / or images to vehicle occupants 82 by projecting them onto the windshield of vehicle 12. Figure 5 Information is provided. Text, graphics, and / or images are reflected by the windshield of vehicle 12 and are visible to vehicle occupants 82. Figure 5 The HMI is visible to the vehicle occupant 82 without requiring them to take their eyes off the road in front of the vehicle 12. In another exemplary embodiment, the HMI includes an augmented reality head-up display (AR-HUD). An AR-HUD is a type of HUD configured to overlay text, graphics, and / or images onto the vehicle occupant 82. Figure 5 The HMI enhances the occupant's view of the road ahead by incorporating physical objects in the vehicle's surrounding environment 12 within the field of view. In a non-limiting example, the vehicle controller 14 may control one or more operating parameters of the HMI, including, for example, display brightness, display color, display notifications, etc.

[0057] In an exemplary embodiment, vehicle occupants 82 ( Figure 5 The infotainment system 44 can be interacted with using human-machine interface devices (HIDs), including, for example, touchscreens, electromechanical switches, capacitive switches, knobs, etc. It should be understood that devices used to interact with vehicle occupants 82 ( Figure 5 Additional systems that display information are also within the scope of this disclosure.

[0058] The sound system is used to provide audio for the occupants 82 inside the interior compartment of vehicle 12. Figure 5 The sound system provides entertainment. In a non-limiting example, the sound system includes an amplifier and one or more speakers. The sound system is operable to play sounds, such as music, for the entertainment of the vehicle occupants. Figure 5 In a non-limiting example, sound is supplied to the amplifier from various sources, including, for example, portable media devices, MP3 players, smartphones, internet connections, AM / FM radio receivers, etc. In an exemplary embodiment, the sound system may be provided by vehicle occupant 82 ( Figure 5The system is controlled via the infotainment system 44, for example, through interaction with the HID, as described above. Furthermore, the vehicle controller 14 can adjust one or more operating parameters of the sound system (e.g., music playback volume, music genre, etc.) via electrical communication with the infotainment system 44, as will be discussed in more detail below.

[0059] The navigation system is used to provide guidance to vehicle occupants 82 when operating vehicle 12. Figure 5 This provides information about navigation routes and destinations. In an exemplary embodiment, the navigation system includes a Global Navigation Satellite System (GNSS). The GNSS is used to determine the geographic location of vehicle 12. In an exemplary embodiment, the GNSS is a Global Positioning System (GPS). In a non-limiting example, the GPS includes a GPS receiver antenna (not shown) and a GPS controller (not shown) in electrical communication with the GPS receiver antenna. The GPS receiver antenna receives signals from multiple satellites, and the GPS controller calculates the geographic location of vehicle 12 based on the signals received by the GPS receiver antenna. In an exemplary embodiment, the GNSS also includes a map. The map includes information about infrastructure, such as municipal boundaries, roads, railways, sidewalks, buildings, etc. Therefore, the map information is used to contextualize the geographic location of vehicle 12. In a non-limiting example, the map is retrieved from a remote source using a wireless connection. In another non-limiting example, the map is stored in a GNSS database. It should be understood that various additional types of satellite-based radio navigation systems, such as Global Positioning System (GPS), Galileo, GLONASS, and BeiDou Navigation Satellite System (BDS), are all within the scope of this disclosure.

[0060] Based on the vehicle's geographical location and map information obtained from GNSS, the navigation system calculates the optimal route to the destination selected by the vehicle occupants (82). Figure 5 In an exemplary embodiment, the navigation system may be provided by vehicle occupants 82 ( Figure 5 The infotainment system 44 is controlled, for example by interacting with the HID to select destination and route parameters, as described above. The infotainment system 44 is in electrical communication with the vehicle controller 14, as described above.

[0061] Door 46 provides access to the interior of vehicle 12. In an exemplary embodiment, door 46 includes a latch and a locking mechanism 46a. The latch and locking mechanism 46a are used to latch door 46 into a closed position and lock door 46 to prevent door 46 from being unlocked and opened. In an exemplary embodiment, the latch and locking mechanism 46a are configured to be manually operated by a vehicle occupant 82. Figure 5And is electronically operated by the vehicle controller 14, enabling the vehicle controller 14 to transmit electrical signals to latch / unlatch and lock / unlock the door 46. The latch and locking mechanism 46a is in electrical communication with the vehicle controller 14, as described above.

[0062] Seat 48 is used for vehicle occupants 82 ( Figure 5 This provides a comfortable seating position. In a non-limiting example, seat 48 is a driver's seat of vehicle 12 arranged near the steering wheel and / or driving pedals. In another non-limiting example, seat 48 is a passenger seat adjacent to the driver's seat and / or located in the rear passenger compartment of vehicle 12. It should be understood that seat 48 can include any seat of vehicle 12. In an exemplary embodiment, seat 48 can be adjusted along one or more axes, such as forward, backward, up, or down, to achieve an optimal seating position. In a non-limiting example, seat 48 includes a plurality of actuators (not shown). Each actuator is configured to adjust the seat position along a specific axis. In a non-limiting example, the actuators can be controlled by buttons, switches, and / or knobs arranged within vehicle 12. In another non-limiting example, the actuators are in electrical communication with vehicle controller 14, as described above.

[0063] It should be understood that the multiple vehicle components 22 discussed above are merely exemplary in nature, and the multiple vehicle components 22 may also include any additional electronically controllable components of the vehicle 12, such as storage compartments (e.g., glove box), lights, mirrors (e.g., rearview mirrors and / or side mirrors).

[0064] refer to Figure 2 This illustration shows a second exemplary embodiment of a system for controlling electronic devices, and is generally indicated by reference numeral 10b. System 10b is described in the context of an exemplary space 62. Although a residential living area is shown, it should be understood that space 62 can be any type of space without departing from the scope of this disclosure. System 10b generally includes a space controller 64, a handheld universal HID 66, and a plurality of electronic devices 68.

[0065] The space controller 64 is used to control the system 10b and execute method 100. In an exemplary embodiment, the space controller 64 is substantially similar to the vehicle controller 14 described above in terms of structure, components, and operation. In a non-limiting example, the space controller 64 is integrated into one of a plurality of electronic devices 68, such as... Figure 2As shown. In a non-limiting example, the space controller 64 also includes a wireless receiving capability to receive signals from the handheld general-purpose HID 66 and determine the orientation of the handheld general-purpose HID 66, as will be discussed in more detail below. In an exemplary embodiment, the space controller 64 is configured to receive user commands from the handheld general-purpose HID 66 and to communicate with and control each of the plurality of electronic devices 68.

[0066] The space controller 64 communicates electrically with a handheld general-purpose HID 66 and multiple electronic devices 68. In exemplary embodiments, networks such as CAN networks, FLEXRAY networks, local area networks (e.g., WiFi, Ethernet), and Serial Peripheral Interface (SPI) networks are used. It should be understood that various additional wired and wireless technologies and communication protocols used for communicating with the space controller 64 are within the scope of this disclosure. It should also be understood that, within the scope of this disclosure, electrical communication also includes power and / or energy transfer between electronic devices (e.g., using wired and / or wireless power transfer technologies).

[0067] The handheld general-purpose HID 66 is used to receive user input and control any one of a plurality of electronic devices 68. In an exemplary embodiment, the handheld general-purpose HID 66 is substantially similar in structure, components, and operation to the general-purpose HID 16 discussed above in reference system 10a. Furthermore, the handheld general-purpose HID 66 is configured to be held and manipulated in three-dimensional space to receive user input and control any one of the plurality of electronic devices 68. In a non-limiting example, the handheld general-purpose HID 66 also includes one or more position and orientation sensors, such as a gyroscope or accelerometer. The handheld general-purpose HID 66 may also include one or more transmitters, such as an infrared (IR) transmitter, a Bluetooth transceiver, or a wireless local area network (WLAN) transceiver, for transmitting control and orientation data to a spatial controller 64. In a non-limiting example, the handheld general-purpose HID 66 also includes one or more buttons, switches, joysticks, knobs, touchpads, touchscreens, etc., for receiving user input. In a non-limiting example, the handheld general-purpose HID 66 also includes the ability to provide visual, auditory, tactile, and / or force feedback to the user. The handheld general-purpose HID66 communicates electrically with the space controller 64, as described above.

[0068] Multiple electronic devices 68 are used to provide various features to the occupants or users of the space 62. In an exemplary embodiment, the multiple electronic devices 68 include at least one of the following: an interior light 70, a space window lock 72, and a space ventilation system 74.

[0069] An indoor light 70 is used to provide illumination within a space 62. In an exemplary embodiment, the indoor light 70 also houses a space controller 64. It should be understood that the space controller 64 may be integrated into any of a plurality of electronic devices 68, a handheld general-purpose HID 66, or as a stand-alone device within the scope of this disclosure. In an exemplary embodiment, the indoor light 70 includes one or more switches, relays, or other electronic circuitry that allows the indoor light 70 to be electronically controlled via wired or wireless communication with the space controller 64.

[0070] The space window lock 72 is used to secure the window of the space 62 to prevent it from being opened. In an exemplary embodiment, the space window lock 72 includes one or more switches, relays, solenoids, motors and / or other electronic circuits and / or electromechanical components, which allow electronic control (i.e., locking and unlocking) of the space window lock 72 via wired or wireless communication with the space controller 64.

[0071] The space ventilation system 74 is used to control the climate within the space 62. In an exemplary embodiment, the space ventilation system 74 includes an air conditioning system and / or a heating system. In an exemplary embodiment, the space ventilation system 74 includes one or more switches, relays, solenoids, motors, and / or other electronic circuits and / or electromechanical components, which allow electronic control of the space ventilation system 74 via wired or wireless communication with the space controller 64 (i.e., starting / stopping the space ventilation system 74, changing the temperature setpoint of the space ventilation system 74, etc.).

[0072] In an exemplary embodiment, each of the plurality of electronic devices 68 communicates with each other via wired or radio communication. In a non-limiting example, each of the plurality of electronic devices 68 participates in a peer-to-peer network, a mesh network, a wireless local area network (WLAN), etc. Therefore, the space controller 64 provides commands to control each of the plurality of electronic devices 68.

[0073] It should be understood that the multiple electronic devices 68 discussed above are merely exemplary in nature, and the multiple electronic devices 68 may also include any additional electronically controllable devices in space 62, such as additional light sources, door / window locks, fans, appliances (e.g., coffee machines), entertainment devices (e.g., televisions, radios, stereo systems).

[0074] It should also be understood that systems 10a and 10b are merely exemplary in nature, and this disclosure is also applicable to a variety of additional applications, such as entertainment (e.g., controlling light shows), heavy industry (e.g., controlling heavy machinery / equipment), logistics (e.g., controlling shipping terminals and facilities), and other means of transportation (e.g., aircraft, ships).

[0075] refer to Figure 3A flowchart is provided for a method 100 for controlling vehicle components or electronic devices. It should be understood that method 100 is applicable to systems 10a and 10b. Method 100 begins at block 102 and proceeds to block 104.

[0076] In the context of system 10a, at block 104, vehicle controller 14 determines a selected component among a plurality of vehicle components 22, as will be discussed in more detail below. In the context of system 10b, at block 104, space controller 64 determines a selected device among a plurality of electronic devices 68. Following block 104, method 100 proceeds to block 106.

[0077] In the context of system 10a, at block 106, vehicle controller 14 uses a universal HID 16 to receive occupant input for controlling selected components. In an exemplary embodiment, the occupant input is a control occupant input. Within the scope of this disclosure, a control occupant input is an occupant input intended to control one of a plurality of vehicle components 22. In a non-limiting example, a control occupant input includes actuation of a button on the universal HID 16, rotation of a knob on the universal HID 16, etc.

[0078] In the context of system 10b, at block 106, the space controller 64 receives input from a user using a handheld universal HID 66 to control a selected device. In an exemplary embodiment, the user input is a control user input. Within the scope of this disclosure, control user input is user input intended to control one of a plurality of electronic devices 68. In a non-limiting example, control user input includes actuation of a button on the handheld universal HID 66, rotation of a knob on the handheld universal HID 66, body gestures performed using the handheld universal HID 66, etc. Following block 106, method 100 proceeds to block 108.

[0079] In the context of system 10a, at block 108, vehicle controller 14 adjusts the operation of a selected component determined at block 104 based on occupant input determined at block 106. In a non-limiting example where the selected component is window 40, vehicle controller 14 adjusts the position of window 40 (i.e., opening / closing window 40) based on occupant input. For example, if the occupant input includes clockwise rotation of a knob, vehicle controller 14 closes window 40 proportionally to the amount of rotation. If the occupant input includes counterclockwise rotation of a knob, vehicle controller 14 opens window 40 proportionally to the amount of rotation. In a non-limiting example where the selected component is ventilation system 42, vehicle controller 14 adjusts at least one of the following based on occupant input: the temperature setpoint of ventilation system 42 and the airflow level of ventilation system 42. For example, if the occupant input includes clockwise rotation of a knob, vehicle controller 14 increases the temperature setpoint proportionally to the amount of rotation. If the occupant input includes counterclockwise rotation of a knob, vehicle controller 14 decreases the temperature setpoint proportionally to the amount of rotation.

[0080] In a non-limiting example where the selected component is the infotainment system 44, the vehicle controller 14 adjusts the audio playback volume of the infotainment system 44 based on occupant input. For example, if the occupant input includes clockwise rotation of a knob, the vehicle controller 14 increases the audio playback volume proportionally to the amount of rotation. If the occupant input includes counterclockwise rotation of a knob, the vehicle controller 14 decreases the audio playback volume proportionally to the amount of rotation. In a non-limiting example where the selected component is the door 46, the vehicle controller 14 adjusts at least one of the following based on occupant input: the latch state (i.e., whether the door 46 remains in the closed position) and the door lock state (i.e., whether the door can be unlocked). For example, if the occupant input includes actuation of a first button, the vehicle controller 14 unlocks the latch and locking mechanism 46a. If the occupant input includes actuation of a second button, the vehicle controller 14 locks the latch and locking mechanism 46a.

[0081] In a non-limiting example where the selected component is seat 48, vehicle controller 14 adjusts the seat position of seat 48 based on occupant input. For example, if the occupant input includes clockwise rotation of a knob, vehicle controller 14 moves seat 48 forward proportionally to the amount of rotation. If the occupant input includes counterclockwise rotation of a knob, vehicle controller 14 moves seat 48 backward proportionally to the amount of rotation.

[0082] In the context of system 10b, at box 108, the space controller 64 adjusts the operation of the selected device determined at box 104 based on user input determined at box 106. In a non-limiting example where the selected device is an indoor light 70, the space controller 64 turns the indoor light 70 on or off based on occupant input. For example, if the user input includes actuation of a first button, the space controller 64 turns on the indoor light 70. If the user input includes actuation of a second button, the space controller 64 turns off the indoor light 70. In a non-limiting example where the selected device is a space window lock 72, the space controller 64 locks or unlocks the space window lock 72 based on user input. For example, if the user input includes actuation of a first button, the space controller 64 unlocks the space window lock 72. If the user input includes actuation of a second button, the space controller 64 locks the space window lock 72. In a non-limiting example where the selected device is a space ventilation system 74, the space controller adjusts the temperature setpoint of the space ventilation system 74 based on user input. For example, if the user input includes an upward gesture, the space controller 64 increases the temperature setpoint. If the user input includes a downward gesture, the space controller 64 lowers the temperature setpoint. After box 108, method 100 proceeds to the standby state at box 110.

[0083] In an exemplary embodiment, method 100 repeatedly exits standby state 110 and restarts at block 102. In a non-limiting example, method 100 exits standby state 110 and restarts on a timer, for example, every three hundred milliseconds.

[0084] refer to Figure 4 A flowchart of a first exemplary embodiment 104a of block 104 is shown. For the first exemplary embodiment 104a of block 104, one or more indicator devices 18 are not required and OMS 20 is used, as will be discussed below. The first exemplary embodiment 104a of block 104 begins at block 402. At block 402, the vehicle controller 14 receives an activated occupant input using a universal HID 16. Within the scope of this disclosure, the activated occupant input is vehicle occupant 82 (… Figure 5 The input indicates the intention to activate gaze detection. Following block 402, in response to receiving the activation occupant input, the first exemplary embodiment 104a of block 104 proceeds to block 404.

[0085] refer to Figure 5 A schematic diagram of an exemplary vehicle interior 80 is shown. The exemplary vehicle interior 80 includes vehicle occupants 82. (Reference) Figure 4 and Figure 5At box 404, in response to receiving an active occupant input at box 402, vehicle controller 14 uses OMS 20 to determine the gaze direction of vehicle occupant 82. In a non-limiting example, the gaze direction of vehicle occupant 82 is defined by the gaze direction vector and the gaze origin. Figure 5 In the image, the direction of gaze of vehicle occupant 82 is indicated by the dotted line 84. (See again...) Figure 4 Following box 404, the first exemplary embodiment 104a of box 104 proceeds to box 406.

[0086] At block 406, vehicle controller 14 identifies a selected component at least partially based on the gaze direction determined at block 404. In an exemplary embodiment, to identify the selected component, vehicle controller 14 performs a gaze intersection machine learning algorithm. In a non-limiting example, the gaze intersection machine learning algorithm is a machine learning algorithm trained on a labeled dataset of gaze direction vectors, gaze origin, and corresponding selected components. In another exemplary embodiment, to identify the selected component, vehicle controller 14 projects the gaze direction vector onto a 3D model of the interior of vehicle 12 based on the gaze origin. Vehicle controller 14 then identifies the selected component as one of a plurality of vehicle components 22 that intersect with the projected gaze direction vector. It should be understood that the techniques discussed above for identifying selected components at least partially based on gaze direction are merely exemplary in nature, and additional methods for identifying selected components at least partially based on gaze direction are within the scope of this disclosure. After block 406, the first exemplary embodiment 104a of block 104 ends, and method 100 continues as described above.

[0087] refer to Figure 6 A flowchart of a second exemplary embodiment 104b of block 104 is shown. For the second exemplary embodiment 104b of block 104, the OMS 20 is not required and one or more indicator devices 18 are used, as will be discussed below. The second exemplary embodiment 104b of block 104 begins at block 602. At block 602, the vehicle controller 14 receives a first occupant selection input using a universal HID 16. Within the scope of this disclosure, the occupant selection input is an occupant input intended to select one of a plurality of vehicle components 22. In a non-limiting example, the occupant selection input includes rotation of a knob of the universal HID 16. In another non-limiting example, the occupant selection input includes actuation of a button of the universal HID 16. Following block 602, the second exemplary embodiment 104b of block 104 proceeds to block 604.

[0088] At block 604, vehicle controller 14, in response to receiving a first selected occupant input at block 602, indicates a first component among a plurality of vehicle components 22. In an exemplary embodiment, to indicate the first component, vehicle controller 14 uses one of one or more indicator devices 18. In a non-limiting example, vehicle controller 14 uses a laser 30 to provide a focused light source indicating the first component. In another non-limiting example, vehicle controller 14 uses one or more LEDs 32 to illuminate the first component or its vicinity to provide a spotlight illuminating the first component and / or to provide a projection indicating the first component. If the first component is a user interface (UI) element displayed on the HMI of infotainment system 44, vehicle controller 14 displays a graphic indicating the UI element on the HMI. In another non-limiting example, vehicle controller 14 uses an audio source 34 to announce the selected component to vehicle occupant 82.

[0089] If a second occupant selection input is received, the vehicle controller 14 uses one or more indicator devices 18 to indicate a second component among a plurality of vehicle components 22. In an exemplary embodiment, the second component is determined at least in part based on the first component and the second occupant selection input. In a non-limiting example, if the second occupant selection input includes clockwise rotation of a knob, the second component is determined to be one of a plurality of vehicle components 22 positioned clockwise relative to the first component based on the viewing angle of the universal HID 16. In a non-limiting example, if the second occupant selection input includes counterclockwise rotation of a knob, the second component is determined to be one of a plurality of vehicle components 22 positioned counterclockwise relative to the first component based on the viewing angle of the universal HID 16. Following block 604, a second exemplary embodiment 104b of block 104 proceeds to block 606.

[0090] At block 606, the vehicle controller 14 uses a universal HID 16 to receive acknowledgment occupant input. Within the scope of this disclosure, acknowledgment occupant input is occupant input intended to indicate a desire to adjust the operation of a first component illuminated at block 604. Therefore, upon receiving acknowledgment occupant input, the first component is determined to be the selected component as described above. In a non-limiting example, acknowledgment occupant input includes actuation of a predetermined button of the universal HID 16 (e.g., a "select" or "OK" button). After block 606, the second exemplary embodiment 104b of block 104 ends, and method 100 continues as described above.

[0091] refer to Figure 7 A flowchart illustrating a third exemplary embodiment 104c of block 104 is shown. (See reference...) Figure 2 and Figure 7The third exemplary embodiment 104c of block 104 utilizes system 10b. The third exemplary embodiment 104c of block 104 begins at block 702. At block 702, the space controller 64 determines the orientation of the handheld universal HID 66 in three-dimensional space. In this exemplary embodiment, the handheld universal HID 66 uses one or more position or orientation sensors to determine its orientation in three-dimensional space. Following block 702, the third exemplary embodiment 104c of block 104 proceeds to block 704.

[0092] At frame 704, the space controller 64 determines the pointing direction of the handheld universal HID 66 based at least in part on the orientation of the handheld universal HID 66 determined at frame 702. Within the scope of this disclosure, the pointing direction is defined as the direction of the normal vector along the plane defining the front of the handheld universal HID 66. Reference Figure 2 An example of the pointing direction is shown by dashed line 86. In an exemplary embodiment, the pointing direction is defined by a pointing direction vector and a pointing direction origin. In a non-limiting example, to determine the pointing direction, the space controller 64 receives the orientation of the handheld general-purpose HID 66 from the handheld general-purpose HID 66 and determines the pointing direction using a mathematical model of the handheld general-purpose HID 66 based on the orientation and geometry of the handheld general-purpose HID 66. Following block 704, a third exemplary embodiment 104c of block 104 proceeds to block 706.

[0093] At block 706, the space controller 64 identifies a selected device at least partially based on the pointing direction determined at block 704. In an exemplary embodiment, to identify the selected device, the space controller 64 performs a pointing direction crossover machine learning algorithm. In a non-limiting example, the pointing direction crossover machine learning algorithm is a machine learning algorithm trained on a labeled dataset of pointing direction vectors and the pointing direction origin, and on the corresponding selected device in space 62. In another exemplary embodiment, to identify a selected component, the vehicle controller 14 projects the pointing direction vector onto a three-dimensional model of space 62 based on the pointing direction origin. The space controller 64 then identifies the selected device as one of a plurality of electronic devices 68 that intersect with the projected pointing direction vector. It should be understood that the techniques discussed above for identifying a selected device at least partially based on the pointing direction are merely exemplary in nature, and additional methods for identifying a selected device at least partially based on the pointing direction are also within the scope of this disclosure. After block 706, the third exemplary embodiment 104c of block 104 ends, and method 100 continues as described above.

[0094] The systems 10a, 10b, and method 100 of this disclosure offer several advantages. Using systems 10a and 10b, vehicle occupants or users with reduced mobility or mobility can operate vehicle features or control electronic devices with minimal physical movement. Using system 10a, vehicle occupants can adjust the operation of vehicle components that would otherwise be inaccessible. Furthermore, using system 10a, vehicle occupants can intuitively select vehicle components for control based on gaze direction. Using system 10b, users can intuitively and efficiently adjust the operation of electronic devices (e.g., smart home devices).

[0095] The descriptions in this disclosure are merely exemplary in nature, and changes that do not depart from the spirit and scope of this disclosure are intended to fall within its scope. Such changes should not be considered as departing from the spirit and scope of this disclosure.

Claims

1. A system for controlling vehicle components, the system comprising: Multiple vehicle components; A universal human-machine interface device (HID) capable of receiving occupant input and controlling any of the plurality of vehicle components; as well as A vehicle controller, which communicates with the plurality of vehicle components and the universal HID electrical system, wherein the vehicle controller is programmed to: Identify a selected component from the plurality of vehicle components; The occupant input is received using the general HID; and The operation of the selected component is adjusted based at least in part on the occupant input.

2. The system of claim 1, further comprising an occupant monitoring system (OMS), the OMS being electrically communicated with the vehicle controller and operable to determine the gaze direction of a vehicle occupant, wherein, in order to determine the selected component, the vehicle controller is further programmed to: Use the general HID to receive and activate crew input; In response to receiving the activated occupant input, the OMS is used to determine the gaze direction of the vehicle occupant; and The selected component is identified at least in part based on the gaze direction.

3. The system according to claim 1, wherein, To determine the selected component, the vehicle controller is also programmed to: The first selected occupant input is received using the general HID; Instructing the vehicle occupants to the first of the plurality of vehicle components; The universal HID is used to receive and confirm passenger input; and In response to receiving the confirmed occupant input, the first component is determined to be the selected component.

4. The system according to claim 3, wherein, To determine the selected component, the vehicle controller is also programmed to: The second occupant selection input is received using the universal HID; and In response to receiving the second selected occupant input, the second component of the plurality of vehicle components is indicated to the vehicle occupant.

5. The system of claim 3, further comprising a light source electrically communicating with the vehicle controller and disposed within the vehicle, wherein, for indicating the first component, the vehicle controller is further programmed to: The light source is illuminated to visually indicate the first component to the vehicle occupants.

6. The system according to claim 5, wherein, The light source also includes at least one of the following: a spotlight, a laser, a projector, and one or more light-emitting diodes (LEDs), which are operable to selectively illuminate one or more of the plurality of vehicle components.

7. The system of claim 3, further comprising an audio source electrically communicating with the vehicle controller and disposed within the vehicle, wherein the vehicle controller is further programmed to: The audio source is used to generate sound to provide audible instructions of the first component to the vehicle occupants.

8. The system according to claim 1, wherein, The universal HID includes one or more tactile interfaces fixed within the reach of one or more vehicle occupants inside the vehicle.

9. The system according to claim 8, wherein, In order to receive the occupant input and adjust the operation of the selected component using the universal HID, the vehicle controller is also programmed to: Use the general HID to receive and control occupant input; The operation of the selected component is adjusted at least in part based on the control occupant input; and In response to the operation of adjusting the selected component, tactile feedback or force feedback is provided using the universal HID.

10. The system according to claim 9, wherein, The plurality of vehicle components include at least one of the following: vehicle windows, vehicle ventilation system, vehicle infotainment system, vehicle doors, and vehicle seats, and wherein, in order to adjust the operation of the selected components, the vehicle controller is further programmed to: In response to determining that the selected component is the window, the position of the window is adjusted based at least in part on the control occupant input; In response to determining that the selected component is the ventilation system, at least one of the following is adjusted, at least in part, based on the control occupant input: temperature setpoint and airflow level; In response to determining that the selected component is the infotainment system, the audio playback volume is adjusted at least in part based on the control occupant input; In response to determining that the selected component is the vehicle door, at least one of the following is adjusted, at least in part, based on the control occupant input: the latch state and the door lock state; and In response to determining that the selected component is the seat, the seat position is adjusted at least in part based on the control occupant input.