Adaptive user interface for a vehicle

Abstract

A method for providing information to vehicle occupants may include using one or more vehicle sensors to determine one or more input information. The method may also include determining the layout of each of a plurality of user interface (UI) elements of an infotainment system, at least in part based on the one or more inputs. The method may further include providing information to vehicle occupants by displaying the plurality of UI elements on the infotainment system, at least in part based on the layout of each of the plurality of UI elements.

Description

Technical Field

[0001] This disclosure relates to systems and methods for providing information to vehicle occupants, and more specifically, to the user interface functionality and design of vehicle infotainment systems. Background Technology

[0002] To facilitate user interaction with the infotainment system within vehicle applications, various user interface technologies can be employed. Vehicle infotainment systems may include displays, touch controls, physical buttons, voice recognition modules, etc., to enable interaction with navigation, media playback, climate control, communication systems, and other vehicle functions. In some examples, the user interface may include configurable layouts or menu structures that adjust according to user preferences. Furthermore, the infotainment system interface can integrate with external devices via wireless communication protocols, enabling users to access mobile applications, cloud services, or obtain real-time traffic and weather updates. Some vehicle infotainment system interfaces also possess multimodal interaction capabilities, such as combining voice commands with haptic feedback or gesture recognition to improve usability while minimizing driver distraction.

[0003] While the systems and methods used for vehicle infotainment user interfaces have achieved their intended purpose, new and improved systems and methods are still needed for the functionality and design of vehicle infotainment system user interfaces in order to provide information to vehicle occupants. Summary of the Invention

[0004] According to several aspects, a method for providing information to vehicle occupants is provided. The method may include: determining one or more inputs using one or more vehicle sensors. The method may also include: determining the layout of each of a plurality of user interface (UI) elements of an infotainment system based at least in part on the layout of each of the plurality of UI elements. The method may further include: providing information to vehicle occupants by displaying the plurality of UI elements on the infotainment system based at least in part on the layout of each of the plurality of UI elements.

[0005] In another aspect of this disclosure, determining one or more inputs may further include: determining one or more inputs. The one or more inputs include measurements of vehicle operating conditions. Vehicle operating conditions include one or more of the following: vehicle speed, vehicle acceleration, and vehicle vibration.

[0006] In another aspect of this disclosure, determining one or more inputs may also include determining one or more inputs. The one or more inputs may include information about the external environmental conditions.

[0007] In another aspect of this disclosure, determining one or more inputs may also include determining one or more inputs. Information about external environmental conditions includes one or more of the following: weather conditions in the environment surrounding the vehicle and traffic congestion conditions in the environment surrounding the vehicle.

[0008] In another aspect of this disclosure, determining the layout of each of the plurality of UI elements may further include: determining an importance score for each of the plurality of UI elements based at least in part on one or more inputs and one or more UI element features of each of the plurality of UI elements. Determining the layout of each of the plurality of UI elements may further include determining the layout of each of the plurality of UI elements based at least in part on the importance score of each of the plurality of UI elements.

[0009] In another aspect of this disclosure, determining the importance score of each of the plurality of UI elements may further include: determining the importance score of each of the plurality of UI elements based at least in part on one or more UI element features of each of the plurality of UI elements. The one or more UI element features include the purpose of each of the plurality of UI elements.

[0010] In another aspect of this disclosure, determining the importance score of each of the plurality of UI elements may further include: determining the importance score of each of the plurality of UI elements based at least in part on one or more UI element characteristics of each of the plurality of UI elements. The UI element uses of each of the plurality of UI elements include information about the inherent importance of each of the plurality of UI elements.

[0011] In another aspect of this disclosure, determining the importance score of each of the plurality of UI elements may further include: determining the importance score of each of the plurality of UI elements based at least in part on one or more inputs. The one or more inputs include the vehicle's speed. The importance score of each of the plurality of UI elements is positively correlated with the vehicle's speed.

[0012] In another aspect of this disclosure, determining the layout of each of the plurality of UI elements may further include: determining the layout of each of the plurality of UI elements based at least in part on the importance score of each of the plurality of UI elements. The layout includes at least the size of each of the plurality of UI elements. The size of each of the plurality of UI elements is positively correlated with the importance score of each of the plurality of UI elements.

[0013] In another aspect of this disclosure, determining the layout of each of the plurality of UI elements may further include: determining the layout of each of the plurality of UI elements based at least in part on the importance score of each of the plurality of UI elements. The layout includes at least the position of each of the plurality of UI elements on the infotainment system. The distance between the position of each of the plurality of UI elements and the edge of the infotainment system is negatively correlated with the importance score of each of the plurality of UI elements.

[0014] According to several aspects, a system for providing information to vehicle occupants is provided. The system may include one or more vehicle sensors, an infotainment system, and a controller electrically communicating with the one or more vehicle sensors and the infotainment system. The controller is programmed to use the one or more vehicle sensors to determine one or more inputs. The controller is also programmed to determine the layout of each of a plurality of UI elements of the infotainment system based at least in part on an importance score of each of the plurality of user interface (UI) elements. The importance score is determined at least in part based on one or more inputs and one or more UI element features of each of the plurality of UI elements. The controller is further programmed to provide information to vehicle occupants by displaying the plurality of UI elements on the infotainment system, based at least in part on the layout of each of the plurality of UI elements.

[0015] In another aspect of this disclosure, one or more inputs include measurements of vehicle operating conditions. Vehicle operating conditions include one or more of the following: the activation status of the vehicle's traction control system and the time-averaged frequency of accelerator pedal operation.

[0016] In another aspect of this disclosure, one or more inputs include information about external environmental conditions. Information about external environmental conditions includes one or more of the following: visibility of the vehicle's surroundings and the distance between the vehicle and the nearest remote vehicle.

[0017] In another aspect of this disclosure, in order to determine the importance score of each of the plurality of UI elements, the controller is also programmed to determine the importance score of each of the plurality of UI elements at least in part based on one or more UI element features of each of the plurality of UI elements. The one or more UI element features include the frequency of use of each of the plurality of UI elements.

[0018] In another aspect of this disclosure, to determine the importance score of each of the plurality of UI elements, the controller is also programmed to determine the importance score of each of the plurality of UI elements based at least in part on traffic congestion conditions. The importance score of each of the plurality of UI elements is positively correlated with the traffic density in the vehicle's surrounding environment.

[0019] In another aspect of this disclosure, to determine the layout of each of the plurality of UI elements, the controller is also programmed to determine the layout of each of the plurality of UI elements at least in part based on the importance score of each of the plurality of UI elements. The layout includes at least the size of each of the plurality of UI elements. The size of each of the plurality of UI elements is positively correlated with the importance score of each of the plurality of UI elements.

[0020] In another aspect of this disclosure, to determine the layout of each of the plurality of UI elements, the controller is also programmed to determine the layout of each of the plurality of UI elements at least in part based on the importance score of each of the plurality of UI elements. The layout includes at least the position of each of the plurality of UI elements on the infotainment system. The distance between the position of each of the plurality of UI elements and the edge of the infotainment system is negatively correlated with the importance score of each of the plurality of UI elements.

[0021] According to several aspects, a method for providing information to vehicle occupants is provided. The method may include determining one or more inputs using one or more vehicle sensors. The one or more inputs include one or more of the following: vehicle speed, vehicle acceleration, vehicle vibration, weather conditions in the vehicle's surrounding environment, and traffic congestion conditions in the vehicle's surrounding environment. The method may further include determining the layout of each of a plurality of UI elements of an infotainment system based at least in part on an importance score for each of a plurality of user interface (UI) elements. The importance score is determined at least in part based on one or more inputs. The importance score of each of the plurality of UI elements is positively correlated with the vehicle's speed. The method may further include providing information to vehicle occupants by displaying the plurality of UI elements on an infotainment system, based at least in part on the layout of each of the plurality of UI elements.

[0022] In another aspect of this disclosure, determining the layout of each of the plurality of UI elements may further include: determining the layout of each of the plurality of UI elements based at least in part on the importance score of each of the plurality of UI elements. The layout includes at least the size of each of the plurality of UI elements. The size of each of the plurality of UI elements is positively correlated with the importance score of each of the plurality of UI elements.

[0023] In another aspect of this disclosure, determining the layout of each of the plurality of UI elements may further include: determining the layout of each of the plurality of UI elements based at least in part on the importance score of each of the plurality of UI elements. The layout includes at least the position of each of the plurality of UI elements on the infotainment system. The distance between the position of each of the plurality of UI elements and the edge of the infotainment system closest to the occupant is negatively correlated with the importance score of each of the plurality of UI elements.

[0024] Other applicable areas will become apparent from the description provided herein. It should be understood that the descriptions and specific examples herein are for illustrative purposes only and are not intended to limit the scope of this disclosure. Attached Figure Description

[0025] The accompanying drawings described herein are for illustrative purposes only and are not intended to limit the scope of this disclosure in any way.

[0026] Figure 1 This is a schematic diagram of a system for providing information to vehicle occupants according to an exemplary embodiment;

[0027] Figure 2 This is a schematic diagram of the interior of a vehicle according to an exemplary embodiment;

[0028] Figure 3 This is a schematic diagram of a first exemplary user interface for an infotainment system according to an exemplary embodiment;

[0029] Figure 4 This is a flowchart of a method for providing information to vehicle occupants according to an exemplary embodiment; and

[0030] Figure 5 This is a schematic diagram of a second exemplary user interface for an infotainment system according to an exemplary embodiment. Detailed Implementation

[0031] The following description is merely illustrative in nature and is not intended to limit the content, application, or purpose of this disclosure.

[0032] In various aspects of this disclosure, it is advantageous to adjust the layout and / or functionality of the user interface of a vehicle infotainment system based on vehicle and / or environmental conditions. Therefore, this disclosure provides a new and improved system and method for providing information to vehicle occupants, which takes current conditions into account when generating the user interface.

[0033] refer to Figure 1 The figure illustrates a system for providing information to vehicle occupants, generally indicated by reference numeral 10. System 10 is shown together with an exemplary vehicle 12. Although a passenger vehicle is shown, it should be understood that vehicle 12 can be any type of vehicle without departing from the scope of this disclosure. System 10 generally includes a controller 14, one or more vehicle sensors 16, and an infotainment system 18.

[0034] As described below, controller 14 is used to implement a method 100 for providing information to vehicle occupants. Controller 14 includes at least one processor 20 and a non-transitory computer-readable storage device or medium 22. Processor 20 may be a custom or commercial processor, a central processing unit (CPU), a graphics processing unit (GPU), an auxiliary processor among several processors associated with controller 14, a semiconductor-based microprocessor (in the form of a microchip or chipset), a macroprocessor, a combination of the above processors, or generally a device for executing instructions.

[0035] Computer-readable storage device or medium 22 may include, for example, volatile and non-volatile memories such as read-only memory (ROM), random access memory (RAM), and keep-alive memory (KAM). KAM is a permanent or non-volatile memory that can be used to store various operational variables when the processor 20 is powered off. Computer-readable storage device or medium 22 may be implemented using a variety of storage devices, such as programmable read-only memory (PROM), electrically programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, or other electrical, magnetic, optical, or combined storage devices capable of storing data, some of which represents executable instructions for the controller 14 to control various systems of the vehicle 12.

[0036] The controller 14 may also include multiple controllers that communicate electrically with each other. The controller 14 may be interconnected with additional systems and / or controllers of the vehicle 12, thereby enabling the controller 14 to acquire data such as the speed, acceleration, braking status and steering angle of the vehicle 12.

[0037] The controller 14 communicates electrically with one or more vehicle sensors 16 and the infotainment system 18. In an exemplary embodiment, electrical communication is established, for example, using a Controller Area Network (CAN) network, a Flexible Data Rate (FLEXRAY) network, a local area network (e.g., Wi-Fi, Ethernet, etc.), a Serial Peripheral Interface (SPI) network, etc. It should be understood that various additional wired and wireless technologies and communication protocols used for communicating with the controller 14 are within the scope of this disclosure. It should also be understood that, within the scope of this disclosure, electrical communication also includes the transfer of power and / or energy between electrical devices (e.g., using wired and / or wireless power transmission technologies).

[0038] One or more vehicle sensors 16 are used to acquire information related to the vehicle 12. In one exemplary embodiment, the one or more vehicle sensors 16 include sensors for determining performance data and / or operating conditions of the vehicle 12. In a non-limiting example, the one or more vehicle sensors 16 include at least one of a motor speed sensor, a motor torque sensor, an electric drive motor voltage and / or current sensor, an accelerator pedal position sensor, a brake position sensor, a coolant temperature sensor, a cooling fan speed sensor, and a transmission oil temperature sensor.

[0039] In one exemplary embodiment, one or more vehicle sensors 16 further include a vehicle speed sensor 24. The vehicle speed sensor 24 is used to measure the speed of the vehicle 12. In one exemplary embodiment, the vehicle speed sensor 24 includes a toothed ferromagnetic ring or disk (also referred to as a magnetic reluctance wheel or toothed ring) mechanically connected to the wheel of the vehicle 12, such that the toothed ferromagnetic ring rotates at the same speed as the wheel of the vehicle 12. The vehicle speed sensor 24 also includes a sensor (e.g., a coil) fixed near the toothed ferromagnetic ring, which remains stationary relative to the toothed ferromagnetic ring, such that the sensor generates an induced alternating voltage due to changes in the magnetic field caused by the rotation of the toothed ferromagnetic ring.

[0040] In a non-limiting example, the induced AC voltage is a sinusoidal wave, and the amplitude and / or frequency of the induced AC voltage is proportional to the rotational speed of the toothed ferromagnetic ring, and thus proportional to the vehicle speed. In an exemplary embodiment, the induced AC voltage is directly transmitted to the controller 14 for further processing, for example, using the analog-to-digital converter of the controller 14. In another exemplary embodiment, the vehicle speed sensor 24 also includes a signal conditioning circuit that further processes the induced AC voltage (e.g., amplifies the induced AC voltage, digitizes the induced AC voltage, encodes the vehicle speed value into a communication protocol, etc.) before transmitting it to the controller 14.

[0041] It should be understood that various additional devices and methods for determining vehicle speed, such as global navigation satellite systems (e.g., Global Positioning System (GPS)) and sensors for measuring other transmission system components (e.g., transmission speed sensors, electric motor speed sensors, etc.), are all within the scope of this disclosure. As described above, the vehicle speed sensor 24 communicates electrically with the controller 14.

[0042] In one exemplary embodiment, one or more vehicle sensors 16 further include an inertial measurement unit (IMU) 26. The IMU 26 is used to determine the direction, velocity, and gravity acting on the vehicle 12. In one exemplary embodiment, the IMU 26 includes several sensors, including an accelerometer, a gyroscope, and / or a magnetometer. In a non-limiting example, the IMU 26 includes a three-axis accelerometer and a three-axis gyroscope integrated into a single unit. The accelerometer measures linear acceleration along each axis, while the gyroscope measures angular velocity about each axis. The IMU 26 processes data from the sensors to calculate the vehicle 12's current orientation, velocity, heading, yaw rate (i.e., rate of change of heading), and acceleration in three-dimensional space. As described above, the IMU 26 communicates electrically with the controller 14.

[0043] In another exemplary embodiment, one or more vehicle sensors 16 further include sensors for determining information related to external environmental conditions in the surrounding environment 28 of the vehicle 12. In a non-limiting example, one or more vehicle sensors 16 further include at least one of an ambient air temperature sensor, an atmospheric pressure sensor, and / or a Global Navigation Satellite System (GNSS).

[0044] In one exemplary embodiment, the one or more vehicle sensors 16 further include one or more sensing sensors capable of sensing objects in the surrounding environment 28 of the vehicle 12 and / or measuring distances, such as camera system 30 and / or lidar (LiDAR) sensor 32. It should be understood that various additional types of sensing sensors, such as ultrasonic ranging sensors, radar sensors, and / or time-of-flight sensors, are within the scope of this disclosure.

[0045] The camera system 30 is a sensing sensor used to capture images and / or video of the environment 28 surrounding the vehicle 12. In one exemplary embodiment, the camera system 30 includes a camera and / or video camera positioned to observe the environment 28 surrounding the vehicle 12. In a non-limiting example, the camera system 30 includes a camera fixed inside the vehicle 12 (e.g., in the headliner of the vehicle 12) that can view through the windshield. In another non-limiting example, the camera system 30 includes a camera fixed outside the vehicle 12 (e.g., mounted on the roof of the vehicle 12) that is capable of capturing images of the environment 28 in front of the vehicle 12.

[0046] In another exemplary embodiment, the camera system 30 is a panoramic camera system comprising a plurality of cameras (also referred to as satellite cameras) arranged to provide views of the adjacent environment 28 on each side of the vehicle 12. In a non-limiting example, the camera system 30 includes a front camera (e.g., mounted in the front grille of the vehicle 12), a rear camera (e.g., mounted on the tailgate of the vehicle 12), and two side cameras (e.g., each mounted below one of the two side mirrors of the vehicle 12). In another non-limiting example, the camera system 30 also includes an additional rearview camera mounted near the high-mounted brake light of the vehicle 12.

[0047] It should be understood that camera systems with additional cameras and / or additional mounting locations are within the scope of this disclosure. It should also be understood that cameras with various sensor types fall within the scope of this disclosure, including, for example, charge-coupled device (CCD) sensors, complementary metal-oxide-semiconductor (CMOS) sensors, and / or high dynamic range (HDR) sensors. Furthermore, cameras with various lens types (including, for example, wide-angle lenses and / or narrow-angle lenses) are also within the scope of this disclosure.

[0048] A LiDAR sensor 32 is used for remote sensing and environmental mapping. It operates by emitting laser pulses and measuring the time required for the laser pulses to return to the LiDAR sensor 32 after hitting an object. In an exemplary embodiment, the LiDAR sensor 32 includes a LiDAR laser source, a LiDAR scanner or reflector, a LiDAR photodetector, and a LiDAR time-of-flight measurement system. In a non-limiting example, the LiDAR laser source emits laser pulses that propagate to a target area, and the LiDAR scanner directs these pulses in different directions. The emitted laser pulses interact with objects in the environment, and their reflected light is captured by the LiDAR photodetector. The LiDAR time-of-flight measurement system calculates the distance to the object based on the time between the emission of the laser pulse by the LiDAR laser source and the reception of the reflected laser pulse by the LiDAR photodetector. As described above, the LiDAR sensor 32 communicates electrically with the controller 14.

[0049] In another exemplary embodiment, one or more vehicle sensors 16 further include a vehicle communication system 34 for receiving information from external systems. The vehicle communication system 34 provides the controller 14 with the ability to communicate with other systems outside the vehicle 12. For example, the vehicle communication system 34 has the capability to communicate with other vehicles (“vehicle-to-vehicle (V2V)” communication), with infrastructure (“vehicle-to-infrastructure (V2I)” communication), with remote systems such as remote call centers (e.g., General Motors’ OnStar system), and / or personal devices. Generally, the term “vehicle-to-everything communication” (“V2X” communication) refers to communication between the vehicle 12 and any remote system (e.g., other vehicles, infrastructure, and / or remote systems).

[0050] In some embodiments, the vehicle communication system 34 is a wireless communication system configured to communicate using a wireless local area network (WLAN) conforming to the IEEE 802.11 standard, or using cellular data communication (e.g., using GSMA standards such as SGP.02, SGP.22, SGP.32, etc.). Therefore, the vehicle communication system 34 may also include an embedded universal integrated circuit card (eUICC) configured to store at least one cellular connectivity profile, such as an embedded subscriber identity module (eSIM) profile.

[0051] The vehicle communication system 34 is also configured to communicate via a personal area network (e.g., Bluetooth), near field communication (NFC), and / or any other type of radio frequency communication. However, additional or alternative communication methods, such as Dedicated Short Range Communication (DSRC) channels and / or mobile telecommunications protocols based on 3GPP standards, are also considered within the scope of this disclosure. A DSRC channel refers to a unidirectional or bidirectional short-to-medium range wireless communication channel specifically designed for automotive applications, along with a corresponding set of protocols and standards. 3GPP refers to a partnership among multiple standards organizations responsible for developing mobile telecommunications protocols and standards. 3GPP standards are architected by "releases." Therefore, communication methods based on 3GPP Release 14, 15, 16, and / or future 3GPP releases are considered within the scope of this disclosure.

[0052] Therefore, the vehicle communication system 34 may include one or more antennas and / or communication transceivers for receiving and / or transmitting signals, such as Cooperative Sensing Messages (CSM). The vehicle communication system 34 is configured to wirelessly transmit information between vehicle 12 and another vehicle. Furthermore, the vehicle communication system 34 is configured to wirelessly transmit information between vehicle 12 and infrastructure or other vehicles. It should be understood that, without departing from the scope of this disclosure, the vehicle communication system 34 may be integrated with the controller 14 (e.g., located on the same circuit board as the controller 14, or otherwise as part of the controller 14).

[0053] In another exemplary embodiment, one or more vehicle sensors 16 further include sensors for determining information about the interior environment of the vehicle 12. In a non-limiting example, one or more vehicle sensors 16 may also include at least one of a seat occupancy sensor, a cabin air temperature sensor, a cabin motion detection sensor, a cabin camera, a cabin microphone, etc.

[0054] It should be understood that the one or more vehicle sensors 16 discussed above are merely exemplary in nature, and without departing from the scope of this disclosure, the one or more vehicle sensors 16 may also include additional and / or alternative sensors.

[0055] The infotainment system 18 is used to provide information to the occupants of the vehicle 12. Within the scope of this disclosure, occupants include the driver and / or passengers of the vehicle 12. In one exemplary embodiment, the infotainment system 18 includes a human-machine interface (HMI) located within the occupants' line of sight and capable of displaying text, graphics, and / or images. It should be understood that HMI display systems, including liquid crystal displays (LCDs), light-emitting diode displays (LEDs), and the like, are within the scope of this disclosure. Other exemplary embodiments of the infotainment system 18 disposed in a rearview mirror are also within the scope of this disclosure.

[0056] In another exemplary embodiment, the infotainment system 18 includes a head-up display (HUD) configured to provide information to occupants of the vehicle 12 by projecting text, graphics, and / or images onto the windshield of the vehicle 12. The windshield of the vehicle 12 reflects the text, graphics, and / or images, and the occupants can see this content without taking their eyes off the road in front of the vehicle 12. In another exemplary embodiment, the infotainment system 18 includes an augmented reality head-up display (AR-HUD). An AR-HUD is a head-up display configured to enhance the occupants' view of the road in front of the vehicle 12 by overlaying text, graphics, and / or images onto physical objects in the environment surrounding the vehicle 12 that are within the occupants' field of vision.

[0057] In one exemplary embodiment, occupants can interact with the infotainment system 18 using a human-machine interface (HID) device, which includes, for example, a touchscreen, electromechanical switches, capacitive switches, knobs, etc. It should be understood that additional systems for displaying information to the occupants of the vehicle 12 are also within the scope of this disclosure.

[0058] refer to Figure 2 The diagram illustrates the interior of a vehicle 12, including an infotainment system 18. In one exemplary embodiment, the infotainment system 18 includes a touchscreen, which is substantially positioned in the center of the passenger compartment of the vehicle 12, for example, as shown in the image. Figure 2 As shown, it is located within the center console / instrument panel of vehicle 12. In a non-limiting example, one or more edges of the infotainment system 18 are defined as edges of the touchscreen, such as including the left edge 40a, upper edge 40b, right edge 40c, and lower edge 40d. In a non-limiting example, in a left-hand drive vehicle, the left edge 40a is closest to the driver of vehicle 12. In a right-hand drive vehicle, the right edge 40c is closest to the passengers of vehicle 12. It should be understood that... Figure 2 The shape, size, location, and construction of the infotainment system 18 shown are merely exemplary in nature.

[0059] refer to Figure 3 This illustrates a first exemplary user interface (UI) 50a of the infotainment system 18. The first exemplary UI 50a includes a plurality of UI elements 52 within a first content area 54a and a second content area 54b. The plurality of UI elements 52 are shapes, text, images, etc., designed for interaction by occupants of the vehicle 12 (e.g., by selection, click, touch, tap, drag, etc.). The first content area 54a is used to display one or more currently running applications and / or the home screen. Figure 3 The main screen is displayed in the first content area 54a. In a non-limiting example, multiple UI elements 52 include multiple application icons 56a displayed on the main screen. The multiple application icons 56a are configured to launch various applications, such as a weather information application, a mobile application, a navigation application, a settings application, etc. When the occupants of vehicle 12 interact with one or more of the multiple application icons 56a, an application can be opened and the main screen in the first content area 54a can be replaced.

[0060] The second content area 54b provides quick access to launch important applications and provides relevant information to the occupants of vehicle 12. In an exemplary embodiment, the second content area 54b is always displayed on the screen regardless of which application is running or displayed in the first content area 54a. In a non-limiting example, the plurality of UI elements 52 also include a plurality of control bar icons 56b displayed in the second content area 54b. In a non-limiting example, the plurality of control bar icons 56b includes a music application icon 58a, a phone application icon 58b, a navigation application icon 58c, a settings application icon 58d, and a signal strength indicator icon 58e.

[0061] In one exemplary embodiment, each of the plurality of UI elements 52 has one or more UI element features. In a non-limiting example, the one or more UI element features include UI element type (e.g., button, slider, text, image, etc.), UI element purpose (e.g., the type of application that the UI element initiates, such as weather, telephone, navigation, etc.), etc. The UI element purpose may also include information about the inherent importance of each of the plurality of UI elements 52. For example, a UI element for a navigation application is inherently more important for a driving task than a UI element for a music application. In a non-limiting example, the one or more UI element features also include dynamic and / or statistical information about each of the plurality of UI elements 52, such as the frequency of occupant use or selection.

[0062] Furthermore, each of the multiple UI elements 52 has a layout. In a non-limiting example, this layout includes the size, shape, rotation angle, color, and position within the first content area 54a and / or the second content area 54b of each of the multiple UI elements 52. The determination of the layout of each of the multiple UI elements 52 will be discussed in more detail below in conjunction with method 100. It should be understood that the above discussion and Figure 3 The first exemplary user interface (UI) 50a shown is merely exemplary in nature, and any additional and / or alternative designs, layouts, and functions are within the scope of this disclosure. Furthermore, Figure 3 The first exemplary UI 50a shown is not necessarily drawn to scale, but it relates to what will be discussed below. Figure 3 and Figure 5 Except when multiple UI elements are of a relative size of 52.

[0063] refer to Figure 4A flowchart of a method 100 for providing information to vehicle occupants is shown. Method 100 begins at block 102 and then proceeds to block 104. At block 104, controller 14 determines one or more inputs. In a non-limiting example, one or more vehicle sensors 16 are used to determine the one or more inputs. In an exemplary embodiment, the one or more inputs include measurements of vehicle operating conditions, such as the speed of vehicle 12 (e.g., determined using vehicle speed sensor 24), the acceleration of vehicle 12 (e.g., determined using IMU 26), the vibration of vehicle 12 (e.g., determined using IMU 26), the activation state of the traction control system of vehicle 12 (i.e., whether the traction control system is working to prevent slippage, indicating slippery road conditions), the time-averaged frequency of accelerator / brake pedal operations, etc.

[0064] In one exemplary embodiment, one or more inputs may also include information about external environmental conditions, such as weather conditions in the environment 28 surrounding the vehicle 12 (e.g., determined using information received via the vehicle communication system 34 and / or camera system 30), traffic congestion and / or traffic density in the environment 28 surrounding the vehicle 12 (e.g., determined using information received via the vehicle communication system 34 and / or camera system 30), visibility in the environment 28 surrounding the vehicle 12 (e.g., determined using camera system 30), the distance between the vehicle 12 and the nearest remote vehicle (e.g., determined using lidar sensor 32 and / or camera system 30), and / or so on. It should be understood that the one or more inputs discussed above are merely exemplary in nature, and various additional and / or alternative inputs may be determined at block 104. Following block 104, method 100 proceeds to block 106.

[0065] At block 106, controller 14 determines an importance score for each of the plurality of UI elements 52. Within the scope of this disclosure, the importance score represents the importance of each of the plurality of UI elements 52 to the occupants of vehicle 12. In one exemplary embodiment, controller 14 determines the importance score for each of the plurality of UI elements 52 based at least in part on one or more inputs determined at block 104 and one or more UI element features of each of the plurality of UI elements 52. In a non-limiting example, a trained machine learning model is used to determine the importance score for each of the plurality of UI elements 52, the model being trained to receive one or more inputs and one or more UI element features of each of the plurality of UI elements 52, and to provide the importance score as output.

[0066] In another non-limiting example, a deterministic algorithm is used to determine the importance score of each of the plurality of UI elements 52. For example, the importance score is determined as a normalized weighted average of one or more inputs determined at box 104, wherein the weight corresponding to each of the one or more inputs is determined based on one or more UI element features (e.g., inherent importance). For example, the importance score of each of the plurality of UI elements 52 is positively correlated with the inherent importance of each of the plurality of UI elements 52.

[0067] In another example, the importance score of each of the multiple UI elements 52 is positively correlated with the speed of vehicle 12. In another example, the importance score of each of the multiple UI elements 52 is positively correlated with the traffic density in the surrounding environment 28 of vehicle 12. In another example, the importance score of each of the multiple UI elements 52 is negatively correlated with the distance between vehicle 12 and the nearest remote vehicle. In another example, if the traction control system is activated, the importance score of each of the multiple UI elements 52 increases by a predetermined amount.

[0068] In another example, the importance score of each of the multiple UI elements 52 is positively correlated with the average temporal frequency of accelerator pedal / brake pedal operations in vehicle 12. It should be understood that the methods for determining importance scores discussed above are merely exemplary in nature and any machine learning-based or non-machine learning-based methods (e.g., mathematical functions, lookup tables, etc.) can be used without departing from the scope of this disclosure. Following box 106, method 100 proceeds to box 108.

[0069] At box 108, controller 14 determines the layout of each of a plurality of UI elements 52. In one exemplary embodiment, controller 14 determines the layout of each of the plurality of UI elements 52 based at least in part on the importance score of each of the one or more UI elements determined at box 106. In one exemplary embodiment, a rule-based algorithm is used to determine the layout of each of the plurality of UI elements 52. For example, if the importance score of a UI element is greater than a first predetermined threshold, the size of the UI element is increased by a predetermined amount (e.g., 10 percent) larger than its default size. In another example, if the importance score of a UI element is greater than a second predetermined threshold, the position of the UI element is moved to a predetermined area within the infotainment system 18.

[0070] In another example, if a UI element's importance score is below a third predetermined threshold, that UI element will not be displayed on the infotainment system 18. In another example, if a UI element's importance score is above a fourth predetermined threshold, the UI element's color is set to a predetermined color indicating high importance (e.g., red). In another example, if a UI element's importance score is below a fifth predetermined threshold, the UI element's color is set to a predetermined color indicating low importance (e.g., gray).

[0071] In another example, the size of each of the multiple UI elements 52 is correlated with the importance score of each of the multiple UI elements 52. In a non-limiting example, the size of each of the multiple UI elements 52 is positively correlated (e.g., proportional) with the importance score of each of the multiple UI elements 52. In another example, the position of each of the multiple UI elements 52 is determined based on the importance score of each of the multiple UI elements 52. In a non-limiting example, the distance between each of the multiple UI elements 52 and the edges of the infotainment system 18 (e.g., left edge 40a, top edge 40b, right edge 40c, and / or bottom edge 40d) is negatively correlated with the importance score of each of the multiple UI elements 52. For example, UI elements with higher importance scores will be closer to the edge closest to the occupant (e.g., left edge 40a in a left-hand drive vehicle and right edge 40c in a right-hand drive vehicle).

[0072] In another non-limiting example, the location of one or more of the UI elements 52 within one or more predetermined areas of the infotainment system 18 is determined by comparing the importance score of each of the multiple UI elements 52 with one or more thresholds. For example, one or more predetermined areas may include areas easily accessible to occupants (e.g., areas near occupant seating positions and / or areas within the occupant's clear line of sight). One or more predetermined areas may be determined based on the specific shape, size, and location of the infotainment system 18.

[0073] It should be understood that the rule-based algorithm examples provided above are merely exemplary in nature, and various additional and / or alternative algorithms, functions, and / or methods for determining the layout of each of the plurality of UI elements 52 are within the scope of this disclosure. In another exemplary embodiment, a machine learning algorithm is used to determine the layout of each of the plurality of UI elements 52, the machine learning algorithm being trained to determine the layout of each of the plurality of UI elements 52 based on an importance score of each of the plurality of UI elements 52.

[0074] refer to Figure 5This illustrates a second exemplary user interface (UI) 50b for the infotainment system 18. (See reference...) Figures 3 to 5 ,and Figure 3 Compared to the first exemplary UI 50a, the second exemplary UI 50b illustrates an exemplary layout change of multiple UI elements 52. In one exemplary embodiment, compared to the first exemplary UI 50a, as shown in the second exemplary UI 50b, some of the multiple application icons 56a are not displayed in the first content area 54a (e.g., because some icons in the multiple application icons 56a have an importance score below a third predetermined threshold), and the remaining icons in the multiple application icons 56a are moved to the left edge 40a and / or resized. In a non-limiting example, the remaining icons in the multiple application icons 56a are moved to the left edge 40a so that they are more easily accessible to the driver of a left-hand drive vehicle. It should be understood that in a right-hand drive vehicle, the remaining icons in the multiple application icons 56a may be moved to the right edge 40c.

[0075] In one exemplary embodiment, compared to the first exemplary UI 50a, as shown in the second exemplary UI 50b, some of the multiple control bar icons 56b are not displayed in the second content area 54b (e.g., because some of the icons in the multiple control bar icons 56b have an importance score below a third predetermined threshold), and the remaining icons in the multiple control bar icons 56b are rearranged such that icons with higher importance scores (e.g., because they have higher inherent importance) are closer to the left edge 40a. For example, the navigation application icon 58c is placed closest to the left edge 40a, followed by the phone application icon 58b, and then the music application icon 58a. Furthermore, compared to the first exemplary user interface 50a, as shown in the second exemplary UI 50b, the size of the multiple control bar icons 56b is enlarged (e.g., because the importance score of each icon in the multiple control bar icons 56b is greater than the first predetermined threshold).

[0076] It should be understood that the above discussion and Figure 5 The second exemplary user interface (UI) 50b shown is merely exemplary in nature, and any additional and / or alternative designs, layouts, and functions are within the scope of this disclosure. Furthermore, Figure 5 The second exemplary UI 50b shown is not necessarily drawn to scale, but involves... Figure 3 and Figure 5 This excludes the case where multiple UI elements are relatively 52. ​​See again... Figure 4 After box 108, method 100 enters box 110.

[0077] At block 110, controller 14 uses infotainment system 18 to display multiple UI elements 52 to provide information to the occupants of vehicle 12. In one exemplary embodiment, controller 14 displays the multiple UI elements 52 based at least in part on the layout (i.e., size, position, color, etc.) of each of the multiple UI elements 52 determined at block 108. In a non-limiting example, layout adjustments to each of the multiple UI elements 52 are displayed smoothly (e.g., using animation, etc.) to help the occupants understand and adapt to layout changes in each of the multiple UI elements 52. In another non-limiting example, controller 14 uses hysteresis rules or algorithms to limit the frequency and / or speed of layout changes in each of the multiple UI elements 52. After block 110, method 100 proceeds to block 112, entering a standby state.

[0078] In one exemplary embodiment, controller 14 repeatedly exits standby state 112 and restarts method 100 at block 102. In a non-limiting example, controller 14 exits standby state 112 and restarts method 100 under the control of a timer, for example, every 300 milliseconds.

[0079] The system 10 and method 100 of this disclosure have several advantages. By adjusting the layout of UI elements based on vehicle state characteristics and / or external environmental characteristics, the user interface of the infotainment system 18 can adapt to the current situation to improve occupant convenience. For example, when relatively large vibrations occur in the vehicle 12, by increasing the size of the UI elements, occupants can more easily select UI elements and control the infotainment system 18. Furthermore, by reducing or removing less important UI elements under stressful driving conditions (e.g., high traffic density, adverse environmental conditions, etc.), occupants can more easily control the infotainment system 18 while reducing distraction.

[0080] The description in this disclosure is exemplary in nature only, and variations that do not depart from the spirit and scope of this disclosure are intended to be included within its scope. Such variations should not be considered as departing from the spirit and scope of this disclosure.

Claims

1. A method for providing information to vehicle occupants, the method comprising: Use one or more vehicle sensors to determine one or more inputs; The layout of each of the multiple user interface (UI) elements of the infotainment system is determined, at least in part, based on the one or more inputs. as well as Information is provided to the vehicle occupants by displaying the plurality of UI elements on the infotainment system, based at least in part on the layout of each of the plurality of UI elements.

2. The method according to claim 1, wherein, Determining the one or more inputs further includes: The one or more inputs are determined, wherein the one or more inputs include measurements of vehicle operating conditions, and wherein the vehicle operating conditions include one or more of the following: the vehicle's speed, the vehicle's acceleration, and the vehicle's vibration.

3. The method according to claim 1, wherein, Determining the one or more inputs further includes: Determine the one or more inputs, wherein the one or more inputs include information about the external environmental conditions.

4. The method according to claim 3, wherein, Determining the one or more inputs further includes: The one or more inputs are determined, wherein the information about the external environment includes one or more of the following: weather conditions in the environment surrounding the vehicle and traffic congestion in the environment surrounding the vehicle.

5. The method according to claim 1, wherein, Determining the layout of each of the plurality of UI elements also includes: An importance score for each of the plurality of UI elements is determined, at least in part, based on the one or more inputs and one or more UI element features of each of the plurality of UI elements; and The layout of each of the plurality of UI elements is determined at least in part based on the importance score of each of the plurality of UI elements.

6. The method according to claim 5, wherein, Determining the importance score for each of the plurality of UI elements also includes: The importance score of each of the plurality of UI elements is determined at least in part based on one or more UI element features of each of the plurality of UI elements, wherein the one or more UI element features include the UI element purpose of each of the plurality of UI elements.

7. The method according to claim 6, wherein, Determining the importance score for each of the plurality of UI elements also includes: The importance score of each of the plurality of UI elements is determined at least in part based on one or more UI element features of each of the plurality of UI elements, wherein the UI element use of each of the plurality of UI elements includes information about the inherent importance of each of the plurality of UI elements.

8. The method according to claim 5, wherein, Determining the importance score for each of the plurality of UI elements also includes: The importance score of each of the plurality of UI elements is determined at least in part based on the one or more inputs, wherein the one or more inputs include the speed of the vehicle, and wherein the importance score of each of the plurality of UI elements is positively correlated with the speed of the vehicle.

9. The method according to claim 5, wherein, Determining the layout of each of the plurality of UI elements also includes: The layout of each of the plurality of UI elements is determined at least in part based on the importance score of each of the plurality of UI elements, wherein the layout includes at least the size of each of the plurality of UI elements, and wherein the size of each of the plurality of UI elements is positively correlated with the importance score of each of the plurality of UI elements.

10. The method according to claim 5, wherein, Determining the layout of each of the plurality of UI elements also includes: The layout of each of the plurality of UI elements is determined at least in part based on the importance score of each of the plurality of UI elements, wherein the layout includes at least the position of each of the plurality of UI elements on the infotainment system, and wherein the distance between the position of each of the plurality of UI elements and the edge of the infotainment system is negatively correlated with the importance score of each of the plurality of UI elements.

Images