Automatically adjusting digital meter cluster using machine learning database

Abstract

Automatically adjusting a digital meter cluster using a machine learning database is provided. In accordance with an exemplary embodiment, methods and systems are provided that include obtaining, via one or more sensors of a vehicle, sensor data relating to a steering wheel of the vehicle; determining, via a processor of the vehicle, whether a field of view of a user of the vehicle to a display of the vehicle is occluded by a steering wheel using the sensor data; and adjusting, via instructions provided by the processor, one or more display images presented on the display when it is determined that the field of view of the display by the user of the vehicle is obscured by the steering wheel.

Description

TECHNICAL FIELD

[0001] The technical field is generally related to vehicles, and more particularly to methods and systems for adjusting a display of a vehicle for optimal viewing by a user of the vehicle. BACKGROUND

[0002] Many vehicles today include displays for viewing by a driver or other user of the vehicle, e.g., including speed and / or other parameters related to the vehicle and / or its operation. However, such existing vehicle systems can not always provide optimal viewing of the display by the user, e.g., when the user’s view of one or more parameters of the display can be obstructed.

[0003] Accordingly, it is desirable to provide improved methods and systems for adjusting a display of a vehicle, including for improved viewing by a user of the vehicle. Moreover, in light of the foregoing technical field and background, it would be further desirable to provide other desirable features and characteristics of the present disclosure in accordance with the following detailed description and appended claims, taken in conjunction with the accompanying drawings. SUMMARY

[0004] According to an example embodiment, a method is provided that includes obtaining, via one or more sensors of a vehicle, sensor data related to a steering wheel of the vehicle; determining, via a processor of the vehicle, using the sensor data, whether a view of a display of the vehicle by a user of the vehicle is obstructed by the steering wheel; and adjusting, via instructions provided by the processor, one or more display images presented on the display when it is determined that the view of the display by the user of the vehicle is obstructed by the steering wheel.

[0005] Further in an example embodiment, the obtaining of the sensor data includes obtaining, via one or more cameras of a driver monitoring system of the vehicle, camera images; the determining of whether the view of the display is obstructed is made by the processor based on the camera images; and the adjusting of the one or more display images is performed via the processor using a machine language model.

[0006] Further in an example embodiment, the camera images are related to both the steering wheel and the user of the vehicle in addition to a reference point used to determine whether the view of the display by the user is obstructed by the steering wheel; and the determining of whether the view of the display is obstructed is made by the processor based on the camera images of the steering wheel, the user, and the reference point.

[0007] Further in an example embodiment, the reference point includes a center of an airbag cover on a B-pillar inside a cabin of the vehicle.

[0008] Further in example embodiments, the step of determining whether the field of view of the display is obstructed is also performed by the processor using a three-dimensional coordinate representation of the camera image representing the head of the driver of the vehicle, which is used to estimate a line of sight between the eyes of the driver and the display in conjunction with the estimated positioning of the steering wheel.

[0009] Further in example embodiments, the step of obtaining sensor data also includes obtaining steering wheel positioning sensor data from one or more steering wheel positioning sensors of the vehicle; and the determination of whether the field of view of the display is obstructed is also made by the processor based on the steering wheel positioning sensor data in addition to the camera image.

[0010] Further in example embodiments, the step of adjusting the one or more display images includes shifting the one or more display images to a different portion of the display that is not obstructed by the steering wheel to the user via the processor.

[0011] Further in example embodiments, the step of adjusting the one or more display images includes rescaling the one or more display images to a different size such that the one or more display images are no longer obstructed by the steering wheel to the user via the processor.

[0012] Further in example embodiments, the magnitude of the rescaling is based on whether the one or more display images represent regulatory requirements; and a portion of the one or more display images is conditionally hidden on the display based on whether the rescaling successfully mitigates the obstruction of the steering wheel and further based on whether the one or more display images represent regulatory requirements.

[0013] Further in example embodiments, the machine language model includes a plurality of input layers having values from the sensor data and from a machine language database, including driver eye positioning, steering wheel positioning, and reference positioning, and shift and focus, rescale, and conditional hide options; a plurality of hidden layers for processing the plurality of input layers; and an output node generated from the plurality of hidden layers using each of the plurality of input layers, including driver eye positioning, steering wheel positioning, and reference positioning, and shift and focus, rescale, and conditional hide options.

[0014] In another example embodiment, a system is provided that includes a processor and one or more sensors of a vehicle. The one or more sensors are configured to obtain sensor data related to a steering wheel of the vehicle. The processor is coupled to the one or more sensors and is configured to facilitate at least: determining, using the sensor data, whether a field of view of a display of the vehicle by a user of the vehicle is obstructed by the steering wheel; and adjusting, via instructions provided by the processor, one or more display images presented on the display when it is determined that the field of view of the display by the user of the vehicle is obstructed by the steering wheel.

[0015] Also in example embodiments, the one or more sensors include one or more cameras configured to obtain camera images; and the processor is further configured to facilitate at least: determining whether the field of view of the display is obstructed based on the camera images; and adjusting the one or more display images using a machine language model.

[0016] Also in example embodiments, the camera images are related to both the steering wheel and a user of the vehicle in addition to a reference point used to determine whether the field of view of the display is obstructed by the steering wheel; and the processor is further configured to facilitate at least determining whether the field of view of the display is obstructed based on the camera images of the steering wheel, the user, and the reference point.

[0017] Also in example embodiments, the processor is further configured to facilitate at least determining whether the field of view of the display is obstructed using a three-dimensional coordinate representation of the camera images representing a head of a driver of the vehicle, the three-dimensional coordinate representation being used to estimate a line of sight between eyes of the driver and the display in conjunction with an estimated positioning of the steering wheel.

[0018] Also in example embodiments, the one or more sensors further include one or more steering wheel positioning sensors of the vehicle configured to obtain steering wheel positioning sensor data; and the processor is further configured to facilitate at least determining whether the field of view of the display is obstructed using the steering wheel positioning sensor data in addition to the camera images.

[0019] Also in example embodiments, the processor is further configured to facilitate adjusting the one or more display images by shifting the one or more display images to a different portion of the display that is not obstructed by the steering wheel for the user.

[0020] Also in example embodiments, the processor is further configured to facilitate adjusting the one or more display images by rescaling the one or more display images to a different size such that the one or more display images are no longer obstructed by the steering wheel for the user.

[0021] Also in example embodiments, a magnitude of the rescaling is based on whether the one or more display images represent regulatory requirements; and a portion of the one or more display images is conditionally hidden on the display based on whether the rescaling successfully mitigates the obstruction of the steering wheel and further based on whether the one or more display images represent regulatory requirements.

[0022] Further in example embodiments, the machine language model includes a plurality of input layers having values from sensor data and from a machine language database, including driver eye positioning, steering wheel positioning, and reference positioning, and shift and focus, rescaling, and conditional hiding options; a plurality of hidden layers for processing the plurality of input layers; and an output node generated from the plurality of hidden layers using each of the plurality of input layers, including driver eye positioning, steering wheel positioning, and reference positioning, and shift and focus, rescaling, and conditional hiding options.

[0023] In another example embodiment, a vehicle is provided that includes a body, a drive system configured to move the body, a steering wheel, a display, one or more sensors, and a processor. The one or more sensors are configured to obtain sensor data related to the steering wheel. The processor is coupled to the one or more sensors and is configured to at least facilitate: determining, using the sensor data, whether a user’s view of the display is obstructed by the steering wheel; and adjusting, via instructions provided by the processor, one or more display images presented on the display when it is determined that the user’s view of the display is obstructed by the steering wheel. BRIEF DESCRIPTION OF DRAWINGS

[0024] The present disclosure will be described below with respect to the following drawings, wherein like numerals indicate like elements, and wherein:

[0025] Figure 1 is a functional block diagram of a vehicle including a display, a steering wheel, and a control system for controlling the display, including when a user’s view of the display would otherwise be affected by the steering wheel, in accordance with example embodiments;

[0026] Figure 2 is a flowchart of a process for controlling a vehicle display, including when a user’s view of the display would otherwise be affected by a steering wheel, in accordance with example embodiments, and which can be implemented in conjunction with Figure 1 a vehicle, display, and control system of

[0027] Figure 3 and Figure 4 are depictions of example implementations of a portion of Figure 2 a process, including a determination of whether a user’s view of a display is affected by a steering wheel, in accordance with example embodiments;

[0028] Figure 5 is a depiction of a machine learning model utilized in example implementations of a portion of Figure 2 a process, in accordance with example embodiments; and

[0029] Figure 6A , Figure 6B ,Figure 7A 、 Figure 7B and Figure 8 depicts an example vehicle display according to process adjustments according to Figure 2 exemplary embodiments. DETAILED DESCRIPTION

[0030] The following detailed description is merely exemplary in nature and is not intended to limit the disclosure or the application and uses of it. Furthermore, there is no intention to be bound by any theory of operation described herein.

[0031] Figure 1 A vehicle 100 according to exemplary embodiments is illustrated. As described in further detail below, according to exemplary embodiments, the vehicle 100 includes a display 103 and a control system 102 configured to control the display 103, including when a user’s view of the display 103 would otherwise be impaired.

[0032] In various embodiments, the vehicle 100 comprises an automobile. The vehicle 100 can be any of several different types of automobiles, such as, for example, a sedan, a van, a truck, or a sport utility vehicle (SUV), and can be two-wheel drive (2WD) (i.e., rear-wheel drive or front-wheel drive), four-wheel drive (4WD), or all-wheel drive (AWD) and / or various other types of vehicles in certain embodiments. The vehicle 100 can also comprise a motorcycle or other conveyance, such as an aircraft, a spacecraft, a watercraft, etc., and / or one or more other types of mobile platforms (e.g., robots and / or other mobile platforms) in certain embodiments.

[0033] The vehicle 100 includes a body 104 disposed on a chassis 116. The body 104 substantially encloses other components of the vehicle 100. The body 104 and the chassis 116 can collectively form a frame. The vehicle 100 also includes a plurality of wheels 112. The wheels 112 are each rotatably coupled to the chassis 116 near a respective corner of the body 104 to facilitate movement of the vehicle 100. In one embodiment, the vehicle 100 includes four wheels 112, although this can vary in other embodiments (e.g., for trucks and certain other vehicles).

[0034] A drive system 110 is mounted on the chassis 116 and drives the wheels 112, e.g., via axles 114. In certain embodiments, the drive system 110 comprises a propulsion system. In certain example embodiments, the drive system 110 includes an internal combustion engine and / or an electric motor / generator coupled with its transmission. The drive system 110 can vary in certain embodiments, and / or two or more drive systems 110 can be used.

[0035] As Figure 1As depicted, in various embodiments, the vehicle also includes a braking system 106 and a steering system 108. In example embodiments, the braking system 106 controls braking of the vehicle 100 using braking components that are controlled via input provided by a driver (e.g., in certain embodiments via a brake pedal) and / or automatically controlled via the control system 102. Also in example embodiments, the steering system 108 controls steering of the vehicle 100 via steering components (e.g., a steering column coupled to an axle 114 and / or a wheel 112) that are controlled via input provided by a driver (e.g., in certain embodiments via a steering wheel 105) and / or automatically controlled via the control system 102.

[0036] In various embodiments, the display 103 provides information to a driver and / or other users of the vehicle 100. For example, in various embodiments, the display 103 provides a digital cluster of display images featuring parameters and information regarding the speed of the vehicle 100, as well as other possible parameters related to the vehicle 100 and / or its operation (e.g., revolutions per minute, temperature, fuel gauge, etc.). In various embodiments, the display 103 includes a system comprising a display screen for visually depicting this information to a user in accordance with instructions provided thereto by the control system 102. In certain embodiments, the display 103 can also include one or more audio, haptic, and / or other components.

[0037] In Figure 1 embodiments depicted therein, the control system 102 is coupled to the display 103. In certain embodiments, the control system 102 can also be coupled to one or more other vehicle components, such as the drive system 110, the steering system 108, the braking system 106, etc. In various embodiments, the control system 102 controls the display 103, including by adjusting images and parameters for the display 103 when a user’s view of the display 103 is impaired or indicated, including when the steering wheel 105 obstructs a user’s view of a portion or more of the display 103. In various embodiments, the control system 102 provides these functions in accordance with the processes 200 and Figure 2 , Figures 3-5 , Figure 6A , Figure 6B , Figure 7A , Figure 7B and Figure 8 as described in further detail below in connection therewith. In certain embodiments, the control system 102 can also control one or more other systems of the vehicle 100.

[0038] As Figure 1As depicted, in various embodiments, the control system 102 includes a sensor array 120 and a controller 140 as described in greater detail below.

[0039] In various embodiments, the sensor array 120 includes various sensors that obtain sensor data used to determine whether a user's field of view of the display 130 is obstructed. In the depicted embodiment, the sensor array 120 includes one or more cameras 122 and one or more steering wheel sensors 124.

[0040] In various embodiments, the one or more cameras 122 obtain camera images that relate to a face of a driver or other user of the vehicle 100, and in further embodiments, also to the steering wheel 105 and one or more reference points of the vehicle 100, including for determining whether the user can directly view the display 130 without obstruction.

[0041] Additionally, in various embodiments, the one or more steering wheel position sensors 124 detect a position of the steering wheel 105 of the vehicle 100, in the form of steering wheel position sensors that can also be used to determine whether the user can directly view the display 130 without obstruction.

[0042] In various embodiments, the controller 140 is coupled to the sensor array 120 and the display 103. In various embodiments, as described above, the controller 140 can also be coupled to one or more other vehicle systems. Further in various embodiments, the controller 140 includes a computer system (also referred to herein as computer system 140), and includes a processor 142, a memory 144, an interface 146, a storage device 148, and a computer bus 150. In various embodiments, the controller (or computer system) 140 controls the display 103, including adjustments thereto, such that a driver or other user of the vehicle 100 can view parameters and information of the display 103 without obstruction, including without obstruction by the steering wheel 105. In various embodiments, the controller 140 provides these and other functions in accordance with the processes 200 of Figure 2 the steps of Figures 3-5 、 Figure 6A 、 Figure 6B 、 Figure 7A 、 Figure 7B and Figure 8 implementations of

[0043] In various embodiments, the controller 140 (and in certain embodiments, the control system 102 itself) is disposed within the body 104 of the vehicle 100. In one embodiment, the control system 102 is mounted on the chassis 116. In certain embodiments, the controller 140 and / or the control system 102 and / or one or more components thereof can be disposed outside of the body 104, for example on a remote server, in the cloud, or in other devices in which image processing is performed remotely.

[0044] It will be appreciated that the controller 140 can otherwise differ from the embodiment depicted in Figure 1 For example, the controller 140 can be coupled to or can otherwise utilize one or more remote computer systems and / or other control systems, for example as part of one or more of the vehicle 100 devices and systems described above.

[0045] In the depicted embodiment, the computer system of the controller 140 includes a processor 142, a memory 144, an interface 146, a storage device 148, and a bus 150. The processor 142 performs the computational and control functions of the controller 140 and can comprise any type of processor or multiple processors, a single integrated circuit such as a microprocessor, or any suitable number of integrated circuit devices and / or circuit boards that cooperate to cause the processing unit to function as described. During operation, the processor 142 executes one or more programs 152 contained in the memory 144 and thus controls the general operation of the controller 140 and the computer system of the controller 140, typically in accordance with the processes described herein such as the process 200 of Figure 2 and the implementation of Figures 3-5 , Figure 6A , Figure 6B , Figure 7A , Figure 7B and Figure 8 .

[0046] The memory 144 can be any suitable type of memory. For example, the memory 144 can include various types of dynamic random access memory (DRAM) such as SDRAM, various types of static RAM (SRAM), and various types of non-volatile memory (PROM, EPROM, and flash memory). In certain examples, the memory 144 is located and / or co-located on the same computer chip as the processor 142. In the depicted embodiment, the memory 144 stores the programs 152 described above as well as stored values 157 (for example, threshold values for the process 200 in various embodiments).

[0047] Bus 150 serves to transmit program, data, status, and other information or signals between various components of the computer system of controller 140. Interface 146 allows communication, for example, from a system drive and / or another computer system to the computer system of controller 140, and can be implemented using any suitable method and means. In one embodiment, interface 146 obtains various data from sensor array 120 and other possible data sources. Interface 146 can include one or more network interfaces to communicate with other systems or components. Interface 146 can also include one or more network interfaces to communicate with a technician and / or one or more storage interfaces to connect to storage devices such as storage device 148.

[0048] Storage device 148 can be any suitable type of storage device, including various different types of direct access storage and / or other memory devices. In one example embodiment, storage device 148 includes a program product from which memory 144 can receive program 152 that performs one or more embodiments of one or more processes of the present disclosure, such as the processes 200 discussed further below and the implementation of the steps of the processes 200 and the implementation of the steps of the processes 200 discussed below in connection with Figure 2 Figures 3-5 、 Figure 6A 、 Figure 6B 、 Figure 7A 、 Figure 7B and Figure 8 . In another example embodiment, the program product can be stored directly in memory 144 and / or disk (e.g., disk 156) and / or otherwise accessed by memory 144 and / or disk, such as referenced hereinafter.

[0049] Bus 150 can be any suitable physical or logical means of connecting computer systems and components. This includes, but is not limited to, direct hard-wired connections, fiber optics, infrared, and wireless bus technology. During operation, program 152 is stored in memory 144 and executed by processor 142.

[0050] ​It will be understood that although this exemplary embodiment is described in the context of a full-featured computer system, those skilled in the art will recognize that the mechanisms of this disclosure can be distributed as a program product using one or more types of non-transitory computer-readable signal-bearing media used to store a program and its instructions and to perform its distribution, such as a non-transitory computer-readable medium carrying a program and containing computer instructions stored therein for causing a computer processor (such as processor 142) to execute and run the program. Such program products can take various forms, and this disclosure applies equally regardless of the specific type of computer-readable signal-bearing medium used to perform the distribution. Examples of signal-bearing media include recordable media such as floppy disks, hard disks, memory cards, and optical disks, and transmission media such as digital and analog communication links. It will be understood that cloud-based storage and / or other technologies may also be utilized in some embodiments. Similarly, it will be understood that the computer system of controller 140 may otherwise differ from other systems. Figure 1 In the depicted embodiments, for example, the computer system of controller 140 may be coupled to or may otherwise utilize one or more remote computer systems and / or other control systems.

[0051] Continue to refer to Figure 1 In some embodiments, the control system 102 may also be interpreted as part of a larger system 101, which, for example, in some embodiments, also includes a display 103 and / or a steering wheel 105.

[0052] Figure 2 This is a flowchart of process 200 for controlling a display of a vehicle (including when the user's view of the display would otherwise be impaired) according to an exemplary embodiment. In various embodiments, process 200 may be combined with... Figure 1 100 vehicles (including) Figure 1 This is achieved through the display 103 and the control system 102, as well as their components. Further reference will be made below. Figures 3-5 , Figure 6A , Figure 6B , Figure 7A , Figure 7B and Figure 8 Further discussion of process 200, these figures depict Figure 2 An exemplary implementation of process 200.

[0053] like Figure 2 As depicted, in various embodiments, process 200 begins at step 202. In one embodiment, process 200 begins when the vehicle is driven or the ignition cycle begins, such as when the driver enters the vehicle to operate it. In one embodiment, the steps of process 200 are performed continuously during operation of the vehicle.

[0054] In various embodiments, sensor data is collected (step 202) when a user (e.g., a driver) adjusts his or her position in vehicle 100. In various embodiments, sensor data is collected when the driver adjusts his or her seat before currently driving the vehicle. Figure 1 When the steering wheel is at 105, sensor data is transferred from... Figure 1 The sensor array 120 was obtained.

[0055] In various embodiments, the steering wheel positioning is determined (step 204). Specifically, in various embodiments, the processor 142 determines the positioning of the steering wheel 105 based on the sensor data from step 202 (including sensor data obtained from one or more of its cameras 122 and / or steering wheel sensors 124).

[0056] refer to Figure 3 The illustration 300 provides a determination of the steering wheel positioning in step 204 according to an exemplary embodiment. Specifically, as shown in the figure... Figure 3 As depicted in Figure 300, in an exemplary embodiment, one or more cameras of the Driver Monitoring System (DMS) 302 (e.g., positioned near the steering wheel 105 in an exemplary embodiment) are used to detect the current position of the steering wheel 105 relative to a known reference point 304. In an exemplary embodiment, the reference point 304 includes the center of the airbag cover on a pillar (such as the B-pillar) of the passenger compartment inside the vehicle 100; however, this may vary in other embodiments. In some other embodiments, the steering wheel positioning may alternatively be determined directly via sensor data obtained by one or more steering wheel sensors 124 (which may also be part of the DMS 302 in some embodiments).

[0057] Return to reference Figure 2 Similarly, in various embodiments, the driver's location is determined (step 206). Specifically, in various embodiments, the processor 142 determines the location of the driver's eyes (and / or, in some embodiments, the location of the head) based on the sensor data from step 202 (including sensor data obtained from one or more cameras 122).

[0058] refer to Figure 4 Illustration 400 is provided regarding the determination of the driver's eyes (and / or head) in step 206 according to an exemplary embodiment. Specifically, as Figure 4depicted in diagram 400, in example embodiments, one or more cameras of DMS 302 are used to collect camera images of seat 406 occupied by the driver and head 404 of the driver in order to obtain a three-dimensional coordinate representation 402 (e.g., AX, AY, AZ) of the driver’s eyes (or, in certain embodiments, head) that is used in conjunction with the estimated positioning of the steering wheel to estimate the line of sight between the driver’s eyes and the display.

[0059] Referring back to Figure 2 In various embodiments, a determination is made as to whether the driver’s view of the display is obscured (step 208). In various embodiments, during step 208, processor 142 utilizes the sensor data of step 202, as well as the determinations of steps 206 and 208, to determine whether the driver has an obscured view of display 103 (e.g., the speed of the vehicle, the fuel mileage, and / or other parameters related to vehicle 100 and / or its operation that are depicted on the screen of display 103). For example, in certain embodiments, the determination of step 208 includes a determination as to whether the edge, hub, or other component or portion of steering wheel 105 obscures all or a portion of the screen of display 103 (including the upper or lower border line of the instrument cluster), as well as other possible obstructions from steering wheel 105 (e.g., such that the driver’s line of sight does not reach certain display images of information on the display).

[0060] In various embodiments, if it is determined in step 208 that there is no steering wheel-based obstruction of the display, the display is unchanged (step 210). Specifically, in various embodiments, when the display is not obstructed, processor 142 provides instructions for display 103 to continue to display display images with parameters and information in the current or default positioning, size, and display manner.

[0061] Conversely, also in various embodiments, if it is instead determined in step 208 that there is a steering wheel-based obstruction of the display, one or more appropriate adjustments to the display images of the display are determined utilizing a machine learning database (step 212). Specifically, in various embodiments, in conjunction with a machine learning model, along with a machine learning database (e.g., as stored values 157 stored in memory 144 of vehicle 100), the sensor data and related determinations of steps 202-208 are utilized in order to determine one or more adjustments to the display images for displaying information to the driver such that the display (or, in certain embodiments, key parameters and / or other information displayed therein) is no longer obstructed, but can instead be easily viewed by the driver of vehicle 100.

[0062] Referring to Figure 5 An example machine learning model 500 is depicted, and it can be utilized in conjunction withFigure 2 Step 208 of process 200. As Figure 5 depicted, in example embodiments, machine learning model 500 includes a plurality of input layers 502, a plurality of hidden layers 520, and an output layer 530.

[0063] Further as Figure 5 depicted, in example embodiments, input layers 502 include driver eye positioning 504, steering wheel positioning 506, reference positioning 508 (e.g., in certain embodiments, a reference positioning of the center of the airbag cover); shift and center options 510; rescale options 512, and conditional hidden options 514. In various embodiments, driver eye positioning 504, steering wheel positioning 506, and reference positioning 508 are determined via processor 142 based on sensor data and determinations of steps 204-208. Further in various embodiments, shift and center options 510, rescale options 512, and conditional hidden options 514 represent potential manipulations of the display image depicted on display 103 that can mitigate the occlusion of the driver’s view of display 103 by steering wheel 105.

[0064] Further as Figure 5 depicted, in example embodiments, hidden layers 520 include at least two additional layers for processing input layers 502. Additionally, in certain embodiments, given sensor data and other input layers 502, output 530 provides a result of the potential manipulation as to whether and to what extent the potential manipulation can successfully mitigate or remove the occlusion of the driver’s view of display 103 by steering wheel 105.

[0065] Referring back to Figure 2 , in example embodiments, a shift and center of data is performed (step 214). In various embodiments, during step 214, processor 142 applies one of the potential manipulations to the display image for information appearing on display 103, namely, shift and center. Specifically, in various embodiments, processor 142 performs the following: shifts the display image having information of interest (e.g., vehicle speed and other important information for the driver to view) along display 103 into a region of display 103 that is not occluded by steering wheel 105 from the driver’s view. In various embodiments, this also includes centering the display image having information of interest into a central or middle region of the portion of display 103 that is not occluded by steering wheel 105 (e.g., in various embodiments, such that a line of sight from the driver’s eyes to display 103 is not occluded by steering wheel 105).

[0066] Further in the example embodiment, a determination is made as to whether the occlusion is resolved (step 216). In certain embodiments, during step 216, the processor 142 determines whether the shifting and centering of step 214 effectively removed the occlusion so that the driver can now successfully view the display 103 (and in particular the information of interest therein).

[0067] In various embodiments, if it is determined in step 216 that the shifting and centering of step 214 effectively removed the occlusion, then the shifting is maintained (step 218). In particular, in various embodiments, during step 216, the processor 142 provides instructions implemented via the display 103 to provide a display image on the display that incorporates the shifting and centering of step 216 with the information.

[0068] Referring to Figure 6A and Figure 6B , illustrations 600 and 650 are provided, respectively, in accordance with the example embodiment, with respect to the display of step 218 (including the shifting and centering of step 214). In particular, as depicted in the example embodiment, Figure 6A the previously occluded area 602 of the first illustration 600 is shifted upward into the updated area 652 as shown in the second illustration 650, which is unoccluded for the driver (e.g., so that the line of sight from the driver's eyes to this area of the display 103 is not occluded by the steering wheel 105). Figure 6B

[0069] Referring back to Figure 2 , if instead it is determined in step 216 that the shifting and centering of step 214 did not effectively remove the occlusion, then in various embodiments, the process 200 proceeds to step 220, which is described immediately below.

[0070] In various embodiments, during step 220, a determination is made as to whether the occluded information of the display 130 (i.e., currently not visible or otherwise occluded with respect to the driver) is related to regulatory requirements or procedural requirements. In various embodiments, regulatory requirements would apply to information required to be visible to the driver by a government and / or other regulatory body. Conversely, further in various embodiments, procedural requirements would apply to information that would be useful for the driver to view, but is not required by a government and / or other regulatory body. In various embodiments, the determination of step 220 is made by the processor 142 based on stored knowledge of regulatory and procedural requirements (e.g., stored as stored values therein) stored in the memory 144 of the Figure 1 .

[0071] ​In various embodiments, if it is determined during step 220 that the occluded information is related to a regulatory requirement, the image is rescaled in display 103 by a first magnitude (step 222). Specifically, in various embodiments, during step 222, processor 142 rescales the displayed image with the occluded information to a first rescaled magnitude in an attempt to remove the occlusion while otherwise maintaining the image of the information as large as possible. In one exemplary embodiment, the first rescaled magnitude includes a new magnitude that is ninety percent (90%) of the original magnitude; however, this may vary in other embodiments.

[0072] Furthermore, in an exemplary embodiment, a determination is made regarding whether the obstruction has been resolved (step 224). In some embodiments, during step 224, the processor 142 determines whether the rescaling in step 222 has effectively removed the obstruction, allowing the driver to now successfully view the information on display 103.

[0073] In various embodiments, if it is determined in step 224 that the rescaling in step 224 effectively removes the occlusion, then the rescaling in step 222 is maintained (step 226). Specifically, in various embodiments, during step 226, processor 142 provides instructions implemented via display 103 to provide the display image and information as rescaled in step 222.

[0074] refer to Figure 7A and Figure 7B According to an exemplary embodiment, first and second illustrations 700 and 750 are provided respectively regarding the display of step 226 (including the rescaling of step 222). Specifically, as depicted in the exemplary embodiment, Figure 7A The previously displayed image of the occluded area 702 in the first illustration 700 is rescaled, as shown. Figure 7B As shown in the second illustration 750, the displayed image is no longer obstructed for the driver (e.g., the driver's line of sight from their eyes to this area of ​​the display 103 is not obstructed by the steering wheel 105). For example, as... Figure 7B As shown in the second illustration 750, the speed limit and other vehicle data have been rescaled so that they are no longer obscured by the steering wheel 105.

[0075] Return to reference Figure 2 If, alternatively, it is determined in step 224 that the rescaling of step 222 has not effectively removed the occlusion, then in various embodiments, process 200 proceeds to step 228, which is described directly below.

[0076] In various embodiments, during step 228, the displayed image is rescaled a second magnitude on display 103. Specifically, in various embodiments, during step 228, processor 142 rescales the occlusion information to a second rescaled magnitude in an attempt to further remove the occlusion. In various embodiments, the second rescaled magnitude of step 228 includes a further reduction in image size, such that the second rescaled magnitude of step 228 is smaller than the first rescaled magnitude of step 222. In one exemplary embodiment, the second rescaled magnitude of step 228 includes a new magnitude such that the displayed image and associated information are fitted within the boundaries of the portion of display 103 visible to the driver (e.g., based on the line of sight from the driver's eyes to display 103), but otherwise maximizes the image size of the information visible to the driver. In various embodiments, the rescaled displayed image of step 228 is provided to the driver via display 103 based on instructions provided by processor 142.

[0077] Returning to step 220, if alternatively, it is determined during step 220 that the occluded information relates to a procedural requirement (rather than a regulatory requirement), the image is rescaled a third magnitude in display 103 (step 230). Specifically, in various embodiments, during step 230, processor 142 rescales the occluded information to a third rescaled magnitude such that the displayed image is smaller than the first rescaled magnitude of step 222. In one exemplary embodiment, the third rescaled magnitude of step 230 includes a new magnitude as seventy percent (70%) of the original magnitude; however, this may vary in other embodiments.

[0078] Furthermore, in an exemplary embodiment, a determination is made regarding whether the obstruction has been resolved (step 232). In some embodiments, during step 232, the processor 142 determines whether the rescaling in step 230 has effectively removed the obstruction, allowing the driver to now successfully view the information on display 103.

[0079] In various embodiments, if it is determined in step 232 that the rescaling in step 230 effectively removed the occlusion, then the rescaling in step 230 is maintained (step 234). Specifically, in various embodiments, during step 234, the processor 142 provides instructions implemented via the display 103 to provide information such as the rescaling in step 230.

[0080] Conversely, if it is determined in step 232 that the rescaling in step 230 has not effectively removed the occlusion, then in various embodiments, process 200 proceeds to step 236, which is described directly below.

[0081] In various embodiments, during step 236, the image is shifted and / or manipulated such that some information is considered relatively less important (compared to other relatively more important information). In various embodiments, this is performed via display 103 based on instructions provided by processor 142.

[0082] refer to Figure 8 The illustration 800 provides a display of step 236. Specifically, according to an exemplary embodiment, certain information (considered relatively less important) and associated display images may be hidden from the driver's field of vision in the display 103 to help ensure that the driver can clearly see other information (such as vehicle speed considered relatively more important) on the display 103.

[0083] Therefore, methods, systems, and vehicles for controlling displays of a vehicle are provided. In various embodiments, sensor data (including, in various embodiments, data from a driver monitoring camera and / or a steering wheel sensor) is used to determine whether information on the display is obstructed by the vehicle's steering wheel for viewing by the vehicle's driver or other users. In various embodiments, the image on the display is adjusted accordingly via instructions provided by the vehicle's processor to remove the obstruction, allowing the driver to clearly view the information on the vehicle's display (including ensuring a clear line of sight from the driver's eyes to the information on the display, unobstructed by the vehicle's steering wheel).

[0084] It will be understood that the systems, vehicles, and methods may differ from those depicted in the accompanying drawings and described herein. For example, Figure 1 The vehicle 100, its control system 102 and / or display 103, and / or Figure 1 Its components can vary in different embodiments. Similarly, it will be understood that the steps of process 200 can differ. Figure 2 The steps described herein, and / or the various steps of process 200, may occur simultaneously and / or be related to... Figure 2 The order described in the text differs from the order in which they occur. Similarly, understanding will... Figures 3-5 , Figure 6A , Figure 6B , Figure 7A , Figure 7B and Figure 8 The implementation method can also be different in various embodiments.

[0085] While at least one exemplary embodiment has been presented in the foregoing detailed description, it should be understood that numerous variations exist. It should also be understood that the exemplary embodiments or multiple exemplary embodiments are merely examples and are not intended to limit the scope, applicability, or configuration of this disclosure in any way. Rather, the foregoing detailed description will provide those skilled in the art with a convenient roadmap for implementing the exemplary embodiments or multiple exemplary embodiments. It should be understood that various changes can be made to the function and arrangement of the elements without departing from the scope of this disclosure as set forth in the appended claims and their legal equivalents.

Claims

1. A method comprising: obtaining, via one or more sensors of a vehicle, sensor data relating to a steering wheel of the vehicle; determining, via a processor of the vehicle, using the sensor data, whether a field of view of a display of the vehicle by a user of the vehicle is obstructed by the steering wheel; and when it is determined that the field of view of the display by the user of the vehicle is obstructed by the steering wheel, adjusting, via instructions provided by the processor, one or more display images presented on the display.

2. The method of claim 1, wherein: the obtaining of the sensor data comprises obtaining, via one or more cameras of a driver monitoring system of the vehicle, camera images; the determining of whether the field of view of the display is obstructed is made by the processor based on the camera images; and the adjusting of the one or more display images is performed via the processor using a machine language model.

3. The method of claim 2, wherein: the camera images relate to both the steering wheel and the user of the vehicle in addition to a reference point used to determine whether the field of view of the display is obstructed by the steering wheel; and the determining of whether the field of view of the display is obstructed is made by the processor based on the camera images of the steering wheel, the user, and the reference point.

4. The method of claim 3, wherein the reference point comprises a center of an airbag cover on a B-pillar inside a cabin of the vehicle.

5. The method of claim 3, wherein the step of determining whether the field of view of the display is obstructed is also performed by the processor using a three-dimensional coordinate representation of the camera images representing a head of a driver of the vehicle, the three-dimensional coordinate representation being used to estimate a line of sight between eyes of the driver and the display in conjunction with an estimated positioning of the steering wheel.

6. The method of claim 2, wherein: the step of obtaining the sensor data further comprises obtaining steering wheel positioning sensor data from one or more steering wheel positioning sensors of the vehicle; and the determining of whether the field of view of the display is obstructed is also made by the processor based on the steering wheel positioning sensor data in addition to the camera images.

7. The method of claim 1, wherein the step of adjusting the one or more display images comprises shifting, via the processor, the one or more display images to a different portion of the display that is not obstructed by the steering wheel for the user.

8. The method of claim 1, wherein the step of adjusting the one or more display images comprises rescaling, via the processor, the one or more display images to a different size such that the one or more display images are no longer obstructed by the steering wheel for the user.

9. The method of claim 2, wherein the machine language model comprises: ​ a plurality of input layers having values from the sensor data and from a machine language database, including driver eye positioning, steering wheel positioning, and reference positioning, and shift and focus, rescale, and conditional hide options; a plurality of hidden layers for processing the plurality of input layers; and an output node generated from the plurality of hidden layers using each of the plurality of input layers, including the driver eye positioning, the steering wheel positioning, and the reference positioning, and the shift and focus, rescale, and conditional hide options.

10. A system comprising: one or more sensors of a vehicle configured to obtain sensor data related to a steering wheel of the vehicle; and a processor coupled to the one or more sensors and configured to facilitate at least: determining, using the sensor data, whether a field of view of a user of the vehicle to a display of the vehicle is obstructed by the steering wheel; and adjusting one or more display images presented on the display via instructions provided by the processor when it is determined that the field of view of the user of the vehicle to the display is obstructed by the steering wheel.

Images