Adaptive visual enhancement for drivers having

Abstract

The present disclosure provides "adaptive visual enhancement of drivers with left and right vision differences". A motorized transport vehicle has a passenger compartment having a plurality of seating locations for respective persons to seate. A display system in the vehicle has a plurality of display zones, wherein each display zone is visualized along a respective vector from one or more of the seating locations. A dominant eye of a particular occupant seated at a respective seating location is identified when there are different visual preferences between the right and left eyes of the particular occupant. Display content is generated for display to the particular occupant. A display area is selected to display the display content, wherein the selected display area corresponds to a respective vector from the seating position of the particular occupant that matches the dominant eye of the particular occupant.

Description

Technical Field

[0001] The present invention generally relates to visual displays in motor vehicles, and more specifically, to enhancing the presentation of visual information based on the left / right visual differences of vehicle occupants. Background Technology

[0002] Differences in visual acuity or intensity between a person's left and right eyes can result in varying levels of sharpness and the ability to perceive detail, potentially making it difficult to accurately judge distances, read road signs, or detect potential hazards. Variations in the field of vision between the eyes can also lead to narrower or wider blind spots, potentially reducing perception of the vehicle's interior and surroundings. When these visual differences between the eyes are permanent, traditional corrective lenses may not adequately address them.

[0003] Visual differences between the two eyes can be caused by a variety of medical conditions, such as anisometropia or amblyopia. Some conditions may be temporary (e.g., eye strain, dry eye, allergies, medications, infections, or injuries). Individuals with significant visual differences sometimes develop coping strategies, such as relying more on their better eye or using assistive devices. However, these adaptations may not completely alleviate the challenge. Summary of the Invention

[0004] In one aspect of the invention, a transport vehicle has a passenger compartment having a plurality of seating positions for respective occupants. A display system is provided having a plurality of display areas, each of which is visualized along a corresponding vector from one or more of the seating positions. A visual classifier responds to a specific occupant seated in a given seating position to identify the dominant eye of the specific occupant when there is a different visual preference between the right and left eyes of the specific occupant. An image source generates display content to be displayed to the specific occupant. A display manager is coupled to the image source and the display system, wherein the display manager is configured to select a display area for displaying the display content. The selected display area corresponds to a corresponding vector from the seat position of the specific occupant that matches the dominant eye of the specific occupant.

[0005] In another aspect of the invention, a method is provided for controlling a display system in a transport vehicle, wherein the transport vehicle has a passenger compartment having a plurality of seating positions for respective occupants, wherein the display system has a plurality of display areas, and wherein each display area is visualized along a corresponding vector from one or more of the seating positions. The method identifies the dominant eye of a particular occupant when there is a different visual preference between the right and left eyes of the occupant seated in the respective seating position. Display content is generated to be displayed to the particular occupant. A display area is selected to display the display content, wherein the selected display area corresponds to a corresponding vector from the seating position of the particular occupant that matches the dominant eye of the particular occupant. Attached Figure Description

[0006] Figure 1 It describes the field of vision.

[0007] Figure 2 and Figure 3 The mapping of the visual field to the retina of the left and right eyes is shown respectively.

[0008] Figure 4 The overlap of the left and right visual fields is shown based on the fixation point.

[0009] Figure 5 This is a schematic diagram illustrating a vehicle layout with multiple visual displays that provide multiple display areas arranged across the field of vision of occupants (e.g., the driver) of the vehicle.

[0010] Figure 6 This is a schematic diagram showing the visual vector of an occupant facing various displays, which present various display areas that may fall within the field of vision of the occupant's dominant eye.

[0011] Figure 7 This is a block diagram illustrating a motorized transport vehicle according to one embodiment.

[0012] Figure 8 This is a block diagram showing the components of the present invention in more detail.

[0013] Figure 9 This is a flowchart illustrating a preferred method of the present invention.

[0014] Figure 10 This is a schematic diagram illustrating a seating arrangement for optimizing the field of vision of vehicle occupants with corresponding visual differences.

[0015] Figure 11 This is a flowchart illustrating a method for determining the seating arrangement.

[0016] Figure 12This is a flowchart illustrating a method for displaying priority information related to obstacles in or near a vehicle's path. Detailed Implementation

[0017] An adaptive in-vehicle vision distribution system is provided that can detect and compensate for visual differences between a user's eyes. Specifically, the user can typically include the driver of a vehicle. Advanced sensors and cameras dynamically assess the user's visual acuity, field of vision, and blind spot differences in real time. In response, the delivery of visual information is customized by intelligently distributing and adapting the displayed content across multiple in-vehicle screens or projection displays (e.g., head-up displays or HUDs). Multiple screens and HUDs provide a series of display zones occupying different portions of the user's field of vision. The redistribution of visual display content among the display zones is configured to compensate for imbalances in visual intensity between the eyes, thereby ensuring that key details are delivered to the stronger eye for clearer perception. The invention can utilize computational vision techniques to identify environmental elements falling within the user's blind spot or reduced visibility zone caused by changes in field of vision. The identified elements can then be strategically displayed within said zones (including dedicated blind spot screens or augmented reality projections within the driver's line of sight). Eye-tracking technology monitors the driver's or other occupant's gaze. The delivery of visual information can be dynamically adjusted based on their current gaze point (i.e., focus). The adaptive system ensures that the expected visual information is presented within the optimal field of vision, thereby mitigating the effects of interocular visual differences.

[0018] Parallax between eyes can be automatically detected by analyzing several parameters, such as gaze direction, eye movement and nature, head position, mirror use, and driver behavior. Consistency in the gaze direction of an eye focused on the road or mirror can be used to assess visual dominance. Examining head position can determine if the head habitually turns towards one eye. Mirror use can reveal which eye is primarily used when checking the mirror. During driving, specific behaviors and movements, such as when the driver veers to one side while the vehicle is turning, may indicate a dominant eye. Eye blinking and reflections (reflections from the corneal surface) can also identify the dominant eye. Eye movement and blinking patterns can be examined, where the frequency and pattern of eye movement and blinking can be correlated with visual dominance based on models of this behavior. In some cases, it can be determined that one eye is nonfunctional (e.g., blind or missing), leading to the conclusion that the other eye is the dominant eye.

[0019] Temporary eye problems can be detected, such as the use of an eye patch, pupil dilation after an eye exam, dry eyes, or damaged or misplaced glasses or contact lenses. These conditions can be detected automatically or triggered manually by the user. In addition to redistributing displayed content, display parameters (such as brightness) can be adjusted to reduce eye strain.

[0020] Different visual preferences (e.g., right-eye or left-eye dominance) can be manually entered by the user or determined automatically. In either case, user profiles can be built and expanded over time to improve detection accuracy. For example, users can manually enter their preference for their dominant eye, which can be stored in their profile. Stored user profiles can be saved in the cloud or on a local network, or shared via a cloud or local network, enabling seamless transfer between vehicles.

[0021] This invention leverages advanced eye-tracking sensors, computational vision algorithms, and dynamic head-up display (HUD) technology to provide a seamless and immersive visual experience. It continuously monitors the user's gaze to assess differences in visual acuity, field of vision, and blind spots between eyes in real time. Based on detected visual imbalances, visual information is intelligently redistributed across multiple in-vehicle displays and / or the HUD. Predetermined information, such as important vehicle operating parameters or driver assistance messages or images (i.e., suggestions), can be prioritized for display within the field of vision of the stronger eye. Prioritized content can be dynamically positioned to align with the dominant eye's line of sight, clarity, and perception. In some embodiments, object detection and environment mapping techniques can identify objects or images falling within the user's blind spot or non-dominant field of vision. These objects / images can be strategically displayed within the dominant field of vision. For example, in the case of a user with macular degeneration, where central visual acuity is reduced, a vehicle camera tracking the user's gaze can capture content at the center of the field of vision, which can then be reproduced in the lower display area of ​​the vehicle's display.

[0022] In some embodiments, eye tracking continuously monitors the driver's focus. As the driver's gaze shifts, the delivery of visual information on the HUD and display screen is adjusted to reposition specific content to align with the dominant eye's current line of sight, thereby ensuring that critical details are always presented within the optimal field of vision. External sensors, such as front radar, can detect obstacles or markings in or near the vehicle's path, allowing corresponding visual information to be displayed in a display area aligned with the dominant eye's field of vision (e.g., for driver assistance features such as lane keeping assist, parking support, or collision warning). The invention is applicable to non-driving occupants (i.e., passengers) with different visual conditions, such that corresponding display content is assigned to a target display area appearing in the dominant eye's field of vision.

[0023] In some embodiments, strategies can be used to manage seating arrangements for multiple individuals in a shared vehicle who have different visual preferences. For example, an occupant with a dominant right eye may sit on one side of the display or HUD, while another occupant with a dominant left eye sits on the other side. The optimal arrangement can be automatically determined and communicated to the occupant who sits accordingly. In autonomous vehicles with adjustable seat orientation, specific occupants in existing seating positions can be rotated so that their dominant eye faces a specific display. In some embodiments, seating arrangements can be determined to substantially protect the dominant eye from solar glare or other stray bright light sources. For example, in cases where glare originates from one side of the vehicle, occupants may sit such that their non-dominant eye faces the glare orientation, and the dominant eye is shielded from glare and can better see the displayed content. When specific types of glass (e.g., tinted, anti-glare, laminated, tempered, anti-reflective) exist for various windows or windshields, these specific types of glass can also be taken into account when determining seating positions optimized for occupant visual preferences.

[0024] refer to Figure 1 The visual scene being gazed at has quadrants 1 to 4. Figure 2 Quadrants 1 to 4 are mapped onto the user's left eye's retinal vision, and Figure 3 Quadrants 1 through 4 are mapped onto the user's right retinal vision. In normal vision, the left and right visual fields combine such that the fixation point F (the intersection of the quadrants) coincides in the overlapping left and right visual fields. When there are different visual preferences between the left and right eyes due to rendering one eye more favorably than the other, it can be beneficial to present images (graphics, illustrations, or text images) that are preferentially placed for the dominant eye.

[0025] Figure 5The instrument panel 10 within the passenger compartment of the vehicle is shown. The display system in the passenger compartment includes multiple displays / head-up displays, particularly on or near the instrument panel 10, for use by the vehicle driver seated in the driver's seat (not shown). The display system includes a head-up display 11 projected onto the windshield 12 and multiple monitor screens (e.g., touchscreen display panels) 13-16. Each display may also typically include individually addressable portions that can be selected to generate display content at a corresponding spatial location. Due to the expansion of the monitors / displays, multiple corresponding display areas can be used to display various images, icons, or text at different locations relative to the field of vision of the vehicle occupants (e.g., the driver). For example, display areas 17 and 18 are provided by individually addressable portions of screens 13 and 14, respectively. The HUD 11 and monitor screen 15 can be considered to have left and right halves, which can act as separate display areas by formatting specific display content, such that items of interest fall on selected sides of the display. In some cases, the display area may correspond to the entire monitor screen, which may be associated with the right or left eye of a particular occupant due to the relative position of their seat (e.g., screen 15 is oriented toward the driver's right eye, and screen 16 is oriented toward the left eye of the passenger sitting next to the driver).

[0026] Each display area is visualized from each corresponding seating position (e.g., driver's seat, passenger seat) along a corresponding vector for each of their eyes. Thus, each display area is seen from each seat along a different vector, and for any given seating position, there exists a corresponding vector along which the person in that position sees the corresponding display area using each of their eyes. When a particular occupant has different visual preferences, the corresponding vector considered for improving visibility is based on the dominant eye's vector. Figure 6 The image shows an occupant 20 looking at a HUD 21, which has a left half 22 and a right half 23. The displayed content 24 is projected by the HUD 21 into a display area 24 appearing at a specific location. From the seated position of the occupant 20, the display area 24 can be viewed along the left eye vector 25 and the right eye vector 26.

[0027] During vehicle movement, the driver's gaze typically scans the road ahead and the environment inside and outside the passenger compartment (including displays or HUDs). When an occupant has a dominant right or left eye, utilizing display areas positioned to the same right or left side facing the average gaze direction can enhance the occupant's ability to accurately and quickly perceive displayed content. In some cases, it is desirable to highlight certain information to the occupant (e.g., the driver) with higher priority than other information. Prioritized information may include vehicle operating parameters and / or instructions, descriptions, or other suggestions related to driver assistance systems. Higher-priority display content can be assigned to display areas whose corresponding vector matches the dominant eye (e.g., a dominant right eye results in priority use of display areas to the driver's right, such as display area 24 of HUD 21 and display area 29 of monitor screen 27). In some embodiments, the selection of display areas may be based on a neutral (e.g., time-averaged) gaze direction. In other embodiments, further enhancements can be achieved by using real-time tracking of the gaze direction and selecting a display area on the dominant side facing the current gaze direction (e.g., display area 28 on the left side of screen 27 or display area 29 on the right side of screen 27 may be selected to display certain preferred content depending on the position of the current gaze point relative to the area).

[0028] Figure 7 Vehicle 35 is shown in more detail. Passenger compartment 36 includes driver's seat 37 and multiple passenger seats. Cameras / image sensors 38 and 39 (e.g., mounted on rearview mirror 40) can be used to monitor the driver and / or occupants, which can use visible light and infrared imaging to track eyes and other physical features. The display system includes displays 41 and 42 and a HUD projector 43 that generates a head-up image 44. The distribution of displays 41, 42, and 44 (along with individually addressable display portions, such as portion 45) creates multiple display areas. For each of the seating positions provided by the driver's seat 37 and the passenger seats, each potential display area has an associated vector (i.e., a line segment pointing from the display area to the corresponding eye of the occupant). The selection of display areas is based on obtaining the vector that places the display area in the preferred field of view of the occupant's dominant eye.

[0029] Vehicle 35 includes a gaze tracking unit 46 configured to monitor the driver (and / or other occupants in other seats) in driver's seat 37 using methods known in the art. Various monitored parameters, such as gaze point, gaze direction, and pupil size, are reported by gaze controller 46 to display controller 50.

[0030] The controller 50 is connected to a controller network 51 (e.g., including a multiplexed communication bus that interconnects various modules such as a powertrain control module, a body control module, and an obstacle detection module), which provides access to vehicle operating parameters such as transmission gear selection, vehicle speed, the position of obstacles in or near the vehicle path, or other information, which can provide display content to be projected to the driver / occupant and can be used to analyze, for example, driver behavior.

[0031] Controller 50 is also coupled to telematics module 52, which has a wireless transceiver such as a cellular modem to exchange data / communication signals with remote network 53. Using network 53, visual profiles created or enhanced at any particular vehicle can be shared with other vehicles for use when the corresponding person moves from one vehicle to another.

[0032] The display controller 50, gaze controller 46, and other support modules in the controller network 51 can act in unison to generate, for example, the ... Figure 8 The control framework shown includes components. The monitoring and analysis box 60 can perform eye tracking, gaze mapping, and / or head position monitoring to identify the dominant eye of a specific occupant in the vehicle (e.g., whenever the occupant has a different visual preference between their right and left eyes). Monitoring can preferably be performed using an internal camera or other image sensor using visible and / or infrared light. One or more occupants are identified and tracked based on their specific seating position. As known in the art, multiple display contents 61 are generated to convey various information, text, or images to the driver or occupants of the vehicle. The display contents may include items that should be prioritized according to any desired criteria, particularly in cases where the driver may need to be presented with certain information urgently (e.g., changes in vehicle operating parameters or the presence of obstacles in the vehicle's path). The display contents 61 are provided to a display management box 62, which receives the identified dominant eye of at least one driver or occupant for whom images or information are being displayed. The display management box 62 optimizes the placement of images or information for the dominant eye to view by selecting an appropriate display area for optimal viewing based on the identity of the dominant eye. More specifically, display area 63 or 64 is selected based on which display area has an associated vector (i.e., the line of sight from the occupant’s eye to the corresponding display area) that best matches the field of vision of the occupant’s dominant eye.

[0033] User input 65 is provided to allow users to specify dominant eye preferences via HMI or other input devices. Corresponding user profiles can be created in user profile box 66 based on user input or automatic detection by the vehicle controller. User profile box 66 can be an electronic storage and management system for compiling and sharing visual profiles for one or more users. User profile box 66 can provide pre-existing user profiles to monitoring and analysis box 60, while box 60 can provide enhanced or updated profiles back to profile box 66.

[0034] Figure 9 A preferred embodiment of a method for controlling a display system in a transport vehicle is shown, wherein camera images and / or other data relating to visual behavior patterns of vehicle occupants are collected in step 70. Using the collected images and data, known methods of face detection, eye detection, eye tracking, and / or gaze mapping are performed in step 71. In step 72, occupant behavior, such as gaze direction or head position during certain activities (e.g., steering the vehicle, scanning the road, looking in a rearview mirror, or looking at a specific display panel), is recorded and analyzed. Based on eye tracking, gaze mapping, and monitored behavior, a dominant eye can be inferred in step 73 using a trained model or other analysis system. If necessary, a visual profile for a specific user can be compiled and then exported in step 73. In step 74, prioritized display content is selected within the full set of display content fed to the display system. In step 75, the prioritized content within the display content is directed to the dominant eye's field of vision. Specifically, a comparison can be made between all available display areas that may receive the prioritized content and the current or expected field of vision of the dominant eye to select the optimal display area for the display content. In step 76, modeling of different visions can continue to further refine the user's visual profile. Then return to step 74 to continue directing the priority display content to the dominant eye's field of vision.

[0035] In some embodiments, such as Figure 10As shown, the seating arrangement of vehicle occupants can be optimized to achieve optimal visibility by simultaneously aligning the displayed content with the visual preferences of multiple occupants, thus utilizing the dominant eyes of multiple occupants. Therefore, the vehicle passenger compartment 80 includes occupants 81-84 in their respective seating positions. Front seat occupants 81 and 82 are presented with a front display panel 85, which is entirely within the field of vision of both occupants. Occupant 81 has a right-eye dominance, and occupant 82 has a left-eye dominance. With the occupants arranged side-by-side as shown, the display 85 has a display area 86 that can coincide with the preferred line of sight of both occupants 81 and 82. Based on the right-eye dominance of occupant 81, vector VR corresponds to the preferred line of sight of occupant 81. Similarly, vector VL corresponds to the preferred line of sight of occupant 82. The display area 86 matches the two corresponding vectors, thereby enabling the simultaneous presentation of prioritized display content for both occupants 81 and 82 using the display area 86.

[0036] Once the visual classifier detects the identities of occupants 81 and 82, it can detect the possibility of a seating arrangement that simultaneously improves the visual presentation of preferred content for both users 81 and 82. Therefore, steps can be taken to inform the users of the preferred seating arrangement. When automatically reconfigurable seats are available, steps can be taken to automatically implement the specific arrangement using appropriate reconfiguration of the seat positions.

[0037] Figure 11 A flowchart of a method for optimizing seat arrangement is shown, wherein in step 90, an eye preference profile is obtained for each identified occupant entering (or already residing) the vehicle's passenger compartment. In step 91, the available line of sight to each available display area is obtained from each seating position. The eye preference of the identified occupant is matched with the available line of sight seat by seat to find seating positions that simultaneously satisfy the needs of multiple occupants to view the same display area from their preferred field of vision. In step 93, the occupants are informed of the preferred seating arrangement, or that the seats can be reconfigured if they can be rotated or otherwise moved (such as in autonomous vehicles with electric seat reconfiguration devices).

[0038] In some embodiments of the invention, prioritized display content can be derived based on external obstacles in or near the vehicle's path. This invention can help ensure rapid notification of obstacles to the driver. Figure 12As shown, during vehicle operation, external obstacle detection is periodically performed in step 95 using known systems and methods (such as radar, lidar, or external camera monitoring). In step 96, a check is performed to determine whether the detected obstacle is within the driver's non-dominant eye's field of vision. If not, the process returns to step 95. When an obstacle falls within the non-dominant eye's field of vision, actions can be taken to generate corresponding display content within the dominant eye's field of vision, thereby drawing the driver's attention to the unseen or less obvious obstacle. A suggestion message and / or a depiction of the obstacle can be generated in step 97. By selecting a display area aligned with the primary line of sight, the message or depiction is displayed within the dominant eye's field of vision in step 98. Prioritized display content may include a graphic depiction of the identified obstacle, an alert icon, or a text message sent to the appropriate display area.

[0039] In one aspect of the invention, the step of identifying the dominant eye includes collecting user input on the different visual preferences of a particular occupant.

[0040] In one aspect of the invention, the method includes the steps of: using an external obstacle detector adapted to identify obstacles along the movement path of the transport vehicle; wherein the generated display content includes graphic depictions, alarm icons, or text messages of the identified obstacles sent to a selected display area.

[0041] In one aspect of the invention, the method includes the steps of: identifying the dominant eye of a plurality of occupants; determining the seating arrangement of the plurality of occupants, wherein a single display area is matched with a corresponding vector associated with the dominant eye of the plurality of occupants; and notifying the plurality of occupants of the seating arrangement.

[0042] In one aspect of the invention, the method includes the steps of: storing a visual profile of a specific user that includes the different visual preferences; and sharing the visual profile with another transport vehicle.

Claims

1. A transport vehicle comprising: The passenger compartment has multiple seating positions for appropriate personnel; A display system having multiple display areas, each of which is visualized along a corresponding vector from one or more of the seating positions; A visual classifier that responds to a specific occupant seated in a given seating position to identify the dominant eye of the specific occupant when there is a different visual preference between the right and left eyes of the specific occupant. An image source that generates display content to be shown to the specific occupant; and A display manager, connected to the image source and the display system, is configured to select a display area for displaying the content, wherein the selected display area corresponds to a vector from the seat position of the particular occupant that matches the dominant eye of the particular occupant.

2. The transport vehicle of claim 1, wherein the displayed content includes priority content for highlighting to the particular occupant.

3. The transport vehicle as claimed in claim 2, wherein the preferred content includes vehicle operating parameters.

4. The transport vehicle as claimed in claim 2, wherein the priority includes driver assistance suggestions.

5. The transport vehicle of claim 1, wherein the plurality of display areas includes a head-up display, an individually addressable portion of a monitor screen, or a plurality of monitor screens or head-up displays.

6. The transport vehicle of claim 1, further comprising a user input terminal connected to the visual classifier for manually inputting the different visual preferences of the particular occupant.

7. The transport vehicle as claimed in claim 1, further comprising: An occupant monitor, coupled to the visual classifier and including an image sensor that captures images of the specific occupant; The visual classifier is configured to: (1) track the right and left eyes of the particular occupant, (2) determine the gaze direction during operation of the transport vehicle, and (3) identify the dominant eye based on the gaze direction being consistent with a predetermined action of the particular occupant.

8. The transport vehicle as claimed in claim 1, further comprising: An external obstacle detector, the external obstacle detector being adapted to identify obstacles along the movement path of the transport vehicle; The image source responds to the obstacle detector to generate the display content based on the identified obstacles, wherein the display content includes a graphic depiction, alarm icon, or text message of the identified obstacles sent to the selected display area.

9. The transport vehicle of claim 1, wherein the visual classifier identifies the dominant eye of a plurality of occupants, and wherein the transport vehicle further comprises: A seating manager determines the seating arrangement of the plurality of occupants, wherein a single display area matches a corresponding vector associated with the dominant eye of the plurality of occupants.

10. The transport vehicle as claimed in claim 1, further comprising: A memory that stores visual profiles for a specific user, including the different visual preferences; and A remote information processing module, which is used to share the visual profile with another transport vehicle.

11. A method for controlling a display system in a transport vehicle, wherein the transport vehicle has a passenger compartment having a plurality of seating positions for respective persons, wherein the display system has a plurality of display areas, wherein each display area is visualized along a corresponding vector from one or more of the seating positions, the method comprising the steps of: When there is a difference in visual preference between the right and left eyes of a particular occupant seated in a given position, the dominant eye of that occupant is identified. Generate display content to be shown to the specific occupant; and A display area is selected for displaying the content, wherein the selected display area corresponds to a corresponding vector from the seat position of the particular occupant that matches the dominant eye of the particular occupant.

12. The method of claim 11, wherein the displayed content includes priority content for highlighting to the particular occupant.

13. The method of claim 12, wherein the preferred content includes vehicle operating parameters or driver assistance suggestions.

14. The method of claim 11, wherein the plurality of display areas includes a head-up display, an individually addressable portion of a monitor screen, or a plurality of monitor screens or head-up displays.

15. The method of claim 11, wherein the step of identifying the dominant eye comprises: Capture images of the specific occupant; Track the right and left eyes of the specific occupant; Determine the gaze direction during the operation of the transport vehicle; as well as The dominant eye is identified based on the alignment of the gaze direction with the predetermined action of the specific occupant.

Images