Method for determining the color vision deficiency of a driver of a vehicle

Abstract

Method for determining a color vision deficiency of a driver (1) of a vehicle (2) by evaluating a reaction time and evaluation of eye movements in relation to a display content of a vehicle-side display unit (3), wherein - if color vision deficiency is detected, a color adjustment of the display unit (3) corresponding to the detected color vision deficiency is carried out, - if the driver (1) consents to the determination of color vision deficiency based on the determined reaction time, eye movements and reading speed of the driver (1) in relation to a display content, an interaction value for determining color vision deficiency is determined and the driver (1) is informed by the vehicle if color vision deficiency is detected, - based on the interaction value in relation to at least one threshold, an assessment of the color vision deficiency of the driver (1) is carried out and - which automatically determines at least one threshold and continuously adjusts it to determine a robust interaction rate within a specified time period in order to assess the driver's determined color vision deficiency (1).

Description

[0001] The invention relates to a method for determining the color vision deficiency of a driver of a vehicle.

[0002] From US patent 2023404395 A1, a computer-implemented method, a computer program, and a device for determining the visual acuity of a person's eye are known. The method comprises displaying a visual stimulus to a person's eye by means of a display unit, wherein the stimulus is configured to elicit a type of eye movement in the person's eye; tracking the person's eye movements with an eye tracker; and determining the visual acuity of the person's eye by using a processing unit with first information about the visual stimulus and second information about the occurrence of a type of eye movement in the person's eye.

[0003] Furthermore, DE 10 2021 114 028 A1 describes a method for adapting integrated vehicle systems to a driver's visual and reaction abilities. The vehicle has a user interface designed to receive predefined inputs from the driver. Upon the driver's initial input for an accommodation test, a series of several test measurements is performed. Each test measurement involves simultaneously displaying two matching or non-matching test symbols on two integrated displays in the vehicle at varying distances from the driver, and receiving a response input from the driver indicating a detected match or non-match. The driver's individual accommodation ability or reaction strength is determined by evaluating the results against a predefined ranking, and an integrated driver assistance system is automatically adjusted accordingly.

[0004] US Patent 2019 / 0250402A1 describes a head-up display device, a control method for it, and a vehicle. The head-up display device comprises an image projection device, a display background detection device, and a processor. The image projection device is configured to generate an image and project the image onto a preset area on a reflective surface. The display background detection device is configured to detect optical information about a background space visible to a user through the preset area, where the background space and the user are located on opposite sides of the reflective surface.The processor is configured to determine an image display mode of the image projection device based on the optical information and to control the image projection device to project images in the specified image display mode.

[0005] US Patent 2017 / 0119246A1 describes a method and apparatus for testing color blindness. The method includes: - Capturing a variety of preset color schemes, each designed to test a type of color blindness and including a primary color and a secondary color; - Capturing color vision test patterns, each corresponding to one of the color schemes; - Changing the color of at least one part of the grids in one of the color vision test patterns successively from the basic color to the changing color according to the grid color change sequence of the corresponding color vision test pattern during the display of the corresponding color vision test pattern, when the corresponding color vision test pattern is used to perform a color blindness test on a tested person, and capturing the positions of the eyeballs of the tested person while the color of the grids changes; - Obtaining an initial degree of adaptation by matching a captured movement trace of the color dot to a movement trace of the eyeballs; and assessing what type of color blindness the tested person has, according to the initial degree of adaptation.

[0006] This involves performing a dependency analysis of the movement trace of the eyeballs of the tested person and the movement trace of a color dot in the corresponding color vision test pattern in order to quantitatively determine what type of color blindness the tested person has.

[0007] The invention is based on the objective of providing an improved method for determining the color vision deficiency of a driver of a vehicle.

[0008] The problem is solved according to the invention by a method which has the features specified in claim 1.

[0009] Advantageous embodiments of the invention are the subject of the dependent claims.

[0010] In the inventive method for determining a driver's color vision deficiency by evaluating reaction time and eye movements in relation to the content displayed on a vehicle display unit, a color adjustment of the display unit corresponding to the determined color vision deficiency is performed if color vision deficiency is detected. If the driver consents to the color vision deficiency determination based on the determined reaction time, eye movements, and reading speed in relation to the displayed content, an interaction value for determining the color vision deficiency is calculated, and the driver is informed by the vehicle if color vision deficiency is detected.

[0011] By applying this method, it is possible to passively and continuously detect a driver's color vision deficiency and adjust the vehicle's display accordingly, thereby increasing driver safety and comfort. In particular, this method makes it possible to improve the accessibility of vehicles for drivers with color vision deficiencies.

[0012] If the vehicle's driver is detected to have color vision deficiency, the vehicle will inform them of this and, if necessary, recommend that they consult an ophthalmologist. The driver will also be informed if no unusual interaction pattern with the displayed content is detected, or if the interaction value is within the range of normal color perception.

[0013] The system uses an interaction value relative to at least one threshold to assess the driver's color vision deficiency. This means that if color vision deficiency is detected, the system not only identifies it but also determines the likely type of deficiency. Specifically, the driver is informed whether they have monochromacy, dichromacy, and the specific form of this or any other type of color vision deficiency.

[0014] At least one threshold value is automatically determined and continuously adjusted within a predefined time period to establish a robust interaction rate and assess the driver's detected color vision deficiency. Specifically, this threshold value serves to determine the degree of the driver's color vision deficiency, enabling color adjustment of the display unit to enhance driver safety and comfort while driving.

[0015] In one version, the interaction value is based on the driver's reaction time through eye movements in relation to the display content and assesses the degree to which a color and shape of the display content attracts the driver's attention.

[0016] Furthermore, one implementation of the procedure stipulates that values ​​for assessing specific color vision deficiencies are specified and taken into account when determining at least one threshold value. This means that the values ​​relating to each type of color vision deficiency are available within the vehicle itself, thus making it possible to classify any color vision deficiency detected in the driver of the vehicle.

[0017] In one possible implementation, the driver's color vision rating and / or corresponding color settings for the display unit are stored in a driver profile. This driver profile is also stored on a central computer unit connected to the vehicle, allowing it to be accessed in any vehicle connected to the central computer unit to adjust the corresponding color settings on one or more display units.

[0018] In another possible implementation of the procedure, if the driver's reaction time to a display element with a predefined color code falls below an average value within a determined timeframe, the display unit is color-adjusted by setting various color schemes and contrast levels and measuring the reaction time for each. The interaction value can then be determined to ascertain whether the driver of the vehicle has color vision deficiency.

[0019] In one implementation, the display unit's color is adjusted based on the driver's shortest reaction time to a display with a specific color scheme and contrast setting. This means that the display's color settings are changed, and the driver's reaction times are again measured and compared to the average value to determine color vision deficiencies. This allows for improvements to driver safety and comfort while driving.

[0020] In another version, if the driver is aware of a specific type of color vision deficiency at the start of the assessment, all types of color vision deficiency are displayed for selection. The driver can then select their preferred type of color vision deficiency, and this selection can be verified, for example, for accuracy, using the same procedure.

[0021] In one possible implementation, the driver's eye movements are determined using signals captured by at least one camera located inside the vehicle, whereby a driver observation camera can be used in particular, which is usually used, for example, to determine the driver's level of attention.

[0022] Exemplary embodiments of the invention are explained in more detail below with reference to drawings.

[0023] This shows: Fig. 1. Schematic overview of a procedure for determining the color vision deficiency of a driver of a vehicle and Fig. 2 schematically shows a further overview of a continuous implementation of the procedure for determining the color vision deficiency of a driver of a vehicle.

[0024] Corresponding parts are marked with the same reference symbols in all figures.

[0025] Fig. Figure 1 shows an overview of a procedure for determining a driver's color vision deficiency, as exemplified in a further overview in Fig. 2 of the vehicle shown.

[0026] Fig. Figure 1 shows in particular a procedure for determining the color vision deficiency of a driver 1 of a vehicle 2, wherein Fig. 3 in a further overview shows a continuous implementation of the procedure for determining a color vision deficiency of a driver 1 of a vehicle 2.

[0027] Color blindness refers to an anomaly of the retina in which at least one of the three types of cones in the retina does not function normally, and therefore a corresponding primary color cannot be seen normally. An affected person can only distinguish certain colors poorly or not at all.

[0028] A person with monochromacy has only one color-mediating receptor and can only perceive shades of gray.

[0029] In dichromacy, the retina has two types of cones. Protanopia refers to red-blindness, and protanomaly to red-blindness. Deuteranopia refers to green-blindness, and deuteranomaly to green-blindness. Tritanopia refers to blue-blindness, and tritanomaly to blue-blindness.

[0030] The procedure described below provides, in particular, that a person, specifically the driver 1 of a vehicle 2, can fully utilize a display unit 3 in the vehicle 2 and experience media. With the driver 1's consent, automatic detection of color vision deficiency is possible in the vehicle 2, thus increasing safety for all occupants of the vehicle 2 and, in particular, enhancing comfort for the driver 1, who has a color vision deficiency. Specifically, safety can be increased through optimized display content on a display unit 3, and especially on all display units 3 used by the driver 1.

[0031] The degree of color vision deficiency can vary, and the procedure provides for adjusting the color of the display unit 3 according to the degree of color vision deficiency.

[0032] To determine whether a driver 1 of a vehicle 2 has color vision deficiency, the use of a driver observation camera 4 is required, which continuously records signals during driving. In particular, the direction of gaze and eye movements of the driver 1 can be determined from the recorded signals.

[0033] The procedure is essentially based on the interaction of driver 1 with vehicle 2, particularly with regard to the display content shown by the display unit 3. By additionally recording driver 1's eye movements, an interaction score is determined using an algorithm. This score is based on driver 1's reaction time to the displayed content shown by the display unit 3 and assesses the degree to which the color and shape of the displayed content attract driver 1's attention.

[0034] To prepare display content for a driver (1) who has and is aware of color vision deficiency, a display assistant presents the driver (1) with three color options at the beginning of the procedure, representing the three different types of color vision deficiency. The driver (1) can therefore choose between monochromatism, dichromatism, and trichromatism, each with a corresponding color scheme. For dichromatism and trichromatism, further distinctions can be made between different subtypes.

[0035] Driver 1 also has the option of carrying out the procedure without making a pre-selection regarding his known color vision deficiency.

[0036] To assess the degree of color vision deficiency of driver 1, at least one threshold value is specified, which is automatically determined and adjusted for a predetermined time, which is necessary to achieve a comparatively robust interaction rate and to derive a degree of color vision deficiency of driver 1.

[0037] Through continuous color adjustment of display unit 3, as shown in the further overview in Fig. As shown in Figure 3, a change in the interaction rate of the driver 1 with respect to displayed display content serves as the basis for determining the color settings of the display unit 3 with the highest interaction rate.

[0038] After completing an analysis to determine the color vision deficiency of driver 1 of vehicle 2, driver 2 will be shown the result, possibly with a recommendation to consult an ophthalmologist, particularly if, based on the determined interaction value and an assessment of their interaction with the displayed content using standard color settings, driver 1 falls within a range for color vision deficiency. If no unusual interaction patterns are detected with the displayed content using standard color settings, or if driver 1's interactions fall within a range for normal color perception, driver 1 of vehicle 2 will be informed accordingly. If the analysis determines that driver 1 of vehicle 2 does not have color vision deficiency, driver 1 will also be informed of this.

[0039] According to the in Fig. In the embodiment shown in Figure 1, in a first step S1, the driver 1 of vehicle 2 is asked, upon the vehicle 2 becoming operational (for example, by switching on the ignition), whether he wishes to perform the procedure, i.e., a test, to determine his color vision deficiency. If the driver confirms that he wishes to perform the procedure, in a second step S2 he has the option to choose between different color settings to specify the display content shown by the display unit 3. Alternatively, the test is performed using the standard color setting of the display unit 3, and the procedure is started. The driver 1 also has the option to decline the color vision test, in which case it is deactivated or not activated.

[0040] In a third step S3 of the overview in Fig. 1. After activation of the automatic color vision deficiency detection, the eye movements of driver 1 are monitored and the algorithm analyzes an interaction of driver 1 and his reaction to the display content output by means of the display unit 3.

[0041] The interaction and reaction behavior of the driver 1 with regard to the display content is fed to a local, i.e., vehicle-side, storage unit 5 and stored there in encrypted form, particularly for evaluation purposes.

[0042] In a fourth step S4, an algorithm for analyzing interaction parameters and comparing them with a threshold value with a tolerance range is used to determine whether a lack of reaction time in relation to a display content output by means of the display unit 3 is a sign of color vision deficiency or is within the tolerance range, in particular a medical tolerance range.

[0043] After the analysis is complete, the driver 1 of vehicle 2 is shown the respective result, particularly when vehicle 2 is parked. Following approval by driver 1, the result is transmitted to a central computer unit 6, which is linked to vehicle 2, and stored there. Specifically, the result is stored in a driver profile on the vehicle, which is also available to the central computer unit 6.

[0044] In a fifth step S5, the algorithm also determines a degree, in particular a severity level, of the detected color vision deficiency of driver 1, by, as in Fig. As shown in section 3, the colors of display unit 3 are silently adjusted over an analysis period, as illustrated by an exemplary and highly simplified color spectrum representing a sixth step S6. Fig. 1 is shown.

[0045] Following this analysis, in a seventh step (S7), when vehicle 2 is parked, the driver 1 is presented with a result. Additionally, ideal color settings for display unit 3 are shown to the driver 1, which the driver 1 can accept or reject by confirmation.

[0046] Furthermore, in an eighth step S8, after completion of the analysis, the result and the settings selected by the driver 1 with regard to the color adjustment of the display content of the display unit 3 are saved in his driver profile, which is then also available in other vehicles 2.

[0047] The determination of a possible color vision deficiency in driver 1 of vehicle 2 is performed dynamically and continuously after the vehicle 2's drive unit is switched on and after confirmation of an automatic and continuous visual check of driver 1. Signals from various sensors, in particular the driver observation camera 4, a control unit, the display unit 3 (which is, for example, part of the vehicle 2's instrument panel), etc., are recorded and standardized in numerical form. The recorded signals are continuously analyzed, especially to calculate the threshold values ​​for determining the degree of color vision deficiency for each specific color value.For this purpose, color ranges are defined to determine an automatic color setting of the display unit 3 in different environments, especially with regard to brightness values; for example, it may be dark in a tunnel; when the sun is shining, it is comparatively bright; when it is cloudy and / or raining, it is gray.

[0048] For example, the reaction time of the driver 1 of vehicle 2 when clicking on a display content of the display unit 3 and / or in relation to external influences in the driving operation of vehicle 2, for example in relation to brake lights of a vehicle in front, colored signs, etc., which are displayed as content on the display unit 3.

[0049] Furthermore, general interactions of the driver 1 of the vehicle 2 are determined, in particular interactions with displayed information via corresponding vehicle-side buttons, which are associated with an action related to the displayed information.

[0050] In addition, the eye movements and reading speed of the driver 1 of the vehicle 2 are determined based on vehicle-side signals, in particular the driver observation camera 4, as well as a kind of preference for color settings of the display unit 3.

[0051] The threshold values ​​are determined based on a range deviation, which is calculated by subtracting the average reaction time from the individual reaction time and dividing by the standard deviation of the reaction times. The individual reaction time corresponds to the reaction time of each driver (1) of vehicle (2) who performed the color vision test. The average reaction time is determined based on the number of drivers (1) of vehicle (2), specifically those drivers (1) whose reaction times and results were transmitted to the central computer (6).

[0052] The standard deviation in relation to reaction times provides a measure of how much the reaction times deviate from the average reaction time.

[0053] Based on the standard deviation of the response times, segments, “buckets” and / or categories are created by means of which the different types of color vision deficiency can be classified in order to adjust the color of the respective display unit 3 to the respective type or degree of color vision deficiency.

[0054] When configuring the display content using the respective display unit 3, the threshold values ​​are continuously measured to ensure that the reaction time is adjusted accordingly. This means that if the reaction time is adjusted with respect to a color setting for a driver 1 with color vision deficiency, this color setting of the display unit 3 can be linked to the driver profile and stored therein. If a driver 1, after being diagnosed with color vision deficiency, gets into another vehicle 2 and retrieves their driver profile, the color setting of the display unit 3(s) in vehicle 2 can be adjusted according to the stored color setting.

[0055] The measurement scales of the considered indices are set such that values ​​outside a normal corridor, which is based on deviations that are considered normal based on the average behavior of a number of drivers 1, represent trigger criteria for adjusting a color setting and contrast.

[0056] In particular, values ​​are predefined for each specific type of color vision deficiency and considered in relation to threshold values ​​to ensure the identification of specific color schemes. If a driver's (1) reaction time in a vehicle (2) to a specific display content with certain color settings (i.e., a specific color coding) falls below an average value within a determined timeframe, the display unit (3) is color-adjusted by setting various color schemes and contrast settings and determining the respective reaction times. Depending on the specific color setting, the reaction times are determined and continuously compared to optimize the color setting of the display unit (3) with respect to the fastest determined reaction time.

[0057] If, after a predetermined number of trips with vehicle 2, for example, two trips with an average trip duration of 60 minutes, no improvement, in particular no faster reaction time, can be detected based on the recorded eye movements and / or recorded interactions with the display unit 3, the current color setting of the display unit 3 is saved in the memory unit 5 and / or by means of the central processing unit 6. When vehicle 2 is driven again, this color setting is then recalled and the respective display unit 3 is adjusted accordingly.

[0058] Once the specified number of trips with an average trip duration of, for example, 60 minutes has been completed, the driver 1 of vehicle 2 will be informed about any color vision deficiency detected and its type.

[0059] If the recorded reaction time is below the average value even with the best possible color adjustment, the driver 1 will be informed of the associated increased safety risk based on a comparatively long reaction time and advised to consult a health expert, in particular an ophthalmologist.

[0060] The further overview shows the continuous determination of any color vision deficiency of driver 1 of vehicle 2.

[0061] The procedure involves, in a first step V1, activating the drive unit of vehicle 1 and initiating the data acquisition process to determine color vision deficiency. In a second step V2, the eye movements of driver 1 are continuously monitored, and driver 1's reaction times to displayed content based on visual stimuli requiring action are recorded.

[0062] Subsequently, in a third process step V3, a continuous color adjustment is made with regard to the display content shown by means of the display unit 3, depending on the previously recorded eye movements and reaction times, in particular depending on the determined interaction value.

[0063] In a fourth procedure step V4, the eye movements of driver 1 are again continuously observed and the reaction times of driver 1 to display content based on visual stimuli that require an action are recorded, with the display content being shown on the display unit 3 with changed colors and / or contrasts.

[0064] In a fifth process step S5, if the reaction times determined in the fourth process step S4 are below average, the continuous color adjustment of the displayed display content of the display unit 3 takes place.

[0065] In a sixth process step, S6, the eye movements and reaction times of driver 1 to display content requiring action are again determined. If the determined reaction times fall within the range of average values, driver 1 of vehicle 2 is informed accordingly in a seventh process step, S7. Specifically, if the average time of 60 minutes is reached over two journeys and no improvement in reaction time can be measured, the optimal color setting for this driver 1 has been achieved, and driver 1 is informed about their color vision deficiency. If applicable, driver 1 is informed about increased safety risks associated with their determined color vision deficiency if the reaction time is below average. The color setting of the display unit 3 is saved for future journeys, particularly in a driver profile. Reference symbol list 1 driver 2 vehicles 3 Display unit 4 Driver observation camera 5 storage units 6 central computing unit S1 to S8 step V1 to V7 Process step

Claims

Method for determining the color vision deficiency of a driver (1) of a vehicle (2) by evaluating a reaction time and eye movements in relation to a display content of a vehicle-side display unit (3), wherein - if color vision deficiency is detected, a color adjustment of the display unit (3) corresponding to the detected color vision deficiency is carried out, - if the driver (1) consents to the determination of the color vision deficiency based on the determined reaction time, eye movements and reading speed of the driver (1) in relation to a display content, an interaction value for determining the color vision deficiency is determined and the driver (1) is informed by the vehicle if color vision deficiency is detected,- based on the interaction value with respect to at least one threshold, an assessment of the driver's color vision deficiency (1) is carried out, and - the at least one threshold is automatically determined and continuously adjusted within a specified time period to determine a robust interaction rate in order to assess the determined color vision deficiency of the driver (1). Method according to claim 1, characterized in that the interaction value is based on the driver's (1) reaction time by eye movements in relation to the display content and evaluates a degree to which a color and shape of the display content attracts the driver's (1) attention. Method according to claim 1 or 2, characterized in that values ​​for assessing a specific color vision deficiency are specified and taken into account when determining the at least one threshold value. Method according to one of the preceding claims, characterized in that the assessment of the color vision deficiency of the driver (1) and / or corresponding color settings of the display unit (3) are stored in a driver profile. Method according to one of the preceding claims, characterized in that if a driver's (1) reaction time with respect to a display content of a predetermined color code within a determined time frame is below an average value, a color adjustment of the display unit (3) is carried out by setting different color schemes and contrast settings and determining a respective reaction time again. Method according to claim 5, characterized in that the color adjustment of the display unit (3) is carried out depending on a determined shortest reaction time of the driver (1) to a display content with a specific color scheme and a specific contrast setting. Method according to one of the preceding claims, characterized in that, given the driver's (1) knowledge of a type of color vision deficiency at the beginning of the color vision deficiency determination, all types of color vision deficiency are displayed for selection. Method according to one of the preceding claims, characterized in that the eye movements of the driver (1) are determined on the basis of detected signals from at least one camera arranged in the interior of the vehicle (2).

Images