Method for preventing eye fatigue of a person in a motor vehicle by means of a support device of the motor vehicle and support device

Abstract

Method for preventing eye fatigue of a person (14) in a motor vehicle (10) by means of a support device (12) of the motor vehicle (10), comprising the steps: - Providing an eye fatigue map (30) for potential eye fatigue for persons for an environment (32) of the motor vehicle (10) by means of an electronic computing device (16) of the support device (12), wherein the eye fatigue map (30) is provided on the basis of a visibility ratio in the environment (32); - Determining a position (P) of the motor vehicle (10) by means of a position detection device (18) of the support device (12); - Determining at least one potential countermeasure for eye fatigue depending on the eye fatigue map (30) and the determined position (P) using the electronic computing device (16); and - Providing the specified, potential countermeasure to the person (14) by means of a dispensing device (20) of the support device (12).

Description

[0001] The following invention relates to a method for preventing eye fatigue of a person in a motor vehicle by means of a support device of the motor vehicle according to the applicable claim 1. The invention further relates to a support device.

[0002] For a person in a motor vehicle, especially the driver, a stretch of road can be particularly tiring for the eyes if it requires concentrated focus on the road or on a nearby vehicle. Similarly, the number and type of traffic signs that must be observed, as well as glare from the sun, oncoming traffic, or other light sources, also affect eye fatigue on a given stretch of road.

[0003] EP 3 671 752 A1 describes a training system for stimulating eye movement and for the independent training of eye movement muscles. The system comprises electrical components that are spaced apart from one another. These electrical components include at least one data processing unit, at least one display unit for the optical signaling of variable objects, and at least one loudspeaker. Furthermore, the system has a housing designed to be worn on the head and a holding device that is detachably connected to the housing. The electrical components are at least partially located in or on the housing. The display unit is positioned in front of the user's eyes and is designed to display at least one object, either rigidly or dynamically, in all spatial directions to guide the user's field of vision.

[0004] EP 3 374 225 B1 describes a device and a method for controlling a display unit in a motor vehicle. Within the framework of the method, at least part of the person's eye area can be captured by means of a camera, an eye geometry of the person can be extracted from the camera data, and an eye opening degree and / or eye tension of the person can be determined based on the eye geometry, whereby in a eutonic body posture the person has an average eye opening degree and / or low eye relaxation.

[0005] German patent DE 10 2021 132 172 A1 describes a method for adjusting a display element, whereby a user's eye fatigue indicators are detected and stored by sensors. An evaluation unit determines an eye fatigue value based on the stored eye fatigue indicators. The display element is adjusted according to this eye fatigue value.

[0006] DE 102 18 676 A1 discloses an on-board computer in a vehicle which, taking into account sleep information about the last sleep and sensor-determined influencing factors, provides information about the driver's current fatigue and a temporal fatigue profile. DE 10 2015 206 334 A1 describes a method in which at least one characteristic value is generated that is characteristic of the degree of strain on the driver due to their current driving.

[0007] The object of the present invention is to provide a method and a support device by which eye fatigue of a person, in particular of a driver of a motor vehicle, can be prevented.

[0008] This problem is solved by a method, a computer program product, and a support device according to the independent claims. Advantageous embodiments are specified in the dependent claims.

[0009] One aspect of the invention relates to a method for preventing eye fatigue in a person in a motor vehicle by means of a support device in the motor vehicle. An eye fatigue map for potential eye fatigue in the vicinity of the motor vehicle is provided by an electronic computing unit of the support device. The position of the motor vehicle is determined by means of a position detection device of the support device. At least one potential countermeasure against eye fatigue is determined by the electronic computing unit, depending on the eye fatigue map and the determined position, and the determined, potential countermeasure is provided to the person by means of an output device of the support device.

[0010] In particular, by transmitting data from, for example, a fleet of vehicles, road sections where the eyes are especially fatigued can be identified and used for route guidance or for comfort functions to promote eye relaxation. A key aspect of eye relaxation is seeing into the distance. Within the scope of this invention, spatiotemporal data on visibility from vehicle windows is also acquired, transmitted to the backend, and used in the implementation of comfort functions for eye relaxation in the vehicle. Overviews can also be generated showing where and when eye relaxation exercises are possible.

[0011] The proposed idea thus makes it possible to counteract driver eye fatigue at an early stage, for example through relaxation exercises or by avoiding sections of road that are particularly strenuous for the eyes. This increases driver comfort and contributes to road safety.

[0012] According to an advantageous design, the current eye fatigue of the person is detected and, depending on this, the countermeasure is determined and provided.

[0013] According to the invention, the eye fatigue map is created and provided based on the visual conditions in the environment.

[0014] It has also proven advantageous to determine route adjustments as a countermeasure based on the eye fatigue map.

[0015] It may also be provided that a focusing task for the person's eyes is determined as a countermeasure depending on the eye fatigue map.

[0016] Furthermore, it may be provided that potential standstill times of the motor vehicle along a route are taken into account for the potential countermeasure.

[0017] The presented method is, in particular, a computer-implemented method. Therefore, a further aspect of the invention relates to a computer program product with program code means which, when the program code means are executed by the electronic computing device, cause a procedure according to the preceding aspect to be carried out. Furthermore, the invention also relates to a computer-readable storage medium containing at least the computer program according to the preceding aspect.

[0018] A further aspect of the invention relates to a support device for preventing eye strain in a person in a motor vehicle, comprising at least one electronic computing unit, a position detection unit, and an output unit, wherein the support device is configured to carry out a method according to the preceding aspect. In particular, the method is carried out by means of the support device.

[0019] Furthermore, the invention also relates to a motor vehicle with a support device according to the preceding aspect.

[0020] Advantageous embodiments of the process are to be regarded as advantageous embodiments of the computer program product, the computer-readable storage medium, the support device, and the motor vehicle. The support device and the motor vehicle possess tangible features to enable the corresponding process steps to be carried out.

[0021] A computing unit / electronic computing device can be understood, in particular, as a data processing device containing a processing circuit. The computing unit can therefore process data to perform arithmetic operations. This may also include operations to perform indexed access to a data structure, such as a lookup table (LUT).

[0022] The computing unit may, in particular, contain one or more computers, one or more microcontrollers, and / or one or more integrated circuits, for example, one or more application-specific integrated circuits (ASICs), one or more field-programmable gate arrays (FPGAs), and / or one or more systems on a chip (SoCs). The computing unit may also contain one or more processors, for example, one or more microprocessors, one or more central processing units (CPUs), one or more graphics processing units (GPUs), and / or one or more signal processors, in particular one or more digital signal processors (DSPs). The computing unit may also include a physical or virtual array of computers or other units of the aforementioned type.

[0023] In various embodiments, the computing unit includes one or more hardware and / or software interfaces and / or one or more storage units.

[0024] A storage unit can be volatile data storage, for example as dynamic random access memory (DRAM) or static random access memory (SRAM), or as non-volatile data storage, for example as read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory or flash EEPROM, ferroelectric random access memory (FRAM), or magnetoresistive random access memory.It can be designed as MRAM (magnetoresistive random access memory) or as phase-change random access memory, PCRAM (phase-change random access memory).

[0025] Further advantages, features, and details of the invention will become apparent from the following description of a preferred embodiment and from the drawings. The features and combinations of features mentioned above in the description, as well as those mentioned below in the figure description and / or shown in the figures alone, can be used not only in the combinations specified, but also in other combinations or individually to extend beyond the scope of the invention.

[0026] This shows: Fig. 1 a schematic side view of an embodiment of a motor vehicle with an embodiment of a support device; Fig. 2 a schematic flowchart according to one embodiment of the method.

[0027] In the figures, identical or functionally equivalent elements are provided with the same reference symbols.

[0028] Fig. Figure 1 shows a schematic side view of an embodiment of a motor vehicle 10. The motor vehicle 10 has at least one support device 12. The support device 12 is designed to prevent eye strain of a person 14 in the motor vehicle 10. For this purpose, the support device 12 has, in particular, at least one electronic computing device 16, one position detection device 18, and one output device 20.

[0029] Furthermore, an external electronic computing device 22, for example in the form of a backend, is shown. In addition, a field of vision 24 of the eyes 26 of person 14 is shown, as well as a route 28 of the motor vehicle 10. Person 14 is specifically designated as the driver.

[0030] In particular, this shows that Fig. 1. A method for preventing eye fatigue in person 14. An eye fatigue map 30, for example from the vehicle-external electronic computing device 22, is provided by the electronic computing device 16 for potential eye fatigue in person 14 in an environment 32 of the vehicle 10. A position P of the vehicle 10 is determined by the position detection device 18. Then, at least one potential countermeasure for eye fatigue is determined by the electronic computing device 16, depending on the eye fatigue map 30 and the determined position P, and the determined potential countermeasure is provided to person 14 by the output device 20.

[0031] The current eye fatigue of person 14 can be recorded, and a countermeasure can be determined and provided accordingly. Furthermore, an eye fatigue map 30 is created and provided based on the visibility conditions in the environment 32. Additionally, a route adjustment can be determined as a countermeasure based on the eye fatigue map 30. Furthermore, a focusing task for person 14's eyes 26 can be determined as a countermeasure based on the eye fatigue map 30. Finally, potential downtimes of the vehicle 10 along route 28 can also be considered for the potential countermeasure.

[0032] In particular, this shows, for example, the Fig. 1 a method for comfort functions in the motor vehicle 10 for relaxing the eyes 26 in which the motor vehicle 10 is connected to an Internet backend, the motor vehicle 10 has sensors and cameras directed into the vehicle interior and the motor vehicle 10 also has sensors and cameras directed outwards.

[0033] The backend can generate a spatiotemporal map of the vehicle's surroundings, showing visibility from the respective vehicle windows as well as opportunities for rest. Furthermore, the vehicle's sensors can capture 10 data points and transmit them cyclically to the backend. Specifically, this data can include timestamps, position, vehicle identification number, degree of eye fatigue, and data from the outward-facing sensors and their visibility from the respective windows. Additionally, the backend can determine the average expected spatiotemporal degree of eye fatigue for all sections of the road network from the fleet data and store it for the respective route segments. If necessary, these values ​​can be parameterized with other factors influencing eye fatigue.

[0034] For example, the duration of the journey so far, weather, season or time of day, lighting conditions, precipitation, road surface color, and personal parameters of person 14 can be taken into account. Furthermore, the amount of stray light, the proportion of blue light, low contrast, the proportion of yellowish-green color areas, local attractions from person 14's perspective, or similar factors can serve as further examples of measurable parameters. On the backend, a spatiotemporal map of the vehicle's surroundings is then created, based on the colors seen from the respective vehicle windows. The average expected degree of eye fatigue 26, stored in the backend based on the aforementioned parameters, is then considered within the eye fatigue map 30, for example, as negative edge weights for route 28 in the route planning process.A spatiotemporal map can be created on the backend to map available eye relaxation exercises. After entering the destination, a driver can specify a desired maximum eye fatigue level (26) at the destination, which will then be factored into route planning. Furthermore, the system can cyclically determine during the journey whether conditions for performing eye relaxation exercises are met, such as a stop at a traffic light, and transmit this information to the backend. For example, the driver can remove their hands from the steering wheel for ten seconds to perform a finger tracking exercise, particularly a focusing exercise. Additionally, the driver can close their eyes tightly for ten seconds.Furthermore, blinking several times for approximately five seconds each is possible as a countermeasure, as is palming, for example, rubbing your hands warm and placing them on your closed eyes for, say, twenty seconds. The user can be shown which route 28, which is more comfortable for the eyes, has a longer distance or travel time. Additionally, an already active route 28 can be modified depending on eye fatigue so that the driver can be offered an eye relaxation exercise 26. A purely manually controlled vehicle 10 can be guided to a parking area to perform the relaxation exercises. The location for the eye relaxation exercise can also offer the opportunity to look into the distance.Furthermore, participation in the eye relaxation exercise can be recommended in several stages, for example less intrusive in case of slight / moderate fatigue, easily perceptible cues in case of moderate fatigue and impending darkness or periods with a high probability of eye fatigue, as well as mandatory participation in case of obvious fatigue or the like.

[0035] A motor vehicle 10 with automatic driving functions can select suitable road sections characterized by the fact that the person 14 can perform an eye relaxation exercise for at least n minutes, in particular by closing their eyes 26, and the motor vehicle 10 can drive autonomously during this time and / or the greatest possible distance visibility is available at this location at this time in order to perform the eye relaxation exercise.

[0036] Furthermore, it can be provided that the person 14 in the vehicle 10 can also be actively notified of sections perceived as "pleasant" for the eyes 26, and that this data can be fused and compared with the measurements. Even without active route guidance after a configurable driving time of, for example, three hours, the driver can be advised to use sections of the route that promote eye relaxation. Routes that contribute significantly to eye fatigue might, for example, feature many different signal colors and few pastel shades, frequent changes between near and far vision, and a high proportion of red and low proportion of green in the view from the vehicle. A route-specific value for eye fatigue can also be determined directly from digital maps, which can then be adjusted and further improved through fleet measurements.Furthermore, the respective visibility from the vehicle window can be improved by information from the digital maps.

[0037] Furthermore, for each relaxation exercise, the respective factors that may impair the simultaneous performance of the driving task, as well as permitted driving modes and / or traffic situations, can be specified or stored. For example, the "fully autonomous driving or parking" mode can be suggested for the "close eyes for thirty seconds" exercise, the "level two mode according to SAE guidelines" for "blink ten times," and any mode for "look into the distance for thirty seconds." Driving situations in which a specific exercise can be performed safely can be recognized or predictively identified by the system, and the system can suggest that the person perform this exercise for this duration, for example, at a stop at a traffic light whose duration is known to the system, or during a stop in a traffic jam.When transitioning to a different situation that requires more attention from Person 14, such as a traffic light turning green or the vehicle in front starting to move, the driver may receive an audible signal indicating that the exercise is over and control must be taken over. Another example of driver takeover is performing relaxation exercises while driving a Level 3 vehicle and taking over control upon receiving an audible signal from the system.

[0038] In particular, it can be provided that sensor data and / or information about the current visibility from the vehicle windows, already derived from the sensor data in the vehicle 10, are transmitted cyclically to the vehicle-external electronic computing unit 22. The extraction of spatiotemporal visibility values ​​from the vehicle data then takes place, and a consistency check is performed to determine whether the obtained spatiotemporal visibility values ​​deviate by more than x percent from the existing data, especially under identical parameters such as, for example, no lighting conditions. Furthermore, the vehicle-external electronic computing unit 22 can also request data entry from the vehicle occupants if, for example, the automatically recorded data is contradictory. In this case, the vehicle occupants can manually enter their visibility from the vehicle windows, and this information is then sent back to the backend.The backend then generates the spatiotemporal map of the visibility from the vehicle windows. Sensors directed towards the driver, such as a camera, can be used to detect eye fatigue. The measured levels of eye fatigue can then be cyclically transmitted, and the spatiotemporal map of eye fatigue can be used to initiate countermeasures.

[0039] To assess the use of spatiotemporal maps for the feasibility of eye relaxation exercises, vehicle sensors can be used to determine, for example, the duration of a stop at a traffic light. Furthermore, driving data, such as position data and / or the duration and type of stops, can be cyclically transmitted to the vehicle-external electronic computing unit 22. The data from the vehicle fleet is then aggregated at the backend. The backend can also create relaxation exercises, including instructions and requirements, and send a request to the driver asking whether a specific eye relaxation exercise is currently feasible at that location. The driver can manually enter the feasibility of an eye relaxation exercise and provide feedback.The spatial-temporal map can then be adapted accordingly to determine the feasibility of relaxation exercises.

[0040] Fig. Figure 2 shows a schematic flowchart according to one embodiment of a method. The diagram shows... Fig.2 In particular, communication takes place between the position detection device 18 and the vehicle-external electronic computing device 22. In a first step S1, the vehicle position and, if applicable, target coordinates are transmitted cyclically. In a second step S2, all road segments within, for example, 10 kilometers are determined for recording the visibility from the vehicle windows, for example, because there is no or insufficient data available for these sections on the backend. In an optional third step S3, this request is transmitted back to the vehicle 10. In a fourth step S4, a cyclical check is performed to determine whether a road segment is being driven on where visibility measurement is desired.In a fifth step, S5, sensor data and / or visibility values ​​determined from the vehicle's sensors, as well as environmental parameters such as light conditions and precipitation, are transmitted to the vehicle's external electronic computing unit 22. In a sixth step, S6, the visibility information is stored in a spatiotemporal map. In a seventh step, S7, the driver's degree of eye fatigue is transmitted cyclically. In an eighth step, S8, changes in eye fatigue are stored in a spatiotemporal map. Optionally, in a ninth step, S9, this adapted map can then be transmitted back to the vehicle 10. Reference symbol list 10 motor vehicle 12 Support device 14 people 16 electronic computing equipment 18 Position detection device 20 Output device 22 vehicle-external electronic computing devices 24 Viewing area 26 eyes Route 28 30 Eye fatigue map 32 surroundings P Position S1-S9 Steps of the procedure

Images