Method for detecting at least one perception profile of a user of a vehicle, computer program product, control unit and vehicle
The method addresses inaccuracies in existing perception models by creating user-specific perception profiles, improving safety and comfort through adaptive vehicle systems.
Patent Information
- Application Number
- DE102021213197
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-11-23
- Publication Date
- 2025-07-03
- Estimated Expiration
- 2041-11-23
AI Technical Summary
Existing perception models for vehicle users are limited by error tolerances and generalizations, leading to inaccurate and non-individualized perception assessments that affect human object perception and recognition, compromising safety and comfort.
A method for actively detecting individual perception profiles, such as color and contrast perception profiles, by using display and monitoring devices to measure, sense, and calculate user-specific gaze directions and stimuli, creating precise and reliable perception maps.
Enables accurate, user-specific perception modeling, enhancing vehicle safety and comfort by adapting driver assistance, safety systems, and display settings to individual user capabilities.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
The invention relates to a method for detecting at least one perception profile, in particular a color perception profile and / or contrast perception profile, of a user of a vehicle. The invention further relates to a corresponding computer program product. The invention further relates to a corresponding control device. The invention also relates to a corresponding vehicle.Safe and accident-free driving presupposes comprehensive perception of the traffic situation by the driver of the vehicle. Generally, perception models for estimating perception limits of a driver of a vehicle are known. The perception limits have an impact on human object perception / recognition. When an object is detected outside the vehicle, a perception probability may be calculated based on the gaze and a general perception model (not adjusted to the driver). Like most models, the perceptual models are also limited by certain error tolerances and generalization degrees.DE 102 55 796 A1 discloses a method for operating an optical display device and an optical display device for using the method.DE 100 30 813 A1 discloses a method for the attention control of an operator of a technical facility, having a display device for displaying action-relevant information in the form of images or symbols.DE 198 52 873 A1 discloses a method and a device for adjusting at least one optical device of a vehicle.DE 10 2010 018 562 A1 relates to a method for calibrating eye tracking systems.DE 10 2017 213 679 A1 relates to a method and a device for evaluating the state of the driver with respect to a driver of a vehicle, in particular of a motor vehicle, and to a motor vehicle having such a device.It is therefore an object of the invention to provide an improved method for detecting at least one perception profile, in particular a color perception profile and / or contrast perception profile, of a user of a vehicle. In particular, it is an object of the invention to provide a method for detecting at least one perception profile of a user of a vehicle, which method enables an active detection, comprising surveying, sensing, calculating and / or creating, of an individual perception profile for a specific user of the vehicle. In other words, it is the object of the invention to provide such a method for acquiring at least one perception profile of a user of a vehicle, which creates individual perception models and in this way minimizes or even avoids the errors through generalizations and / or error estimates, and which provides accurate, reliable and individual results in a flexible way. It is a further object of the invention to provide a corresponding computer program product. It is a further object of the invention to make possible a corresponding control device. It is also an object of the invention to provide.The object according to the invention is achieved by: a method for detecting at least one perception profile, in particular a color perception profile and / or contrast perception profile, of a user of a vehicle having the features of the independent method claim. The invention further relates to a corresponding computer program product having the features of the independent product claim. The invention further relates to a corresponding control device having the features of the independent device claim. The invention also relates to a corresponding vehicle having the features of the subordinate device claim. Features which are described in connection with individual aspects of the invention naturally also apply in connection with the other aspects and vice versa, so that with regard to the disclosure reference is or can always be made to the individual aspects of the invention reciprocally.The invention provides: a method for, in particular actively, capturing (which means surveying, sensing, calculating and / or creating) at least one (or more) perception profile(s) of a user of a vehicle. The acquisition of at least one perception profile within the scope of the invention can generally comprise acquisition of perception profiles, which can be output in a spatially resolved manner, for example, and / or in particular include acquisition of color perception profiles and / or contrast perception profiles, which can be output in a resolved manner, for example, in a local manner and in addition in a color and / or contrast manner, for example, according to the light intensity. The perception profiles can be created individually for different vehicle occupants, for example for a driver, a passenger or any other passenger of the vehicle.The method comprising:displaying a viewing target for the user of the vehicle with the aid of a display device on the vehicle, which can be arranged, for example, inside and / or outside the vehicle,determining a viewing direction of the user toward the viewing target with the aid of a, for example optical, monitoring device, which may be arranged, for example, within the vehicle,displaying a gaze stimulus, for example a color stimulus and / or a contrast stimulus, to the user with the aid of the display device or a further display device on the vehicle,checking a viewing direction of the user for the viewing stimulus with the aid of the optical monitoring device,creating at least one perception profile of the user depending on the checking,wherein the at least one perception profile of the user is mapped and / or output in the form of a map.The displayed gaze target may indicate a (0, 0) coordinate in a perception profile to be created. The determined viewing direction of the user can advantageously serve for adjusting the monitoring device. The displayed gaze stimuli can serve to check the gaze direction of the user. Using the displayed gaze stimuli, the user's field of view can be sensed and his perception limits determined.The perception profiles may preferably be mapped in the 2D spatial coordinates. In this way, the perception profiles can be resolved locally. The perception profiles can be created, for example, in the form of maps. The perception profiles can be imaged in a plane which runs, for example, perpendicular to the viewing direction of the user onto the viewing target.In addition, it is conceivable that the visual stimuli can have different colors and / or different light intensities, so that the perception profiles can also be resolved in terms of color and / or contrast. It is also conceivable that a set of perception profiles can be created for different colors and / or different light intensities.The monitoring device for determining a viewing direction of the user can be designed optically, for example in the form of a viewing direction recognition device, such as a camera. However, other physiological monitoring devices are also conceivable which can determine the viewing direction of the user, for example. Devices capable of Measuring Muscle Contractions of the User.When checking a viewing direction of the user for the viewing stimulus, the field of vision of the user can be scanned and, in particular, the perception limits of the user can be determined. The user's perception limits may map the local limits of the perception profile.The inventive concept is that an active acquisition, including surveying, sensing, calculating and / or creating, of an individual perception profile for a specific user of the vehicle is carried out in order to create an accurate and individual perception profile for the specific user of the vehicle. In this way, errors from general perception models (not matched to the driver) are avoided.Advantageously, the at least one perception profile of the user can be used for at least one specific vehicle function:notifying the user of the at least one perception profile.Knowledge about its individual perception profile or its individual perception limits can be advantageous for health-related, comfort-related and / or safety-related aspects for the user.Advantageously, the at least one perception profile of the user can be used for at least one specific vehicle function:adapting at least one driver assistance system of the vehicle as a function of the at least one perception profile, and / oradapting at least one safety system of the vehicle as a function of the at least one perception profile.In this way, the functionality of the driver assistance systems and / or safety systems of the vehicle can be improved.Advantageously, the at least one perception profile of the user can be used for at least one specific vehicle function:aligning display devices in the vehicle depending on the at least one perception profile.In this way, user comfort and user safety can be improved.Advantageously, the at least one perception profile of the user can be used for at least one specific vehicle function:constructing display devices in the vehicle depending on the at least one perception profile, and / orconstructing a vehicle interior as a function of the at least one perception profile.In this way, the design conditions in the vehicle can be improved for more user comfort and user safety.Advantageously, the at least one perception profile of the user can be used for at least one specific vehicle function:configuring and / or adapting user-specific settings.In this way, the vehicle can be designed and / or prepared for the specific user, for example by automatically setting the user-specific settings (such as, for example, alignment of display devices, cameras, displays, mirrors, etc.) in or on the vehicle.Furthermore, it can be provided that the method is carried out at least partially repeatedly in order to scan a field of view of the user in spatial coordinates and / or to determine the perception limits of the user. In particular, the gaze stimuli can be generated at different locations in the vehicle interior in order to correspondingly direct the gaze of the user. In this way, an enhanced, enhanced perception profile of the user may be created.Advantageously, it can be provided that the creation of perception profiles of the user takes place for different colors, in particular one after the other, and / or the creation of perception profiles of the user takes place for different light intensities, in particular one after the other. In this way, different color-resolved and / or contrast-resolved sets of perception profiles can be created.In order to enable the possibility of interaction with the user, it can further be provided that the user is offered to the user during or after checking the viewing direction of the user for the displayed viewing stimulus:confirming that he has perceived the gaze stimulus; and / orselecting a specific color which it has perceived, in particular via an input, preferably on an input device, for example on a steering wheel.In this way, the results of the determination and / or verification by the monitoring device can be verified by the user and the accuracy in creating perception profiles can be increased.Within the scope of the present disclosure, it is conceivable that the display device can have at least one display, an infotainment display, an LED display, an LED array, an LED bar, a head-up display, a display on a windshield inside and / or outside the vehicle. In addition, it is conceivable that the further display device may have at least one LED display, an LED array, an LED strip, a head-up display, a display on a windshield inside and / or outside the vehicle. In this way, the display devices present on the vehicle, in particular inside and / or outside the vehicle, can be used flexibly in order to direct the gaze of the user when carrying out the method. This can also enable flexible execution of the method for different vehicle occupants.It is furthermore conceivable that the monitoring device can have at least one viewing direction recognition device, a camera, an electronic evaluation unit, a computing device, and / or an output device for the captured perception profiles of the user. Thus, established devices and techniques for determining and / or checking the field of view of the user in an advantageous and flexible manner may be used for performing the method.According to the invention, the at least one perception profile of the user is mapped and / or output in the form of a map. In this way, the results of the method can be presented in an comprehensible and intuitive manner.The invention further provides: a computer program product comprising instructions which, when the computer program product is executed by a computer, cause the computer program product to carry out the method as described above. With the aid of the computer program product according to the invention, the same advantages can be achieved as have been described above in connection with the method according to the invention. These advantages are referred to in the present case in their entirety. In addition, the computer program product according to the invention can be used to achieve the advantage that the method can be implemented in the form of an update and / or an app in different vehicles.The invention furthermore provides: a control device, having a computing unit and a memory unit in which a code is stored which, when at least partially executed by the computing unit, carries out a method as described above. With the aid of the control device according to the invention, the same advantages can be achieved as have been described above in connection with the method according to the invention. The control device can be designed as a separate control device or be implemented as a central control device. These advantages are referred to in the present case in their entirety.The invention also provides: a vehicle having a corresponding control device. With the aid of the vehicle according to the invention, the same advantages can be achieved that have been described above in connection with the method according to the invention. These advantages are referred to in the present case in their entirety.The invention is further illustrated in more detail with reference to the figures. It should be noted that the figures have only descriptive character and are not intended to limit the invention in any form. It shows: FIG. 1 shows an exemplary display device, FIG. 2 shows a further exemplary display device, FIG. 3 shows an exemplary monitoring device, FIG. 4 shows example perception profiles, FIG. 5 shows an exemplary input device.FIGS. 1 to 5 serve to explain a method within the meaning of the present disclosure. The method serves for, in particular actively, capturing (comprising surveying, sensing, calculating and / or creating) at least one (or more) perception profile(s) WP of a user of a vehicle 10.As FIG. 4 indicates, the perception profiles WP can generally comprise within the scope of the invention perception profiles WP which can be output, for example, in a spatially resolved manner, for example in 2D space coordinates, such as, for example, Cartesian coordinates x, y and / or polar coordinates r, φ. Within the scope of the invention, the perception profiles WP can have, in particular, color perception profiles and / or contrast perception profiles, which can be output, for example, in a spatially resolved manner and additionally in a color resolved manner and / or in contrast resolved manner, for example, according to the light intensity. The perception profiles WP can be created individually for different users of the vehicle 10, for example for a driver, a passenger or any other passenger of the vehicle. The display in the sense of FIG. 4 can be displayed in the vehicle 10, for example, with the aid of a display device 12. The possible embodiments of the display device 12 will be discussed in detail below.The method comprising:displaying a viewing target Z for the user of the vehicle 10 by means of a display device 12 on the vehicle 10 (cf. FIG. 1 ),determining a viewing direction of the user toward the viewing target Z with the aid of a, for example optical, monitoring device 11 (cf. FIG. 2 ),displaying a gaze stimulus BR, for example a color stimulus and / or a contrast stimulus, for the user with the aid of the display device 12 or a further display device 14 on the vehicle 10 (cf. FIG. 3 ),checking a viewing direction of the user for the viewing stimulus BR with the aid of the optical monitoring device 11 (cf. FIG. 2 ),creating at least one perception profile WP of the user as a function of the checking (cf. FIG. 4 ).The displayed gaze target Z may indicate a (0, 0) coordinate at a perception profile WP to be created, as indicated in FIG. 4. The determined viewing direction of the user can advantageously serve for adjusting the monitoring device 11, which is shown by way of example in FIG. 2. The displayed gaze stimuli BR can serve to check the gaze direction of the user. Using the displayed gaze stimuli BR, the user's field of view can be scanned from pixel to pixel and his perception limits determined. The user's perception limits may map the local limits of the perception profile WP.In addition, it is conceivable that the gaze stimuli BR can have different colors and / or different light intensities, so that the perception profiles WP can also be resolved in terms of color and / or contrast. Furthermore, a set of perception profiles WP for different colors and / or different light intensities can be created.The perception profiles WP can be created, for example, in the form of maps, which are schematically indicated in FIG. 4. The perception profiles WP can be mapped in a plane which runs, for example, perpendicular to the viewing direction of the user onto the viewing target Z.An exemplary monitoring device 11 is shown in FIG. 2. The monitoring device 11 can be embodied, for example, in the form of a viewing direction recognition device, such as a camera. However, other physiological monitoring devices 11 are also conceivable which can determine the viewing direction of the user, for example. Devices capable of Measuring Muscle Contractions of the User.The perception profiles WP can be used in an advantageous manner for different uses:notifying the user of the at least one perception profile WP,adapting at least one driver assistance system of the vehicle 10 as a function of the at least one perception profile WP,adapting at least one safety system of the vehicle 10 as a function of the at least one perception profile WP,aligning display devices 12, 14 in the vehicle 10 depending on the at least one perception profile WP,constructing display devices 12, 14 in the vehicle 10 depending on the at least one perception profile WP,constructing a vehicle interior as a function of the at least one perception profile WP, and / orconfiguring and / or adapting user-specific settings.The method may be performed at least partially repeatedly to scan the user's field of view in the spatial coordinates and / or determine the user's perception limits. For this purpose, the gaze stimuli BR can be generated at different locations in the vehicle interior in order to correspondingly direct the gaze of the user.As FIG. 5 shows, the user can be offered to the user during or after checking the viewing direction of the user for the displayed viewing stimulus BR:confirming that he has perceived the gaze stimulus BR, and / orselecting a particular color it has perceived, for example via an input, for example on an input device 16, for example on a steering wheel 17.The user can confirm with the aid of the input device 16, for example on the steering wheel 17, that he has perceived the visual stimulus BR (at all or with a specific color and / or a specific light intensity). Furthermore, the user can use the input device 16, for example on the steering wheel 17, to select a color he has perceived.The viewing target Z can be displayed with the aid of the display device 12 for example in the form of a display, for example an infotainment display, an LED display, an LED array, an LED strip, a head-up display, a display or projection on a windshield inside and / or outside the vehicle 10.The gaze stimuli BR can be displayed with the aid of the same display device 12 or a further display device 14, for example in the form of an LED display, an LED array, an LED bar, a head-up display, a display or projection on a windshield inside and / or outside the vehicle 10.For displaying gaze stimuli BR, LED displays, LED arrays, LED strips outside the vehicle 10 can be used, which can be arranged, for example, on the vehicle headlights and / or on the side mirrors. For displaying gaze stimuli BR, LED displays, LED arrays, LED strips inside the vehicle 10 can be used, which, for example, surround the instrument panel. The latter example is shown in Fig. 3.The monitoring device 11, which is shown by way of example in FIG. 2, can have at least one viewing direction recognition device, a camera, an electronic evaluation unit, a computing device, and / or an output device for the captured perception profiles WP of the user.A corresponding control device 15 and a corresponding vehicle 10 also represent aspects of the invention. The control device 15 is only schematically indicated in the figures. The control device 15 can be embodied as a separate control device or as a central control device of the vehicle 10. The vehicle 10 as a whole is not shown in the figures for the sake of simplicity only.The above description of the figures describes the present invention solely in the context of examples. Of course, individual features of the embodiments can be freely combined with one another, provided that it is technically expedient, without departing from the scope of the invention.List of reference characters10 Vehicle 11 Monitoring device 12 Display device 14 Display device 15 Control device 16 Input device 17 Steering wheel BR Gaze stimulus WP Perception profile Z Gaze target
Claims
Method for detecting at least one perception profile (WP) of a user of a vehicle (10), comprising: - displaying a viewing target (Z) for the user of the vehicle (10) with the aid of a display device (12) on the vehicle (10), - determining a viewing direction of the user on the viewing target (Z) with the aid of a monitoring device (11), in particular a visual monitoring device, - displaying a viewing stimulus (BR) for the user with the aid of the display device (12) or a further display device (14) on the vehicle (10), - checking a viewing direction of the user on the viewing stimulus (BR) with the aid of the visual monitoring device (11), - creating at least one perception profile (WP) of the user as a function of the checking, wherein the at least one perception profile (WP) of the user is mapped and / or output in the form of a map.Method according to claim 1, characterised in that the at least one perception profile (WP) of the user is used for at least one specific vehicle function: - informing the user via the at least one perception profile (WP), - adapting at least one driver assistance system of the vehicle (10) as a function of the at least one perception profile (WP), - adapting at least one safety system of the vehicle (10) as a function of the at least one perception profile (WP), - aligning display devices (12, 14) in the vehicle (10) as a function of the at least one perception profile (WP), - constructing display devices (12, 14) in the vehicle (10) as a function of the at least one perception profile (WP), - constructing a vehicle interior as a function of the at least one perception profile (WP), and / or - configuring and / or adapting user-specific settings.Method according to claim 1 or 2, characterized in that the method is performed at least partially repeatedly in order to scan a field of vision of the user in space coordinates and / or to determine the perception limits of the user.Method according to one of the preceding claims, characterized in that the creation of perception profiles (WP) of the user is carried out for different colors, in particular one after the other, and / or the creation of perception profiles (WP) of the user is carried out for different light intensities, in particular one after the other.Method according to one of the preceding claims, characterized in that, during or after checking the viewing direction of the user for the displayed viewing stimulus (BR), the user is offered: - to confirm that he has perceived the viewing stimulus (BR), and / or - to select a specific colour which he has perceived, in particular via an input, preferably on an input device (16), for example on a steering wheel (17).Method according to one of the preceding claims, characterized in that the display device (12) has at least one display, an infotainment display, an LED display, an LED array, an LED strip, a head-up display, a display on a windshield inside and / or outside the vehicle (10), and / or in that the further display device (14) has at least one LED display, an LED array, an LED strip, a head-up display, a display on a windshield inside and / or outside the vehicle (10), and / or in that the monitoring device (11) has at least one viewing direction detection device, a camera, an evaluation electronics, a computing device, and / or an output device for the captured perception profiles (WP) of the user.A computer program product comprising instructions which, when the computer program product is executed by a computer, cause the computer program product to perform the method of any preceding claim.Control device (15), having a computing unit and a memory unit in which a code is stored which, when at least partially executed by the computing unit, carries out a method according to one of the preceding claims.Vehicle (10) comprising a control device (15) according to the preceding claim.
Citation Information
Patent Citations
attention control for operators of a technical facility
DE10030813A1
Eye tracking system calibrating method for measurement of eye movements of e.g. human, involves determining fixation optical and / or physical parameters of eyelet for calibration of eye tracking system
DE102010018562A1
Method and device for driver condition assessment and vehicle
DE102017213679A1
Method and device for operating an optical display device
DE10255796A1
Setting up at least one optical device in vehicle involves e.g. setting angular positionof information output surface or influencing optical element depending on measured eyeposition
DE19852873A1