vehicle
The vehicle system uses detection and projection technology to identify users and project context-specific user profile probabilities, improving user experience by enabling convenient profile selection through gestures, addressing the need for enhanced user interaction in configuring vehicle settings.
Patent Information
- Application Number
- JP2025541722
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2023-01-19
- Filing Date
- 2023-12-20
- Publication Date
- 2026-02-24
- Estimated Expiration
- 2043-12-20
AI Technical Summary
Existing vehicle systems require cumbersome manual operations for selecting user profiles, and there is a need for improved user experience in configuring vehicle settings based on user identification and context awareness.
A vehicle equipped with detection means, context determination means, and a computing unit that processes sensor data to identify users and project light patterns in the environment, allowing users to select user profiles through gestures and visualize profile probabilities, enabling context-specific profile selection.
Enhances user convenience by allowing profile selection outside the vehicle through intuitive gesture recognition and projection of user profile probabilities, reducing the need for manual in-vehicle operations.
Smart Images

Figure 0007819424000001 
Figure 0007819424000002 
Figure 0007819424000003
Abstract
Description
[Technical Field]
[0001] The invention relates to a vehicle as defined in the preamble of claim 1. [Background technology]
[0002] Vehicles, such as passenger cars, have various configurable components. For example, seats can be adapted to the body dimensions of vehicle occupants, the airflow strength and air temperature of the climate control can be adjusted, audio sources can be selected via the infotainment system, for example to select a preferred volume for a favorite radio station, the suspension can be adjusted to be firmer or softer, and display options for a graphical user interface can be changed. Corresponding configuration parameters can also be combined into a group in the form of a user profile. If different people use the same vehicle, each person can select their own respective user profile, thereby quickly and easily changing all configuration parameters to their preferred settings. Activating a user profile can, for example, adjust the vehicle's driver's seat to their height, adjust the vehicle's exterior mirrors accordingly, and activate Bluetooth. (registered trademark) The user's smartphone, connected via the Internet, is selected as the audio source, thereby improving the vehicle user's comfort.
[0003] The same user may create different user profiles and select a preferred user profile depending on the situation. For example, during the daily commute, a user may prefer a firmer sports suspension setting and a news radio station, while during weekend trips with the family, a more comfortable suspension setting and audiobook playback may be preferred. Typically, the selection of a user profile is performed via the vehicle's infotainment system, typically via a touch-sensitive display.
[0004] German Patent Application Publication No. 102019132403 discloses a method for automatically selecting a user profile in a vehicle. In this method, the vehicle reads digital key parameters from a vehicle key carried by the vehicle user, e.g., a radio key or a corresponding key file on a smartphone, and automatically selects a user profile based on the key parameters. Components of the key parameters that are not used to start the vehicle are taken into account. Additionally, the vehicle can also take into account complementary contextual information, such as whether music is being played on a mobile phone or whether a chat is taking place, which user profile was frequently selected in the past at that time or time period, how many vehicle occupants are currently in the vehicle, what the current weather is like, and / or what the current season is. The vehicle can also have biometric sensors, such as a scale, a microphone, or a camera, which can be used to uniquely identify the user. The vehicle can use this information to uniquely associate a user profile with a person.
[0005] Additionally, vehicle projectors are commonly known that can be used to illuminate the vehicle's surroundings, for example, to make it easier to find lost items at night or to better identify the route from the parking lot to the front door, and can also project graphical objects, such as the vehicle manufacturer's logo or other information, into the vehicle's surroundings.
[0006] Furthermore, German Patent Application No. 102019135410 discloses a motor vehicle equipped with a projection device for detecting projection-related user input gestures, as well as a method for operating the projection device. The projection device can be used to project virtual control elements onto a projection surface in the vehicle's surroundings. The virtual control elements can be operated by user gestures.
[0007] Furthermore, U.S. Patent Application Publication No. 2015 / 0180999 discloses an automated dialogue system for a social network for a vehicle, which can identify a user and log into the user's profile in the social network, and can project a user interface onto the vehicle's windshield, which can be operated by gestures. Summary of the Invention [Problem to be solved by the invention]
[0008] It is an object of the present invention to provide an improved vehicle characterized by an improved user experience. [Means for solving the problem]
[0009] According to the invention, this object is achieved by a vehicle with the features of claim 1. Advantageous embodiments and developments emerge from the claims dependent on this claim.
[0010] The vehicle generally comprises a plurality of configurable components, a detection means, a context determination means, and a computing unit configured to store a user profile database capable of storing user profiles, each user profile being formed by combining at least configuration parameters of the configurable components, the user profile database storing at least two user profiles for at least one user, the computing unit being configured to process sensor data generated by the detection means to identify (recognize) humans present in the vehicle's environment and to select a user profile contained in the user profile database for one of the identified users. The vehicle as mentioned in the introduction is improved according to the invention in that the computing unit is further configured as follows: - controlling projection means of the vehicle to output a light pattern into the vehicle environment comprising at least a visualization portion of a user profile for at least the identified user and a respective user profile probability; - processing the sensor data to identify a selection gesture performed by a human identified as the user on a visualization included in the light pattern, interpreting the selection gesture as an input for a manipulation action, and activating and modifying a context-specific user profile based on the selected visualization and / or modifying configuration parameters based on the selected visualization; determining a situation context taking into account the context data generated by the context determination means and selecting a context-specific user profile that fits the situation context; -processing the context data to determine, for at least two context-specific user profiles of the identified user, user profile probabilities describing the degree of probability that each context-specific user profile fits the current situation context;
[0011] In other words, the vehicle has a projection device that can also function as an operating interface. This allows the user to comfortably select and adjust the respective user profile even outside the vehicle. For this purpose, detection means can be used to identify selection gestures. For example, a camera can be used to identify and track the user's movements, thereby identifying whether the user is pointing at or intersecting (overlapping) the respective visualization or graphic object. Corresponding selection gestures can also be identified by determining the user's relative position or position change with respect to the vehicle using radar sensors, ultrasonic sensors, and lidar. The vehicle according to the present invention allows for particularly comfortable user interaction.
[0012] The vehicle may include, for example, a camera, a microphone, a weight sensor, a laser scanner, an ultrasonic sensor, a radar system, a transponder, etc., as a detection means. A camera can be used to visually detect and evaluate the vehicle's surroundings. This allows for the identification of a person's biological characteristics, such as distinctive facial features, using machine vision techniques to uniquely identify the person. The sensor data generated by the detection means preferably also includes a movement of a person identified as a user, which the computing unit can interpret as a selection gesture, if necessary. In this case, the sensor data forms a database from which the computing unit determines the user's identity as well as the user's movement or gesture. A lidar, radar system, or ultrasonic sensor can be used to acquire depth information, which can identify the approach of a person to the vehicle and their movement. This can also identify that a person or animal is passing by the vehicle rather than approaching it, and a light pattern can be projected only if the identified user is actually approaching the vehicle. Evaluation of the depth information can also identify a person's characteristic gait (walking pattern), which can also identify the person.
[0013] As a projection means, the vehicle can have various lighting devices, such as high-resolution matrix headlights or specially designed projectors. Such projectors can include, for example, LEDs or lasers as light sources. Such projectors can be integrated into any location in the vehicle, such as the side sills, exterior mirrors, or bumpers. Thus, the light pattern can be projected anywhere in the vehicle's surroundings. Projection can be performed on horizontal, inclined, and vertical surfaces. This ensures reliable user identification in various situations. To deflect the light beam, such projectors can also have various adjustment elements, such as movable mirrors, reflectors, and lenses. Projectors can also have additional components, such as filters, diffusing disks, diffusers, and diaphragms.
[0014] A microphone can be used to analyze human voice and also to give voice commands, i.e., the light pattern can be automatically projected into the vehicle's surroundings only when the approach of a specific person to the vehicle is identified or after the user gives a corresponding voice command.
[0015] The method described above can be used to identify users in a very convenient way, that is, the corresponding user does not need to carry an identification object such as a radio key, a transponder, or a mobile terminal with a digital key function. Of course, as already mentioned, the vehicle can also have a corresponding transceiver that can identify such an identification object, thereby realizing or enabling user identification.
[0016] In an embodiment of the present invention, the computing unit selects a context-specific user profile that is suitable for the respective situation, taking into account the context data generated by the context determination means. In this case, depending on external ambient conditions, multiple context-specific user profiles may be available, and the user may actually select one of these user profiles. In this case, the pre-selection made by the computing unit may not necessarily coincide with the user's wishes. By projecting light patterns into the vehicle's surroundings, the user receives information about which context-specific user profile the vehicle proposes for selection upon approaching the vehicle and which user profile is pre-set, i.e., which user profile will be set if no operating action is performed.
[0017] As a context determination means, the vehicle can use various sensors, control devices, and computing units. The vehicle can have, for example, temperature and humidity sensors, which the computing unit can use to evaluate the current climatic and weather conditions. For example, if it is warm, the computing unit can propose a context-specific user profile in which the air conditioning is set to 20°C and the fan speed is set to high. In the case of a convertible, an open top could be included in the configuration of the corresponding user profile. However, if it is cold or raining, the computing unit selects a context-specific user profile in which the convertible top is closed or the ventilation is set to high temperature. Information for deriving the context data can also be obtained externally. For this purpose, the computing unit can be connected to a corresponding control device, and the information is obtained via this control device. Thus, for example, the computing unit can request climate or weather data from a meteorological service or traffic information from a traffic service. Each user can also have a (digital) calendar. The calendar can be integrated into the vehicle, accessed on a mobile terminal device, such as a smartphone, to which the computing unit has access, or via the Internet. That is, the computing unit can be connected to the Internet, for example by mobile radio via the telecommunications unit, and can thereby access a calendar. The calendar can store the user's appointments, which the computing unit can take into account to derive the context data. For example, if there is a medical appointment in the morning, the computing unit can derive from this appointment that the next drive is not a commute and accordingly propose a context-specific user profile in which music is played instead of news via the vehicle's infotainment system. Other factors that influence the context are, for example, the date, the day of the week, the time of day, the number of vehicle occupants, the mood of the vehicle user, the vehicle load, visibility conditions such as day or night, brightness, fog or sunset, the duration of a section of a navigation route set via the vehicle's navigation system, etc.
[0018] According to the present invention, the computing unit is further configured to process the context data to determine, for at least two context-specific user profiles of the identified user, user profile probabilities that describe the degree of probability that each context-specific user profile fits the current situation context. For example, two or three user profiles with the highest user profile probabilities are output to the identified user using the projection means. Since the user receives this information while outside the vehicle, he or she already knows which user profile has been selected or which user profile is available for selection when entering the vehicle. Therefore, there is no need for cumbersome operations inside the vehicle to obtain this information.
[0019] To determine the user profile probability, various procedures can be programmed into the computing unit. For example, the computing unit can weight the data according to the individual context data. For example, the object identification can be compared (matched) with the current time, the vehicle's location, and the illuminance sensor value. That is, the vehicle can identify, for example, that the user is wearing casual clothes instead of work clothes, even though it is a weekday and the user would normally commute to work. Furthermore, it is already light outside. The vehicle is in the user's place of residence. The vehicle's location and image recognition can be weighted more heavily than the illuminance sensor value and the time, resulting in a higher user profile probability for the "leisure profile" and a lower user profile probability for the "work profile." Of course, the user may still be heading to work and, for example, wearing casual clothes today because they have no meetings scheduled. In this case, the user prefers the work profile to the leisure profile, even though the work profile has a lower user profile probability.
[0020] Furthermore, the light pattern also includes an output of the user profile probability, so that the user receives information about whether the computing unit considers multiple user profiles to be suitable for the current situation. For example, when two context-specific user profiles with similar user profile probabilities are presented, even if it is clear to the user that one of the two user profiles is clearly more suitable for the current context, the user can make a corresponding setting to shift the user profile probability toward the preferred user profile. When the current context occurs again later, the computing unit will more accurately suggest or pre-set the context-specific user profile that the user actually prefers. Therefore, automatic activation of a context-specific user profile that the user does not prefer is suppressed.
[0021] The basic content of the light pattern can be configured in various ways. For example, the light pattern can include text, numbers and / or geometric objects. For example, two context-specific user profiles can be projected into the surrounding environment along with their names. The user profile probability can be projected next to each user profile in the light pattern in percentage.
[0022] In an advantageous configuration of the vehicle according to the present invention, the computing unit is further configured to control the projection means to visualize each user profile in a light pattern, preferably context-specific, such that a separate graphic object is included in the light pattern for each user profile to be projected into the vehicle's surroundings, the area of the separate graphic object being selected according to the respective user profile probability. This ensures that the user can quickly and intuitively identify the content of the light pattern. For example, the light pattern can include one circle for each displayed user profile. In this case, the individual circles have different diameters and therefore different areas. The higher the user profile probability of each user profile, the larger the area. Different user profiles can also include different graphic objects. For example, if four user profiles are displayed, the first user profile can be represented by a circle, the second by a triangle, the third by a square, and the fourth by a star. Complementary information, such as the profile name, can be inserted as text within or next to each graphic object. Complementarily, the user profile probabilities can be displayed as numerical values, for example 75%, 12%, 7% and 6%.
[0023] Also, the user profile with the highest user profile probability can be projected closest geographically to the identified user's current location, and user profiles with lower user profile probabilities can be projected further away. Thus, for example, the user profile with the highest probability can be projected in front of the driver's door of a vehicle, and the remaining user profiles can be shown in the trunk area.
[0024] According to another advantageous configuration of the vehicle, the computing unit is further configured to control the projection means so that the individual graphical objects or light patterns have different designs in terms of color, contrast, sharpness, color gradation, brightness, transparency, animation, complementary text instructions, and / or complementary pictograms. This makes it easier for the user to quickly and clearly distinguish between the respective user profiles. The various visual representations of the graphical objects can depend on the user profile probability or configuration parameters included in the respective user profile, or can be freely set by the user. For example, the respective graphical objects can be displayed with very vivid colors, high contrast, high sharpness, high brightness, low transparency, etc. in the case of a high user profile probability, and correspondingly, with pastel colors, low contrast and / or low sharpness, low brightness, high transparency, etc. in the case of a low user profile probability.
[0025] Individual graphical objects may further include animated pictograms, making them easier for users to understand. For example, for a work profile, the graphical objects may include a stick figure running with a briefcase, while for a leisure profile, a smiley face may be displayed. For a rainy profile, the respective graphical objects may include clouds with raindrops falling, while for a sunny profile, the respective graphical objects may include a sun emitting rays.
[0026] Preferably, the computing unit is further configured to read and analyze the settings, i.e., configuration parameters, of each context-specific user profile and adapt the visual design of the graphical object to be projected based on the read and analyzed settings. For example, if a work profile and a leisure profile are included in the light pattern, both profiles can be represented by circles. In this case, the work profile is particularly clearly displayed in black and white. The leisure profile is displayed by a colorful color gradient moving from left to right within the graphical object, with the corresponding circle appearing to vibrate by swaying back and forth on the ground. This is relevant, for example, to playing heavy metal music instead of the news in a vehicle while driving, or to colorful interior lighting that changes depending on the music instead of static, cold white ambient light. In other words, a user can see the configuration parameters stored in each user profile by simply glancing at the graphical object, thereby enabling the user to more quickly grasp and more accurately understand the visualizations included therein.
[0027] According to another advantageous configuration of the vehicle according to the invention, the computing unit is further configured to control the projection means so that at least one visualization of the configuration stored in the user profile, which is also included in the light pattern, is included in the light pattern together with the corresponding configuration parameters. This allows the user to more easily interpret the characteristics of the settings, i.e., the configuration parameters, associated with the respective user profile. A complementary visualization of the configuration parameters of each user profile can be created for all, selected ones, or only one of the user profiles included in the light pattern. Preferably, configuration parameters that are particularly relevant to the respective user profile are displayed. In particular, this applies only to the most probable user profiles.
[0028] For example, the light pattern may include two preferred context-specific user profiles, specifically a sunny profile and a rainy profile. The user profile probability is higher for the sunny profile than for the rainy profile. For example, both user profiles are represented by circles as graphic objects, and three other circles are displayed relatively close to the circle representing the sunny profile in the light pattern. The first additional circle displays a pictogram of a convertible with its top open. The second additional circle displays a temperature of 22°C in numbers. The third additional circle displays a fan with the number 2. The user can thereby select the sunny profile with the top of the convertible open and the ventilation system configured according to the settings shown in the second and third additional circles. Rep It can be quickly and intuitively recognized that the calculation unit automatically sets the profile. Complementarily, an additional circle for the rain profile may be included in the light pattern.
[0029] Preferably, the computing unit is further configured to select at least one configuration to be included in the light pattern depending on the context data using the corresponding configuration parameters themselves. Therefore, the computing unit can implement a routine that defines which configuration parameters characterize each context-specific user profile. Since the sunny profile and the rainy profile are distinguished in particular by the roof and air conditioning settings, the computing unit displays this information complementary to each other. In contrast, the work profile and the leisure profile may display information related to the vehicle's infotainment system and / or ambient light.
[0030] Furthermore, if the user wants to display special settings for configuration parameters for a particular context-specific user profile, the user can configure additional settings through a submenu in the vehicle's infotainment system, i.e., the user can configure the design routines for the light patterns themselves.
[0031] If a user wants to select a particular context-specific user profile, the user can confirm that this user profile should be activated by, for example, selecting a visualization representing the user profile with the highest user profile probability, or can activate a different user profile by selecting a visualization representing a user profile with a relatively low user profile probability. If the user's preferred context-specific user profile is not represented by a visualization in the light pattern, the light pattern can also typically include a visualization for opening a submenu in which all context-specific user profiles are listed. The user can then select their preferred user profile from this list.
[0032] Furthermore, the user can manipulate individual configuration parameters in the complementary display. For example, if the user wants to activate the sunny profile but with a closed top, the user can perform a corresponding manipulation input on the first additional circle. This will close the convertible top. The user can also change the temperature setting of the air conditioning unit. For example, the second additional circle could display an up arrow above the temperature display and a down arrow below the temperature display. By selecting the arrow accordingly, the temperature can be changed up or down, for example, by one degree Celsius.
[0033] Preferably, the computing unit is further configured to identify a human crossing and / or touching the visualization with his / her foot as a selection gesture, which makes operation very convenient (comfortable) for the user: the user only needs to lift his / her foot and touch the corresponding visualization, e.g., each individual graphic object, with his / her foot. Selection can be detected, for example, from a change in the stationary or moving direction of the foot.
[0034] According to another advantageous configuration of the vehicle, the computing unit is further configured to control the projection means such that, after a visualization is selected, further information related to the user profile underlying the respective visualization or related to the configuration parameters underlying the visualization is shown in the light pattern. In other words, the visualizations of the light pattern, e.g., individual graphic objects, are clickable. Clicking on the corresponding visualization opens a pop-up submenu. In such a pop-up submenu, further settings can be made or complementary information can be output to the user. For example, it is conceivable that three user profiles are represented by individual graphic objects in the light pattern. In this case, selecting one of the graphic objects causes further visualizations to appear in the light pattern, showing the respective settings of the associated configuration parameters or all configuration parameters of the selected user profile. Selecting or clicking on the user profile again activates the user profile.
[0035] In another advantageous configuration of the vehicle, the computing unit is further configured to identify a characteristic operation sequence or a characteristic operation pattern in the operation action and receive user authentication as a result. This can be compared to entering a PIN, password, or unlocking pattern, as is known from smartphones, for example. The light pattern may or may not have a corresponding input surface for entering the characteristic operation pattern. In particular, if the light pattern does not contain such visual information, it becomes difficult for a hacker (attacker) to enter an operation action via the light pattern. In this case, the light pattern can be projected into the vehicle's surroundings, but it cannot enter an operation action. Only after the characteristic operation sequence or the characteristic operation pattern is identified can the light pattern receive the actual operation action. In contrast, if a corresponding input area, such as a numeric keypad or a grid area, is displayed, the user can more easily understand whether the characteristic operation pattern is being correctly executed.
[0036] The identification of the characteristic operation sequence or characteristic operation pattern and the corresponding receipt of user authorization can be used by the computing unit to grant the user further usage rights, i.e., to grant more detailed access to vehicle functions, for example.
[0037] According to another advantageous configuration of the vehicle, the computing unit is further configured to select a user profile, unlock the vehicle doors and / or enable the drive after receiving the user authentication, thereby making the vehicle easier to use, since the user can enter and start the vehicle without having to carry the vehicle key. Enabling the drive can be compared to starting the starter motor, disarming the immobilizer, operating the ignition or, in the case of an electric vehicle, activating the on-board electronics.
[0038] After receiving user authentication, i.e., immediately after inputting a characteristic operating sequence or a characteristic operating pattern, the drive can be immediately enabled or the vehicle's operating device can be enabled to receive a start command. For example, a vehicle has a start button instead of an ignition key that can start the vehicle's engine. This start button can be enabled. However, the user can get off very comfortably and quickly, especially if the drive is enabled immediately after inputting a characteristic operating sequence or an operating pattern. The drive can be started accordingly even before the user gets into the vehicle.
[0039] Preferably, the computing unit is further configured to process the sensor data to create a new user profile for a vehicle occupant identified for the first time and to associate the user profile with the vehicle occupant, thereby reducing the effort required for storing the user profile and further increasing user comfort.
[0040] Further advantageous configurations of the vehicle according to the invention will become apparent from the exemplary embodiments which are described in more detail below with reference to the figures. [Brief explanation of the drawings]
[0041] [Figure 1] 1 is a schematic top view of a vehicle according to the present invention; [Figure 2] FIG. 2 is a detailed view of the light pattern projected into the surrounding environment by a vehicle according to the present invention. [Figure 3] 1A-1C show representations of light patterns projected onto the surrounding environment at two successive times before and after user interaction. [Figure 4] FIG. 10 is another detailed view of the light pattern projected onto the surrounding environment, showing the unlocking pattern. [Figure 5] 3 is a flowchart of the method steps performed by a computing unit according to the present invention for projecting a light pattern into the surrounding environment. DETAILED DESCRIPTION OF THE INVENTION
[0042] The vehicle 1 according to the present invention, as shown in FIG. 1, comprises a detection means 2, a context determination means 3 and a calculation unit 4. The vehicle 1 further comprises a number of configurable components, not shown in detail. For example, the vehicle seats can be adapted to the physique of the respective vehicle occupant, playback parameters of audio and video content can be adapted via the infotainment system of the vehicle 1, seat heaters can be activated, and ventilation can be adjusted. Each vehicle occupant has their own preferences for the ideal configuration of the corresponding components. The calculation unit 4 further comprises a user profile database, in which each user can create multiple user profiles. For an activated user profile, the corresponding components of the vehicle 1 are configured as defined by the respective configuration parameters stored in the user profile.
[0043] For the same user, multiple user profiles can be defined and stored, which are activated in a context-specific manner, i.e., depending on the situation. The vehicle 1 includes the aforementioned context determination means 3 for this purpose. The context determination means 3 consists of the computing unit 4 itself and components of vehicle subsystems, such as the temperature sensor 11, the control device 12, the telecommunications unit 13, etc. Using the context determination means 3, the vehicle 1 can determine the situation context, such as what time it is, what day of the week it is, what date it is, what the weather conditions are, what route is planned for the next drive of the vehicle 1, what the traffic situation along the route is, what the vehicle user's next plans are, etc. The computing unit 4 can select a respective context-specific user profile for activation depending on the determined situation context.
[0044] Detection means 2, for example in the form of radar sensors, lidar, external cameras, ultrasonic sensor systems etc., can be used to identify static and dynamic objects in the surrounding environment. This allows the computing unit 4 to identify that a person is approaching the vehicle 1. Also, the person can be uniquely identified, for example by analyzing their gait, scanning their biometric features and / or reading a unique identifying feature such as a digital vehicle key. Furthermore, the detection means 2 is configured to identify user manipulation actions performed as gestures. The selection gestures may be pointing gestures, gaze gestures or other movements in space, which gestures are detected by the detection means using techniques known from the prior art. 2 is identified by
[0045] The vehicle 1 further comprises at least one projection means 5. The projection means 5 may be, for example, a high-resolution matrix headlight or an LED projector or a laser projector. The projection means 5 may be located anywhere on the vehicle 1, for example, it may be integrated into the front of the vehicle, the radiator grille, the exterior mirrors, the scuff plates, the bumpers, etc.
[0046] Once the computation unit 4 has identified a user approaching the vehicle 1, a light pattern 6 can be projected into the vehicle's surroundings using the projection means 5. The light pattern 6 comprises information about context-specific user profiles selectable by the user. For example, the light pattern 6 comprises a visualization 7 for at least two user profiles of the identified user. In this case, for each user profile shown, a user profile probability is displayed describing the probability determined by the computation unit 4 that the respective user profile fits the current situation context.
[0047] This means that the computing unit 4 may generally predetermine a user profile that the user does not want to activate. In contrast, the light pattern 6 projected into the surrounding environment allows the user, even when approaching the vehicle 1, to evaluate whether the computing unit 4 has indeed selected a preferred user profile and to select a different user profile if necessary.
[0048] 1 shows how the light pattern 6 looks in a first example. According to the invention, each user profile is represented by an individual graphic object 8. The graphic objects 8 are, for example, geometric figures such as circles, rectangles, squares, triangles, stars, or other polygons. In this case, the individual graphic objects 8 are preferably displayed according to the user profile probabilities. User profiles with a particularly high matching probability are shown correspondingly larger, while user profiles with a low matching probability are shown correspondingly smaller. That is, the corresponding visualization 7 consists of the individual graphic objects 8, the size of which is scaled to the user profile probabilities. Complementarily or alternatively, instead of size differences, it is also conceivable to include the user profile probabilities in the light pattern 6 as plain text, for example as a percentage (not shown).
[0049] The graphic objects 8 can be arranged arbitrarily in the light pattern 6. For example, the graphic object 8 representing the most likely user profile is highlighted, and the other graphic objects 8 are aligned with each other in the form of a list.
[0050] 2 shows another possible implementation of such a light pattern 6. As visualization part 7, the light pattern 6 includes, besides a separate graphic object 8 for each user profile, a visualization part 7 in the form of a complementary object 14.1 for each user profile that is most likely to fit the current situation context. These complementary objects 14.1 represent information describing the respective configuration parameters of the corresponding user profile. For each complementary object 14.1, further sub-complementary objects 14.2 can also be displayed.
[0051] In the example shown in Figure 2, the graphical object 8 representing the user profile with the highest user profile probability is a work profile that shows the settings for vehicle components that the user prefers while driving to work. For clarity, a person working is shown within the graphical object 8 as a pictogram 15. The complementary object 14.1 shows a convertible with the top closed and a radio as an audio source for playing audio media content via the infotainment system of the vehicle 1.
[0052] Control actions can be input via the light patterns 6, as will be explained in more detail below in connection with FIG. 3. The corresponding visualization 7 can include selection surfaces, such as up and down arrows. By performing a selection gesture on such arrows, it is possible, for example, to change the audio source, so that music can be played via the vehicle radio, a smartphone, an SD card, etc., and the sub-complementary object 14.2 can be used to set, for example, which radio station to select. This allows the user to optimally adjust the vehicle 1 even before actually getting into the vehicle 1. Instead of arrows, the respective graphic object 8, the complementary object 14.1 and / or the sub-complementary object 14.2 themselves can also function as selection or control surfaces.
[0053] The relatively small graphic objects 8 represent context-specific user profiles with low likelihood of matching. Here, in addition to the pictograms 15, the determined user profile probabilities as well as descriptive keywords can also be displayed as plain text (not shown). For example, in the "Audio Book" profile, the user's smartphone is set as the audio source and the audio book application is automatically activated. In contrast, the "Racing" user profile provides a stiffer suspension setting and a sporty automatic gear selection with shifting only at high engine speeds.
[0054] Furthermore, the light pattern 6 can include a menu object 14.3. By performing a selection gesture on the menu object 14.3, for example, a pop-up submenu can be opened, via which the user can select all user profiles defined for him.
[0055] The selection gesture can be detected in different ways: the detection means 2 can be used to analyze the relative position or change in position of the person with respect to the vehicle 1, thereby identifying the person's actions, in particular their approach to the vehicle 1. It can also be identified which area of the light pattern 6 the corresponding user is pointing at.
[0056] Particularly preferably, a selection gesture is recognized when a person touches or crosses the visualization 7 with their foot 9. For this purpose, the light pattern 6 can be monitored, for example, by means of a camera. This makes it very easy to identify whether image content is in contact with or covered by the foot 9. As shown on the left side of Fig. 3, crossing the corresponding graphical object 8 opens a submenu, which informs the user of the configuration parameters stored in the respective user profile. By selecting information displayed in the submenu, the corresponding configuration parameters may be directly changed.
[0057] 4 shows an input mask 16. The input mask 16 may be, for example, a numeric keypad, or, as shown, an array of circles or a grid area, or may be any shape or graphic. Here, the input mask 16 can be used to input a characteristic operation pattern 10 in the form of a sequence of contacts of the circles on the input mask 16. This can be used to perform user authentication, which can grant the user further access rights. For example, this can be used to unlock the vehicle 1 and / or enable the drive, i.e., start the engine.
[0058] The calculation unit 4 carries out the method steps shown in Figure 5 in order to project the light pattern 6 into the vehicle environment. In method step 501 the method starts.
[0059] In method step 502 , the calculation unit 4 obtains the sensor data provided by the detection means 2 .
[0060] In method step 503, the calculation unit 4 identifies static and dynamic objects present in the vehicle environment.
[0061] In method step 504, the sensor data and the context data generated by means of the context determination means 3 are evaluated, and on this basis the calculation unit 4 determines the situation context. The corresponding information is transferred as indicated by the dashed arrows.
[0062] In method step 505, the calculation unit 4 checks whether one of the people identified in the vehicle environment can be identified as a known user. If not, the method ends in method step 514.
[0063] On the other hand, if a known user has been identified, the computing unit 4 checks in process step 506 whether the user is moving towards the vehicle 1. If not, the method also ends in method step 514. On the other hand, if moving, the computing unit 4 checks in method step 507 whether multiple context-specific user profiles have been stored for the user.
[0064] If so, the calculation unit 4 determines the corresponding valid user profile probability in method step 509. To this end, the calculation unit 4 first checks in method step 508 which user profile is actually relevant for the respective situation context. For this purpose, it can access, for example, a separate link database that associates various peripheral conditions with context-specific user profiles. Here too, the corresponding information is transferred as indicated by the dashed arrows. If no user profile is stored and no general setting suggestions are made, the method ends in method step 514.
[0065] In method step 510, a suitable light pattern 6 is projected into the surrounding environment. In method step 513, the light pattern 6 may include suitable complementary information, such as the aforementioned complementary objects 14.1, sub-complementary objects 14.2 and / or menu objects 14.3.
[0066] In method step 511, the calculation unit 4 checks whether the user has touched, crossed or otherwise selected the image content of the light pattern 6, i.e. the visualization 7. This is evaluated as an operating action. In this way, for example, the input of a characteristic operating pattern 10 can also be identified.
[0067] If such an operating action is identified, the computing unit 4 performs the appropriate action in method step 512, activating the respective user profile or modifying the corresponding configuration parameters. [Prior art documents] [Patent documents]
[0068] [Patent Document 1] German Patent Application Publication No. 102019132403 [Patent Document 2] German Patent Invention No. 102019135410 [Patent Document 3] US Patent Application Publication No. 2015 / 0180999
Claims
1. a vehicle (1) comprising a plurality of configurable components, detection means (2) and a computation unit (4) configured to store a user profile database capable of storing user profiles, each user profile being formed by combining at least configuration parameters of the configurable components, the user profile database storing at least two user profiles for users, the computation unit (4) being configured to process sensor data generated by the detection means (2) to identify people present in the vehicle's environment and to select a user profile belonging to one of the identified users, The calculation unit (4) further comprises: - controlling projection means (5) of said vehicle (1) to output a light pattern (6) into the vehicle environment, said light pattern including a visualization (7) of said user profile for said identified user; - processing the sensor data to identify a selection gesture performed by the identified user on the visualization portion (7) included in the light pattern (6), interpreting the selection gesture as an input for a manipulation action, activating a user profile based on the selected visualization portion (7) and / or modifying configuration parameters based on the selected visualization portion (7); - determining a situation context taking into account the context data generated by the context determination means (3) and selecting a context-specific user profile that matches said situation context; - configured to process the context data to determine, for at least two context-specific user profiles of the identified user, user profile probabilities describing the degree of probability that each of the context-specific user profiles fits the current situation context. A vehicle (1).
2. The calculation unit (4) is further configured to control the projection means (5) so that for each user profile to be projected onto the vehicle environment, an individual graphic object (8) is included in the light pattern (6) to visualize the respective user profile in the light pattern (6), the area of the individual graphic object (8) being selected depending on the respective user profile probability.
2. A vehicle (1) according to claim 1, characterized in that:
3. The calculation unit (4) is further adapted to control the projection means (5) to vary the color, contrast, sharpness, color gradation, brightness, transparency, animation, complementary text instructions and / or complementary pictograms of the individual graphic objects (8).
3. A vehicle (1) according to claim 2, characterized in that:
4. The calculation unit (4) is further adapted to control the projection means (5) so that the individual graphic objects (8) have different designs depending on the configuration parameters stored in the user profile. Vehicle (1) according to claim 2 or 3, characterized in that it
5. The calculation unit (4) is further configured to control the projection means (5) such that at least one visualization (7) of a configuration stored in the user profile, which is also included in the light pattern (6), is included in the light pattern (6) together with corresponding configuration parameters. A vehicle (1) according to any one of claims 1 to 3, characterized in that
6. The calculation unit (4) is further configured to select, depending on the context data, at least one of the configurations to be included in the light pattern (6) using the corresponding configuration parameters themselves.
6. A vehicle (1) according to claim 5, characterized in that it
7. The computing unit (4) is further configured to identify the selection gesture as a human crossing and / or touching the visualization (7) with a foot (9). A vehicle (1) according to any one of claims 1 to 3, characterized in that
8. The calculation unit (4) is further configured to control the projection means (5) such that, after selection of the visualization portion (7), further information related to the user profile underlying the respective visualization portion (7) or further information related to the configuration parameters underlying the visualization portion (7) is shown in the light pattern (6). A vehicle (1) according to any one of claims 1 to 3, characterized in that
9. The computing unit (4) is further configured to identify a characteristic operation sequence or a characteristic operation pattern (10) in the operation action and receive a user authentication as a result. Vehicle (1) according to claim 7, characterized in that it
10. The computing unit (4) is further configured to unlock the vehicle door and / or enable the drive after receiving the user authentication.
10. A vehicle (1) according to claim 9, characterized in that
11. The computing unit (4) is further configured to process the sensor data to create a new user profile for a vehicle occupant identified for the first time and to associate the user profile with the vehicle occupant. A vehicle (1) according to any one of claims 1 to 3, characterized in that
Citation Information
Patent Citations
Method for automatically selecting a user profile in a vehicle
DE102019132403A1
Motor vehicle with a projection device for capturing a user's input gesture in relation to a projection, and method for operating a projection device
DE102019135410A1
Systems and methods for selecting user profile from multiple users carrying personal devices
JP2022076468A
Interactive vehicle window display system with personal convenience reminders
US20150077272A1
Automated social network interaction system for a vehicle
US20150180999A1