Method for providing an infotainment module and user system
The method and user system create personalized user profiles using biometric data and AI to adapt vehicle functions and content, enhancing user engagement and loyalty through interactive experiences and rewards, addressing the lack of personalized intercommunication in existing infotainment systems.
Patent Information
- Application Number
- DE102024003735
- Authority / Receiving Office
- DE · DE
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-11-14
- Publication Date
- 2025-01-02
AI Technical Summary
Existing infotainment modules in vehicles lack personalized and intelligent intercommunication with users, failing to adapt to individual user preferences and behaviors, leading to low user engagement and loyalty.
A method and user system that creates a personalized user profile using biometric data, voice recognition, and AI algorithms to control vehicle functions and provide interactive, adaptive infotainment, including a customizable avatar that reflects user appearance and emotional state, with features like mini-games and rewards for user interactions.
Enhances user engagement and loyalty by dynamically adapting vehicle functions and content to individual preferences, promoting brand loyalty through interactive experiences and rewards, while ensuring safety through real-time monitoring and assistance.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The invention relates to a method for providing an infotainment module for a user of a vehicle according to the preamble of patent claim 1. Furthermore, the invention relates to a user system.
[0002] DE 10 2021 120 221 A1 discloses a method for providing a gamification module for vehicle users. A system determines a user identifier and links it to a vehicle to load a user profile. Based on the user's usage history, a gamification module is selected, which is displayed to the user on one or more output devices in the vehicle. The gamification module is designed to playfully encourage and personalize the use of vehicle functions, taking various user data into account in real time.
[0003] The object of the invention is to further develop a method for providing an infotainment module for a user of a vehicle in such a way that particularly personalized and user-adapted, intelligent intercommunication is possible.
[0004] This object is achieved by means of a method having the features of patent claim 1 and by means of a user system according to the invention. Advantageous refinements of the user system according to the invention are to be regarded as advantageous embodiments of the method according to the invention, wherein the means of the user system are used to carry out the method steps. Furthermore, advantageous developments of the invention are described by the dependent claims, the following description, and the figures.
[0005] A first aspect of the invention relates to a method for providing an infotainment module for a user of a vehicle, in particular a motor vehicle, in particular a passenger car. This method comprises several method steps for providing a personalized infotainment module in the vehicle.
[0006] First, a user profile is recorded, which serves as a control component for the various vehicle functions. This user profile can be created in various ways. If a profile already exists, it is loaded from a database, either locally in the vehicle or via a cloud-based platform. If no existing profile is available, the user can create a new profile via an initial recording. These user profiles can also be downloaded via synchronization from external devices, such as smartphones or smartwatches.
[0007] The user profile controls various vehicle functions based on the user's individual preferences and settings. For example, seat position, climate settings, preferred navigation routes, or audio sources can be automatically adjusted as soon as the user is recognized.
[0008] The infotainment module is then deployed and activated based on the recorded user profile. The infotainment module has interactive and playful features to provide the user with an entertaining and personalized environment. For example, it can be used as a game module in which the user plays interactive games based on driving conditions or the vehicle's status, such as mini-games during an electric vehicle charging process.
[0009] The infotainment module thus provides interactive communication between the vehicle and the user. It acts proactively by suggesting entertainment options or displaying personalized content based on the user profile. For example, the user system could suggest playing certain media content, launching mini-games, or offering interactive challenges tailored to the user's preferences and previous interactions. These interactions are enabled by a combination of voice recognition, touch interface, and haptic feedback.
[0010] To achieve the object of the invention and develop an advanced infotainment module that is more closely tailored to the user, the invention provides that the user profile is created and / or recognized by detecting the user using a detection device integrated in the vehicle. This includes the use of various components and / or detection of parameters to enable a substantially precise and / or personalized control of the vehicle functions.
[0011] The detection devices can use various parameters and information, such as biometric data captured via camera systems in the vehicle. These systems could themselves use facial recognition technology to uniquely identify the user and thus create an individual user profile. The user system can also use or be linked to advanced driver assistance systems (ADAS) that analyze the user's behavior while driving and make adjustments to the vehicle's functions based on this data.
[0012] In addition to visual recognition, user profiling can also be performed by capturing audio input. Microphones and / or speech recognition systems are used, for example, to analyze the user's voice commands. This data can be compared with stored voice profiles to enable additional user authentication.
[0013] Furthermore, the integration of databases in which registered user profiles are stored is also possible. These profiles can, for example, be synchronized across different vehicles, either by storing them locally in the vehicle and / or via a cloud connection. This allows a user to take their profile with them between different vehicles. Technologies such as RFID or NFC can also be used to transfer user profiles or activate them when the user enters another vehicle.
[0014] The use of the internet and wireless communication, such as Wi-Fi and Bluetooth, also enables the transfer of data between vehicles and the synchronization of user profiles with external services or third-party entities. This allows data such as driving behavior, preferences, and settings to be continuously updated between different devices and vehicles.
[0015] Overall, this combination of visual, auditory, and database-driven features contributes to adapting the infotainment module to the individual user in a highly personalized and dynamic manner. The ability to capture and combine data from various sources allows the vehicle to adapt seamlessly to the user's needs and preferences.
[0016] By capturing the user profile, it is now also possible to adapt vehicle functions based on the user profile. This allows the system to dynamically adapt vehicle functions to the created user profile. The captured data enables the vehicle to automatically make settings based on the user's specific preferences. For example, the temperature could be automatically adjusted, the user's preferred audio entertainment could be selected, or certain driving modes, such as sporty or eco, could be activated.
[0017] This can also be achieved, for example, through AI-supported algorithms and machine learning, which provide increasingly precise adjustments and more specific suggestions through continuous use. The user system learns the user's preferences better over time and adapts accordingly. Furthermore, cloud integration enables the synchronization of user profiles between different vehicles, ensuring seamless adjustments even when changing vehicles.
[0018] In an advantageous embodiment of the invention, the user's visual characteristics are used to create a personalized avatar in the infotainment module. These avatars can, for example, be created or based on AI-supported analysis of the data acquired by camera systems. Software or AI processes the visual information collected by high-resolution cameras to create the most accurate image of the user possible. This includes features such as face shape, skin color, hairstyle, and even clothing details. The avatar is created using preset options and individual adjustments. The user system allows the user to modify various aspects of the avatar so that it is displayed either faithfully or with a comic-like appearance.To meet the needs of different preferences, the avatar can switch between 2D and 3D representations and be displayed in both realistic and stylized forms. Additionally, the infotainment module can take regional settings into account, such as country-specific characteristics or cultural preferences. Weather conditions can also influence the avatar's appearance. For example, the avatar could wear seasonally appropriate clothing and / or fashion-conscious clothing depending on the weather or region. Another function allows the avatar to be adjusted dynamically and in real time as soon as new visual information is captured. These adjustments are made with a high degree of accuracy to approximate the user's real-life appearance as closely as possible.
[0019] In a further advantageous embodiment of the invention, the user's emotional and physical characteristics can also be recorded and transferred to the avatar in the infotainment module in real time. This enables the creation of a real-time avatar that not only reflects the user's visual appearance, but also their current state of health. To make this possible, camera systems and sensors in the vehicle can be used to record both visual and physiological data from the user. Emotional states such as joy, anger or tiredness can be recorded by analyzing facial expressions and mimicry. The AI or other software can detect changes in facial expressions for emotion recognition and transfer these to the avatar in real time. In addition, physical states such as tiredness or tension can be recorded through the integration of driver monitoring systems. Such systems use, for example,Infrared cameras monitor eye movements and patterns to detect signs of fatigue. The user's posture or movement behavior can also be analyzed to assess the user's physical condition and represent it accordingly in the avatar. The avatar could dynamically adapt based on this data and display visual cues such as closed eyelids or altered facial expressions if the user shows signs of fatigue. This not only enables a realistic and interactive representation of the user in the infotainment module but also offers potential for additional functions, such as drowsiness warnings, to increase safety.
[0020] Thus, depending on the detected state of the user, for example emotional or physical changes such as fatigue, the user system can be configured to automatically inform a third party or offer warning signals and assistance. This could be done by notifying an external service, such as a health monitoring system or an emergency call center. Upon detecting fatigue, the user system could, for example, activate a driver assistance mode or advise the user to take a break through visual and acoustic warning signals. In addition, the infotainment module could proactively offer assistance, such as suggesting nearby rest areas / service stations and / or activating functions to increase attention, such as activating music support to keep the user alert.
[0021] A further aspect of the invention relates to a user system for operating a method according to the previous aspect, wherein the user system comprises, for example, various detection devices and processing components to enable personalized customization and interaction of the user with the infotainment module. The user system thus comprises, for example, cameras, microphones, driver monitoring systems, and other sensor devices that continuously collect data about the user, including their external appearance, emotional states, and / or physical condition. The user system comprises, for example, a display device that provides an interface for the user via which all relevant information and interactions are visualized.The user system also includes an electronic computing device that can both process user inputs and transmit / send outputs to the user and / or to control devices. Furthermore, the user system is linked to all control units in the vehicle to execute the required functions of the process, including adapting vehicle functions and interacting with the infotainment module.
[0022] Further advantages, features, and details of the invention will become apparent from the following description of a preferred embodiment and from the drawings. The features and combinations of features mentioned above in the description, as well as the features and combinations of features mentioned below in the description of the figures and / or shown alone in the figure, can be used not only in the respective combinations specified, but also in other combinations or on their own, without departing from the scope of the invention.
[0023] Showing: Fig. 1 is a pictorial diagram illustrating a method for providing an infotainment module to a user of a vehicle; Fig. 2 shows another diagram illustrating the process; Fig. 3 is another diagram illustrating the method; and Fig. 4 shows another diagram to illustrate the process.
[0024] In the figures, identical or functionally identical elements are provided with the same reference numerals.
[0025] Fig. 1 shows a picture diagram to illustrate a method for providing an infotainment module or alternatively a gamification module for a user 18 of a vehicle (HCCP = Highly Customizable Customer Profile).
[0026] Fig. 1 shows in particular a user system 10 with an interface 12 which is connected to a vehicle 14 and an avatar 16 for a Fig. 1 shows a user 18 (not shown), who is intended to visualize the method. The user system 10 detects the user 18, creates the avatar 16 based on the acquired data, and the interface 12 displays control elements 20 available to the user 18. These control elements 20 are designed to adapt various aspects, settings, and / or preferences for the user 18.
[0027] The method for providing the infotainment module to the user 18 of the vehicle 14 comprises several steps to enable personalized and interactive use of the vehicle 14. First, a user profile of the user 14 is created, which is recorded by various recording devices in the vehicle and controls the vehicle functions depending on the collected data. The infotainment module is provided and adapted based on this user profile.
[0028] The interaction between the user 18 and the infotainment module is dynamic, with the user system 10 proactively offering entertainment suggestions and customizations based on the preferences of the user 18. Visual characteristics of the user 18 can be captured by camera systems and used to create a personalized avatar 16 in the infotainment module. Additionally, emotional and / or physical characteristics of the user 18, such as fatigue or stress, can be captured and transferred to the avatar 16 in real time to enable a realistic interaction. This data also influences the vehicle functions, which are adapted depending on the captured information to increase the comfort and safety of the user 18.
[0029] In the context presented here, acquisition means that the user 18 can receive or use something that is made available to him. It is a provided resource or function that is made accessible to him, for example, through interaction or the completion of certain actions in the user system 10, without requiring an explicit reference to a traditional acquisition process in the sense of transactions. This offers the opportunity to access exclusive functions or rewards that are unlocked for the user 18.
[0030] The user system 10 provides the user 18, and thus the vehicle owner, with the ability, similar to a computer game, to create a virtual avatar 16 in the user profile of a head unit or a display device with an electronic computing device, e.g., a touch-sensitive display device or touchscreen, and thus on the interface 12, and to collect experience points with this profile through certain actions. These points can be used, for example, to unlock rewards.
[0031] It's well known that creating a user profile is now a standard feature for almost all manufacturers. However, they often only save settings such as seating position, specific mobile devices, ambient lighting color settings, and other vehicle settings. However, this lacks user loyalty, the development of an emotional connection, and identification with the vehicle.
[0032] In addition, user profiles from other manufacturers lack the playful approach to getting to know functions, the unlocking of functions as a reward for defined actions, and the smooth transition from testing the functions to purchasing the features or purchasing function subscriptions.
[0033] In addition, user profiles from other manufacturers lack the ability to share these profiles on social networks and to compare themselves in rankings based on the experience points or rewards earned.
[0034] The solution to the technical problem lies in the extended use of the existing head unit, the integrated sensor elements such as cameras, GPS antenna and the vehicle's internet connection 14.
[0035] The first step is to create a user profile with a virtual avatar 16, which is either created automatically by AI through the upload of an image or manually designed by the vehicle user. Clothing, haircut, and facial contours are freely configurable. Fig. 1 For example, a chat system and / or the help of a vehicle assistance system was used for this purpose.
[0036] In addition to the Avatar 16, as in Fig. 1, a vehicle 14 is also shown. This can be based directly on the purchased vehicle 14 including equipment or can be created completely individually, analogous to the avatar 16.
[0037] Fig. Figure 2 shows a pictorial diagram to further illustrate the method and thus also the user system 10 with the interface 12, wherein control elements 20 are now shown that are applicable for using the system 10. These control elements 20 enable the user 18 to adjust various aspects, settings, and / or preferences for the user 18. They are specifically designed to facilitate interaction with the user system 10 and to make personalized adjustments for the user 18.
[0038] After creating a new profile, the user starts at level 18 and can then collect experience points through various actions.
[0039] For every kilometer driven, the vehicle user receives experience points. Service work and maintenance performed at the OEM branch are rewarded with points, as described in Fig. 2. In the navigation menu, points of interest can be selected and driven to in order to earn points, with a visit to the OEM Museum earning a particularly high number of points. With navigation guidance activated, virtual gates can be displayed in the head-up display or head unit in augmented reality mode, which the user must drive through, for example on scenic routes. In addition, special objects or items can be collected on the road to earn additional experience points or bonuses. The purchase of licensed vehicle accessories is also registered, and the user receives points for them. The purchase of licensed products such as clothing, model cars, or other accessories is also rewarded with points for the profile.
[0040] Fig. Figure 3 shows a diagram to further illustrate the process. When the user 18 uses the functions of the driver assistance systems, they collect experience points, for example. At the same time, statistics can be kept that record how many kilometers they have driven using the respective systems or how often they have successfully parked automatically.
[0041] Thus, Fig. 3 also shows the user system 10 with the interface 12, where a rating system 22 is visible that evaluates the way the user 18 uses the user system 10. A distinction is made between "good" 24, "average" 26, and "poor" 28, with this rating being determined depending on preferences and the design of the process. The rating system 22 is intended to create stronger customer or user loyalty 18 to the user system 10.
[0042] In addition, the user 18 can, for example, receive further points if he rates the user system 10 after a certain period of use or after a successful parking maneuver using a smiley selection (good, medium, bad), or the user system 10 can rate automatically.
[0043] As soon as the user (18) reaches a certain number of experience points defined by the OEM, they advance to the next level. With each level increase, the number of experience points required for the next level increases exponentially. Advancing to higher levels unlocks rewards and achievements that can either be activated by the user (18) themselves or automatically unlocked by the OEM. The user (18) can choose between various reward options. These include, among others, the unlocking of new background images or skins for the avatar (16) or the vehicle (14) in the system, as well as mini-games such as Tetris or racing games that can be played in traffic jams, during autonomous driving at level 3 (here, the driving level is meant, not the player level), or while charging an electric vehicle. There are also exclusive rewards in the form of time-limited unlocking of certain features or functions.For example, highly automated driving (Level 3, Drive Pilot) can be activated for a few days or weeks, or memory parking can be activated for a week after several successful parking maneuvers. Other forms of reward include discounts on OEM products or discounts for upcoming service at an authorized workshop.
[0044] The user profile, the level achieved, and the personalized Avatar 16 and vehicle skins are linked to a system app and can be shared via various social media channels. In corresponding communities, there are also rankings based on levels and experience points. Additional rankings can include, for example, kilometers driven, fuel consumption, completed goals, or achieved goals or achievements, such as reaching the capital of each German state. Placements in these rankings also bring bonuses, discounts, or special feature unlocks, as well as other material and virtual rewards.
[0045] When changing vehicles, the profile is automatically transferred. It is also possible to assign multiple vehicles 14 to one avatar 16 or to lend vehicles 14 to other users 18. Both the lender and the borrower of the vehicle receive additional experience points for lending the vehicle.
[0046] Fig. 4 shows another image diagram illustrating the method and thus the user system 10, in which the interface 12 again represents a vehicle 14 and the avatar 16 for the user 18. Additionally, an options bar 30 is displayed, via which the user 18 can adjust further options, settings, or preferences.
[0047] The advantages thus vary depending on the design of the method. When creating a virtual avatar 16, the invention enables personal identification of the user 18 with the vehicle. Furthermore, OEM products, such as clothing styles, can be purchased that match the created avatar 16. During virtual vehicle creation, the user 18 can be offered accessories for their vehicle 14, which can then be ordered directly. If the vehicle user has configured a different virtual vehicle 14 than the one they actually drive, they can be shown offers for similar vehicles 14 or those with similar features. Upon request, they can contact the dealer directly, which improves user loyalty.
[0048] A special effect is shown by the interaction of the virtual avatar 16s with the desired vehicle, as in Fig.4, the user 18 can see how he would look next to a new vehicle 14, which can encourage him to purchase OEM vehicles.
[0049] Leveling up the user profile encourages the user to purchase, use, and recommend OEM products in a playful way. Leveling up encourages the use of OEM products, and comparing levels with other users contributes to a deeper immersion in the world of OEM products. For kilometers driven, the user receives experience points, which encourage them to use OEM products. Service work at OEM branches also earns experience points and motivates the user to service and maintain their vehicle. These measures strengthen user loyalty through the branches. Visits to attractions associated with OEM products also earn experience points. Attending OEM marketing events can be effectively promoted by earning a particularly high number of experience points, which strengthens brand loyalty.Positive experiences through augmented reality route accompaniments and through the purchase of licensed OEM vehicle accessories, clothing, or model cars increase User 18's desire to purchase additional OEM products. User 18 also collects points for using driver assistance systems, which motivates them to use these features. Usage statistics help developers with field validation and turn User 18 into a tester of Vehicle 14.
[0050] Leveling up also creates replay value, similar to a computer game—or in this case, a "re-drive value"—and strengthens the user's loyalty to promotions related to OEM products. Rewards for leveling up can also be used for marketing purposes to promote new features or feature subscriptions. Rewards such as wallpapers and skins are unlocked that can promote and sell OEM products or regional features. Mini-games that can be played during charging situations or autonomous journeys at level 3 also create positive experiences with the brand and strengthen brand loyalty. Exclusive rewards in the form of time-limited feature unlocks pique the user's curiosity about new features and encourage them to purchase additional features. Discounts and special offers on OEM products, unlockable features, or workshop packages also increase user loyalty. List of reference symbols 10 systems 12 Interface 14 vehicles 16 Avatar 18 users 20 Control element 22 Rating system 24 Good 26 remedies 28 Bad 30 Options bar QUOTES CONTAINED IN THE DESCRIPTION
[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature
[0000] DE 10 2021 120 221 A1
[0002]
Claims
[1] Method for providing an infotainment module for a user (18) of a vehicle (14), comprising the method steps: - Recording a user profile of the user (18) which controls vehicle functions depending on the user (18); - Providing the infotainment module based on the user profile; - performing an interaction between the user (18) and the infotainment module; characterized by that the user profile is created and / or recognized by detecting a user (18) by means of a detection device integrated in the vehicle (14). [2] Method according to claim 1, characterized by that the user profile is created and / or recognized by capturing an external appearance of the user (18). [3] Method according to claim 1 or 2, characterized by that the user profile is created and / or recognized by detecting an audio input from the user (18). [4] Method according to one of the preceding claims, characterized by that visual characteristics of the user (18) are used to create a personalized avatar in the infotainment module. [5] Method according to one of the preceding claims, characterized by that emotional and / or physical characteristics of the user (18) are recorded and transferred in real time to the avatar in the infotainment module. [6] Method according to one of the preceding claims, characterized by that the vehicle functions are adapted depending on the user (18) and / or the recorded data of the user profile. [7] User system (10) with an infotainment module for operating a method according to claims 1 to 6.
Citation Information
Patent Citations
Method for providing a gamification module to a user of a vehicle, computer-readable medium, system, and vehicle
DE102021120221A1
Cited By
Method and device for creating a digital personality profile and method for activating at least one driver assistance function in a vehicle
DE102025109558A1
METHOD FOR PERSONALIZED PLAYBACK OF MEDIA CONTENT IN A MOTOR VEHICLE
DE102025114858A1
