User interaction system and user interaction method for a vehicle

Abstract

The present disclosure relates to a user interaction system (100) for a vehicle (10), comprising: - a generation module (110) configured to generate, using generative artificial intelligence, animation data defining or specifying a graphical animation, wherein the generation module (110) is configured to generate the animation data based on user-specific data relating to a vehicle user; and - at least one in-vehicle display module (120) configured to display the graphical animation based on the animation data for the vehicle user.

Description

[0001] 24-2462

[0002] User interaction system and user interaction procedures for a vehicle

[0003] The present disclosure relates to a user interaction system for a vehicle, a vehicle with such a user interaction system, a user interaction method for a vehicle, and a storage medium for executing the user interaction method. The present disclosure relates in particular to a personalized and interactive video presentation in the vehicle.

[0004] State of the art

[0005] It is known to provide personalized video greetings ("festivals") in vehicles for vehicle users. Such festivals comprise animated content that plays on the vehicle display for specific occasions. Currently, creating such festivals requires significant manual effort by design agencies, resulting in high costs. Furthermore, the animations created are identical for all customers within a market, making individual customization for specific users or vehicle configurations impossible.

[0006] Disclosure of the invention

[0007] It is an objective of the present disclosure to specify a user interaction system for a vehicle, a vehicle with such a user interaction system, a user interaction method for a vehicle, and a storage medium for executing the user interaction method, all of which are capable of generating and providing optimized graphical animations. In particular, it is an objective of the present disclosure to enable more efficient, flexible, and personalized generation of animation data.

[0008] This problem is solved by the subject matter of the independent claims. Advantageous embodiments are specified in the dependent claims. 24-2462

[0009] According to an independent aspect of the present disclosure, a user interaction system for a vehicle, in particular a motor vehicle, is specified. The user interaction system comprises:

[0010] a generation module configured to generate animation data defining or specifying a graphical animation using generative artificial intelligence, wherein the generation module is configured to generate the animation data based on user-specific data relating to a vehicle user; and

[0011] at least one display module that is provided and set up on the vehicle side to display the graphical animation based on the animation data to the vehicle user.

[0012] According to the invention, generative artificial intelligence is used to efficiently, flexibly, and individually generate and provide a graphic animation for the vehicle user. This eliminates the need for time-consuming, manual creation by design agencies, resulting in significant cost savings and reduced production effort. Furthermore, the generative artificial intelligence enables dynamic adaptation of the animation to different user preferences, vehicle models, or regional characteristics, thereby creating a personalized and occasion-specific user experience.

[0013] The generation module and the at least one display module may include software components / algorithms that are set up to run on at least one processor and thereby perform the functionalities of the respective module.

[0014] The at least one display module may comprise a display, in particular an LCD display, a plasma display or an OLED display. Additionally or alternatively, the at least one display module may comprise a projection device configured to project information directly into the driver's field of vision, in particular onto a 24-2462

[0015] to project onto the windshield. In some embodiments, the at least one display module can be a central information output device of an infotainment system, such as a head unit or a pillar-to-pillar display. Preferably, the at least one display module is permanently installed in the vehicle.

[0016] The term “graphic animation,” as used in the present revelation, refers to a visual representation in which graphic elements change over time to create movement or dynamic effects. It may consist of individual images (frames) played in rapid succession or be generated by vector-based transformations and algorithms.

[0017] Preferably, the graphic animation is a video.

[0018] The term “animation data,” as used in this disclosure, refers to digital data sets used to generate, control, and display graphic animation. The animation data contains information about how graphic elements change over time to represent visual movement or a dynamic effect.

[0019] Preferably, the graphic animation is a festival. A festival is an animated video greeting message that is played on specific occasions.

[0020] Preferably, the generation module is implemented in a central unit. The term "central unit" refers to a component within a network or system that serves as a control and / or management unit. This central unit can be, for example, a server, a backend, or another comparable device. One of its tasks is to process, store, and / or manage data.

[0021] Alternatively, the generation module can be provided on the vehicle side. 24-2462

[0022] The term “generative artificial intelligence,” as used in this disclosure, refers to systems capable of generating animation data for graphic animation (e.g., text-to-video and / or animation-to-video) based on input data such as images and / or text. These systems utilize complex algorithms to learn patterns, relationships, and data from existing datasets and, based on this, generate new data or content that corresponds to, but is not identical to, the learned patterns. Examples of generative artificial intelligence include, but are not limited to, Generative Adversarial Networks (GANs), Variational Autoencoders (VAEs), and Transformers.

[0023] Ideally, the generative artificial intelligence is pre-trained. Specifically, the generative artificial intelligence can be (pre-)trained in a prior learning process using relevant data, such as existing animations and / or style guides, before being used in the actual application. This can enable, for example, faster response times and higher quality in the generated graphic animations.

[0024] The term “user-specific data”, as used in the context of this disclosure, refers to personal or user-related information that is specific to an individual person.

[0025] Preferably, the user-specific data relates to or includes the vehicle user's preferences. The vehicle user's preferences may include, for example, personal preferences (e.g., animals) and / or visual preferences (e.g., colors), but the present disclosure is not limited to these.

[0026] Preferably, at least one display module is set up to show the graphic animation when the vehicle user enters the vehicle. For example, the graphic animation can be played as a greeting video message or festival announcement. 24-2462

[0027] Preferably, at least one display module is configured to show the graphical animation only when the vehicle speed is below a speed threshold. This prevents the driver from being distracted while driving.

[0028] Preferably, the speed threshold is 5 km / h or less. However, the present disclosure is not limited to this, and the vehicle can be operated with an automated driving function, for example, from SAE Level 3 upwards. In this case, it would also be legally possible to play videos at higher speeds, thereby creating additional value during such journeys.

[0029] Preferably, the user interaction system further comprises at least one input module configured to receive at least one user input relating to the graphical animation.

[0030] The at least one input module may include a speech input device and / or a touch-sensitive input device, such as a touch panel or touch pad, and / or a tactile input device, such as a switch (e.g. push button and / or rotary switch) or other mechanically actuated key elements.

[0031] Preferably, the user interaction system includes a touchscreen that provides at least one display module and optionally at least one input module.

[0032] Preferably, at least one display module is configured to display the graphical animation based on at least one user input. For example, the start and / or the content progression of the graphical animation can be influenced and / or determined by the at least one user input.

[0033] Preferably, at least one display module is configured to display the graphical animation only when a corresponding user input is / has been received. In some embodiments, the user interaction system can be configured to display a 24-2462

[0034] Display a user notification via at least one display module (e.g., "An animation is available for you. Would you like to view it?") and only show the graphical animation if the vehicle user confirms.

[0035] Preferably, at least one display module is configured to display content from the graphical animation based on at least one user input. This allows the vehicle user to directly influence or determine the displayed content through their user input.

[0036] Preferably, at least one user input is received during the course of the graphical animation, and the content of the subsequent graphical animation is based on this at least one user input. For example, defined intervention points can be present at the end of certain segments during the playback of the graphical animation, allowing the vehicle user to interactively intervene and influence the further course of the animation—that is, the selection of the next segment.

[0037] According to another independent aspect of the present disclosure, a vehicle, in particular a motor vehicle, is specified. The vehicle comprises the user interaction system according to the embodiments of the present disclosure.

[0038] The term "vehicle" includes cars, trucks, vans, buses, motorhomes, motorcycles, etc., used for the transport of people, goods, etc. In particular, the term includes motor vehicles for passenger transport.

[0039] According to another independent aspect of the present disclosure, a user interaction method for a vehicle, in particular a motor vehicle, is specified. The user interaction method comprises:

[0040] Generating, by means of a generation module, animation data using generative artificial intelligence, wherein the animation data defines or specifies a graphical animation, and wherein the generation module is configured to the 24-2462

[0041] To generate animation data based on user-specific data relating to a vehicle user; and

[0042] Displays, through at least one vehicle-side display module, of the graphical animation based on the animation data for the vehicle user.

[0043] The user interaction procedure can implement the aspects of the user interaction system described in this document.

[0044] According to another independent aspect of the present disclosure, a software (SW) program is specified. The SW program can be configured to run on one or more processors and thereby perform the user interaction procedure described in this document.

[0045] According to another independent aspect of the present disclosure, a storage medium is specified. The storage medium may include a software program configured to run on one or more processors and thereby execute the user interaction procedure described in this document.

[0046] According to another independent aspect of the present disclosure, software with program code is specified. The software is configured to carry out the user interaction procedure when the software runs on one or more software-controlled devices.

[0047] According to another independent aspect of the present disclosure, a system is specified. The system comprises one or more processors; and at least one memory associated with the one or more processors and containing instructions that can be executed by the one or more processors to perform the user interaction procedure described in this document.24-2462

[0048] A processor or processor module is a programmable computing unit, i.e., a machine or an electronic circuit that controls other elements according to given instructions and thereby advances an algorithm (process).

[0049] Brief description of the drawings

[0050] Examples of the manifestation of the revelation are shown in the figures and are described in more detail below. They show:

[0051] Figure 1 schematically shows a vehicle with a user interaction system according to embodiments of the present disclosure, and

[0052] Figure 2 shows a flowchart of a user interaction method according to embodiments of the present disclosure.

[0053] Implementations of the revelation

[0054] Unless otherwise noted, the same reference symbols are used for identical and equivalent elements in the following.

[0055] Figure 1 schematically shows a vehicle 10 with a user interaction system 200 according to embodiments of the present disclosure.

[0056] The user interaction system 100 comprises a generation module 110 configured to generate animation data defining or specifying a graphical animation using generative artificial intelligence, wherein the generation module 110 is configured to generate the animation data based on user-specific data relating to a vehicle user; and at least one display module 120, provided on the vehicle side and configured to display the graphical animation based on the animation data to the vehicle user. 24-2462

[0057] In the example shown in Figure 1, the generation module 110 is provided on the vehicle side. However, the present disclosure is not limited to this and the generation module can also be implemented in a central unit, such as a server or backend, with which the vehicle 10 communicates.

[0058] In some versions, the graphic animation may include or be a festival. A festival is an animated video greeting message that is played on specific occasions.

[0059] In some implementations, the generative artificial intelligence can be pre-trained. Specifically, the generative artificial intelligence can be (pre-)trained in a prior learning process using relevant data, such as existing animations and / or style guides, before being used in the actual application. This can, for example, enable faster response times and higher quality in the generated graphic animations.

[0060] In some embodiments, the user-specific data relates to or includes the vehicle user's preferences. The vehicle user's preferences may include, for example, personal preferences (e.g., animals) and / or visual preferences (e.g., colors), but the present disclosure is not limited to these.

[0061] In some embodiments, at least one display module 120 is configured to display the graphic animation when the vehicle user enters the vehicle 10. For example, the graphic animation can be played as a greeting video message or festival.

[0062] In some embodiments, at least one display module 120 is configured to display the graphic animation only when the vehicle speed is below a speed threshold. This prevents the driver from being distracted while driving. The speed threshold can be, for example, 5 km / h or less. 24-2462

[0063] In some embodiments, the user interaction system 120 further comprises at least one input module 130 which is configured to receive at least one user input relating to the graphical animation.

[0064] In some embodiments, the at least one display module 120 is configured to display the graphical animation based on the at least one user input. For example, the start and / or the content progression of the graphical animation can be influenced and / or determined by the at least one user input.

[0065] In some embodiments, the at least one display module 120 is configured to display the graphical animation only when a corresponding user input is received. For example, the user interaction system 100 can issue a user message via the at least one display module (e.g., "An animation is available for you. Would you like to view it?") and display the graphical animation only if the vehicle user confirms.

[0066] In some embodiments, the at least one display module 120 is configured to display content from the graphical animation based on at least one user input. This allows the vehicle user to directly influence or determine the displayed content through their user input.

[0067] In some embodiments, at least one user input is received during a sequence of the graphical animation, and the content in the further course of the graphical animation is based on the at least one user input. For example, during the playback of the graphical animation, defined intervention points may be present at the end of certain segments, at which the vehicle user can interactively intervene and influence the further course of the animation—that is, the selection of the next segment.24-2462

[0068] In one example, the vehicle user might be interested in environmental protection and horses. Upon entering her all-electric vehicle, she receives a notification about a personalized Earth Day video. Curious and delighted by this tailored recommendation, she starts the sequence. A scene appears on the vehicle display: A group of majestic horses gallops across a lush green meadow in Iceland. The images immediately evoke memories of her last vacation. Towards the end of the sequence, the vehicle user can interact with the video – she can decide where the horses should go next. She chooses a path along a waterfall. The video immediately adapts, and the scene changes: The horses now appear in front of an impressive waterfall plunging into the depths below.

[0069] Figure 2 schematically shows a flowchart of a user interaction method 200 according to embodiments of the present disclosure. The user interaction method 200 can be implemented by appropriate software that can be executed by one or more processors (e.g., a CPU).

[0070] The user interaction method 200 comprises in block 210 a generation, by a generation module, of animation data using generative artificial intelligence, wherein the animation data defines or specifies a graphical animation, and wherein the generation module is configured to generate the animation data based on user-specific data relating to a vehicle user; and in block 220 a display, by at least one vehicle-side display module, of the graphical animation based on the animation data to the vehicle user.

[0071] According to the invention, generative artificial intelligence is used to efficiently, flexibly, and individually generate and provide a graphic animation for the vehicle user. This eliminates the need for time-consuming, manual creation by design agencies, thereby saving considerable costs and reducing production effort. Furthermore, the generative artificial intelligence enables dynamic adaptation of the animation to different user preferences.24-2462

[0072] Vehicle models or regional characteristics, thereby creating a personalized and occasion-related user experience.

[0073] Although the invention has been further illustrated and explained in detail by means of preferred embodiments, the invention is not limited by the disclosed examples, and other variations can be derived from them by a person skilled in the art without departing from the scope of protection of the invention. It is therefore clear that a multitude of possible variations exist. It is also clear that the embodiments mentioned as examples are truly only examples and are not to be understood in any way as limiting, for example, the scope of protection, the possible applications, or the configuration of the invention.Rather, the preceding description and the description of the figures enable the person skilled in the art to implement the exemplary embodiments in concrete terms, whereby the person skilled in the art, with knowledge of the disclosed inventive concept, can make various changes, for example with regard to the function or the arrangement of individual elements mentioned in an exemplary embodiment, without leaving the scope of protection defined by the claims and their legal equivalents, such as further explanations in the description.

Claims

24-2462 Patent claims 1. User interaction system (100) for a vehicle (10), comprising: a generation module (110) configured to generate animation data defining or specifying a graphical animation using generative artificial intelligence, wherein the generation module (110) is configured to generate the animation data based on user-specific data relating to a vehicle user; and at least one display module (120) that is provided and configured on the vehicle side to display the graphical animation based on the animation data to the vehicle user.

2. User interaction system (100) according to claim 1, wherein: the generative artificial intelligence is pre-trained; and / or The user-specific data concerns the preferences of the vehicle user.

3. User interaction system (100) according to claim 1 or 2, wherein the at least one display module (120) is configured to: to display the graphical animation when the vehicle user enters the vehicle (10); and / or The graphical animation should only be displayed if a vehicle speed is less than a speed threshold, in particular where the speed threshold is 5 km / h or less.

4. User interaction system (100) according to any one of claims 1 to 3, further comprising at least one input module (130) configured to receive at least one user input relating to the graphical animation, wherein the at least one display module (120) is configured to display the graphical animation based on the at least one user input. 24-2462 5. User interaction system (100) according to claim 4, wherein the at least one display module (120) is configured to display the graphical animation only when a corresponding user input has been received, in particular in response to a user instruction by the user interaction system (100).

6. User interaction system (100) according to claim 4 or 5, wherein the at least one display module (120) is configured to display content of the graphic animation based on the at least one user input.

7. User interaction system (100) according to claim 6, wherein the at least one user input is received during a course of the graphic animation and the content in the further course of the graphic animation is based on the at least one user input.

8. Vehicle (10), in particular motor vehicle, comprising the user interaction system (100) according to any one of claims 1 to 7.

9. User interaction method (200) for a vehicle (10), comprising: Generating (210) animation data using generative artificial intelligence, wherein the animation data defines or specifies a graphical animation, and wherein the generation module (110) is configured to generate the animation data based on user-specific data relating to a vehicle user; and Displays (210) by at least one vehicle-side display module (220) of the graphical animation based on the animation data for the vehicle user.

10. Storage medium comprising a software program configured to run on one or more processors and thereby to execute the user interaction method (200) according to claim 9.

Images