Methods for generating, recording and / or activating entertainment content in a vehicle

The entertainment system in vehicles generates personalized content using AI to combine vehicle and environmental data, creating unique and tradable experiences, addressing the lack of immersive entertainment in existing systems.

DE102024003192A1Pending Publication Date: 2026-04-02MERCEDES BENZ GROUP AG
View PDF 6 Cites 0 Cited by

Patent Information

Authority / Receiving Office
DE · DE
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-09-30
Publication Date
2026-04-02

AI Technical Summary

Technical Problem

Existing methods fail to enhance user experience in vehicles by integrating personalized and immersive entertainment content generation using vehicle and environmental data, limiting the interactive and experiential aspects of in-vehicle entertainment systems.

Method used

An entertainment system that generates personalized entertainment content by combining vehicle function data, environmental data, and entertainment data using artificial intelligence, allowing for the creation of unique and non-reproducible audio and visual experiences, which can be stored and traded as non-fungible tokens.

Benefits of technology

Enhances user experience by providing hyper-personalized entertainment content that adapts to vehicle behavior and environment, offering a new form of interactive and tradable entertainment within the vehicle.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000009_0000
    Figure 00000009_0000
  • Figure 00000009_0001
    Figure 00000009_0001
  • Figure 00000010_0000
    Figure 00000010_0000
Patent Text Reader

Abstract

The invention relates to a method for generating, recording and / or activating entertainment content (UI, Uln) in a vehicle (1), characterized in that - an entertainment signal (US) and / or entertainment data (UD) is captured and / or loaded, - Vehicle Function Data (FFD) is recorded and / or loaded, and / or - Vehicle (1) environmental data (FUD) is acquired and / or loaded, whereby entertainment content (UI, Uln) is generated and output and optionally stored in the vehicle (1) based on the entertainment data (UD) and / or the entertainment signal (US) in combination with the vehicle function data (FFD) and / or the environmental data (FUD).
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The invention relates to methods for generating, recording and / or activating entertainment content in a vehicle according to the preamble of claim 1. Furthermore, the invention relates to an entertainment system for carrying out such a method according to the preamble of claim 4 and a vehicle with such an entertainment system.

[0002] Document US 2012 / 0317161 A1 describes an in-vehicle computer system with instructions that cause a processor to store a media profile of a first user, specifying their media preferences. The processor further detects when the vehicle encounters a second vehicle and receives a media profile of that second user. The processor then evaluates the profiles to determine any similarity between them. If a similarity is detected, recommended media is identified based on the profile characteristics, and the delivery of recommended media to one of the users of the first vehicle and the user of the second vehicle is triggered.

[0003] From DE 10 2022 004 820 A1 a method and a device for individually assigning at least one vehicle function scheme to at least one vehicle in order to individually adjust selected settings are known.

[0004] The invention is based on the objective of providing a method and an entertainment system in a vehicle, as well as a vehicle with such an entertainment system, in order to improve a user experience in and / or outside the vehicle.

[0005] The first-mentioned problem is solved according to the invention by a method for generating, recording and / or activating entertainment content in a vehicle with the features of claim 1. The second-mentioned problem is solved according to the invention by an entertainment system with the features of claim 4. The third-mentioned problem is solved according to the invention by a vehicle with the features of claim 5.

[0006] Advantageous embodiments of the invention are the subject of the dependent claims.

[0007] The first task is solved by a method for generating, recording and / or activating entertainment content in a vehicle, wherein stored entertainment data (also called infotainment data), such as music data, audio data or the like, are loaded, vehicle function data, such as navigation data, recuperation data, steering data, brake data or the like, are captured and / or loaded, and / or environmental data of the vehicle are captured and / or loaded, wherein entertainment content is generated and output in the vehicle based on the entertainment data in combination with the vehicle function data and / or the environmental data and optionally stored.

[0008] Entertainment content generated in the vehicle refers in particular to the creation of experiential content, such as the creation of music, audio and / or visual content, for example by combining, mixing, remixing or the like.

[0009] According to further training, entertainment data, vehicle function data and / or environmental data can be analyzed, especially digitally, for example using an expert system, an artificial intelligence system or the like, and combined with each other depending on the analysis results.For example, vehicle function data, in particular navigation data, can be used to determine, for example, a traveled or future route, route length or the like, and compared and / or combined with environmental data and / or further navigation data, such as geographical data, like altitude above sea level in the vehicle's surroundings, tree landscape, fields, lakes / water, beach or the like, and entertainment data, in particular music data, in order to generate, optionally record, in particular store, and / or activate or output music content, in particular tones, acoustic beats, music data or the like, at certain intervals and / or at certain moments in accordance with the recorded / analyzed vehicle function data and / or environmental data.

[0010] Vehicle function data can be acquired using existing vehicle sensors, such as those for steering, recuperation, acceleration, navigation, braking, and other internal motion functions. This vehicle function data can then be used to generate entertainment content, such as sounds and / or music. For example, a specific single sound or multiple sound schemes (such as a song, a musical instrument, several songs, or a combination of several songs and instruments) can be generated based on a particular vehicle movement.

[0011] Preferably, the in-vehicle entertainment content is generated using an entertainment generator based on artificial intelligence (AI). For example, the entertainment generator can analyze a current audio signal, dividing it into individual instrument layers. In a subsequent step, the entertainment generator can modify, repeat, and / or improvise audio signal ranges, tones, and / or segments based on the acquired, particularly current, stored, and / or future, vehicle function data and / or acquired, particularly current, stored, and / or future, environmental data.In particular, the entertainment generator can adapt the audio signal, especially audio signal ranges and / or audio signal tones that fit the overall audio signal representing a song, to, for example, the driving behavior, personal mood, and / or taste of the driver. By means of the in-vehicle entertainment generator, a unique and non-reproducible, hyper-personal entertainment content, in particular a new audio signal, music signal, or the like, is created.

[0012] Additionally, the entertainment generator can use environmental data, such as geographical data, as input for sound generation or sound adjustment of the audio signal, thus creating a connection between sound and environment.

[0013] The created or generated entertainment content can be stored locally or on a head unit, cloud storage, computer system, or other storage medium. In particular, the generated entertainment content can be stored and played back as a non-fungible token (NFT) to help the driver recreate previous original driving experiences, which can then be traded among other drivers, for example, driving like a celebrity, as original content.

[0014] The invention also enables the marketing of the vehicle as a new way of generating entertainment content, such as music, audio, and / or visual content, for example, by combining, mixing, remixing, or the like. The invention improves upon existing entertainment content, such as in-vehicle scenarios like karaoke. This allows for a better form of entertainment for groups in the vehicle. The entertainment content generated in the vehicle can be traded and sold as a product.

[0015] The entertainment system (also called infotainment system) according to the invention in a vehicle comprises at least a display screen, a loudspeaker system and a microphone system and a coupling interface, wherein the coupling interface is configured to communicate with vehicle functional units in the vehicle and to provide vehicle functional data to the entertainment system, wherein the entertainment system is configured to execute the method described above.

[0016] The vehicle according to the invention comprises at least the entertainment system described above.

[0017] Exemplary embodiments of the invention are explained in more detail below with reference to drawings.

[0018] This shows: Fig. 1 schematically a vehicle with an entertainment system, and Fig. 2. Schematically, an example of how entertainment content is created. Fig. 3. Schematically, a scheme of generated individual entertainment content, and Fig. 4 schematically depicts an entertainment scene in a vehicle during a recording of entertainment content in the vehicle.

[0019] Corresponding parts are marked with the same reference symbols in all figures.

[0020] Fig. Figure 1 shows a vehicle 1 with an entertainment system 2.

[0021] The entertainment system 2 (also called infotainment system) in the vehicle 1 includes at least a display screen 2.1, a speaker system 2.2 and a microphone system 2.3 and a coupling interface 2.4 and an entertainment generator 2.5 (also called experience generator) for generating entertainment content Ul, Uln (also called experience content).

[0022] The coupling interface 2.4 is specifically designed to communicate with vehicle function units 4 in the vehicle 1 and to provide vehicle function data FFD to the entertainment system 2.

[0023] Additionally or alternatively, the coupling interface 2.4 can be set up to communicate with an environment unit 6 in the vehicle 1 and to provide environment data FUD to the entertainment system 2.

[0024] By means of the entertainment system 2, communicating with at least one vehicle function unit 4, in particular a steering system, a braking system, a lighting system or the like, and / or with at least one environmental unit 6, in particular a camera, a radar unit or the like, entertainment content UI can be generated, stored, activated and / or output in the vehicle 1, wherein current and / or stored entertainment data UD (also called infotainment data) and / or an entertainment signal US, such as music data, audio data, audio stream, music stream, video stream or the like, are loaded and / or acquired from a unit 8, in particular a storage device and / or a switched-on music system, and current and / or stored vehicle function data FFD, such as navigation data, recuperation data, steering data, braking data or the like, of the vehicle 1 are acquired and / or loaded.and / or current and / or stored environmental data (FUD) of the vehicle are captured and / or loaded, whereby in vehicle 1, the entertainment content (UI) is generated and output and optionally stored based on the entertainment data (UD) in combination with the vehicle function data (FFD) and / or the environmental data (FUD).

[0025] Unit 8 can be understood as an in-vehicle device, such as a music storage device, a video storage device, a radio or the like, and / or an external vehicle device, such as a cloud system, a service provider, an application on a mobile device or the like.

[0026] Entertainment content (UI, Uln) generated in vehicle 1 includes, in particular, the creation of experiential content, such as music, audio and / or visual content, for example by combining, mixing, remixing or the like.

[0027] The vehicle 1 can have a variety of vehicle function data FFD, which are acquired, for example, by vehicle function units 4, such as steering and turning systems, acceleration and braking systems, biometric feedback / capture systems (voice, including but not limited to volume / tone, heart rate, facial recognition for mood personalization, e.g., happy, sad, angry, etc.), and / or environmental data FUD, for example, rain, sun, snow, trees, rivers, or the like, which are acquired by environmental units 6, and the entertainment system 2, in particular the entertainment generator 2.5, to link or combine these vehicle function data FFD and / or environment data FUD, such as current rain, road type, physical user feedback, with the entertainment data UD (also called infotainment data), in particular with a specific music track, multiple tracks, user-defined tones or the like, in order to generate the entertainment content Ul, in particular experience content, such as audio content adapted to the vehicle function data FFD and / or the environment data FUD, in particular music content, and optionally in combination with experience content on vehicle function units 4, such as a rhythmic massage on a vehicle seat, an adapted video sequence on the display screen 2.1 or the like.

[0028] Various other physical sensors, telematics and data systems can also be integrated and linked with interactions that influence the captured or loaded music content and generate, output and optionally store corresponding entertainment content (UI), especially experience content, in the vehicle 1.

[0029] Additionally, entertainment data (UD) can be manually selected, for example, via a head unit and / or a mobile device, particularly a mobile phone, and / or via the 2.4 communication interface, particularly via an application such as "Mercedes me". This additional downloadable or selected entertainment data (UD) can be loaded into the vehicle 1 from a cloud ecosystem via the 2.4 communication interface. This remotely downloadable entertainment data (UD) can also be automatically selected by the 2.5 entertainment generator, which is based primarily on artificial intelligence.Furthermore, the vehicle function units 4 can be used to capture and recognize driver characteristics as vehicle function data (FFD), including but not limited to biometric data for determining mood, voice (a song request, a single song, a beat, several sung songs) or the like, and feed them to the entertainment generator 2.5.

[0030] The Entertainment Generator 2.5 can generate new UI entertainment content from UD entertainment data, particularly music, for each individual vehicle function, specifically FFD vehicle function data such as steering wheel, brakes, acceleration, etc. It can, for example, check the "compatibility" of various selected music genres (e.g., Taylor Swift and Eminem together) to identify sound elements and characteristics of a song (measured by wavelength, timbre, bass, treble, intensity) and assign them to the specific vehicle functions. Manual assignment of specific sounds and functions to generate this new UI entertainment content is also possible for finer customization.

[0031] For example, the display screen 2.1, the coupling interface 2.4, the speaker system 2.2, a head unit or another interface of the vehicle 1 can be used as output unit 10 to display color and image deviations / adjustments, audio deviations / adjustments or the like during music playback, which are responsive and unique when playing sounds.

[0032] The user has the option to record special or individual entertainment content UI, Uln during the entire journey using the entertainment data UD, the environment data FUD and / or the vehicle function data FFD. This content can be output or transmitted via various methods (USB, Bluetooth, Cloud Connection, etc.), whereby this recorded entertainment content UI, Uln can be output, for example, to an output unit 10, for example, on the display screen 2.1, the speaker system 2.2, to the coupling interface 2.4, to a storage device and / or remotely to a cloud system (such as the Mercedes Intelligent Cloud), for example, transmitted, stored or uploaded.

[0033] The generated entertainment content (UI, Uln) can be stored in various formats (e.g., .MP3, .WAV, etc.) on unit 8, both internally and / or externally, and output on output unit 10. Unit 8 can be a data carrier within a blockchain system for the use and trading of the generated entertainment content as a non-fungible token (NFT) for internal trading, for example, within the Mercedes-Benz ecosystem, or for external trading, for example, via service providers. Storing the generated entertainment content (UI) as combined entertainment data (UD), vehicle function data (FFD), and / or environmental data (FUD) in the form of an NFT allows for the provision of a new, unique, and specific lighting and music sequence.These entertainment UI content generated in vehicle 1 can be stored externally on open marketplaces as Unit 8, where additional vehicle functions, such as lighting, self-driving behavior along a specific navigation path, or the like, are bound to the relevant NFT and can be used to unlock functions of vehicle 1.

[0034] The vehicle 1 with the integrated entertainment system 2 with the previously described entertainment generator 2.5 forms a dynamic instrument and a visual system for generating, for example, new music and for copying the driver's behavior through music as entertainment content UI to be generated, which is created, for example, from the behavior and sounds of the vehicle in combination with music data or a music stream.

[0035] The AI-based entertainment generator 2.5 can, for example, analyze vehicle function data (FFD), such as route length, and compare it with navigation data, while also using environmental data (FUD), such as specific geographical elements like altitude and surroundings (e.g., woodland, fields, lakes / water, beach), to trigger and generate entertainment content (UI), for example, sounds / tones / beats / music, at specific intervals or moments in accordance with this data, and optionally store it as an NFT.

[0036] For example, the entertainment system 2 uses 4 vehicle sensors as vehicle functional units, such as those for steering, recuperation, acceleration, navigation, braking and / or other internal motion functions, to generate UI sounds and music as entertainment content based on a specific single sound or multiple sound schemes.

[0037] Fig. Figure 2 schematically shows an example of generating an entertainment content UI from vehicle function data FFD, environment data FUD and entertainment data UD, entertainment signals US.

[0038] For example, entertainment signals US, such as several songs, individual songs, a musical instrument, or a combination of these, are filtered into individual entertainment signals US of individual musical instruments, individual songs, and / or entertainment data UD, such as tones or the like, using the entertainment generator 2.5.

[0039] Using the AI-based entertainment generator 2.5, for example, a current audio stream, such as radio reception or a song sung by users in vehicle 1, can be divided in entertainment system 2 into individual instrument layers, specifically individual entertainment signals USn and / or entertainment data UD. In a subsequent step, the AI-based entertainment generator 2.5 can modify, repeat, and improvise musical elements that fit the current audio stream (the current song) but perfectly match the driving behavior, personal mood, or taste of the driver, and generate these as new entertainment content Ul, which can then be stored, for example, as an NFT.

[0040] The result is a unique and non-reproducible, hyper-personal version of the music presented by user N, which can be created and saved as individual entertainment content (Uln), as described in Fig. 3 and Fig. 4 is shown.

[0041] Fig. Figure 3 schematically shows a scheme of generated individual entertainment content Uln.

[0042] Fig. Figure 4 schematically shows an entertainment scene generated by two users N in vehicle 1 during a recording and generation of the individual entertainment content Uln in vehicle 1.

[0043] Additionally, as previously described, environmental data FUD (also called vehicle environment data), for example geodata, can be used as input for the entertainment generator 2.5 to generate sounds and entertainment content Uln, thus creating a connection between sound and environment.

[0044] The created entertainment content (UI, Uln) can be stored on the Unit 8, stored locally, and / or stored and / or executed on a main device, cloud storage, a computer system, or other storage medium. It can also be saved and played back as an original NFT to help a user (N), for example, a driver, create previous original driving experiences, which can then be shared as original content among other users (N), especially other drivers (e.g., driving like a celebrity).

[0045] The vehicle 1 with the integrated entertainment system 2 with the previously described entertainment generator 2.5 forms a dynamic instrument and visual system and also includes unique visual elements that can be mixed together to create, for example, so-called "Easter Egg" effects in the vehicle 1 as entertainment content UI.

[0046] If the generated entertainment content (UI) is created by well-known users (N), such as artists, and sold as a so-called skin, there is also an incentive to sell this entertainment content (UI). If a user (N) downloads or purchases multiple generated entertainment content (Uln) via an external platform, these multiple generated entertainment content (Uln) can be combined to create new, hidden "Easter egg" components as new entertainment content (Uln). For example, if a user (N) buys a Taylor Swift entertainment content (UI) (also called a Taylor Swift skin) and an Eminem entertainment content (UI) (also called an Eminem skin), they will be viewed by the user (N) as two separate systems.However, once both skins are owned by a user N, these skins can be combined or "mixed" to create new lighting features and combinations as new entertainment content Uln, which are only available in certain variants.

[0047] Fig.Section 3 explains how the matching element works in detail, while the combination of different skin types can extend beyond a single pair (e.g., 3, 4, or 5 mixed skins, etc.). Each skin combination can also generate unique digital effects specific to that combination. For example, using a combination of Taylor Swift and The Weeknd can unlock a hidden concert show, graphic icon, or other visual element not available with the skins alone, but only in combination. If no Easter egg is available, a KL element can compare one or more skins and generate an additional digital feature locally or via a cloud-based platform. This would be useful in scenarios where the content is not yet curated and can still provide the customer with a consistent experience across all products.

[0048] This entertainment system 2 represents a new and unique enhancement that creates new forms of digital content and immersive user experiences in the vehicle 1. Reference symbol list 1 vehicle 2 Entertainment systems 2.1 Display screen 2.2 Speaker system 2.3 Microphone system 2.4 Coupling interface 2.5 Entertainment Generator 4 Vehicle functional unit 6 environmental units 8 units 10 output units FFD Vehicle Function Data N users UD Entertainment Data (Infotainment Data) US entertainment signal (experience signal) FUD environmental data Ul,Uln Entertainment content (experience content) QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] US 2012 / 0317161 A1

[0002] DE 10 2022 004 820 A1

[0003]

Claims

[1] Method for generating, recording and / or activating entertainment content (UI, Uln) in a vehicle (1), characterized by , that - an entertainment signal (US) and / or entertainment data (UD) is captured and / or loaded, - Vehicle Function Data (FFD) is recorded and / or loaded, and / or - Vehicle (1) environmental data (FUD) is acquired and / or loaded, whereby entertainment content (UI, Uln) is generated and output and optionally stored in the vehicle (1) based on the entertainment data (UD) and / or the entertainment signal (US) in combination with the vehicle function data (FFD) and / or the environmental data (FUD). [2] Method according to claim 1, characterized by, that the entertainment content (UI, Uln) is stored in the form of non-fungible tokens for configuring vehicle functions, in particular for configuring a color scheme for vehicle interior lighting and / or for configuring a sound and / or audio scheme. [3] Method according to claim 1 or 2, characterized by , that the entertainment content (UI, Uln) is continuously generated during a journey of the vehicle (1). [4] Entertainment system (2) in a vehicle (1), wherein the entertainment system (2) comprises at least a display screen (2.1), a speaker system (2.2) and a microphone system (2.3) and includes a coupling interface (2.4), characterized by , that the coupling interface (2.4) is set up to communicate with vehicle functional units (4) in the vehicle (1) and to provide vehicle function data (FFD) to the entertainment system (2), wherein the entertainment system (2) is set up to execute the method according to one of claims 1 to 3. [5] Vehicle (1) with an entertainment system (2) according to claim 4, which is configured to perform the method according to any one of claims 1 to 3.

Citation Information

Patent Citations

  • buffering scheme for storing broadcast content

    DE102005040065A1

  • Method for audible display of system information in vehicle, involves assigning system information to audible music attribute in vehicle inner chamber and audible display of the system information is carried out depending on attribute

    DE102007008815A1

  • Method for personalizing multiple time-dependent data streams from multiple sources in real time, involves retrieving sources from single or multiple servers in Internet or digital mobile

    DE102009017133A1

  • vehicle-based content sharing

    DE102016118848A1

  • Method and device for individually assigning at least one vehicle function scheme to at least one vehicle

    DE102022004820A1