Entertainment system and method for producing an entertainment programme that is output in a vehicle

Abstract

The invention provides a method for producing an entertainment programme that is output in a vehicle, wherein the entertainment programme is a film or an audio book or music or a game, and wherein the production is carried out as an optical and / or haptic and / or olfactory and / or acoustic production by means of output units present in the vehicle by analysing the entertainment programme during the output of the entertainment programme. If, in case a), it is detected that a scent and / or a mood is / are described, the description is analysed, from which a type of production is determined, and / or if, in case b), it is detected that metadata associated with the entertainment programme are present, they contain information from which it is possible to infer a type of production matching the entertainment programme, or contain a prescribed type of production. On the basis of the result of the analysis, it is determined whether a type of production matching the entertainment programme can be output by the output means, and if this is the case, the output is carried out.

Description

[0001] Entertainment system and method for staging an entertainment program displayed in a vehicle

[0002] The invention relates to an entertainment system and a method for staging an entertainment program displayed in a vehicle.

[0003] For example, DE 10 2018 200 670 B3 discloses a staging of a message received by a vehicle entertainment system to an occupant.

[0004] The object of this invention is to provide an improved presentation of an entertainment function in the vehicle. This object is achieved according to the invention by the features of the independent patent claims. Advantageous embodiments are the subject of the dependent claims.

[0005] A method is provided for staging an entertainment program output in a vehicle, wherein the entertainment program is a film or an audio book or music or a game, and wherein the staging takes place as an optical and / or haptic and / or olfactory and / or acoustic staging by means of output units present in the vehicle by performing an analysis of the entertainment program while the entertainment program is output. If in case a) it is detected that a description of a scent and / or a mood is given, an analysis of the description is carried out, from which a type of staging is determined, and / or if in case b) it is detected that metadata associated with the entertainment program is present, which contains information from which a type of staging suitable for the entertainment program can be inferred or which contains a predetermined type of staging.Based on the result of the analysis, it is determined whether a type of production suitable for the entertainment program can be output by the output means, and if this is the case, the output takes place.

[0006] Furthermore, it is provided that in case a) the staging will only be output if the description of a fragrance and / or a mood is given for a given period of time.

[0007] Furthermore, it is planned that the analysis will take place in real time.

[0008] Furthermore, it is intended that the analysis in case a) takes into account the availability of output units.

[0009] Furthermore, it is provided that in the event that both an analysis of the description is carried out and metadata is present, the type of staging determined by the metadata is executed if this can be executed by the output units.

[0010] Furthermore, a computer program product with program code for carrying out the method is provided when executed on a control unit of the vehicle.

[0011] Furthermore, it is provided that parts thereof are designed as a learning system which, based on an automatic review of a reaction of the occupant or based on a query for feedback from the occupant on the outputted staging, determines whether a change in the staging is necessary or not, and determines the change to be carried out and carries it out the next time an entertainment program is executed.

[0012] Furthermore, a vehicle entertainment system is provided, comprising at least one control unit configured to execute an entertainment program output in the vehicle according to the method. Furthermore, a vehicle is provided, comprising the entertainment system and at least one output unit configured to provide an optical, haptic, olfactory, or acoustic output, and which is operatively and communicatively connected to the control unit of the entertainment system.

[0013] Further features and advantages of the invention will become apparent from the following description of exemplary embodiments of the invention, with reference to the figures of the drawing, which illustrate details of the invention, and from the claims. The individual features can be implemented individually or in combination in a variant of the invention.

[0014] Preferred embodiments of the invention are explained in more detail below with reference to the accompanying drawings.

[0015] Fig. 1 shows a schematic representation of important components of the system for carrying out the method according to an embodiment of the present invention.

[0016] In the following descriptions of the figures, the same elements or functions are provided with the same reference symbols.

[0017] The basic concept of the invention is to provide a presentation of an entertainment program played in a vehicle. The term entertainment program refers to the presentation of a medium such as a film, an audio book, music, or a game. The difference between these media and simple messages such as text messages or video messages is that they tell a story that keeps the occupant occupied for an extended period of time and distracts them from reality. To make this experience even more tangible, a presentation dependent on the story told in the entertainment program is proposed, as described below. To further enhance the experience, it is envisaged that an improvement in the delivery of the presentation is made based on feedback from an occupant. This is achieved by a learning system.As schematically shown in Figure 1, current vehicles 100 have a plurality of output units, which can be divided into optical output units 1, e.g. screens or lighting devices, haptic output units 2, e.g. vibration units on the steering wheel and / or in the vehicle seat, fragrance units 3 (olfactory output units), e.g. fragrance cartridges, and acoustic output units 4, e.g. loudspeakers. Fragrance units 3 for use in the proposed method are preferably formed as base fragrances provided in several containers, e.g. citrus, spice, wood, vanilla, a floral fragrance. The base fragrances can be mixed via a mixing unit in such a way that a fragrance impression is created for the occupant that evokes a certain mood in them.

[0018] All output units 1-4 can be controlled by at least one control unit 10 of the vehicle 100 to provide the associated output.

[0019] The proposed method for staging an entertainment program can utilize one or more of the output units 1-4 to stage an entertainment program output by one of the output units 1-4. When a medium is output, at least part of the acoustic output unit 4 is unavailable due to the output of the medium. Other output units 1-3, such as the scent unit 3, light units, and massage units, are available. However, these are not currently used to provide staging to enhance the experience of the medium. Depending on the type of medium output, one or more loudspeakers may also be available and can be used for staging.

[0020] As already mentioned at the beginning, it is characteristic of entertainment programs that they tell a story. In order to stage at least parts of the story in such a way that an even more realistic impression of the story is created, output units 1-4 are used. The output units 1-4 not only address the sense of the occupant that is addressed by the entertainment program, for example the sense of hearing, but also one or more other senses. To make the experience multimodal, it is important that the story told in the entertainment program is recorded and analyzed in order to provide the appropriate staging. The analysis of the entertainment program takes place in a control unit 10 of the vehicle 100, which can also be the control unit 10 that controls the output units 1-4.In order to provide the best possible staging for the inmate, the analysis should be carried out in real time if possible so that the staging fits the current part of the story being told.

[0021] In one embodiment, the staging is only displayed once the analysis has detected that a longer passage of description with a specific mood and / or a description of a scent is occurring. This detection can be achieved using appropriately trained artificial intelligence.

[0022] If a staging is carried out, it can be intended to be carried out over a longer period of time, for example during the reading of an entire chapter of an audio book, or during an entire episode of a game or film. However, the staging can also be intended to be carried out only in pulses to briefly appeal to the occupant. This is particularly useful for scent distribution, as scenting over a longer period of time often results in the occupant no longer perceiving the scent. If, on the other hand, a scent is released in pulses (i.e. with pauses between each release) over a longer period of time, it is perceived more clearly and for a longer period.

[0023] For example, it can be specified (stored and retrievable in the control unit 10) which moods identified through the analysis and / or a description of a scent are to be staged, e.g., descriptions of nature, descriptions of colors, sounds, smells, temperatures, or human moods. For these moods, a specific type of staging can be provided, e.g., optical and / or haptic and / or olfactory and / or acoustic staging.

[0024] Furthermore, information about the type of mood of the entertainment program can be stored in metadata of the entertainment program, thus simplifying the analysis in the control unit 10. In a further embodiment, information about the type of mood of the entertainment program and / or a scent to be emitted can be stored for certain sections of the entertainment program. In a further embodiment, a specification for the entertainment program or a part of the entertainment program can be available as metadata, which specifies or suggests the type of staging. Whether this specification is used depends on the analysis in the control unit 10 and on the available staging options of the vehicle 100, i.e. which output units 1-4 are available (are present at all and, if present, whether they are functional).If fragrance units 3 are used, it must also be checked whether they can provide the required fragrance mixture.

[0025] In one embodiment, it is provided that the available output units 1 - 4 are known to the control unit 10 and are taken into account in the analysis.

[0026] Alternatively, the control unit 10 checks whether the staging determined by the analysis can be executed with the output units 1-4 of the vehicle 100. If an output unit 1-4 required for the staging is missing or defective in the vehicle 100, the staging can either be performed without this staging type, or a new staging can be determined to replace the missing staging type. For example, there may be no fragrance unit in the vehicle 100, or one or more base fragrances may be empty or no longer available in sufficient quantities.

[0027] If metadata is available that specifies a type of presentation, the type of presentation determined from the metadata is executed with priority. If execution cannot occur, for example, because one of the required output units 1-4 is missing or defective, an output is executed without it, or the type of presentation is used preferentially from the description analysis, since the analysis also takes the availability of output units 1-4 into account.

[0028] When analyzing which type of staging should be used to accompany the medium, the type of medium must be taken into account. In the case of an audio book or music, for example, only the sense of hearing is addressed, so all other staging options (i.e. visual, olfactory, acoustic, haptic) can be used to underline the listening experience. In the case of a film or a game, it may be the case that many of the senses except for the olfactory sense are already covered by the type of output of the medium, or the senses are already heavily stressed. It may therefore be sensible to only provide a scent as background music. Depending on the type of output of the medium, the interior lighting could also be adapted to the medium. An additional haptic output can also be provided, e.g. a vibration of the vehicle seat.The decision as to which output units 1-4 are used to enhance the media experience can be made through analysis in control unit 10, i.e., through a corresponding evaluation program. Alternatively or additionally, the occupant can specify a setting or change the type of presentation, for example, by making a corresponding adjustment during the output, which control unit 10 remembers and applies adaptively to other media.

[0029] In one embodiment, it is therefore provided that the occupant, in particular a driver, can use a setting device, e.g., in an infotainment system of the vehicle 100, to set whether they desire a presentation of an entertainment program (general or for a current entertainment program), as well as what type of presentation they desire or do not desire. Furthermore, it can be provided that the presentation is attenuated or not performed when the vehicle 100 is not in an autonomous driving mode.

[0030] If a fragrance unit is used, it is advantageous to provide several containers, each containing a base fragrance. Depending on the mixing ratio, mixing several base fragrances creates a specific fragrance impression for the occupant, which can influence their mood or convey a certain mood. For example, by appropriately mixing the base fragrances, the impression can be created that the occupant is in a forest or by the sea. This impression can be reinforced, for example, with appropriate visual accompaniment, e.g. green for forest and blue or yellow for sea, an acoustic accompaniment in the form of birdsong / rustling trees or the sound of the sea, a haptic experience such as a wave-like massage of the vehicle seat (to simulate the sea), or a combination thereof.

[0031] The described method is suitable for underscoring the story of an entertainment program, i.e. staging it, and thus making it more tangible for the occupant. For this purpose, several of the occupant's senses can be addressed simultaneously by the staging controlling several different output units 1-4. It is also possible to address a sense of the occupant not addressed by the output of the medium by a corresponding output, so that more senses are addressed than those predetermined by the medium. An entertainment program can, for example, be a film or a game that conveys or presents a certain mood. In this case, for example, the brightness and / or color of the lighting in the interior can be adjusted accordingly, and a scent can be emitted that puts the occupant in the corresponding mood, e.g. happy or gloomy.In the case of an audiobook, where only one of the occupant's senses is addressed by the audiobook itself, other senses such as sight, smell, and touch can be integrated through appropriate staging, thus enhancing the occupant's perception of the story and its mood. The same applies to listening to music. Especially in the case of an audiobook, but also with other media, not only a mood can be described, but also a scent. In this respect, the analysis of the control unit 10 is carried out in relation to both a description of a mood and a description of a scent.

[0032] To further improve the staging, i.e., to achieve better recognition of the mood in an entertainment program. Furthermore, the staging can be improved to better understand the inmate's needs and desires regarding the staging, a learning system is established. The learning system used for this purpose serves to evaluate the type of staging selected based on the analysis and, if necessary, improve it.

[0033] The improvement can be achieved in different ways, checking whether the type of staging is perceived as pleasant / appropriate for the occupant, and also whether the staging is played at the correct time. In one embodiment, an automated check can be performed to determine whether the played staging elicits a positive reaction from the occupant. This can be achieved, for example, by detecting the occupant's mood and / or state using known means such as facial recognition or state detection (pulse, etc.), as well as known methods. Thus, if it is detected that the occupant is satisfied with the staging, i.e., their mood / state is achieved as intended by the staging, no change occurs.If their mood / state is not achieved as intended by the enactment, the type or timing of the enactment is changed to alter their mood / state accordingly. This can involve intensifying the enactment or changing or adapting the type of enactment, for example, removing the acoustic accompaniment and instead intensifying the scent. Or, for example, choosing a different scent. A (retrospective) determination can also be made as to whether the enactment was perceived by the occupant as being delivered (and ending) at the right time, or whether they were confused by the delivery of the enactment.

[0034] In a further embodiment, feedback can be obtained from the inmate for certain productions, for example by asking them to rate the production. This can be done by simply asking whether the inmate is satisfied with the production or not. However, more detailed questions can also be asked about what the inmate found good and what he or she found bad, i.e. whether the type of production was perceived as appropriate and whether the production was played (and ended) at the right time. The type of production is then adapted based on the feedback. Advantageously, the feedback is saved in connection with the inmate so that a profile with the specific inmate's preferences is saved and can be used when the next entertainment program is played.

[0035] In addition, the learning system can also incorporate environmental conditions and the type of driving into the assessment. For example, the system can determine whether a certain type of staging is perceived as disturbing under certain environmental conditions or driving situations. This can be determined for the case where the occupant is a driver and the vehicle is not driving autonomously, and for the case of an autonomously driving vehicle, or for the case where the occupant is not a driver and the vehicle is not driving autonomously. The results can vary, from which it can be learned when a certain type of staging is perceived as disturbing and when not. Depending on the testing options, it can also be determined in which case certain outputs, i.e. acoustic, visual, haptic, olfactory outputs, are perceived as disturbing.This can also be done automatically or through an active request for feedback.

[0036] By using a learning system implemented as a computer program on a control unit 10 of the vehicle, the staging of an entertainment program can be improved so that occupants of a vehicle have an improved sensory experience.

[0037] List of reference symbols

[0038] 100 vehicles

[0039] 10 Control unit

[0040] 1-4 output units

Claims

Patent claims 1. A method for staging an entertainment program output in a vehicle (100), wherein the entertainment program is a film or an audio book or music or a game, and wherein the staging takes place as an optical and / or haptic and / or olfactory and / or acoustic staging by means of output units (1-4) present in the vehicle (100), by performing an analysis of the entertainment program during the output of the entertainment program, and if it is recognized that a) a description of a scent and / or a mood is being given, an analysis of the description is being performed, from which a type of staging is determined, and / or b) that metadata associated with the entertainment program is present, which metadata contain information from which a type of staging suitable for the entertainment program can be inferred or which contain a predetermined type of staging,based on the result of the analysis, it is determined whether a type of production suitable for the entertainment program can be output by the output means (1-4), and if this is the case, the output takes place.

2. Method according to claim 1, wherein in case a) the staging is only output if the description of a fragrance and / or a mood occurs for a predetermined period of time.

3. Method according to one of the preceding claims, wherein the analysis is carried out in real time.

4. Method according to one of the preceding claims, wherein in the analysis in case a) an availability of output units (1-4) is taken into account.

5. Method according to one of the preceding claims, wherein in the case that both an analysis of the description is carried out and metadata are present, the type of staging determined by the metadata is carried out if this can be carried out by the output units (1-4).

6. Computer program product with program code for carrying out the method according to one of the preceding claims when it is executed on a control unit (10) of the vehicle (100).

7. The computer program product according to claim 6, wherein parts thereof are implemented as a learning system which, based on an automatic review of a reaction of the occupant or based on a query for feedback from the occupant on the outputted staging, determines whether a change in the staging is necessary or not, and determines the change to be implemented and implements it the next time an entertainment program is executed.

8. An entertainment system of a vehicle (100), comprising at least one control unit (10) configured to execute an entertainment program output in the vehicle (100) according to the method of any one of claims 1 to 5.

9. Vehicle (100) comprising the entertainment system according to claim 8, and at least one output unit (1-4) which is configured to provide an optical or haptic or olfactory or acoustic output and which is in operative and communicative connection with the control unit (10) of the entertainment system.

Images