Method for operating at least one display of a motor vehicle and motor vehicle

The method enhances motor vehicle display user experience by adapting image content based on interior state information, creating an immersive and interactive environment that responds to physical conditions and events within the vehicle.

DE102023130179A1Pending Publication Date: 2025-04-30AUDI AG
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
DE102023130179
Authority / Receiving Office
DE · DE
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-10-31
Publication Date
2025-04-30

AI Technical Summary

Technical Problem

Existing motor vehicle displays lack immersive and interactive features that can enhance the user experience by responding to the current state of the vehicle's interior, without requiring direct user interaction.

Method used

A method where a control device determines state information about the vehicle's interior and adapts the image content of the display by incorporating additional images that respond to physical conditions and events within the vehicle, such as temperature, air movement, and vibrations, creating an immersive and interactive experience.

Benefits of technology

This solution enhances the user experience by providing an immersive and interactive display that responds to the vehicle's interior conditions, improving occupant engagement and comfort without the need for direct user interaction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Method for operating at least one display (13) installed in the interior (14) of a motor vehicle (11), wherein a display image (7) to be output on the display (13) is generated by means of a control device (12) and the display (13) is controlled to output the display image (7), wherein at least one state information relating to the interior (14) of the motor vehicle (11) is determined by means of the control device (12) and an image content of the display image (7) comprising at least one display component is adapted using the state information.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The invention relates to a method for operating at least one display installed in the interior of a motor vehicle, wherein a control device generates an image to be output on the display and controls the display to output the image. The invention also relates to a motor vehicle.

[0002] Displays in the interiors of motor vehicles, especially passenger cars, are increasing in number and importance. For example, displays in the area of ​​a center console and / or adjacent to the windshield are known that offer various setting options and / or provide information about the vehicle. Such displays can be designed as touch displays and thus also accept user inputs.

[0003] Displays have also been proposed to act as part of an electronic, virtual rear-view mirror. In this case, displays can be provided on the side of a vehicle's instrument panel as a replacement for exterior mirrors. For a central rear-view mirror (interior mirror), a display can be arranged at the position of the conventional interior mirror, or elsewhere. Displays for rear-view cameras have also been proposed. For such displays of virtual exterior mirrors, for example, a camera image from a suitably aligned camera, possibly pre-processed, can be shown on the mirrors as a display image. Other types of such interior displays in motor vehicles include head-up displays, a display of a so-called "virtual cockpit", and displays intended for the entertainment of a front passenger and / or rear seat passengers.

[0004] It has also been suggested that user-specific adjustments be made to the interior in general and / or displays installed in the interior in particular, such as user-specific color schemes for lighting, display images, and the like. The setting of user-specific background images has also been suggested.

[0005] DE 10 2012 222 522 A1 discloses a projected entertainment system for occupants. This system can display animated graphics, such as virtual animals, virtual flowers, and virtual toys, that react to the detected movement of the motor vehicle. Furthermore, occupants can interact with the graphics.

[0006] The invention is based on the object of providing a particularly immersive possibility for operating displays installed in the interior of a motor vehicle, which improves the viewer's user experience.

[0007] This object is achieved according to the invention by a method, in particular a computer-implemented method, and a motor vehicle according to the independent patent claims. Advantageous further developments emerge from the subclaims.

[0008] In a method of the type mentioned at the outset, the invention provides that at least one item of status information relating to the interior of the motor vehicle is determined by means of the control device and an image content of the display image comprising at least one display component is adapted using the status information.

[0009] It is therefore proposed that the image content, specifically at least one display component, be adapted depending on the current state of the interior, i.e., a current event and / or a current circumstance. The display component thus reacts to a circumstance that is equally perceptible to and / or even caused by the occupant viewing the display. It is therefore possible to display an indirect consequence of an occupant's action, whereby the action does not represent a direct interaction with the display, i.e., an operating action, and thus, in the case of a touch display, for example, does not involve touching. Overall, the reaction of the display component is directly comprehensible to the occupant, and an excellent degree of immersion is achieved.

[0010] The present invention relates to an actual adaptation of the image content, i.e., a display component that forms a semantic part of the image content, which can thus be directly perceived and interpreted. However, adaptation processes of display parameters, particularly with regard to improved perceptibility, such as automatic brightness adjustment of displays, can of course be used in addition to the procedure described here.

[0011] In a particularly preferred embodiment, it can be provided that, in order to determine the display image, a basic image is determined or provided which comprises at least one piece of information relating to the operation of the motor vehicle and / or at least one operating option relating to the operation of the motor vehicle, and an additional image to be added to the basic image and / or superimposed thereon, in particular an aesthetic and / or ambience image, is determined, wherein the additional image comprises the display component. In other words, in this embodiment, it is proposed to create a dynamic overlay and / or a dynamic addition to basic images, wherein the additional image can, for example, depict a specific topic, in particular a specified topic. For example, the additional image can provide static and / or animated graphics, text, symbols and / or effects. The additional image can supplement the basic image and / or provide visual effects.

[0012] The basic image can be determined in such a way that it does not utilize the entire surface of the display and / or comprises overlaid areas which, in exemplary embodiments, can be kept free of information and / or operating options. In other words, the determination of the basic image relevant to the operation of the motor vehicle and the additional image can be coordinated with one another, in particular such that the additional image can provide an overlay for the basic image. The additional image and thus the at least one display component can serve a feel-good aspect, the well-being, comfort, and general satisfaction of the viewing occupant, but can also additionally or alternatively serve an entertainment aspect, for example for the amusement or other mental stimulation of the occupant.

[0013] It should be noted at this point that the basic image does not have to depict only primary operating aspects of the motor vehicle, but can also refer to secondary operating aspects of the motor vehicle, such as multimedia functionalities, setting functions, and the like, which may be provided by vehicle systems of the motor vehicle, which may be of various types. The at least one display is also part of the motor vehicle, i.e., installed in the interior, for example, as part of an instrument panel, on trim elements, on seat components, in the headliner, and the like.

[0014] Overall, and generally speaking, the method according to the invention provides intelligent, particularly interactive, immersive illustrations in the interior. In particular, a high level of immersion with regard to the given theme is possible.

[0015] In an expedient development, the base image for at least one of the at least one display can be a camera image and / or based on a camera image, in particular as part of a virtual exterior mirror and / or a virtual interior mirror. In this case, the additional image can be placed over a live camera image of the virtual rearview mirror as a digital, graphic layer that is placed over the base image. The additional image is rendered in particular in real time and superimposed on the camera image. The adapted additional image can then be shown in real time on the display of the virtual rearview mirror, so that the occupant, in this example the driver, can perceive the changes due to the circumstances described by the status information and understand them intuitively and immersively.

[0016] Particularly advantageously, the additional image can be determined according to a theme specification, in particular one specified by the user and / or one used throughout the motor vehicle. By selecting the theme specification either by the user or at least by at least one occupant, in particular the driver, the intelligent immersive illustrations in the interior can be personalized. For example, a desired theme can be selected via a user-friendly interface, for example in an infotainment system of the motor vehicle or via a mobile device application (app) assigned to the motor vehicle. As soon as the general theme specification is available, the control device can load the required graphics, animations, and effects—i.e., display components—and prepare the display.For example, parts of the additional image assigned to topic specifications, comprising the display components, and / or instructions for generating the additional image, which may also include the dependencies on the at least one item of status information, can be stored in a database.

[0017] A theme can also refer to other components of the vehicle, particularly the interior and its equipment, particularly in a holistic approach similar to "theme worlds." Such a theme world thus offers the possibility of configuring various components to a specific theme according to the theme. For example, if the theme is "Green Meadow," in addition to an additional image containing grass as a display component, corresponding background images, a green coloring of the interior lighting, and the like are conceivable.For example, with a theme centered around a red-and-blue superhero, a corresponding background image can be set, the interior lighting can be red / blue, the superhero can be used as an avatar for a profile, and the additional image can point to or depict the superhero's command center, their equipment, a superpower such as "spinning webs," and the like. Thus, a content package containing content for various interior components can be provided by a central server device located inside or outside the vehicle, which is then taken into account by the control device for activation.

[0018] The topic setting can primarily concern the driver, for example, be set by the driver and / or be based on a known driver characteristic, such as a profile setting. However, it is also possible for the topic setting to concern a passenger and / or other occupants. For example, the choice of a topic setting can concern a passenger's favorite sports club, a holiday of the passenger, a hobby of the passenger, and the like, and the same applies to the other occupants.

[0019] A further development of the present invention can further provide that time information is determined by the control device and the topic is selected depending on the time information. The time information can be determined, for example, by a timer of the motor vehicle and / or an external timer, for example a radio clock and / or as part of a mobile phone signal. This provides a type of "global trigger" for the automatic selection of a topic. Specifically, it can be provided, for example, that the topic, in particular depending on a date as time information, relates to a holiday and / or a festive season and / or a personal anniversary of a driver and / or other occupants of the motor vehicle and / or a public event.The theme setting can therefore be used to congratulate a driver and / or other passengers on their birthday or an anniversary, for example, with confetti as a display component or similar. Holidays and festivals, such as Christmas, New Year's Eve, and Easter, can also lead to an automated theme setting. It is also conceivable, if necessary as a variant of a theme setting, to distinguish between day and night based on time information and adapt themes accordingly. In general, events can also be used to select the theme setting, for example, ongoing sporting events (world championships, etc.).

[0020] An automatic selection of a theme and / or an adaptation / variant selection of a theme can also be carried out via an online link. In concrete terms, it can be provided, for example, that the selection of a theme and / or an adaptation of a theme is carried out on the basis of internet information retrieved from the internet and relating to the driver and / or other passengers. For example, it can be checked which computer game the driver and / or other passengers are currently playing in order to then select an appropriate theme. A theme and / or an adaptation of the theme can also be carried out depending on a current game situation in the computer game, for example by mirroring a season and / or the weather in a computer game currently being played in the additional image.Furthermore, for example, a topic specification and / or adjustment of the topic specification can occur when a certain number of likes is reached for a post.

[0021] In a particularly advantageous embodiment of the present invention, it can be provided that the state information describes at least one physical circumstance in the interior, and in order to adapt the representation, the behavior of at least a first of the at least one representation component under the influence of the physical circumstance is determined, in particular by physical simulation and / or calculation using at least one physical law, and used to adapt the at least one first representation component. This means that for at least a first of the at least one representation component, a physically correct reaction to the event described by the state information or the circumstance described by the state information can be determined and implemented, so that the at least one first representation component ultimately behaves as expected by the observer, in particular the driver.Thus, the adaptation, i.e., the behavior of the at least one first display component, is intuitively understandable, which further increases the immersion with this display component, especially with regard to the topic or the additional image as a whole. Specifically, simulations and / or physical laws described by formulas can be used in this context to determine the correct physical response of the at least one first display component.

[0022] Specifically, it can be provided that the status information describes a temperature and / or air movement within the interior and / or a vibration of the interior. In this way, thermal effects and / or mechanical effects leading to movement of the at least one first display component are ultimately described by the status information, which have concrete physical effects on the object and / or material displayed as a display component, which can be determined by the control device and used to adapt the display image, in particular the additional image.

[0023] It should be noted at this point that in this context, but also in other embodiments of the method according to the invention, the adaptation of the display image, specifically of the at least one display component, can also take place over a plurality of time steps. This means that entire processes can be represented, for example, with regard to a vibration, the swaying of an object represented by the display component until it falls over, a continuous movement to a target location, and the like.

[0024] In a first specific embodiment, it can be provided that at least one of the at least one first display component relates to a substance that changes its state of aggregation under the influence of temperature, in particular water in the form of snow, and the behavior relates to a change in the state of aggregation. If, for example, a topic specification relates to snow or winter, or if a display component is generally snow, this is subjected to temperature changes in the interior of the motor vehicle both mathematically and through adaptation. For example, the snow that initially covered parts of the display can melt away due to higher temperatures, for example under the effect of a climate control system (air conditioning) in the motor vehicle. In principle, evaporating water, for example in cooking pots, and other substances that change their state of aggregation are of course also conceivable.Reverse changes in state are of course also conceivable, for example rain forming an ice layer as a display component at low interior temperatures.

[0025] In a second specific embodiment, it can be provided that at least one of the at least one first display component relates to a material or object that can be moved by air movement and / or vibration, wherein the behavior relates to a movement. With regard to air movement, this can be triggered by a variety of causes, for example by the aforementioned interior air conditioning system and / or an open window, but also by an occupant, for example by blowing, coughing or the like. In the above-mentioned example of snow as a display component, for example, drifting can occur or the snow can be visually "blown off" the display, for example by the occupant blowing. Something similar is of course also possible with other materials or objects, for example dust, feathers, spider webs and the like.Other objects that are generally depicted as stationary, such as a flower, can also be deformed in a physically correct manner by the air movement. Since the reference is to the interior, and not, for example, to a wind outside the vehicle that is not noticeable in the interior, the physical reaction of the representation component is more intuitive and easier to understand. Because air movement caused by occupants or other effects can be detected and taken into account, particularly using suitable sensors close to the display, indirect interaction with the corresponding first representation component is possible, for example, blowing away snow, dust, feathers, or other light materials and / or objects.

[0026] Vibrations felt in the interior of the vehicle can also be physically accurately reacted to. Such vibrations can be generated, for example, by a vehicle door closing into the interior. In this case, an object represented by the first display component can wobble / shake and / or slip. For example, the head of a virtual bobblehead dog can also begin to wobble, and the like.

[0027] These embodiments and concrete physical interactions can of course also be used in a complementary manner, so that, for example, snow as a display object can be influenced thermally and can also be blown away by air movement and / or slipped by vibration.

[0028] Specifically, it can be provided that the temperature and / or air movement is determined based on temperature data from at least one temperature sensor and / or setting data from an air conditioning system and / or a seat heater of the motor vehicle and / or the opening state of windows and / or doors of the interior and / or pressure sensor data from at least one pressure sensor, and / or that the vibration is determined by a vibration sensor and / or by the closing of an interior door. Of course, other and / or additional determination methods are also conceivable in principle.

[0029] In another conceivable development of the present invention, it can be provided that light information describing the illumination of the interior, in particular from sensor data from a light sensor, is determined as state information. Here, for example, it can be provided that at least a second of the at least one display component comprises a light-responsive display element, whose reaction to the illumination of the interior is determined and used to adapt the display image. Reactions of objects and / or materials, in particular simulating natural behavior, can also occur with regard to the brightness within the interior.In particularly immersive, intuitively comprehensible and enjoyable embodiments, it can be provided, for example, that a second representation component represents an eye whose degree of opening depends on the illumination, i.e. the brightness, of the interior and / or that a second representation component represents a flower whose petals open with increasing illumination in the interior or close with decreasing illumination in the interior.

[0030] In a further development of the inventive concept, the status information can be determined relating to an operating event on an operating means in the interior of the motor vehicle that is different from the display and / or an acoustic output in the interior and / or the operation of a windshield wiper on a window bordering the interior. Thus, an operating event that does not relate to the display can also be used to achieve a reaction, in particular an intuitively identifiable one, from at least one of the at least one display components. For example, engaging a specific gear, for example the "D" gear, can lead to a vibration visible at the at least one display component, for example in the manner of an earthquake pulse throughout the entire additional image. Activating a direction indicator can, for example, result in pulsating animations of at least one display component.

[0031] Such operating events can also be used to accelerate intuitively understandable, immersive effects compared to physical processes—deviating from typical physical behavior. For example, it can be provided that, for a topic related to snow, simply activating the interior climate control system is sufficient to virtually defrost the display within a short period of time, for example, 3 to 10 seconds. For example, if a driver enters their vehicle in winter, the displays may initially be virtually covered in snow, but they can trigger a rapid defrosting process by activating the interior climate control system, a seat heater, or the like.

[0032] However, acoustic conditions, particularly those reproduced by a motor vehicle's infotainment system, such as music playback, can also be appropriately responded to by at least one of the at least one display component to provide an immersive feel-good and / or entertainment environment. For example, visual effects of the additional image can adapt depending on the volume and rhythm.

[0033] The operation of a windshield wiper, which is both perceptible from the interior and influences it at least in terms of the incidence of light, can also be used in the state information as the basis for immersive adaptation. For example, windshield wipers activated during rain can cause windshield wipers to appear in the additional image, removing, for example, a display component or even the entire additional image, especially as an overlay.

[0034] In exemplary embodiments, it can further be provided that the status information is determined in a descriptive manner regarding a degree of soiling and / or air quality in the interior. In this case, a degree of soiling in the interior can be recorded, for example, using a camera directed into the interior and suitable image processing. If, for example, dust forms a display component or a theme, the amount of dust shown on the display can depend on the overall soiling in the interior. The air quality can be recorded using an air quality sensor, which is already provided, for example, as part of an interior air conditioning system of the motor vehicle. Here, for example, one of the at least one display component can represent a character who, for example, can put on a mask and / or wrinkle their nose if a threshold value for the air quality is exceeded.

[0035] Basically, it should be noted that within the scope of the present invention, a multitude of themes or general themes for additional images / display components are conceivable. For example, it is possible to use display components to depict snowfall, rain, clouds and the like in a weather theme, leaves in an autumn theme, and the like. The protagonist of a theme can also be an animal, for example a spider that builds a web (as an additional display component). Here, the web can be "blown away" by an air movement, for example. Characters in one theme can, for example, have a snowball fight, while another theme can also relate to an underwater world. In an underwater world or other water-related themes, low temperatures can, for example, lead to the formation of ice and / or air movements can lead to waves on a depicted water surface.

[0036] In principle, however, it is also conceivable within the scope of the present invention to use further information beyond the status information mentioned here in order to achieve an adaptation of at least one of the at least one display component, in particular in addition to the use of the status information. For example, it can be provided that the adaptation of at least one of the at least one display component and / or a further, third display component takes place additionally as a function of at least one piece of movement information describing the movement of the motor vehicle and / or environmental information describing an external circumstance, in particular a weather condition.Corresponding adaptation options have already been proposed in the prior art and can also be used within the scope of the present invention, particularly if the immersion created by using the state information is not negatively affected.

[0037] In a preferred embodiment of the present invention, if multiple displays are installed in the interior of the motor vehicle, the control device can adapt the display images of at least several, in particular all, displays jointly based on the status information, provided that the at least one display component is present in its display images. This creates a uniform, coherent overall impression with regard to the displays installed in the interior of the motor vehicle, further enhancing the display experience.Such different displays, which are installed in the motor vehicle and are also expediently controlled together with regard to the theme, can include, for example, a central display provided on or in the area of ​​a center console with setting options and operating options for a variety of vehicle systems (often referred to as MMI), a display provided in the instrument panel, virtual rearview mirror displays, a head-up display, entertainment displays for front passengers and rear seat occupants, rear seat remote control displays and / or other displays.

[0038] In addition to the method, the invention also relates to a motor vehicle having an interior in which at least one display is installed, and a control device designed to implement the method according to the invention. All statements regarding the method according to the invention can be applied analogously to the motor vehicle according to the invention, with which the aforementioned advantages can also be achieved.

[0039] Further advantages and details of the present invention will become apparent from the exemplary embodiments described below and from the drawings. In the drawings: Fig. 1 a flow chart of an embodiment of the method according to the invention, Fig. 2 the overlay of an additional image on a basic image, Fig. 3 a first possible adaptation of a display component, Fig. 4 a second possible adaptation of a display component, and Fig. 5 a schematic diagram of a motor vehicle according to the invention.

[0040] Fig. 1 shows a flow chart of an embodiment of the method according to the invention, wherein the steps are carried out by a control device of a motor vehicle for at least one display installed in the motor vehicle, specifically an interior.

[0041] In a step S1, a theme is selected for an ambience and / or aesthetic enhancement of the display's visualization mode. This can be done based on user input, which in turn also activates the immersion display system implemented here. It should be noted that, regardless of the choice of theme, the immersion display system can be deactivated at any time by a user, for example, a driver or another passenger. The user input as well as the activation / deactivation can be performed in a user interface displayed on at least one of the at least one displays; however, it is also conceivable to use a mobile device application (app) assigned to the motor vehicle for this purpose, for example.

[0042] An automatic selection of a theme, for example based on time information determined by the control device and / or on the basis of a known characteristic and / or preference of the driver and / or another passenger, is also possible.

[0043] Based on the time information, it is conceivable, for example, to select the theme based on a holiday, a special occasion, a personal anniversary, such as a birthday, etc. Furthermore, the control device can also process internet information, for example, selecting the theme based on a computer game played, the number of likes on a post, and similar information about an inmate.

[0044] The theme specification can be retrieved, for example, from a database and contains display components assigned to it, instructions for generating an additional image, and dependencies on at least one piece of status information. Beyond the at least one display, the theme specification can relate to several, in particular all, displays of the motor vehicle's interior and even extend beyond this, for example, containing control information for other components of the interior that matches the theme specification. These can relate, for example, to the interior lighting, background images, and the like.

[0045] Based on the theme specification, a supplementary image is determined in step S2, which is to be superimposed on a base image to compose the display image to be output on the screen. The supplementary image contains display components according to the theme specification. For a winter- or specifically snow-related theme, for example, a display component for lying snow and / or snowflakes. For a spider-related theme, for example, the spider and its webs can form display components. Display components can, generally speaking, be or include graphics, text components, symbols, and / or effects.

[0046] Parallel to these processes, in step S3, status information is determined that describes at least one condition related to the interior and / or at least one event related to the interior. In the present case, the status information describes an interior temperature, air movements in the interior, the illumination of the interior, vibrations in the interior, operating events not related to the at least one display, acoustic signals emitted into the interior, in particular music, air quality in the interior, and the activity of windshield wipers. To determine the status information, sensors such as temperature sensors, vibration sensors, pressure sensors, light sensors, and the like can be used, just as information from other vehicle systems, for example, an interior climate control system, seat heating, an infotainment system, operating devices, and the like, can be retrieved.

[0047] The state information is used in step S4 to adapt the additional image with respect to its image content, specifically at least one display component of the additional image. Different display components can be affected by different portions of the additional information, and / or some display components can also be adapted depending on multiple portions of the additional information. For at least some of the display components to be adapted, hereinafter referred to as the first display components, the adaptation follows physical principles by using the state information for at least one physical simulation and / or at least one calculation using at least one physical law for the display component.

[0048] This is particularly useful with regard to the interior temperature, air movement within the interior, and vibrations. For example, for vibrations that can be caused by slamming interior doors, a resulting movement of an object and / or material described by the representation component can be determined. This also applies to the influence of air movement on an object and / or material. Air movement can be caused, for example, by open windows, an interior air conditioning system, and / or by occupants. As far as the temperature within the interior is concerned, which can also be influenced by the interior air conditioning system, for example, it can exert a virtual physical influence on a substance in a representation component that undergoes a change of state, such as water.

[0049] The interior lighting can at least be used to replicate natural effects, for example, by adjusting display elements that change with the incidence of light, such as flowers (opening / closing of the blossom) and / or eyes (degree of opening). Regarding operating events, for example, engaging a D gear can lead to an earthquake impulse, activating a turn indicator can lead to pulsing of display components, and activating the interior climate control system and / or the seat heating can lead to an accelerated change in the aggregate state of a substance in a display component, for example, melting snow or ice.When music is played in the vehicle interior, visual effects can adapt to the volume and rhythm, while the activity of a windshield wiper can also be transferred to the display, at least with regard to some display components, by "wiping" them away. This can be achieved by adding virtual windshield wipers to the display component.

[0050] In some embodiments, additional information can also be incorporated into the adaptation, for example, movement information of the motor vehicle and / or environmental information describing environmental conditions, such as weather conditions. However, it is preferable to consider such additional information only to the extent that the immersion with the interior, as achieved by the state information, is not disrupted.

[0051] In parallel with the determination of the (adapted) additional image, in step S5 the control device determines the basic image, which in this case comprises at least one piece of information related to the operation of the motor vehicle and / or at least one operating option related to the operation of the motor vehicle. In particular, the basic image provides the usual, expected functionality of the display, so that the additional image ultimately provides a genuine aesthetic addition to delight and increase the well-being of occupants with high immersive potential through adaptation to conditions and events in the interior. In the case of a virtual exterior mirror, the basic image can, for example, be based on a camera image from a corresponding camera of the motor vehicle; in the case of displays providing user interfaces, the basic image can contain corresponding user interfaces with information and / or operating options.

[0052] In step S6, the display image to be output on the display is determined by the control device by superimposing the additional image from step S4 on the base image from step S5. Accordingly, in step S7, the display image is output on the respective one of the at least one displays. To achieve real-time rendering and real-time overlay, a powerful graphics processing unit (GPU) and / or a dedicated image processor capable of displaying the display images, in particular any animations contained therein, smoothly and without delays can be used to achieve real-time rendering and real-time overlay.

[0053] Fig. Figure 2 explains this overlay of the additional image 1 onto the main image 2 in more detail. The main image contains operating options 3 and information 4 related to the operation of the motor vehicle. The additional image 1 shows a blanket of snow 5 and snowflakes 6 as display components. After overlaying, a display image 7 is created in which the respective image contents (operating options 3, information 4 related to the operation of the motor vehicle, blanket of snow 5, and snowflakes 6) are all visible.

[0054] Fig. Figure 3 shows a concrete example of a first possible adaptation based on the state information. Supplementary Figure 1 initially shows snowflakes 6 and a blanket of snow 5. Due to the (possibly accelerated) virtual influence of the temperature in the interior, symbolized by arrow 8, the adaptation result (implemented as an animation over several time steps) is a melting of the snow cover 5 and a transition of the depicted snowfall into rain, compare raindrops 6'.

[0055] Fig. Figure 4 shows another concrete example, namely a second possible adaptation based on the state information. Here, additional image 1 contains a spider's web 9 spun by a spider in the lower right corner as a display component. If the additional information now describes an air movement from right to left, for example also based on an action of an occupant that generates this, the adaptation in step S4, arrow 10, which is again implemented as an animation over several time steps, results in a spider's web 9 being detached and flying to the left out of the display. Such a "blowing away" can also be implemented for the snow cover 5. Air movements can of course also have a virtual physical influence on other display objects, for example confetti in a birthday greeting as a theme.

[0056] Fig. 3 and Fig. 4 are to be understood purely as examples; of course, a multitude of further immersive and intuitively comprehensible adaptations in the sense of reactions of display objects to conditions and events in the interior of the vehicle are conceivable.

[0057] Fig.5 finally shows a schematic diagram of a motor vehicle 11 according to the invention. In addition to the control device 12 designed to carry out the method according to the invention, the motor vehicle 11 also has displays 13, as described, which are installed in the interior 14 of the motor vehicle 11. Information sources of the control device 12 for determining the status information include, for example, a temperature sensor 15, a vibration sensor 16, an air quality sensor 17, a pressure sensor 18, and a light sensor 19. Furthermore, the control device 12 communicates with other vehicle systems, here, for example, an interior air conditioning system 20, an infotainment system 21, and a communication device 22 on the Internet, although other vehicle systems and other information sources, for example sensors, can of course also be provided.In particular, the control device 12 can also be configured to control other interior components, such as interior lighting, according to a theme, in the sense of a "theme world." A database containing theme specifications can be stored in the motor vehicle 11, for example, in the control device 12 itself. QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] DE 10 2012 222 522 A1

[0005]

Claims

[1] Method for operating at least one display (13) which is installed in an interior (14) of a motor vehicle (11), wherein a display image (7) to be output on the display (13) is generated by means of a control device (12) and the display (13) is controlled to output the display image (7), characterized by that at least one item of status information relating to the interior (14) of the motor vehicle (11) is determined by means of the control device (12) and an image content of the display image (7) comprising at least one display component is adapted using the status information. [2] Method according to claim 1, characterized byin that, in order to determine the display image (7), a basic image (2) is determined or provided, which comprises at least one piece of information (4) relating to the operation of the motor vehicle (11) and / or at least one operating option (3) relating to the operation of the motor vehicle (11), and an additional image (1), in particular an aesthetic and / or ambience image, which is to be added to the basic image (2) and / or superimposed thereon is determined, wherein the additional image (1) comprises the display component. [3] Method according to claim 2, characterized by that the basic image (2) is a camera image and / or is based on a camera image, in particular as part of a virtual exterior mirror, and / or that the additional image (1) is determined according to a theme specification, in particular one provided by the user and / or used in the entire motor vehicle (11). [4] Method according to claim 3, characterized bythat time information is determined by the control device (12) and the theme specification is selected depending on the time information. [5] Method according to one of the preceding claims, characterized by that the state information describes at least one physical circumstance in the interior (14) and, in order to adapt the display image (7), the behavior of at least a first of the at least one display component is determined under the influence of the physical circumstance, in particular by physical simulation and / or calculation using at least one physical law, and is used to adapt the at least one first display component. [6] Method according to claim 5, characterized by that the state information describes a temperature and / or an air movement within the interior (14) and / or a vibration of the interior (14). [7] Method according to claim 6, characterized by , that at least one of the at least one first representation component relates to a substance that changes its state of aggregation under the influence of temperature, in particular water in the form of snow, and the behavior relates to a change in the state of aggregation, and / or at least one of the at least one first representation component relates to a material or object movable by air movement and / or vibration, wherein the behavior relates to a movement. [8] Method according to claim 6 or 7, characterized bythat the determination of the temperature and / or the air movement is carried out on the basis of temperature data from at least one temperature sensor (15) and / or setting data from an air conditioning device (20) and / or a seat heater of the motor vehicle (11) and / or an opening state of windows and / or doors of the interior (14) and / or pressure sensor data from at least one pressure sensor (18) and / or the determination of the shock is carried out by a vibration sensor (16) and / or by means of a closing of a door of the interior (14). [9] Method according to one of the preceding claims, characterized by that light information describing the illumination of the interior (14), in particular from sensor data of a light sensor (19), is determined as status information. [10] Method according to claim 9, characterized bythat at least a second of the at least one display component comprises a light-responsive display element, the reaction of which to the illumination of the interior (14) is determined and used to adapt the display image (7). [11] Method according to one of the preceding claims, characterized by that the status information is determined relating to an operating event on an operating means in the interior (14) of the motor vehicle (11) that is different from the display (13) and / or an acoustic output in the interior (11) and / or the operation of a windscreen wiper of a window bordering the interior (14). [12] Method according to one of the preceding claims, characterized by that the status information is determined describing a degree of contamination and / or an air quality of the interior (14). [13] Method according to one of the preceding claims, characterized bythat the adaptation of at least one of the at least one display component and / or a further, third display component is additionally adapted as a function of at least one item of movement information describing the movement of the motor vehicle (11) and / or of environmental information describing an external circumstance, in particular a weather condition. [14] Method according to one of the preceding claims, characterized by that several displays (13) are installed in the interior (14) of the motor vehicle (11), wherein the control device (12) adapts the display images (7) of all displays (13) together on the basis of the status information, insofar as the at least one display component is present in its display images (7). [15] Motor vehicle (11), comprising an interior (14) in which at least one display (13) is installed, and a control device (13) which is designed to carry out a method according to one of the preceding claims.

Citation Information

Patent Citations

  • CN000104210423A

  • Device for extending e.g. virtual flower images displayed at e.g. seatback in passenger car using rear seat entertainment projection system management device, has projection system displaying produced and extended graphics at surface

    DE102012222522A1

  • Device and method for information output and / or information input within a vehicle

    DE102017007854A1

  • System for controlling output units in a vehicle, vehicle and method for controlling output units in a vehicle

    DE102018207849A1

  • display for a vehicle interior

    DE10307976A1