Method for operating at least one display of motor vehicle, and motor vehicle
By using control devices to determine status information and adapting to display images in the display of the internal space of the motor vehicle, the problem of difficulty in providing an immersive user experience in the prior art is solved, and the direct response of the display components to the internal space status and events is realized, and the immersion and satisfaction of the user experience is improved.
Patent Information
- Application Number
- CN202411491381.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-10-31
- Filing Date
- 2024-10-24
- Publication Date
- 2025-05-02
AI Technical Summary
The monitors in the interior space of the existing motor vehicle are difficult to provide an immersive user experience and cannot effectively adapt to the current status and events of the interior space.
The state information of the internal space of the motor vehicle is determined by the control device, and the image content of the display image is adapted according to this information, including dynamic overlay and adding additional images related to the theme presets to achieve semantic adjustments and immersive experiences of the display components.
It realizes the direct response of the display components to the internal space state and events, improves the immersion and satisfaction of the user experience, and provides intelligent and interactive immersive illustration effects.
Smart Images

Figure CN119911112A_ABST
Abstract
Description
Technical Field
[0001] The invention relates to a method for operating at least one display installed in the interior of a motor vehicle, wherein a display image to be output on the display is generated by means of a control device and the display is driven for outputting the display image. The invention also relates to a motor vehicle. Background Art
[0002] The number and importance of displays in the interior of motor vehicles, in particular passenger cars, are increasing. For example, displays in the center console region and / or adjacent to the windshield are known, which provide different setting options and / or output information about the motor vehicle. Displays of this type can be designed as touch displays and can thus also accept user inputs.
[0003] Displays are also proposed as part of an electronic virtual rearview mirror. In this case, a display can be arranged laterally on the dashboard of the motor vehicle as an alternative to an exterior rearview mirror. For a central rearview mirror (interior rearview mirror), the display can be arranged at the location of a conventional interior rearview mirror, but it can also be arranged at other locations. Displays for reversing cameras are also proposed. For displays of this type of virtual exterior rearview mirror, for example, a camera image of a correspondingly oriented camera - if necessary preprocessed - can be displayed on the display as a display image. Other types of motor vehicle interior displays include head-up displays, displays of so-called "virtual cockpits" and displays for the entertainment of the front passenger and / or rear passengers.
[0004] Universal displays for interiors and / or displays installed in interiors with special user-specific adaptations have also been proposed, such as user-specific color schemes in lighting, display images, etc. Setting a user-specific background image has also been proposed.
[0005] DE 10 2012 222 522 A1 discloses a projection-type entertainment system for passengers. Here, for example, animated graphics such as virtual animals, virtual flowers and virtual toys can be output, which react to the detected movement of the motor vehicle. In addition, the passengers can interact with the graphics. Summary of the invention
[0006] The object of the present invention is to provide an operating option for a motor vehicle display installed in the interior of a motor vehicle that is in particular immersive and improves the user experience of a viewer.
[0007] According to the invention, this object is achieved by a method, in particular a computer-implemented method, and a motor vehicle according to the independent claims. Advantageous developments are derived from the dependent claims.
[0008] In a method of the type mentioned at the outset, provision is made according to the invention to determine at least one piece of status information about the interior of the motor vehicle by means of a control device and to adapt the image content of a display image, which includes at least one display component, using this status information.
[0009] It is therefore proposed to adapt the image content, in particular at least one display component, as a function of the current state of the interior, i.e. as a function of current events and / or current situations. The display component thus reacts to conditions which are also perceptible to an occupant viewing the display and / or even initiated by the occupant. Thus, indirect results of an occupant's action can be displayed, wherein the action does not directly interact with the display, i.e. is not an operating action, and therefore does not, for example, involve touching in the case of a touch display. Overall, the reaction of the display component is directly understandable to the occupant and an excellent level of immersion is achieved.
[0010] The invention relates here to a practical adaptation of the image content, i.e., of the display components which form the semantic part of the image content, so that they can be directly perceived and interpreted. In addition to the procedure described here, however, additional adaptation processes of the display parameters can of course be used, in particular with regard to better perceptibility, such as, for example, automatic adaptation of the display brightness.
[0011] In a particularly preferred design, it can be provided that, in order to determine the display image, a basic image is determined or provided, the basic image comprising at least one piece of information related to the operation of the motor vehicle and / or at least one operating option related to the operation of the motor vehicle, and an additional image to be added to the basic image and / or superimposed on the basic image, in particular an aesthetic image and / or an atmosphere image, is determined, wherein the additional image comprises a display component. In other words, it is proposed in this design that the basic image is dynamically superimposed and / or dynamically added, wherein the additional image can, for example, depict a certain theme, in particular a theme preset. For example, the additional image can provide static and / or animated graphics, texts, symbols and / or effects. The additional image can supplement the basic image and / or provide a visual effect.
[0012] Here, the basic image can be determined in such a way that it does not occupy the entire surface of the display and / or includes an area that can be superimposed, and in an embodiment, this area can be kept free of information and / or operating options. In other words, the determination of the basic image and the additional image that are important for the operation of the motor vehicle can be coordinated with each other, in particular coordinated so that the additional image can provide an overlay ("overlay") for the basic graphic. In this case, the additional image and thus at least one display component can provide a sense of pleasure, comfort and overall satisfaction to the viewing occupant from a pleasing perspective, but additionally or alternatively, it can also be entertaining from an entertainment perspective, for example, for the occupant to entertain or meet other mental needs.
[0013] At this point it should also be noted that the basic image does not have to depict only primary operating aspects of the motor vehicle, but can also relate to secondary operating aspects of the motor vehicle, such as multimedia functions, setting functions, etc., which can be provided by vehicle systems of possibly different types of motor vehicles. The at least one display is also part of the motor vehicle, i.e. is installed in the interior, for example as part of the instrument panel, installed in the interior, for example on trim, on seat components, on the roof lining, etc.
[0014] In summary, the method according to the invention provides an intelligent, in particular interactive, immersive illustration in an interior space, in particular achieving a high degree of immersion in relation to a pre-set theme.
[0015] In a suitable development, for at least one of the at least one display, the base image can be a camera image and / or based on a camera image, in particular as part of a virtual exterior rearview mirror and / or a virtual interior rearview mirror. In this case, the additional image can therefore be superimposed on the live camera image of the virtual rearview mirror as a digital graphic layer superimposed on the base image. In particular, the additional image is rendered in real time and superimposed on the camera image. The adapted additional image can then be displayed in real time on the display of the virtual rearview mirror, so that the occupant (in this example the driver) can perceive and intuitively understand changes in accordance with the situation described by the status information.
[0016] It is particularly advantageous that the additional images can be determined based on a theme preset, in particular on the user side and / or used in the entire motor vehicle. By selecting a theme preset from the user side or at least based on at least one occupant, in particular the driver, a personalization of the intelligent immersive illustrations in the interior space is achieved. For example, the desired theme can be selected via a user-friendly user interface, for example in the infotainment system of the motor vehicle, or via an application (App) for a mobile device equipped for the motor vehicle. Once the theme preset is generally available, the required graphics, animations and effects (i.e. display components) can be loaded by the control device and the display can be made ready. For example, additional image parts (including display components) related to the theme preset and / or instructions for generating additional images can be stored in a database, which instructions can also include a correlation with at least one status information.
[0017] Here, the theme preset can also relate to other components of the motor vehicle, in particular the interior and its equipment, and in particular be treated as a whole in the form of a "theme world". Such a theme world thus offers the possibility of adapting different components to a certain theme according to the theme preset. For example, if the theme preset is "green grass", then in addition to the additional image containing, for example, grass (as a display component), a corresponding background image can also be envisaged, the interior light can be changed to green, etc. In a theme related to a red and blue superhero, for example, the corresponding background image can be adjusted, the interior light can be kept red / blue, the superhero can be used as an avatar of the profile, and the additional image can indicate the application center of the superhero and its equipment, super powers (such as "weaving a net"), etc., or show them. Thus, a central server device located inside or outside the motor vehicle can provide content packages with content for different interior components, and the control device can take these contents into account for driving accordingly.
[0018] Preferably, the theme preset may be driver-related, for example, it may be set by the driver, and / or for known driver characteristics, such as profile settings. However, it is also possible that the theme preset is related to the co-pilot and / or other passengers. For example, the selection of the theme preset may be related to the sports club of the co-pilot's favorite sport type, the co-pilot's holidays, the co-pilot's hobbies, etc., and similarly for other passengers.
[0019] In addition, a further development of the present invention can provide that the time information is determined by the control device and the theme preset is selected according to the time information. Here, the time information can be determined, for example, by a timer of the motor vehicle and / or by an external timer (e.g. a radio clock) and / or as part of a mobile radio signal. Thus, a "global trigger" is provided for the automatic selection of the theme preset. For example, it can be specifically provided that the theme preset is related to festivals and / or holidays and / or personal anniversaries and / or public events of the driver and / or other members of the motor vehicle, especially according to the date as time information. Thus, the theme preset can be used to congratulate the driver and / or other passengers on their birthdays or anniversaries, for example with confetti as display components, etc. Of course, festivals and holidays, such as Christmas, New Year's Eve and Easter, can also generate automatic theme presets. In addition, it is also conceivable that, as a variation of the theme preset, day and night are distinguished according to the time information, and the theme is adapted accordingly. In general, events, such as ongoing sports events (World Cup, etc.) can also be used for the selection of theme presets.
[0020] The automatic selection of a theme preset and / or the adaptation / variation selection of a theme preset can also be automatically completed by means of an online link. Specifically, it can be provided, for example, that the selection of a theme preset and / or the adaptation of a theme preset are performed based on Internet information related to the driver and / or other passengers that is called from the Internet. For example, the computer game that the driver and / or other passengers are just playing can be checked, so that the corresponding theme preset is then selected. The theme preset and / or the adaptation of the theme preset can also be completed according to the current game situation in the computer game, that is, for example, by reflecting the season and / or weather in the currently played computer game in the additional image. In addition, the theme preset and / or the adaptation of the theme preset can be completed when, for example, a post reaches a certain number of likes.
[0021] In a particularly advantageous embodiment of the invention, it can be provided that the state information describes at least one physical condition in the interior space, and for the purpose of adapting the display, the behavior of at least one first display component of at least one display component under the influence of the physical condition is determined, in particular by physical simulation and / or calculation using at least one physical law, and this behavior is used to adapt the at least one first display component. That is, for at least one first display component of at least one display component, its correct physical reaction to the event described by the state information or to the situation described by the state information can be determined and implemented, so that the at least one display component ultimately exhibits the behavior expected by the viewer, in particular the driver. Therefore, the adaptation of the at least one first display component, that is, the behavior of the at least one first display component is intuitive and easy to understand, which further enhances the immersion of the display component, in particular also the theme preset or the additional image as a whole. In this regard, in particular, the correct physical reaction of the at least one first display component can be determined using simulations and / or physical laws described by formulas.
[0022] In particular, it can be provided that the state information describes air movements and / or temperatures in the interior and / or vibrations of the interior. In this way, thermal effects and / or mechanical effects that lead to movements of at least one first display component are ultimately described by the state information, which have a specific physical effect on the objects and / or materials shown as display components, which can be determined by means of the control device and can be used to adapt the display image, in particular the additional image.
[0023] At this point it should also be noted that in this case, but also in other embodiments of the method according to the invention, the display image, in particular at least one display component, can also be adapted in a plurality of time steps. That is, the entire process can be depicted, for example, in the case of vibrations, the swaying of the object depicted by the display component until it falls over, a continuous movement to a target position, etc. can be depicted.
[0024] In a first specific embodiment, it can be provided that at least one of the at least one first display component is a substance that changes its physical state under the influence of temperature, in particular water in the state of snow, and this change of physical state is represented. For example, if the theme preset is related to snow or winter, or if the display component is snow in general, the display part is subjected to temperature changes in the interior of the motor vehicle by calculation and by adaptation. For example, the snow that first covers the part of the display may melt due to higher temperatures, for example under the action of the air conditioning device (air conditioning equipment) of the motor vehicle. Of course, in principle, evaporating water, such as water in a cooking pot, and other substances that change their physical state are also conceivable. Of course, the opposite state change is also conceivable, such as the formation of an ice layer of rain as a display component when the temperature in the interior is low.
[0025] In a second specific embodiment, it can be provided that at least one of the at least one first display component is a material or object that can be moved due to air movement and / or vibration, wherein the behavior involves movement. As far as air movement is concerned, the air movement may be triggered for a variety of reasons, such as the opening of the interior air conditioning device and / or the window mentioned above, but it may also be triggered by the occupants, such as by blowing, coughing, etc. In the example of snow as a display component described above, for example, the snow may be blown off by the wind, or, for example, the snow may be visually "blown off" from the display by the occupants blowing. Of course, the same may also occur with other materials or objects, such as dust, feathers, cobwebs, etc. In principle, other objects, such as flowers, which are displayed in a static manner, may also undergo correct physical deformation in air movement. Because the reference is to the interior space, rather than, for example, the headwind outside the motor vehicle that cannot be felt in the interior space, the displayed physical reaction of the display component is more intuitive and easier to understand. Indirect interaction with the corresponding first display component, such as blowing snow, dust, feathers or other light materials and / or objects, is achieved by detecting air movements caused by occupants or other effects and taking them into account, in particular also by suitable sensor devices close to the display.
[0026] It is also possible to react correctly physically to vibrations that can be felt in the interior of the motor vehicle. For example, such vibrations may be caused by the closing of a door of the motor vehicle relative to the interior. In this case, the object reproduced by the first display component may sway / tremble and / or slide. For example, the head of a virtual bobblehead may also start to sway, etc.
[0027] Of course, these embodiments and specific physical interactions can also be used in a complementary manner so that, for example, snow as a display object can not only be influenced by heat, but can also be blown off by air movements and / or slide down under vibrations.
[0028] Specifically, it can be provided that the temperature and / or air movement is determined based on temperature data from at least one temperature sensor, and / or based on setting data of an air conditioning system and / or a seat heating system of the motor vehicle, and / or based on the opening state of a window and / or a door of the interior, and / or based on pressure sensor data from at least one pressure sensor, and / or vibrations are determined by a vibration sensor and / or based on the closing of a door of the interior. Of course, other and / or additional determination methods are also conceivable in principle.
[0029] In another conceivable improvement of the invention, it can be provided that light information describing the illumination of the interior is determined as state information, in particular from sensor data of a light sensor. Here, it can be provided, for example, that at least one second display component of at least one display component comprises a display element that reacts to light, that the reaction of the display element to the illumination of the interior is determined, and that the reaction is used to adapt the display image. Objects and / or materials can also react to the brightness in the interior, in particular to imitate natural behavior. In a particularly immersive, intuitive and pleasing embodiment, it can be provided, for example, that the second display component represents an eye, the degree of opening of the eye is related to the illumination (i.e. brightness) of the interior, and / or that the second display component represents a flower, the petals of which open as the illumination in the interior increases and close as the illumination in the interior decreases.
[0030] In a further development of the concept of the invention, status information can be determined that is related to operating events at an operating device other than the display in the interior of the motor vehicle and / or to sound output in the interior and / or to the operation of windshield wipers of a window delimiting the interior. Thus, operating events that are not related to the display can also be used to achieve a reaction that is particularly intuitively assignable in at least one of the at least one display component. For example, engaging a certain driving gear (e.g. "D") can lead to visible vibrations at the at least one display component, for example also in the form of seismic pulses that pass through the entire additional image. For example, activating the turn signal indicator can result in a pulsating animation of the at least one display component.
[0031] Such operator control events can also be used expediently - in contrast to the usual physical representation - to achieve an acceleration of an intuitively understandable immersive effect compared to a physical process. Thus, for example, it can be provided that in a theme preset related to snow, activation of the interior air conditioning system is sufficient to achieve a virtual defrosting of the display within a short time (e.g. within 3 to 10 seconds). For example, if the driver enters his motor vehicle in winter, the display can also be virtually covered with snow at first, but a rapid defrosting can be triggered with the activation of the interior air conditioning system, seat heating, etc.
[0032] Of course, in order to provide an immersive comfort and / or entertainment environment, at least one of the at least one display component can also react in a suitable manner to acoustic conditions, such as music playback, which are presented in particular by means of an infotainment system of the motor vehicle. For example, the visual effects of the additional image can be adapted according to the volume and rhythm.
[0033] The operation of the windshield wipers can not only be perceived from the interior but also influences the interior at least in terms of the light input and can therefore also be used as a basis for immersive adaptation in the status information. For example, activated windshield wipers in rainy weather can cause the windshield wipers to also appear in the additional image, for example by removing a display component or even removing the entire additional image, in particular as an overlay.
[0034] In an embodiment, it may also be provided that status information describing the degree of pollution and / or the air quality of the interior is determined. In this case, for example, the degree of pollution of the interior can be detected by a camera pointed into the interior and suitable image processing. For example, if dust forms a display component or a theme preset, the amount of dust shown on the display can depend on the overall degree of pollution in the interior. The air quality can be detected by an air quality sensor, which is for example provided as part of the interior air conditioning system of the motor vehicle, wherein for example one of the at least one display component can represent a person who, for example, may wear a mask and / or wrinkle his nose when an air quality threshold value is exceeded.
[0035] In principle, it should be noted that within the scope of the present invention, multiple theme presets or universal themes for additional images / display components are conceivable. Thus, for example, it is feasible to depict snowfall, rain, cloudy weather, etc. in a weather theme, leaves, etc. in an autumn theme, by means of display components. The protagonist of the theme preset can also be an animal, such as a spider that spins a web (as an additional display component). In this case, the spider web can also be "blown away" by air movements, for example. For example, in one theme preset, characters can have a snowball fight, while another theme preset can also involve the underwater world. For example, in the underwater world or other water-related themes, for example, low temperatures can lead to the formation of ice, and / or air movements can lead to the appearance of waves on the water surface shown.
[0036] In principle, however, it is also conceivable within the scope of the invention to use, in addition to the status information described here, in particular in addition to the use of the status information, further information for adapting at least one of the at least one display component. Thus, for example, it can be provided that at least one of the at least one display component and / or a further third display component is adapted additionally as a function of at least one piece of motion information describing the movement of the motor vehicle and / or as a function of environmental information describing external conditions, in particular weather conditions. Corresponding adaptation concepts have already been proposed in the prior art and can also be used within the scope of the invention, in particular if the immersion achieved by the use of the status information is not negatively affected.
[0037] In a preferred embodiment of the invention, it can be provided that if a plurality of displays are installed in the interior of the motor vehicle, the control device jointly adapts the display images of at least a plurality of, in particular all, displays in accordance with the status information in such a way that at least one display component is present in the display images of the displays. In this way, a uniform and coordinated overall impression is produced with respect to the motor vehicle displays installed in the interior of the motor vehicle, which further improves the display experience. The different displays installed in the motor vehicle and which are also conveniently jointly controlled in terms of thematic presetting can include, for example: a central display arranged on or in the area of the center console, which has setting options and operating options for a variety of vehicle systems (often referred to as MMI); a display arranged in the instrument panel; a virtual rearview mirror display; a head-up display; an entertainment display for the front passenger and rear passengers; a rear remote control display; and / or other displays.
[0038] In addition to the method, the invention also relates to a motor vehicle having an interior space in which at least one display is installed and a control device which is designed to carry out the method according to the invention. All embodiments relating to the method according to the invention can be transferred similarly to the motor vehicle according to the invention, so that the advantages already mentioned can also be achieved with the motor vehicle according to the invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] Further advantages and details of the invention emerge from the exemplary embodiments described below and with reference to the drawings.
[0040] in:
[0041] Figure 1 A flow chart showing an embodiment of the method according to the present invention is shown.
[0042] Figure 2 shows the superposition of the additional image on the basic image,
[0043] Figure 3A first possible adaptation of the display components is shown,
[0044] Figure 4 A second possible adaptation of the display components is shown, and
[0045] Figure 5 A schematic diagram of a motor vehicle according to the invention is shown. DETAILED DESCRIPTION
[0046] Figure 1 A flow chart of an exemplary embodiment of the method according to the invention is shown, wherein the steps are carried out by a motor vehicle control device for at least one display installed in a motor vehicle, in particular in the interior.
[0047] In step S1, a theme preset is now selected for the ambience and / or aesthetics expansion of the visualization operation of the display. This can be done based on a user input, in which way the immersive display system implemented here is also activated. It should be noted that, independently of the selection of the theme preset, the immersive display system can be deactivated again at any time by a user, for example the driver or another occupant. The user input and the activation / deactivation can be done in a user interface displayed on at least one of the at least one display; however, it is also conceivable to use, for example, a mobile device application (App) provided for the motor vehicle for this purpose.
[0048] For example, it is also possible to automatically select a theme preset as a function of time information determined by the control device and / or as a function of known characteristics and / or preferences of the driver and / or another occupant.
[0049] For example, it is conceivable that based on time information, a theme preset is selected in a manner corresponding to festivals, holidays, personal anniversaries (such as birthdays), etc. In addition, Internet information can also be processed by the control device, for example, a theme preset is selected based on computer games played by the occupant, the number of likes on a post, and similar information.
[0050] In this case, the theme preset can be retrieved from a database, for example, and contains display components corresponding to the theme preset, instructions for generating additional images, and a correlation with at least one status information. The theme preset can extend beyond at least one display to multiple displays in the interior of the motor vehicle, in particular to all displays, and can even extend beyond this, for example to contain control information for other components of the interior that conform to the theme preset. This control information can, for example, relate to interior lighting, background images, etc.
[0051] In step S2, based on the theme preset, an additional image is determined, which is to be superimposed with the basic image to synthesize a display image to be output on the display. The additional image contains display components according to the theme preset. In winter or a specific theme related to snow, for example, the additional image can contain display components about snow and / or snowflakes. In a theme related to spiders, for example, spiders and their webs can form display components. In general, display components can be or include graphics, text elements, symbols and / or effects.
[0052] In parallel with these processes, in step S3, state information is determined, which describes at least one interior-related situation and / or at least one interior-related event. The state information describes the interior temperature, air movement in the interior, interior illumination, vibrations in the interior, acoustic signals output in the interior (especially music), air quality in the interior, and windshield wiper activity, but does not describe at least one display-related operating event. For determining the state information, sensors such as temperature sensors, vibration sensors, pressure sensors, light sensors, etc. can be used, for example, and information from other vehicle systems (such as interior air conditioning, seat heating, infotainment system, operating elements, etc.) can also be retrieved.
[0053] In step S4, the state information is used to adapt the image content of the additional image, i.e., in particular to adapt at least one display component of the additional image. Different display components may be affected by different parts of the state information and / or some display components may also be adapted according to a plurality of parts of the state information. For at least one part of the display components to be adapted (hereinafter referred to as the first display component), the adaptation is made physically compliant in that the state information is used for at least one physical simulation and / or at least one calculation using at least one physical law for the display component.
[0054] This is particularly useful with regard to the interior temperature, air movements in the interior and vibrations. Thus, for example, for vibrations that may be caused, for example, by the closing of a door in the interior, the resulting movement of objects and / or materials represented by the display component can be determined, and the same applies to the influence of air movements on objects and / or materials. Air movements can be caused, for example, by opening a window, by the interior air conditioning system and / or also by the occupants. As for the temperature in the interior (which can also be influenced by the interior air conditioning system, for example), this temperature can, for example, have a virtual physical influence on a substance of the display component that undergoes a physical change (for example, water).
[0055] The illumination of the interior can be used to simulate natural effects at least in the following way, i.e., for example, display elements that change with the entrance of light, such as flowers (opening / closing of the flowers) and / or eyes (degree of opening), can be adapted accordingly. In the case of operator control events, for example, engaging the D gear can cause ground pulses; activating the turn indicator can cause a display component to pulsate; and activating the interior air conditioning system and / or the seat heating can cause an accelerated change in the physical state of the material of the display component, such as melting snow or ice. When music is played in the interior of the motor vehicle, the visual effects can be adapted according to the volume and rhythm, and at least for some display components, the activity of the windshield wipers can also be transferred to the display by causing them to "wipe". This can be achieved by adding virtual windshield wipers to the display components.
[0056] In some embodiments, further information may also be included in the adaptation, such as movement information of the motor vehicle and / or environmental information describing environmental conditions (e.g. weather conditions). However, it is preferred that such further information is only taken into account to such an extent that the immersive feeling of the interior space, which is achieved, for example, by the status information, is not affected.
[0057] In parallel with the determination of the (adapted) additional image, in step S5 a basic image is determined by the control device, wherein the basic image comprises at least one piece of information related to the operation of the motor vehicle and / or at least one operating option related to the operation of the motor vehicle. In particular, the basic image provides the usual intended functionality of the display, so that the additional image ultimately provides a practical, aesthetic additional functionality, so that by adapting to the situation and events in the interior, the occupants are satisfied and their sense of pleasure is increased while achieving a high immersion potential. In the case of a virtual exterior mirror, the basic image can be based on a camera image of a corresponding motor vehicle camera, and in the case of a display providing a user interface, the basic image can contain a corresponding user interface with information and / or operating options.
[0058] In step S6, the control device determines the display image to be output on the display in the following manner, that is, the additional image of step S4 is superimposed on the basic image of step S5. Correspondingly, in step S7, the display image is output on the corresponding display of at least one display. In order to achieve the determination of the additional image and the basic image in real time and to superimpose the additional image and the basic image into a display image and then output it, a powerful image processing unit (GPU) and / or a dedicated image processor can be used to achieve real-time rendering and real-time superposition, and the dedicated image processor can smoothly and without delay show the display image, especially the animation contained therein.
[0059] Figure 2The superposition of the additional image 1 on the basic image 2 is explained in more detail. The basic image now contains operating options 3 and information 4 related to the operation of the motor vehicle. In the additional image 1, snow accumulation 5 and snowflakes 6 are shown as display components. After the superposition, a display image 7 is generated in which the corresponding image contents (operating options 3, information 4 related to the operation of the motor vehicle, snow accumulation 5 and snowflakes 6) are all visible.
[0060] As a specific example, Figure 3 A first possible adaptation based on the state information is shown. Here, the additional image 1 again shows snowflakes 6 and snow 5. Due to the (possibly accelerated) virtual influence of the temperature in the interior (symbolically shown by arrow 8), the adaptation result (presented as an animation in multiple time steps) is the melting of the snow 5 and the transformation of the shown snowfall into rain, see raindrops 6'.
[0061] Figure 4 Another specific example is shown, namely a second possible adaptation scheme based on the state information. Here, as a display component, the additional image 1 contains a spider web 9 woven by a spider in the lower right corner. Now, if the state information describes an air movement from right to left (for example, also based on the occupant's action that produces this air movement), the adaptation for this air movement, also as an animation over a plurality of time steps, is represented in step S4 (arrow 10) as a spider web 9 that spreads out and flies out of the display to the left. This "blowing away" can also be used for snow 5. Of course, the air movement can also have a virtual physical effect on other displayed objects, such as confetti when celebrating a birthday as a theme preset.
[0062] Figure 3 and Figure 4 This is to be understood as purely exemplary; of course, many other immersive and intuitively understandable adaptations of the display objects to situations and events in the interior of the motor vehicle are also conceivable.
[0063] at last, Figure 5The schematic diagram of a motor vehicle 11 according to the invention is shown. In addition to a control device 12 designed to carry out the method according to the invention, the motor vehicle 11 also has a display 13, which, as described, is installed in the interior 14 of the motor vehicle 11. The information sources of the control device 12 for determining the status information include, for example, a temperature sensor 15, a vibration sensor 16, an air quality sensor 17, a pressure sensor 18 and a light sensor 19. In addition, the control device 12 is connected to the Internet in order to communicate / exchange information with other vehicle systems, for example, an interior air conditioning system 20, an infotainment system 21 and a communication device 22, wherein of course, further vehicle systems and other information sources, such as sensors, can also be provided. In particular, the control device 12 can also be designed to control other interior components, such as interior lighting, in accordance with a theme preset in the sense of a "theme world". A database related to the theme preset can be stored in the motor vehicle 11, for example, in the control device 12 itself.
Claims
1. A method for operating at least one display (13) installed in the interior (14) of a motor vehicle (11), wherein: A display image (7) to be output on a display (13) is generated by means of a control device (12), and the display (13) is controlled to output the display image (7), characterized in that at least one status information related to the interior (14) of a motor vehicle (11) is determined by means of the control device (12), and the image content of the display image (7) is adapted using the status information, the image content including at least one display component.
2. The method according to claim 1, characterized in that In order to determine a display image (7), a basic image (2) is determined or provided, the basic image comprising at least one piece of information (4) related to the operation of a motor vehicle (11) and / or at least one operating option (3) related to the operation of a motor vehicle (11), and an additional image (1) to be added to the basic image (2) and / or superimposed on the basic image (2), in particular an aesthetic image and / or an ambience image, is determined, wherein the additional image (1) comprises the display component.
3. The method according to claim 2, characterized in that The base image (2) is a camera image and / or is based on a camera image, in particular as part of a virtual exterior mirror, and / or an additional image (1) is determined according to a theme presetting, in particular on the user side and / or used in the entire motor vehicle (11).
4. The method according to claim 3, characterized in that Time information is determined by a control device (12), and a theme preset is selected based on the time information.
5. The method according to any one of the preceding claims, characterized in that The state information describes at least one physical condition in the interior space (14), and in order to adapt the display image (7), in particular by performing physical simulation and / or calculation using at least one physical law, the behavior of at least one first display component of at least one display component under the influence of the physical condition is determined, and the behavior is used to adapt the at least one first display component.
6. The method according to claim 5, characterized in that The state information describes air movements in the interior (14) and / or the temperature and / or vibrations of the interior (14).
7. The method according to claim 6, characterized in that At least one of the at least one first display component relates to a substance that changes state under the influence of temperature, in particular water in the form of snow, and the behavior relates to a change in state, and / or At least one of the at least one first display component relates to a material or an object that can be moved due to air movements and / or vibrations, wherein the behavior relates to the movement.
8. The method according to claim 6 or 7, characterized in that: The temperature and / or air movement are determined based on temperature data from at least one temperature sensor (15), and / or based on setting data of an air conditioning device (20) and / or a seat heating device of the motor vehicle (11), and / or based on the opening state of windows and / or doors of the interior space (14), and / or based on pressure sensor data from at least one pressure sensor (18), and / or vibrations are determined via a vibration sensor (16) and / or based on the closing of a door of the interior space (14).
9. The method according to any one of the preceding claims, characterized in that Light information describing the illumination level of the interior (14) is determined as status information, in particular from sensor data of a light sensor (19).
10. The method according to claim 9, characterized in that At least one second display component of the at least one display component comprises a display element that reacts to light, the reaction of the display element to the illumination of the interior space (14) being determined and used to adapt the display image (7).
11. The method according to any one of the preceding claims, characterized in that The determined status information is related to operating events on an operating device other than a display (13) in an interior (14) of a motor vehicle (11) and / or to acoustic outputs in the interior (14) and / or to the operation of windshield wipers of a window defining the interior (14).
12. The method according to any one of the preceding claims, characterized in that The determined status information describes the degree of pollution and / or the air quality of the interior (14).
13. The method according to any one of the preceding claims, characterized in that Additionally, at least one of the at least one display component and / or a further third display component is adapted based on at least one piece of movement information describing the movement of the motor vehicle (11) and / or based on environmental information describing external conditions, in particular weather conditions.
14. The method according to any one of the preceding claims, characterized in that A plurality of displays (13) are installed in an interior space (14) of a motor vehicle (11), wherein a control device (12) jointly adapts the display images (7) of all displays (13) as a function of status information such that at least one display component is present in the display images (7) of the displays.
15. A motor vehicle (11) having an interior (14) in which at least one display (13) is installed, and a control device (12) which is designed to carry out the method according to one of the preceding claims.
Citation Information
Patent Citations
Device for extending e.g. virtual flower images displayed at e.g. seatback in passenger car using rear seat entertainment projection system management device, has projection system displaying produced and extended graphics at surface
DE102012222522A1