motor vehicle

Abstract

Motor vehicle, comprising at least one projection device (2) for projecting a photographic image (12) onto a projection surface (9) external to the vehicle, as well as an environment detection device (5) for detecting environmental information, and a control device (8) configured to evaluate the environmental information to determine an upright projection surface (9) located in the environment and its position, size and shape, as well as one or more objects (11) located in front of or to the side of the projection surface (9) and their position, size and shape, to generate a dynamically changing photographic image (12) depending on the determined position, size and shape of the projection surface (9) and the determined position, size and shape of the object(s) (11), and to control the projection device (2) to project the determined photographic image (12).

Description

[0001] The invention relates to a motor vehicle comprising at least one projection device for projecting a light image onto a projection surface external to the vehicle.

[0002] Such a motor vehicle is known, for example, from DE 10 2018 212 056 A1. By means of a projection device, a photographic image can be projected, for example, onto a roadway or a wall, which can be seen by a person. The motor vehicle is equipped with a detection device for detecting an interaction of the person with regard to the displayed photographic image, which device evaluates the interaction to determine whether the person reacts to the information conveyed by the photographic image. The interaction can, for example, be a movement of a hand or a step or something similar. The photographic image can, for example, be a warning notice projected onto a floor surface, or a word or a sequence of words, for example in the form of a question, which the person can answer via the interaction.

[0003] DE 10 2023 002 770 A1 discloses a method for operating a projection device of a vehicle. A detection device is provided, via which information of a projection surface in the surroundings of the vehicle can be detected. Furthermore, a control unit is provided, via which a projection device can be controlled. Using the detection device, information relating to a texture of the projection surface and information relating to a structure of the projection surface are determined by the control unit, as well as a characteristic of the projection surface on the basis of the information relating to the texture and the structure. The control unit then generates a projection image on the basis of this information and projects it onto the projection surface by controlling the projection unit. By detecting a texture or structure of the projection surface, distortions, offsets or irregularities in the projection orThe distortion of the projection image can be minimized, and by considering the properties and design of the projection surface, a dynamic projection can also be achieved, as the textures and structures of the projection surface are taken into account and incorporated into the projection. The projection surface is always a floor surface.

[0004] The invention is based on the problem of providing a motor vehicle with an extended possibility of light image projection.

[0005] To solve the problem, according to the invention a motor vehicle is provided, comprising at least one projection device for projecting a light image onto a projection surface external to the vehicle and an environment detection device for detecting environment information, and a control device configured to evaluate the environment information to determine an upright projection surface located in the environment and its position, size and shape and one or more objects located in front of or to the side of the projection surface and their position, size and shape, to generate a dynamically changing light image depending on the determined position, size and shape of the projection surface and the determined position, size and shape of the object or objects and to control the projection device to project the determined light image.

[0006] The motor vehicle according to the invention is characterized in that a dynamic light image display, which is specifically tailored to the detected environmental situation or is generated specifically with regard to this, can be projected onto the projection surface. The concrete configuration of the light image display or the concrete design of the light image display, i.e. the local projection of image content onto the projection surface, is oriented towards the position, size, or shape of objects located in front of or to the side of the projection surface. Such an object can be, for example, a bicycle leaning against the projection surface, a box or shelf standing in front of it, or any other object, or a structural frame surrounding the projection surface or the like. Environmental information, i.e. information describing the surroundings of the motor vehicle, is recorded by means of an environmental detection device.This information is evaluated by a control device. The control device is set up to use the environmental information to determine whether there is a projection surface in the area suitable for projecting a slide image onto it. The control device is also set up to use the environmental information to determine any objects located in front of or to the side of the potential projection surface, i.e. their position and shape or geometry. Using this analyzed information, the control device can then specifically determine the slide image, the geometry of which is adapted to the geometry of the projection surface on the one hand, but also to any detected objects on the other. This means that the object(s) are essentially integrated into the slide image or that they interact with the slide image.The image display is dynamic, meaning it changes continuously, almost like a film, but the projection takes into account the conditions of the projection surface and the object(s). A kind of augmented reality is created.

[0007] The control device is equipped with a suitable algorithm or program for evaluating the environmental information in order to detect any projection surface and any objects within the environmental information or data set. The control device also has an algorithm or program for generating the type and dynamics of the light image to be produced, based on the evaluation results of the environmental information. Finally, the control device is equipped with an algorithm or program for controlling the projection device in order to project the generated light image onto the projection surface via the projection device.

[0008] With a motor vehicle equipped in this way, it is possible, for example, when the vehicle drives up to a potential projection surface and comes to a stop, for example in a carport or in front of or in a garage, to project a slide image onto a corresponding wall that serves as a projection surface. This slide image can be viewed by the driver and possibly also the front passenger, as well as by external persons. A wide variety of representations or image scenarios are conceivable as a slide image. For example, the slide image could be used to depict snowfall. Since the geometry of the projection surface and any objects in front of it are known, the dynamic slide image can be such that the snow gradually piles up on the object(s).If, for example, there is a bicycle in front of the projection surface, the slide image can be displayed in such a way that the snow gradually piles up on the bicycle seat or handlebars. If there is a box, a shelf, an electrical box or something similar in front of the projection surface, the snow would gradually pile up on the box, etc. This means that the dynamics and interaction essentially depict a real situation in the slide image, as it might actually occur. An alternative image scenario could be, for example, the slide image showing animals such as birds flying “over” the projection surface and landing on the bicycle seat or the box, or a spider building a web in a corner of the projection surface and then moving off to the side, or something similar.Also conceivable are plants that are depicted, whose position and representation are quasi-interactively depicted with respect to the captured objects, for example, growing "on" the box, and the like. Likewise, figures can be depicted, for example, sitting on the box or bicycle, and the like. Thus, virtually any image scenario is conceivable that can be presented via the slide display, and that are interactively integrated into the given situation on the projection surface, or are designed or generated with respect to it.

[0009] At least one camera is preferably used as the environment detection device for recording images of the area in front of the motor vehicle. The algorithm or program means of the control device is therefore configured to evaluate the images. The images show the area in front of the motor vehicle in correspondingly detailed resolution. Within the images, the algorithm or program means can be used, for example, to detect the projection surface and any objects using edge detection and the like. This information then forms the basis for generating the control information that defines the light image display. The camera can, for example, be part of a driver assistance system already provided on the vehicle, whereby not just one camera but, if available, several cameras can record images that are then evaluated.

[0010] In addition, the environmental device can comprise at least one sensor that detects an environmental parameter. This sensor can be, for example, a temperature sensor, a rain sensor, or a brightness sensor, although this list is not exhaustive. Using this sensor, which can also be part of a driver assistance system already installed in the vehicle, it is possible to detect an environmental parameter such as the ambient temperature, any rain or snowfall, or the ambient brightness. This sensor information can be taken into account or processed by the control device when generating the light image display. The control device is also able to consider sensor information that was acquired before the environmental information was detected.For example, if the vehicle drives into the carport or garage during snowfall, the information that it is raining or snowing can be subsequently taken into account when generating the photographic image. This means that the photographic image could also depict rain or snowfall, for example. Or a snowy landscape with animals moving around could be depicted, or something similar. This means that such sensor information can, in principle, be incorporated into the generation of the photographic image, particularly with regard to the image information content.

[0011] It is also conceivable for the control device to be set up to adapt the determined light image display depending on the continuously acquired environmental information. It is fundamentally possible that the situation in front of or on the projection surface changes. For example, an object can move for whatever reason. For example, a bicycle can fall over, or a window can suddenly open, or something similar. The environmental information is continuously acquired so that this changing situation can be recorded and evaluated by the control device. At the same time, the control device can adapt the light image display accordingly in real time, for example, to now pile up accumulating snow on the lying bicycle, or something similar.This means that there is not only a dynamic within the image representation as such, but also a dynamic with regard to an adaptation to changing objective boundary conditions.

[0012] There are various options for determining the image content displayed via the slide show. According to a first variant, it is conceivable that the image content can be defined by a user of the motor vehicle via an input device on the motor vehicle. The user therefore selects which image content they would like to have displayed, for example when driving into the carport or in front of the garage or when reaching a parking space in front of another wall. The selection can be made at an earlier point in time and stored remanently in the control device, i.e. basic information that defines the fundamental image content is stored in the control device. For example, the user can select “snow” as the image content, and snowfall will be displayed as the slide show. If they select “animals,” for example, a slide show with one or more animals will be displayed.The user thus defines the displayed image scenario in advance. The final type of image display, i.e., the specific imaging of the predefined image content, is then determined, as described, via the control device depending on the evaluation result of the environmental information and, if applicable, the environmental parameters, in particular the conditions regarding any detected objects.

[0013] Alternatively, it is conceivable that the image content could be automatically defined depending on the environmental parameter detected by the sensor. For example, if the sensor detects that it is raining, snowing, or dark, the control system can select rainfall, snowfall, or a starry sky as the general image scenario, with the specific image representation being generated based on the detected and evaluated environmental information.

[0014] It is also conceivable to combine both variants when it comes to specifically determining the image content. For example, if the user has previously selected the "Figures" option on the input device and, for example, "Spiderman", "Spiderman" will be displayed as the basic image content, for example by "Spiderman" moving or swinging across the projection surface or something similar. If the sensor has detected snowfall, the image can contain snowfall in addition to the figure, which means that in this case "Spiderman" moves across the projection surface when it snows. The environmental parameter is used to determine the image content in addition to the option selected by the user. The user easily selects the corresponding option using an input device on the vehicle, for example a touchscreen, and the menu offers a variety of different display options.The selection is retentive but can be changed at any time.

[0015] The projection device itself is preferably a headlight. This is, in particular, a headlight with a matrix LED module with an associated digital micromirror device. The matrix LED module has a plurality of individual, separately controllable LEDs arranged as an array. Preferably, these are color LEDs so that a colored light image can be projected. The light underlying the light image is generated via the matrix LED module. The digital micromirror device, often referred to as a "DMD" (digital mirror device), is a chip with a plurality of individual, separately controllable micromirrors. The number of these micromirrors in common chips is approximately 1.3 million.The specific image content can be defined using these micromirrors, as each micromirror can be adjusted between a position in which it reflects incident light and a position in which it does not reflect it, allowing the specific image being projected as a high-resolution, high-performance pixel image. Since the module's individual LEDs can also be controlled separately, both functionalities can be superimposed during imaging. For example, by controlling the LED module, a type of theatrical effect can be created, similar to an opening stage curtain, where the initially dark projection surface is brightened from the center to both sides, like a curtain. The actual illuminated image, for example the swinging "Spiderman," can then be generated using the micromirror device.Another combination scenario, for example, is the display of falling snowflakes collecting on the ground using a micromirror device. The LED array is controlled in such a way that light-generating segments move from side to side. This superimposed effect causes the falling snowflakes to be moved laterally out of the image. This means that, in principle, the combination of both controls of the LED array and the micromirror array is possible to create overlapping moving effects. However, other devices such as microLEDs can also be used instead of a DMD to project such content.

[0016] Since a motor vehicle typically has two headlights, which are usually identical in design or have identical components, it is conceivable to use both headlights, which are preferably designed as matrix LED headlights with a matrix LED module and associated digital micromirror device, to display the projection image. The control device thus controls both projection devices simultaneously, which complement or overlap each other to generate the light image. This means that the control device is configured to generate the control parameters defining the light image in such a way that both headlights can be controlled accordingly.

[0017] The control device itself is configured for appropriate data processing and data generation, i.e., it has corresponding algorithms or programming tools. It can also be configured for machine learning, particularly to adapt the light image projections to the environment and the real objects in real time.

[0018] The motor vehicle according to the invention therefore allows a seamless interaction between the image content generated on the basis of digital data and the physical environment.

[0019] Furthermore, the invention relates to a method for displaying a photographic image by means of a projection device provided in a motor vehicle on a projection surface external to the vehicle, wherein the motor vehicle has an environment detection device and a control device communicating with the latter, via which the projection device is also controlled, in which method environment information is recorded by means of the environment detection device, wherein the control device evaluates the environment information to determine an upright projection surface located in the environment and its position, size and shape as well as one or more objects located in front of or to the side of the projection surface and their position, size and shape and depending on the determined position, size and shape of the projection surface and the determined position,size and shape of the object(s) generates a dynamically changing light image and controls the projection device for projecting the determined light image.

[0020] At least one camera for capturing images of the area in front of the motor vehicle can be used as the environmental detection device. Furthermore, at least one sensor for detecting an environmental parameter can be used as the environmental image detection device.

[0021] The environmental information is preferably determined continuously, which makes it possible for the control device to continuously adapt the determined light image display depending on the continuously recorded environmental information.

[0022] Furthermore, it can be provided that the image content reproduced via the photographic display is defined by a user of the motor vehicle via an input device of the motor vehicle, and / or that the image content is defined automatically depending on the environmental parameter.

[0023] A headlight, in particular a headlight comprising a matrix LED module with an associated digital micromirror device, is preferably used as the projection device.

[0024] Further advantages and details of the present invention will become apparent from the exemplary embodiments described below and from the drawings. These show: Fig. 1 a schematic diagram of a motor vehicle according to the invention, Fig. 2 a schematic diagram of an environmental situation with a first photographic representation, and Fig. 3 a schematic representation of an environmental situation with a second photographic representation.

[0025] Fig. 1 shows a motor vehicle 1 according to the invention, which is configured to carry out the method likewise according to the invention. The motor vehicle 1 has a projection device 2 in the form of a headlight 3, wherein a second headlight 4 is provided, which can optionally also be used as a projection device 2, or can be operated together with the headlight 3 as a projection device. The headlight 3 (the same applies to the headlight 4) is designed as a matrix LED headlight. It comprises a matrix LED module with an array having a plurality of individual LEDs, wherein preferably color LEDs are used. Each LED can be controlled separately, so that almost any desired shaping of the emitted light beam is possible via the array. A digital micromirror device, commonly also called a DMD (digital mirror device), is assigned to the matrix LED module.This micromirror device has over a million individual, separately controllable micromirrors that reflect the light pixel by pixel or not depending on their position, so that almost any image content can be generated via the micromirror device and output as a light image.

[0026] Also provided is an environment detection device 5 comprising a camera 6, which can be used to detect the area in front of the motor vehicle 1. This camera 6 is preferably assigned to a driver assistance system already installed in the vehicle, and can therefore also be integrated into the existing driver assistance system, which allows for light image projection onto an external projection surface. The camera captures environmental information in the form of camera images, which are subsequently evaluated.

[0027] In the example shown, the environment detection device 5 further comprises three sensors 7, although fewer or more sensors 7 can also be integrated. The sensors 7 serve to detect environmental parameters. They can be, for example, a temperature sensor, a rain sensor, or a brightness sensor. The sensors 7 can also be assigned to other driver assistance systems, but are integrated into the present system.

[0028] Furthermore, a control device 8 is provided, which serves to control the projection device 2, i.e., the headlight 3 and, if applicable, also the headlight 4, as shown by the dashed control line. The control device 8 also communicates with the components of the environment detection device 5, i.e., the camera 6 and the sensors 7. The control device 8 is equipped with suitable algorithms orProgram means are set up which, on the one hand, serve to process and evaluate the information which is passed to the control device 8 via the environment detection device 5, i.e. the camera 6 or the sensors 7, and, on the other hand, to generate a light image which is to be projected onto a projection surface 9 via the projection device 2, i.e. for example the headlight 3, wherein the light image is generated in the form of corresponding control data via which the matrix LED module and the micromirror device are controlled.

[0029] Furthermore, an input device 10 is provided, for example in the form of a touch display, on which the user can make a selection regarding a preferred image content that forms the basis for the slide display to be displayed. For example, the user can choose from various image scenarios, e.g., "snowfall," "rain," "animals," "plants," "falling building blocks," etc. This basic image content is used by the control device 8 when generating the slide display to be ultimately projected, although the slide display is adapted accordingly to the surrounding conditions.

[0030] When the motor vehicle 1 comes to a stop in front of a wall, for example a garage door or similar, images of the area in front of the vehicle are recorded via the camera 6 and evaluated by the control device 8. The control device 8 has a suitable algorithm or a program means that allows a potential projection surface 9 to be determined within the recorded image(s), onto which a projection image can be projected via the headlight 3 and / or the headlight 4. At the same time, the algorithm or the program means can detect one or more objects 11, for example in the form of a box, a shelf, a bicycle, or the like, within the image(s), which are on or in front of the projection surface 9 and can be seen by the user of the vehicle through the windshield. The control device also has an algorithm ora program means which, after evaluating the environmental information provided about the image(s), determines the photographic image based on the environmental information. As stated, the environmental information describes the position, size, and shape of the projection surface 9, as well as the position, size, and shape of any objects 11. The control device 8 then determines the photographic image such that it is adapted to the spatial conditions on or in front of the projection surface 11. This means that the photographic image is projected in such a way that the edges or size of the projection surface 9 are taken into account, but equally the objects 11 are also taken into account. The image is generated in such a way that it is adapted to the position, size, or type, and shape of the objects, so that there is essentially an interaction between the digital photographic image and the physical environment on or in front of the projection surface 9.The slide display is generated as a dynamic slide display, meaning that not only a static image is projected, but a dynamically changing image.

[0031] As explained, the user can use the input device 10 to select an image content to be displayed, which the control device uses to generate the final dynamic slide display. If, for example, the user selects "snowfall," the control device 8 will generally generate a snowfall display as the slide display, with falling snowflakes that may also move sideways, etc., which is possible by appropriately controlling the LED array and the micromirror array. However, the slide display is now generated in such a way that it takes into account the position, size, shape, etc. of the object(s) 11. Thus, if snow falls in the slide display, it can gradually accumulate on the object(s) 11. If the objects 11 are boxes, for example, a layer of snow will form on top of the boxes and gradually grow.If the user has selected "animals" as the image content, animals such as a mouse, a spider, or the like can be projected as the image content. These animals "move" on the projection surface, for example, walking on the objects 11, or abseiling from the upper edge of the projection surface, and the like. If the user has selected "figures," for example, the slide display can show, for example, a figure sitting on an object and also moving, which can also walk from one side to the other, or the well-known "Spiderman," who swings from one side to the other on a rope, and the like.

[0032] In addition to the ambient information, any detected ambient parameters can also be incorporated into the generation of the light image. For example, if one of the sensors detects that it is very cold, i.e., temperatures below 0°C, or that snow is falling, then in addition to the selected central image content (animals, figures, etc.), several icicles hanging from the upper end of the projection surface 9 can be displayed at very cold temperatures below 0°C, or snowfall can be displayed if snowfall has been detected by a sensor, and similar.

[0033] The duration of the light image display, i.e. the projection, can be set in advance, for example for 30 seconds or 1 minute or similar, but it can also be individually selected by the user and, for example, end automatically when the user leaves the vehicle.

[0034] Fig. Figure 2 shows an exemplary embodiment of an environmental situation in which a motor vehicle 1 is stationary in front of a projection surface 9, which is shown here as a garage door. The projected living space 9 is enclosed on one side by a structural edge detected as object 11, i.e., the garage side walls and the garage ceiling. Furthermore, in the situation shown, an object 11 in the shape of a bicycle and an object 11 in the shape of a ball are shown, which are located in front of the projection surface 9, i.e., the garage door. All of these elements are shown in the image recorded by the camera 6 and can therefore be detected by the control device 8. In the present case, the photographic representation 12 is such that it contains individual snowflakes 13 that successively trickle down from top to bottom and that successively accumulate as a pile of snow 15, for example, on the saddle 14 of the bicycle or the ball 11.Also shown are icicles 16, as well as a larger pile of snow 17 in the left corner. Both the icicles 16 and the pile of snow 17 can grow as the image display progresses, i.e., become longer or larger. It is therefore evident that the image display is based on the actual situation in front of the projection surface 9, meaning that there is a seamless interaction between the projection image and the actual on-site conditions with regard to the image display.

[0035] Fig.Figure 3 shows an example of the same environmental situation, but there, only the structural boundary of the projection surface 9 is shown as object 11, which is captured in the camera image and evaluated by the control device 8. The light image 12 here comprises several spider webs 18 and, as an example, a spider 19 hanging from one of the spider webs 18 and successively descending on a thread from top to bottom. Here, too, a dynamic change in the light image occurs as a result of this movement.

[0036] Finally, the control device is configured to control the projection device 2 such that the light image 12 is projected onto the production surface 9 without distortion, utilizing the entire size of the projection surface 9. For this purpose, the distance of the motor vehicle 1 or the headlight 3, 4 used to the projection surface 9 can be determined via a suitable sensor system, as can the relative position of the motor vehicle 1 or its longitudinal axis to the plane of the projection surface 9 in order to calculate out any distortion.

Claims

[1] Motor vehicle, comprising at least one projection device (2) for projecting a light image (12) onto a projection surface (9) external to the vehicle, as well as an environment detection device (5) for detecting environmental information, and a control device (8) configured to evaluate the environmental information to determine an upright projection surface (9) located in the environment and its position, size and shape, as well as one or more objects (11) located in front of or to the side of the projection surface (9) and their position, size and shape, to generate a dynamically changing light image (12) depending on the determined position, size and shape of the projection surface (9) and the determined position, size and shape of the object or objects (11), and to control the projection device (2) to project the determined light image (12). [2] Motor vehicle according to claim 1, characterized by that the environment detection device (5) comprises at least one camera (6) for recording images of the area in front of the motor vehicle (1). [3] Motor vehicle according to claim 2, characterized by that the environmental image recording device (5) comprises at least one sensor (7) recording an environmental parameter. [4] Motor vehicle according to one of the preceding claims, characterized by that the control device (8) is arranged to adapt the determined light image display depending on the continuously recorded environmental information. [5] Motor vehicle according to one of the preceding claims, characterized by that the image content reproduced via the photographic display can be defined by a user of the motor vehicle (1) via an input device (10) of the motor vehicle (1), and / or that the image content can be defined automatically as a function of the environmental parameter. [6] Motor vehicle according to one of the preceding claims, characterized by that the projection device (2) is a headlight (3, 4). [7] Motor vehicle according to claim 6, characterized by that the headlight (3, 4) is a matrix LED module with an associated digital micromirror device. [8] Method for displaying a photographic image (12) by means of a projection device (2) provided in a motor vehicle (1) on a projection surface (9) external to the vehicle, wherein the motor vehicle (1) has an environment detection device (5) and a control device (8) communicating with the latter, via which the projection device (2) is also controlled, in which method environment information is detected by means of the environment detection device (5), wherein the control device (8) evaluates the environment information to determine an upright projection surface (9) located in the environment and its position, size and shape, as well as one or more objects (11) located in front of or to the side of the projection surface (9) and their position, size and shape, and depending on the determined position, size and shape of the projection surface (9) and the determined position,size and shape of the object(s) (11) generates a dynamically changing light image (12) and controls the projection device (9) for projecting the determined light image (12). [9] Method according to claim 8, characterized by that at least one camera (6) is used as the environment detection device (5) for recording images of the area in front of the motor vehicle (1). [10] Method according to claim 9, characterized by that at least one sensor (7) detecting an environmental parameter is used as the environmental image detection device (5). [11] Method according to one of claims 8 to 10, characterized by that the environmental information is continuously determined and the determined light image display (12) is adapted via the control device (8) as a function of the continuously recorded environmental information. [12] Method according to one of claims 8 to 11, characterized bythat the image content reproduced via the photographic display (12) is defined by a user of the motor vehicle (1) via an input device (10) of the motor vehicle (1), and / or that the image content is defined automatically as a function of the environmental parameter. [13] Method according to one of claims 8 to 12, characterized by that a headlight (3, 4), in particular a headlight (3, 4) comprising a matrix LED module with an associated digital micromirror device, is used as the projection device (2).

Images