Methods for illuminating the surroundings of a motor vehicle and motor vehicle
Patent Information
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- AUDI AG
- Filing Date
- 2024-12-16
- Publication Date
- 2026-07-23
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The present invention relates to a method for illuminating the surroundings of a motor vehicle, in particular when stationary.
[0002] Originally, the purpose of exterior lighting devices on motor vehicles was twofold: firstly, to illuminate the area around the vehicle for the driver, and secondly, to make the vehicle more visible to other road users. However, technology has advanced to such a degree that lighting devices can now perform functions that go far beyond these original requirements. For example, specific lanes can be illuminated, or oncoming traffic can be selectively excluded from the light to prevent glare.
[0003] A concept relating to the illumination of the surroundings of a motor vehicle is known from DE 10 2020 126 251 A1. The motor vehicle disclosed therein includes a lighting device for illuminating a lighting area. The illumination is achieved, for example, based on personalization information relating to user-defined patterns, colors, or intensities.
[0004] A motor vehicle with lighting devices is known from DE 10 2012 024 513 A1. In this concept, a user specifies beam directions, angles, and brightness levels, for example, to provide specific lighting for a parking space where the vehicle is normally parked. To verify the settings, a camera image of the surroundings is displayed when the settings are entered.
[0005] The present invention aims to provide an improved concept for the lighting of the environment of a motor vehicle, in particular with regard to the simplest and most intuitive possible predefinability of relevant parameters for a user.
[0006] According to the invention, the problem is solved in a method of the type mentioned at the outset by the fact that it comprises the following steps: a) Capture of image data relating to at least part of the environment using at least one camera, b) Displaying an image of the environment or part of the environment using a touchscreen display area and based on image data, c) Specifying at least one desired illumination area of the environment by having a user mark at least one image area of the image display that corresponds to the at least one desired illumination area by touching the touch-sensitive display surface, d) generating control signals based on at least one image area by means of a control device and outputting the control signals to at least one lighting device of the motor vehicle, so that at least one lighting area in the surroundings is illuminated by means of the at least one lighting device which corresponds to the at least one desired lighting area.
[0007] The invention is based on the idea that an area of the environment to be illuminated, referred to as the illumination area, is defined by the image area, which in turn is defined by the user touching the display surface of the touchscreen. An image or representation of the environment is displayed on the display surface, preferably in real time, and the user intuitively and easily defines the image area by touching or marking it. For example, the user defines the boundaries of the image area. The illumination of the environment then occurs based on the image area in such a way that the illuminated area corresponds to the image area and thus to the area of the image representation that the user has marked by touching. In particular, the defined boundaries of the image area correspond to the actual boundaries of the generated illumination area.
[0008] In step a), the image data relating to, depicting, or representing the vehicle's surroundings is captured. This image data can consist of at least one data set, which is a two-dimensional array or matrix comprising multiple data or image points. Each data point, which can also be called a pixel, is assigned at least one numerical value indicating its color and / or brightness.
[0009] At least one camera, which is a component of the motor vehicle, is used to acquire the image data. The camera captures image data relating to a visually visible portion of the electromagnetic spectrum. Additionally or alternatively, the camera can also capture infrared, radar, and / or lidar data. The camera preferably captures image data relating to a horizontal direction, particularly the area in front of the vehicle. If multiple cameras are used, the image data can cover several horizontal directions. In this way, the image data can represent a complete, and in particular, a 360-degree view around the vehicle.
[0010] In step b), the image data is used to generate a visual representation of the surroundings, or the captured portion thereof, and displayed on the touchscreen. The touchscreen can be located in the passenger compartment of the vehicle, where the occupants or user typically sit during the journey, also known as the passenger cell. Alternatively, the touchscreen can be mounted on a vehicle console, such as a front console forming part of the dashboard.
[0011] In step c) of the process, the user specifies the image area of the display, which is a section or region of the image. The image area corresponds to a section of the real environment or can be assigned to a real section of the environment. The image area defines the desired illumination area, i.e., the section of the environment that is to be illuminated according to the user's wishes.
[0012] When a user's finger touches a point on the display surface, the touchscreen generates a sensing signal. This signal determines whether and where on the display surface the touch occurred. The sensing signal can be transmitted directly to the control unit, which may be a component of the vehicle, or to a control unit of the touchscreen itself. The touchscreen's control unit can then transmit this information to the control unit. The result of this evaluation, i.e., the image area, can also be stored as a data set, for example, in the form of image data. Each pixel in the image data can be assigned information, for example, binary code, indicating whether it lies within the image area or not.
[0013] In step d), the image area, or rather the image data realizing the image area, is used by the control unit to generate the control signals. These control signals are output to the vehicle's lighting system and, in particular, cause the lighting system to emit light according to a light distribution defined by the image area. The light distribution can define a relationship between a spatial direction emanating from the lighting system and the parameters of the light emitted in that direction, such as brightness and / or color. The light distribution is defined in such a way that the resulting, actual illuminated area corresponds, at least substantially, to the desired illuminated area.
[0014] Light can be emitted from the vehicle in a frontal direction by means of the lighting device or at least one of the lighting devices. This lighting device can therefore be a headlight of the vehicle. Lateral emission of light from the vehicle is also conceivable, in which case the respective lighting device could be a side light of the vehicle. Rear emission of light from the vehicle is also conceivable, in which case the respective lighting device could be a rear light of the vehicle.
[0015] The image data can represent a two-dimensional projection of the environment onto an imaginary projection surface. This means that the environment, as seen from the camera's perspective, is projected onto the imaginary, i.e., virtual, projection surface. The projection surface represents the area of the image data's pixels. The projection is displayed as the image representation in step b). Since the display area corresponds to the projection surface, and the image area corresponds to a portion of the display area, the image area corresponds to a region of the projection surface. If the portion of the environment represented by the image representation encompasses a small solid angle, the projection surface can be assumed to be a flat surface.For larger solid angle areas or when displaying a 360° view, the projection surface can be curved and, for example, an imaginary hollow sphere that concentrically surrounds the motor vehicle and corresponds in particular to the concept of the celestial sphere known from astronomy.
[0016] In step d), the control signals can be generated such that a light cone produced by the at least one lighting device strikes the area of the projection surface corresponding to the image area. The light cone is not necessarily a cone in the geometric sense, but rather a pyramid whose base, corresponding to the image area, lies within the projection surface and whose apex is located at the respective lighting device. Deviations in the projection surface between the camera and the lighting device, arising from different installation positions and thus different perspectives of the camera and the lighting device, can be taken into account by the control device, for example, by computationally correcting them.
[0017] It is conceivable that in step c) at least one image area is defined by freehand drawing on the display surface. Specifically, the user can define the desired illuminated area by drawing a line, particularly a closed line, on the display surface that defines, and especially encloses, the desired illuminated area. This freehand drawing is preferably done using the user's finger.
[0018] It is also conceivable that in step c), the specification of at least one image area is achieved, or the user is supported in this specification, by the automated recognition of at least one section and / or object present in the environment and depicted in the image. Typically, the user does not specify the image area arbitrarily, but rather focuses on a specific section of the environment or an object located within it. The automated recognition of such sections and / or objects can thus be used within the context of specifying the image area. This automated recognition can be performed using image analysis software, particularly software implemented on the control unit, to which the image data is fed for evaluation. The image analysis software preferably implements an artificial intelligence, especially one that has been trained.
[0019] As part of the automated detection of the section and / or object, an automated classification of the respective area and / or object can be performed. The classification can indicate whether the detected area is a road, a parking lot, a building facade, or something similar. Regarding the detected object, the classification can indicate whether it is a fixed infrastructure feature, such as a traffic light, a road sign, or a bollard, or a person, an animal, another road user, or another object, such as a tent.
[0020] According to a possible further development, it is provided that in step c) at least one recognition area of the image display is shown, which relates to an automatically recognized section and / or an automatically recognized object, wherein the user can select the at least one recognition area as the at least one image area. The recognition area can be a marked part of the image display in which the recognized section or object is located or which shows this section or object. The recognition area can be indicated by an area on the image display, in particular a partially transparent and / or colored and / or hatched area, which overlays the recognition area. The recognition area can be selected as the image area by tapping the display area in the respective recognition area.In addition, information relating to the classification, particularly in the form of text output, can be displayed on the display area or image display for the respective recognition area.
[0021] It is conceivable that in step c), a point on the display area, marked by the user, particularly by tapping the display area, is evaluated to determine whether this point lies within a recognition area of the image display that relates to an automatically recognized section and / or an automatically recognized object, whereby in this case this recognition area is defined as at least one image area. The display or marking of the recognition area in the image display is not necessarily mandatory; rather, the marked and thus selected point is evaluated to determine whether it can be assigned to a recognized recognition area. If so, this recognition area is selected as the desired image area, and a corresponding marker can then be generated in the image display.
[0022] Preferably, the at least one desired illumination area is automatically specified based on at least one scenario signal provided by the user via an input device, whereby this specification is based on the automated recognition of the at least one section and / or object. In this embodiment, the user's specification of the desired illumination area by touching the display surface is essentially skipped, with the selection of the desired illumination area instead being made based on the scenario signal. This signal is directed at a specific scenario to be realized by means of the lighting.Depending on the scenario currently desired by the user via the scenario signal, specific sections or objects in the environment are illuminated. The user does not need to select these separately; they are selected automatically. The automated specification of the desired illumination area is preferably based on the previously performed classification.
[0023] The scenario signal is specified via the input device, which is primarily the touchscreen. Thus, at least one button can be displayed on the screen, for example next to the image, which may have a label describing the respective scenario. Selecting or tapping this button generates the corresponding scenario signal and outputs it to the control unit.
[0024] It is conceivable that the scenario signal, or one of the scenario signals, is a path lighting signal, the presence of which means that at least one desired lighting area affects at least one automatically detected path. When this scenario is executed, streets and paths in the vicinity are therefore preferentially or exclusively illuminated. The button displayed for selecting this scenario may be labeled "Path Lighting" or bear a corresponding pictogram, i.e., symbol.
[0025] It is conceivable that the scenario signal, or one of the scenario signals, is an emergency signal, in which case the at least one desired illumination area affects at least one automatically detected path and / or at least one detected person. In this case, immediate implementation of the illumination is essential, making it advisable to skip the process of illuminating the desired area by touching the screen. Especially since emergencies often involve malicious actions by third parties, such as robberies or harassment, illuminating the detected paths and detected persons is recommended. The button displayed for selecting this scenario may be labeled "Emergency" or "SOS" or bear a corresponding pictogram.
[0026] Preferably, when an emergency signal is present, at least one additional emergency announcement is made by the vehicle. This emergency announcement can alert passersby to the emergency, enabling them to intervene and provide assistance. The emergency announcement can be made using the vehicle's lighting system and may be implemented as a left-hand signal, particularly a red one. Alternatively, or in addition, the emergency announcement can be made using an audible signaling device in the vehicle and may be implemented as an alarm tone, particularly one with a rising and falling tone.
[0027] It is conceivable that the scenario signal, or one of the scenario signals, is an outdoor activity signal. When present, the at least one desired illumination area encompasses at least one automatically detected activity area of the environment where an outdoor activity is taking place, and / or at least one detected person. During the execution of this scenario, the activity area where the outdoor activity is taking place is determined and selected as the desired illumination area. The outdoor activity could involve setting up a tent camp, with the activity area being identified as the area containing at least one object classified as a tent. Alternatively, selecting an area adjacent to the activity area, for example, where the detected person is currently gathering wood for a campfire, as the desired illumination area would also be appropriate.The button displayed for selecting this scenario may be labelled "Activity" or "Tent Camp" or bear a corresponding pictogram.
[0028] It is conceivable that the scenario signal, or one of the scenario signals, is a parking signal, the presence of which means that at least one desired illumination area affects at least one automatically detected parking space. When this scenario is executed, areas of a parking space where the vehicle is currently located are preferentially or exclusively illuminated. The button displayed for selecting this scenario may be labeled "Parking Space" or display a corresponding pictogram.
[0029] It is conceivable that the scenario signal, or one of the scenario signals, is an animal observation signal, the presence of which indicates that at least one desired illumination area affects at least one automatically detected animal. Animals often appear in the wild outside of cities, which can be particularly interesting for children. When this scenario is triggered, the lighting must be activated immediately, as the animal often disappears quickly. During this scenario, an area in the vicinity is illuminated where the object classified as an animal is located. The button displayed for selecting this scenario may be labeled "Animal" or display a corresponding pictogram.
[0030] Preferably, at least one detection device, in particular the at least one camera, detects changes in the surrounding environment over time, particularly concerning the at least one section and / or the at least one object, and automatically adapts the at least one desired illumination area based on the detected change over time. In this embodiment, the illumination area does not necessarily remain static and unchanged, but its position and / or extent can be adjusted based on changing circumstances in the environment.
[0031] Provided that the automated detection of the section and / or object present in the vicinity occurs, the automated adaptation can track the at least one illuminated area in such a way that the at least one moving object remains within the respective illuminated area. Particularly in the scenarios described above, it is conceivable that the person present during the emergency or the person collecting wood will not always remain in the same position, but will move around. Similarly, the wild animal will not necessarily remain in the same position, but may, for example, flee. In these cases, tracking the illuminated area is advantageous.
[0032] It is conceivable that, particularly in step c), a desired overall brightness within the respective illuminated area, or at least one of the illuminated areas, is specified by the user and / or automatically, with the control signals being generated in step d) such that the illuminated area is lit, producing an overall brightness corresponding to the desired overall brightness. Thus, in certain situations, it may be advantageous to provide a brighter or dimerous illumination. For example, brighter illumination is appropriate in an emergency situation, whereas dimerous illumination is preferable for wildlife observation or a campfire. The overall brightness refers specifically to a brightness distribution integrated across the entire illuminated area, which can remain constant throughout the entire area.To set the overall brightness, the user can specify a numerical value, for example, between 1 and 100, where a value of 1 represents the minimum possible overall brightness at which the lighting is not switched off, and a value of 100 represents the maximum possible overall brightness. This setting can be made using the input device. For example, a slider can be displayed on the touchscreen, allowing the user to set the overall brightness.
[0033] Furthermore, it is conceivable that in step c), a desired brightness distribution within the illuminated area, or at least one of the illuminated areas, is specified by the user and / or automatically, and in step d), the control signals are generated such that the illuminated area is lit, producing a brightness distribution that corresponds to the desired brightness distribution. In this embodiment, the brightness distribution within the illuminated area is not locally constant, but varies depending on the respective beam angle of the lighting device. The user can specify the brightness distribution by drawing on the touchscreen. For example, a diagram could be displayed to the user to specify a horizontal brightness distribution, into which a curve describing the desired brightness distribution can be drawn with a finger.The user can specify a curve that rises from left to right, so that the brightness distribution increases from left to right. Alternatively, the user can draw a bell curve, so that the brightness distribution is generated in such a way that there is maximum brightness in its horizontal central area.
[0034] The aspects described regarding overall brightness and / or brightness distribution can equally apply to an overall color and / or color distribution. For example, in step c), a desired overall color and / or color distribution within the respective illuminated area is specified by the user and / or automatically for the illuminated area or at least one of the illuminated areas, and in step d), the control signals are generated such that the illuminated area is lit, producing an overall color and / or color distribution that corresponds to the desired overall color and / or color distribution.
[0035] It is also conceivable that at least one user-selectable, predefined brightness distribution is suggested. In this embodiment, the user simply needs to select the suggested brightness distribution, for example, by tapping a corresponding button. The predefined brightness distribution can be stored on a storage medium, particularly the control unit, and can be retrieved from it. An image can be displayed when the predefined brightness distribution is applied. The image can depict a playing field, such as the markings of a sports field, for example, a soccer field. The image can depict a chessboard pattern or the squares of a children's hopscotch game.
[0036] Particularly preferably, at least one detection device, in particular at least one camera, is used to detect a change action performed by a user in the vicinity, aimed at a desired change to at least one illuminated area, and the change to the at least one desired illuminated area is then carried out based on this change action. In this embodiment, the user is enabled to make changes to the illuminated area even after specifying the desired illuminated area and leaving the vehicle. For this purpose, the user only needs to perform the change action, which is automatically recognized by the detection device using the data it has captured.
[0037] The action required for modification can involve user gestures. The user can use their hands to indicate a shift and / or change in the size of the illuminated area. Image data from the camera can be analyzed for this purpose. User authentication can also be performed, for example, via facial recognition.
[0038] Furthermore, the present invention comprises a motor vehicle including a control device. The problem is solved according to the invention in such a motor vehicle by… - that at least one camera of the vehicle can capture image data relating to at least part of the surroundings, - wherein control signals can be generated by means of the control device and output to a touchscreen of the motor vehicle, so that an image representation of the environment or part of the environment can be displayed on a display surface of the touchscreen based on the image data, - wherein at least one desired illumination area of the environment can be specified by a user touching at least one image area of the image display that corresponds to the at least one desired illumination area, on the touch-sensitive display surface, - wherein control signals can be generated from the at least one image area and by means of the control device and output to at least one lighting device of the motor vehicle, so that at least one lighting area in the surroundings is illuminated by means of the at least one lighting device which corresponds to the at least one desired lighting area.
[0039] All advantages, features and aspects explained in connection with the method according to the invention are equally transferable to the motor vehicle according to the invention and vice versa.
[0040] Preferably, the steps of the method according to the invention, such as data evaluation and / or generation of control signals, are carried out by means of software implemented by the control unit, wherein the software implements, preferably, a trained artificial intelligence. For this purpose, the control unit is connected to the components involved via signal lines. The control unit can comprise a computer-readable storage medium and a processing unit, wherein the storage medium comprises instructions implementing the software which, when executed by the processing unit (designed as a computer), cause it to carry out the corresponding method steps.
[0041] Preferably, the at least one lighting device comprises at least one micromirror actuator. The micromirror actuator modulates light generated by at least one light source of the lighting device with high resolution to create the desired illuminated area. The micromirror actuator preferably comprises matrix-arranged, reflective individual elements or micromirrors that can be tilted. The light source is preferably at least one light-emitting diode (LED) that can generate light of different brightness and / or different colors.
[0042] Further advantages, features and details of the present invention will become apparent from the exemplary embodiments described below and from the figures. These show schematically: Fig. 1 a schematic top view of a motor vehicle according to an embodiment according to the invention, by means of which several methods according to the invention are explained, each according to an embodiment, Fig. 2 a perspective view of the passenger compartment of the motor vehicle of the Fig. 1, relating to a first embodiment of the method according to the invention, Fig. 3 a perspective view of the environment of the motor vehicle Fig. 1, concerning the first embodiment of the method according to the invention, Fig. 4. A representation of a touchscreen of the motor vehicle. Fig. 1, which displays an image representation within the framework of a second embodiment of a method according to the invention, Fig. 5 a representation of a touchscreen of the motor vehicle of the Fig. 1, which displays an image representation within the framework of a third embodiment of a method according to the invention, and Fig. 6. A perspective view of the environment of the motor vehicle. Fig. 1 concerning the third embodiment of the method according to the invention.
[0043] Fig. Figure 1 shows a bird's-eye view of a motor vehicle 1 according to an embodiment of the invention, wherein the motor vehicle 1 comprises several lighting devices 2 by means of which an area 3 surrounding the motor vehicle 1 is illuminated. Two of the lighting devices 2 are headlights, two of the lighting devices 2 are side lights, and two of the lighting devices 2 are rear lights of the motor vehicle 1. Although all aspects explained below relate to the headlights, these can also be implemented additionally or alternatively by means of the other lighting devices 2. Furthermore, it is assumed below that the motor vehicle 1 is stationary, i.e., parked.
[0044] The lighting devices 2 each comprise a micromirror actuator (not shown in the figures) and a light source comprising several light-emitting diodes (LEDs). The micromirror actuator modulates the light generated by the light source with high resolution to produce a desired light distribution. For this purpose, the micromirror actuator includes matrix-arranged, reflective micromirrors that can be tilted. Light of different colors and brightness levels can be generated by the LEDs. The light distribution achievable by the micromirror actuator relates to the beam angle-dependent brightness and color of the light emitted by the respective lighting device 2.
[0045] The following also refers to the Fig. 2 Reference is made to Figure 2, which shows a perspective view of an occupant compartment 4 of the motor vehicle 1. In the occupant compartment 4, specifically on a console forming a dashboard, a touchscreen 5 with a touch-sensitive display surface 6 is arranged, wherein an image 7 of the environment 3 is displayed in the area of the display surface 6.
[0046] Now, with reference to the Fig. 1, Fig. 2 to Fig. 3 a method according to the invention in a first embodiment is explained, which is based on the one described in the Fig. The procedure is carried out on the motor vehicle shown in section 1. Regarding all embodiments, it should be noted that all features and aspects of each embodiment are, in principle, equally transferable to the other embodiments, provided this is reasonably possible and does not contradict the respective embodiment.
[0047] Fig. Figure 3 shows a perspective view of the environment 3 of the vehicle 1. In a first step of the procedure, image data relating to a frontal part of the environment 3 are acquired using a camera 8 of the vehicle 1. The image data is in the form of a two-dimensional array of image points or pixels, each of which is assigned a brightness and a color value.
[0048] In the next step, the image display 7 is shown on the touchscreen 5 in such a way that it depicts the part of the environment 3 captured by the camera 8. The image display 7 realizes a two-dimensional projection of this part of the environment 3, with a corresponding imaginary projection surface 9 in the Fig. Figure 3 is shown as an example. The image representation 7 displayed on the display area 6 refers to the projection surface 9 from the camera's perspective 8.
[0049] In the next step, user 30 specifies a desired illumination area 11 of the environment 3, which is to be illuminated by the lighting devices 2. To do this, user 30 marks an image area 10 of the display 7 by touching the display surface 6 with their finger. This marks and defines the image area. This is done by drawing freehand on the display surface 6. The image area 10 corresponds to the desired illumination area 11. When user 30's finger touches a point on the display surface 6, a sensor signal is generated. This signal is used by a control unit of the touchscreen 5 to determine that the touch occurred and its location on the display surface 6.The result of this evaluation is a data set presented as image data, realizing image area 10, in which each pixel is assigned information indicating whether it lies within the illumination area 11. Similarly, the specification of several separate image areas 10 is also conceivable.
[0050] Based on image area 10, a control unit 12 of the vehicle 1 generates control signals and outputs them to the lighting devices 2. These control signals cause the lighting devices 2 to generate a lighting area 11 that corresponds to the desired lighting area 11. For this purpose, the result of the evaluation of image area 10, i.e., the corresponding image data, as described above, is used. Thus, the control signals cause the generation of illumination by one or more of the lighting devices 2 according to a light distribution specified by image area 10. The light distribution defines a relationship between a spatial direction emanating from the lighting device 2 and the parameters of the light emitted in this spatial direction, i.e., the brightness and the color.For this purpose, the control unit converts the image data relating to image area 10 into the light distribution, so that the resulting actual illuminated area 11 corresponds to the desired illuminated area 11. A light cone 16 emitted by the lighting device 2 and realizing the illuminated area 11 strikes the imaginary projection surface 9 in such a way that the area of the projection surface 9 illuminated by the light of the light cone 16 corresponds to the image area 10 on the display surface 6 or the image display 7. Fig. For the sake of clarity, only one of the lighting devices 2 of the light cone 16 is shown.
[0051] As already mentioned, the evaluation of the image data realizing image area 10 and the generation of the control signals are carried out by means of the control unit 12. Thus, the procedural steps provided for in the execution of the procedure, in particular the data evaluation described above, are carried out by means of software 13 implemented by the control unit 12, which implements a trained artificial intelligence. The control unit comprises a computer-readable storage medium 14 and a processing unit 15, wherein the storage medium 14 contains instructions implementing the software 13, which, when executed by the processing unit 15 (designed as a computer), cause it to carry out the corresponding procedural steps, in particular to generate the control signals.
[0052] Now, with reference to the Fig. 4 a method according to the invention in a second embodiment is explained, which also applies to the motor vehicle 1 of the Fig. 1 is carried out. Fig. Figure 4 shows the touchscreen 5 along with an image display 7. In principle, the further procedure can correspond to the steps already explained in connection with the first embodiment. In addition, in the second embodiment, the image data and the software 13 automatically detect sections 17 and objects 18 visible on the image display 7 and thus present in the environment 3. This also includes an automated classification of the sections 17 and objects 18. Thus, one section 17 is classified as a path 19, one of the objects 18 as an animal 20, one of the objects 18 as a person 21, and two of the objects 18 as a tree 22 each. For each of the sections 17 and for each of the objects 18, a detection area 23 is displayed in the image display 7, with a marker for the respective detection area 23 being a semi-transparent, colored area superimposed on the image display 7. Fig. 4 is indicated by dashed lines. Although this is shown in the Fig. Since 4 is not shown, a text field is displayed for each recognition area 23, by means of which a designation of the respective classification is given in text form. In this embodiment, the selection of the desired illuminated area 11 is made by the user 30 tapping at least one of the recognition areas 23 on the display surface 6, which results in the respective recognition area 23 being specified as the desired image area 10.
[0053] Alternatively, the markers relating to the respective recognition areas 23 can be omitted, allowing the user 30 to tap and mark a location on the display area 6. The system then automatically checks whether this location lies within one of the recognition areas 23 that can be assigned to a recognized section 17 or object 18. If so, this recognition area 23 is specified as the desired image area 10.
[0054] Furthermore, a slider 24 is displayed on display area 6, which is in Fig. 4 is shown to the right of the touchscreen 5 for clarity. Once the user 30 has selected one of the recognition areas 23 as the desired image area 11, they can use the slider 24 to specify the desired overall brightness for the illuminated area 11. The brightness distribution across the illuminated area 11 remains constant. To specify the overall brightness, the user 30 can use the slider 24 to set a value between 1% and 100%, where 1% represents the minimum and 100% the maximum achievable overall brightness. Before the user 30 uses the slider 24, a value for the overall brightness is automatically suggested based on the ambient brightness detected by the camera 8. By tapping a button with a checkmark, the user 30 can then confirm their selection, which is subsequently implemented.
[0055] Furthermore, a control menu 25 comprising several buttons 26 is displayed on the display area 6, which is in Fig. 4 is shown to the left of the touchscreen 5 for clarity. Instead of explicitly selecting one of the detection areas 23 as the image area 10, the user 30 can tap one of the buttons 26 to initiate an automated selection of at least one of the detection areas 23 as the image area 10 within a predefined scenario. Tapping one of the buttons 26 thus triggers a corresponding scenario signal, which is transmitted to the control unit 12. The control unit 12 then makes a scenario-specific selection of at least one of the detection areas 23 as the image area 10 to specify the desired illumination area 11. The previously mentioned classifications of the detection areas 23 serve as the selection criterion.
[0056] One of the generable scenario signals is a path lighting signal, which is generated by tapping the top button 26, which bears a pictogram depicting a road. Within this scenario, the detection area 23 relating to path 19 is selected as image area 10. In this scenario, only path 19 in the surrounding area 3 is illuminated, which is useful, for example, if an occupant is currently exiting vehicle 1 and following path 19 to their front door.
[0057] Another of the generable scenario signals is an emergency signal, which is generated by tapping the second-from-top button 26, labeled "SOS". Within this scenario, the detection area 23 relating to path 19 and the detection area 23 relating to person 21 are selected as image areas 10, with the highest possible overall brightness automatically set for the corresponding illuminated areas 11. This scenario implements a countermeasure against a malicious act by person 21, such as an attack or harassment of the user. When the emergency signal is triggered, an emergency announcement is also made via the vehicle 1 to alert other passersby to the emergency.The emergency signal is indicated by all lighting devices 2 as a red flashing signal, and an alarm tone is also emitted via an acoustic output device of the vehicle 1, namely a horn. Furthermore, an emergency call can be automatically placed when the emergency signal is present.
[0058] Another aspect of the emergency scenario concerns the fact that a detection device 29, in this case camera 8, automatically detects changes in the situation in the environment 3 over time. Specifically, a change in the position of person 23 is detected, whereby the image area 10 or illumination area 11 relating to person 23 is automatically adapted such that the illumination area 11 is tracked so that the moving person 23 remains within this illumination area 11.
[0059] Another of the scenario signals is an animal observation signal, which is generated when the bottom button 26, bearing an animal pictogram, is tapped. Following this, only the detection area 23 pertaining to animal 20 is selected as image area 10 to enable observation of animal 20. The overall brightness is automatically adjusted to a sufficiently low level to prevent glare for animal 20. The illuminated area 11 is also automatically tracked, as already explained in connection with the emergency signal.
[0060] Another of the generable scenario signals is a parking signal, which is generated when the second-lowest button 26 is tapped; this button bears a pictogram showing a parking symbol. Within this scenario, only recognition areas 23 that have been identified as parking spaces during classification are selected as image areas 10. This is also useful if an occupant is currently exiting vehicle 1 and walking home across the parking lot.
[0061] Finally, another of the generable scenario signals is an outdoor activity signal, which is generated by tapping the middle button 26, which bears a pictogram of a tent. The outdoor activity signal is exemplified by an outdoor activity related to holding a tent camp. Within this scenario, only one detection area 23 is selected as image area 10, which is classified as an activity area. The activity area corresponds to a section of the image display 7 in which at least one object classified as a tent is present. Furthermore, detection areas 23 are selected as desired image areas 10, each assigned to a person 21. The automated tracking of the respective illuminated areas 11 also takes place here, as already explained in connection with the emergency signal.This is useful, for example, because these persons 21 are provided with appropriate lighting when collecting wood for a campfire.
[0062] Finally, with reference to the Fig. 5 and Fig. 6 a method according to the invention in a third embodiment is explained, which also applies to the motor vehicle 1 of the Fig. 1 is carried out. Fig. Figure 5 shows the touchscreen 5 along with an image display 7. Fig. Figure 6 shows a perspective view of the environment 3 of the motor vehicle 1 together with the motor vehicle 1 relating to this embodiment.
[0063] As from the Fig.As can be seen in Figure 5, there is a road in the area 3 in front of the vehicle. By selecting a corresponding menu item, a control menu 25 with several buttons 26 is displayed on the display area 6. By selecting or tapping one of the buttons 26, a desired brightness distribution within the desired illumination area 11 is automatically specified, and an image 28 is displayed when this distribution is implemented.
[0064] When the top button 26, which bears a pictogram of a knight from a chessboard, is tapped, the brightness distribution is adjusted so that the image 28 displayed by the illuminated area 11 represents a chessboard. If the user 30 taps this button 26, a corresponding image area 10 is automatically displayed on the screen 7. Sensor-detected information is taken into account, such as the current inclination of the vehicle 1 and the distance to the image 28 to be generated by the corresponding illuminated area 11. As a result, the suggested image area 10 is perspectively distorted on the screen 7 so that the image 28 actually generated on the road has the desired proportions, i.e., the chessboard is square.User 30 can move, enlarge, or reduce the proposed image area 10 by touching the display area 7, if desired. Tapping a button with a checkmark displayed on the display area 7 generates the control signals from the control unit 12 to create the desired illuminated area 11.
[0065] Similarly, when the middle button 26 is tapped, the illuminated area 11 is generated such that the resulting image 28 depicts a football field. Furthermore, when the bottom button 26 is tapped, the illuminated area 11 is generated in a similar manner, such that the resulting image 28 depicts the squares of the hopscotch game "Heaven and Hell," which is very popular with children.
[0066] Finally, a situation is assumed in which user 30 has specified the chessboard as the image 28 to be generated and has then left the vehicle 1. He then notices that the size and positioning of the illuminated area 11, or image 28, do not yet meet his expectations and wishes to make changes. For this purpose, a detection device 31, which is the camera 8, records any changes made by user 30, who is located in the vicinity 3, that are directed towards the desired changes to the illuminated area 11, or image 28. First, user 30 is authenticated using facial recognition software implemented by the control device 12. The changes are then made by gestures made with user 30's hands.Specifically, the user 30 moves the illuminated area 11 by corresponding hand movements. Alternatively, or in addition, the user enlarges or reduces the illuminated area 11 by moving their hands apart or towards each other. These gestures, and thus the actions to change the illuminated area 11, are automatically recognized by the software 13 based on the image data captured by the detection device 31, and effect the desired changes to the illuminated area 11. QUOTES INCLUDED IN THE DESCRIPTION
[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature
[0000] DE 10 2020 126 251 A1
[0003] DE 10 2012 024 513 A1
[0004]
Claims
[1] Method for illuminating the surroundings (3) of a motor vehicle (1), in particular when stationary, comprising the following steps: a) Capture of image data relating to at least part of the environment (3) using at least one camera (8), b) Displaying an image representation (7) of the environment (3) or part of the environment (3) using a display area (6) of a touchscreen (5) and based on the image data, c) Specifying at least one desired illumination area (11) of the environment (3) by having a user (30) mark at least one image area (10) of the image display (7) corresponding to the at least one desired illumination area (11) by touching the touch-sensitive display surface (6), d) generating control signals by means of a control device (12) based on the at least one image area (10) and outputting the control signals to at least one lighting device (2) of the motor vehicle (1), so that at least one lighting area (11) in the surroundings (3) is illuminated by means of the at least one lighting device (2) which corresponds to the at least one desired lighting area (11). [2] Method according to claim 1, characterized by, that the image data relates to a two-dimensional projection of the environment (3) onto an imaginary projection surface (9), wherein the projection is displayed in step b) as the image representation (7) such that the image area (10) corresponds to an area on the projection surface (9), wherein in step d) the control signals are generated such that a light cone (16) generated by means of the at least one lighting device (2) strikes the area of the projection surface (9) corresponding to the image area (10). [3] Method according to claim 1 or 2, characterized by , that in step c) at least one image area (10) is specified by freehand drawing on the display surface (6). [4] Method according to any of the preceding claims, characterized by, that in step c) the specification of at least one image area (10) is carried out or the user (30) is supported in the specification by an automated, in particular by means of an artificial intelligence, recognition of at least one section (17) and / or object (18) present in the environment (3) and shown in the image display (7). [5] Method according to claim 4, characterized by , that in step c) at least one recognition area (23) of the image display (7) is displayed, which relates to an automatically recognized section (17) and / or an automatically recognized object (18), wherein the at least one recognition area (23) can be selected by the user (30) as the at least one image area (10), in particular by tapping the display area (6) in the at least one recognition area (23). [6] Method according to claim 4 or 5, characterized by, that in step c) a location on the display area (6) marked by the user (30), in particular by tapping the display area (6), with regard to whether this location lies within a recognition area (23) of the image display (7) which concerns an automatically recognized section (17) and / or an automatically recognized object (18), wherein in this case this recognition area (23) is defined as the at least one image area (10). [7] Method according to any one of claims 4 to 6, characterized by , that, based on at least one scenario signal specified by the user (30) and by means of an input device, an automated specification of the at least one desired illumination area (11) takes place, wherein this specification is based on the automated recognition of the at least one section (17) and / or object (18). [8] Method according to claim 7, characterized bythat the scenario signal or one of the scenario signals - a path lighting signal, in the presence of which at least one desired lighting area (11) affects at least one automatically detected path (19), and / or - an emergency signal, in the presence of which, in particular with the additional issuance of an emergency output by means of the motor vehicle (1), concerns at least one desired illumination area (11), at least one automatically detected path (19) and / or at least one detected person (21), and / or - an outdoor activity signal, the presence of which affects at least one desired illumination area (11) at least one automatically detected activity area of the environment (3) in which an outdoor activity takes place, and / or at least one detected person (21), and / or - a parking signal, in the presence of which at least one desired illuminated area (11) covers at least one automatically detected parking space, and / or - is an animal observation signal, the presence of which affects at least one desired illumination area (11) and at least one automatically detected animal (20). [9] Method according to any of the preceding claims, characterized by , that by means of at least one detection device (29), which in particular is the at least one camera (8), a temporal change of a situation in the environment (3), concerning in particular the at least one section (17) and / or the at least one object (18), is detected, wherein an adaptation of the at least one desired illumination area (11) is carried out automatically on the basis of the detected temporal change. [10] Method according to any one of claims 4 to 8 and according to claim 9, characterized by, that the automated adaptation causes the at least one illumination area (11) to be tracked in such a way that the at least one moving object (18) remains within the respective illumination area (11). [11] Method according to any of the preceding claims, characterized by , that in step c) for the illuminating area (11) or at least one of the illuminating areas (11) a desired overall brightness and / or brightness distribution within the respective illuminating area (11) is specified by the user (30) and / or automatically, wherein in step d) the control signals are generated in such a way that the illuminating area (11) is illuminated by generating an overall brightness and / or brightness distribution that corresponds to the desired overall brightness and / or brightness distribution. [12] Method according to claim 11, characterized by, that at least one predefined brightness distribution selectable by the user (30) is proposed, in the implementation of which in particular an image (28) is displayed. [13] Method according to any of the preceding claims, characterized by , that by means of at least one detection device (31), in particular the at least one camera (8), a change action performed by the user (30) located in the vicinity (3), in particular a gesture directed towards a desired change of the at least one illumination area (11), is detected, wherein a change of the at least one desired illumination area (11) is carried out on the basis of the change action. [14] Motor vehicle (1) comprising a control device (12), - wherein image data relating to at least part of the surroundings (3) can be captured by means of at least one camera (8) of the motor vehicle (1), - wherein control signals can be generated by means of the control device (12) and output to a touchscreen (5) of the motor vehicle (1), so that an image display (7) of the environment (3) or part of the environment (3) can be displayed on a display surface (6) of the touchscreen (5) using the image data, - wherein at least one desired illumination area (11) of the environment (3) can be specified by a user (30) touching at least one image area (10) of the image display (7) corresponding to the at least one desired illumination area (11) of the touch-sensitive display surface (6), - wherein control signals can be generated on the basis of the at least one image area (10) and by means of the control device (12) and output to at least one lighting device (2) of the motor vehicle (1), so that at least one lighting area (11) in the surroundings (3) is illuminated by means of the at least one lighting device (2) which corresponds to the at least one desired lighting area (11). [15] Motor vehicle (1) according to claim 14, characterized by , that the at least one lighting device (2) comprises at least one micromirror actuator.