Display system

Abstract

The invention relates to a display system for at least one window pane of a window of an interior (2) of a vehicle, said display system having a light-emitting element arranged on the at least one window pane, at least one control device (34) and at least one sensor for detecting the environment of the vehicle, said at least one sensor being designed to detect the environment of the vehicle, at least one object in the environment of the vehicle is detected, the at least one control device (34) is designed to activate at least one light-emitting element on the at least one window pane, which light-emitting element is assigned to the at least one object detected in the environment on the basis of a viewing angle of an observer from the interior (2) through the at least one window pane, the activated at least one light-emitting element is designed to mark the at least one object.

Description

Technical Field

[0001] The invention relates to a display system and a method for operating a display system. Background Art

[0002] A display device integrated into the windshield of a vehicle is known from US 2021 / 063738 A1.

[0003] Document DE 20 2015 009 229 U1 describes a glazing unit for a vehicle windshield with an integrated optical signaling function. Summary of the Invention

[0004] Against this background, it is an object of the present invention to present the vehicle surroundings in a suitable manner for the vehicle occupants.

[0005] This object is achieved by a display system and a method having the features of the independent claims. Embodiments of the display system and the method are derived from the dependent claims and the description.

[0006] The display system according to the present invention is designed for at least one window pane of a vehicle, such as a vehicle window, which is typically oriented to the outside and / or closes off the vehicle interior. The display system includes lighting elements or light sources, which are typically arranged in a regularly and / or uniformly distributed manner on the at least one window pane or corresponding window panes and typically completely and / or over the entire surface of the at least one window pane or corresponding window pane. Furthermore, the display system includes at least one control device and at least one sensor for detecting the environment outside the vehicle. The at least one sensor, such as a camera, radar sensor, lidar sensor, or ultrasonic sensor, is designed to detect at least one object in the vehicle's environment. The at least one control device, which can be designed and / or referred to as a computing unit, is designed to activate at least one lighting element on the at least one window pane. The at least one lighting element is assigned to the at least one detected object in the environment based on the viewing angle of an observer in the interior through the at least one window pane. The activated at least one lighting element is designed to mark the at least one object with at least one assigned label and / or to mark the at least one object with the at least one assigned label, typically based on the viewing angle of the observer.

[0007] Typically, the light-emitting elements are arranged in at least one strip on at least one window pane, which, in a design, completely covers the respective window pane. Each of these strips is transparent and has a plurality of light-emitting elements distributed regularly and / or evenly. In a design, the at least one strip is fixed, for example, adhesively bonded, to the inner side of the respective window pane facing the interior. Typically, the display system comprises a plurality of such strips, which are oriented parallel to one another, for example, horizontally (optionally only horizontally) and / or vertically (optionally only vertically), and arranged flush with one another on at least one window pane. These strips can, for example, be arranged in a matrix pattern. However, it is also possible for all light-emitting elements to be arranged in a single strip, which can completely cover the respective window pane. In a design, the light-emitting elements are arranged in a region consisting of rows and columns on at least one window pane. The light-emitting elements can be arranged with uniform density on at least one window pane, thereby utilizing the entire surface of the respective window pane.

[0008] In design solutions, digital light-emitting elements are typically designed as light-emitting diodes (LEDs), such as organic light-emitting diodes (OLEDs) or micro-LEDs (μLEDs). When activated, the LEDs display a color. When deactivated, they are transparent. These LEDs each have a maximum dimension or size, i.e., length, width, and / or height, of 1 mm.

[0009] The design concept provides for at least one control device to exchange data with at least one driver assistance system of the vehicle. This at least one driver assistance system, which may also be designed as a component of a display system, is designed to assist the driver as a vehicle occupant and, in this case, typically monitor, for example, control, and / or regulate vehicle driving according to the currently set vehicle automation level. This is possible, for example, for Level 2, Level 3, Level 4, or Level 5. Levels 2 to 5 represent assisted, partially automated, highly automated, fully automated, or unmanned driving of the vehicle, with the respective assisted and / or at least partially automated driving corresponding to each level.

[0010] Furthermore, at least one driver assistance system is designed to detect, identify, and / or determine at least one object to be marked from a plurality of objects in the environment using a sensor. At least one sensor for the environment, such as a camera, a radar sensor, or another sensor for detecting the environment, provides the at least one driver assistance system with an image of the environment, which is evaluated by the at least one driver assistance system, wherein the at least one driver assistance system also identifies objects to be marked in the environment. A display system typically includes multiple driver assistance systems, multiple sensors for detecting the environment, and multiple control devices as components.

[0011] At least one driver assistance system can analyze and process data detected by sensors and respond accordingly to changes in the environment, such as the movement of other road users, such as external vehicles. Traffic signs can also be detected and marked, particularly when they indicate a speed limit (e.g., 50 km / h). The marking can have at least one specific color and be static or dynamic, such as flashing to indicate, for example, that the vehicle's set speed has been automatically adjusted or that the vehicle's speed has been automatically reduced. Furthermore, it is possible for objects in the environment to be detected or already identified, even though they are not yet visible through the windshield. These objects can be displayed in advance by markings on the edge of the window pane (e.g., by displaying a traffic sign at the top edge).

[0012] Typically, a display system is provided and / or used for a vehicle front window, which is designed as a windshield or windshield. However, a display system can also be provided and / or used for other vehicle windows, such as side windows or a rear window. Objects that are approaching the vehicle from behind or driving alongside the vehicle and approaching the vehicle as the relative distance decreases, for example, when the distance is less than a predetermined limit and the object is within the visible range, can also be marked on the side windows or rear window.

[0013] Furthermore, the display system may include at least one sensor for detecting the vehicle interior, such as a camera, which is designed to detect the gaze direction of the head and / or eyes of an occupant, acting as an observer in the vehicle interior, looking through at least one window pane into the surroundings. Based on the head or the position of the head in the interior and / or the gaze direction of the eyes, the viewing angle and / or field of view of the observer from the interior through the at least one window pane into the surroundings is determined. Furthermore, at least one light element to be activated is determined, which is assigned to at least one object detected in the surroundings based on the viewing angle of the observer.

[0014] The method according to the present invention is designed to operate a display system for at least one window pane of the interior of a vehicle, such as a motor vehicle, such as the aforementioned embodiments of the display system. The display system comprises light-emitting elements arranged on the at least one window pane, at least one control unit, and at least one sensor for detecting the vehicle's surroundings. The at least one sensor detects at least one object in the vehicle's surroundings. At least one light-emitting element on the at least one window pane is selectively activated and, for example, color-set by the at least one control unit. The at least one light-emitting element is assigned to the at least one object detected in the surroundings based on the viewing angle of an observer from the interior through the at least one window pane. All other light-emitting elements arranged on the at least one window pane are deactivated or remain deactivated. Furthermore, the at least one object is marked by the activated at least one light-emitting element.

[0015] In one embodiment, the corresponding activated light elements are colored with a color selected for them, wherein the correspondingly colored light elements for the environment and the objects to be marked are or remain transparent. In one embodiment, at least one driver assistance system checks which of at least one detected object in the environment is relevant / important for the vehicle's typically current travel and / or driving situation. The at least one driver assistance system selects the at least one object that is relevant for the driving situation from a number of objects in the environment detected by sensors. At least one driver assistance system, which exchanges data with at least one control device, typically takes into account a determined observer perspective, marks the at least one object that is relevant and / or classified as such by the driver assistance system with at least one light element. The at least one light element is controlled and activated, for example, digitally, by the at least one driver assistance system and / or by the at least one control device, wherein the corresponding color is also selected and set based on the object's importance.

[0016] In this case, it is proposed that at least one traffic participant (typically another oncoming vehicle, such as an external vehicle or a pedestrian), typically a stationary installation (such as a building), vegetation (such as a tree), and / or a traffic sign (such as a traffic sign) or lighting device (typically a traffic light) be marked with at least one color as at least one object. At least one driver assistance system (FAS) automatically identifies the corresponding object detected and / or recorded by at least one sensor, i.e., only one sensor or multiple sensors, of the environment and determines its relevance for the respective travel and / or driving situation.

[0017] The importance of an identified or recognized object can be automatically determined by at least one driver assistance system based on at least one kinematic parameter of the object, such as the object's position, velocity, and / or acceleration relative to the host vehicle or ego vehicle. A distinction can be made here between whether the object is located on the road or lane being driven by the vehicle or adjacent to it, such as on an oncoming lane or on a side road. It can also be determined whether an object is located on the planned trajectory of the ego vehicle. The closer the distance between the object and the ego vehicle, the more important the object. Furthermore, if the distance between a moving object and the moving ego vehicle decreases, the object becomes more important, while if the distance increases, the object's importance decreases.

[0018] In one embodiment, at least one activated light-emitting element generates a symbol that is assigned to at least one object to mark it. The type of symbol and / or its corresponding assigned color can depend on the importance, status, and / or movement of the object to be marked. Thus, particularly critical objects can be assigned a symbol and / or sign with a so-called warning color, such as red or yellow, to warn against them. Less critical objects can simply be assigned a so-called indicator color, such as green or blue. In one embodiment, a color spectrum / color range can be set and / or defined, for example, individually by the vehicle driver, with each color assigned a specific importance or status. It is also possible for the corresponding marking to be static or dynamic, in the latter case flashing and / or including an animation to mark the object. The corresponding color can reflect the state and / or importance of the object. Colors can be assigned to definable limits of corresponding kinematic parameters.

[0019] In one possible embodiment, at least one line of sight of the driver toward at least one object in the surroundings is determined based on the head of an interior passenger (e.g., a driver) detected by at least one sensor for the interior. Furthermore, at least one control device typically determines, for example, calculates, at least one point of intersection of the at least one line of sight with at least one window pane, wherein at least one light-emitting element is activated at the at least one point of intersection or at a position determined therefor on the at least one window pane, and the object is marked.

[0020] This display system and method can be used to provide enhanced windshield marking of objects on and / or in a windshield using digital light-emitting diodes as light-emitting elements. A corresponding enhanced windshield has light-emitting elements arranged in rows and / or columns, typically programmable. Each light-emitting element, for example, designed as a light-emitting diode, can be controlled via a transparent electrode, which connects the light-emitting element to at least one control device.

[0021] A plurality of adjacent light-emitting elements can be connected to one another along corresponding horizontal or vertical lines by thin and / or fine wires, such as guide wires. The resulting visual restriction of the surroundings is similar to that caused by the thin guide wires of a heated windshield and is therefore negligible.

[0022] This method can be implemented, for example, for a Level 2 or Level 3 situation, or a fully automated driving situation, of the host vehicle as at least a semi-automated driving situation. Here, the vehicle or its corresponding driving situation (Level 1 or Level 2) is assisted by or with the aid of at least one driver assistance system and / or is at least partially automatically or autonomously monitored, i.e., controlled, and / or regulated. The at least one driver assistance system automatically responds to objects in the environment, automatically maintains a distance to such objects, automatically maintains a speed specified for the route, and / or automatically responds to changes in the external or environmental situation, i.e., the often dynamically changing arrangement of objects in the environment relative to the host vehicle. These objects can be detected and marked, for example, based on their significance, on at least one reinforced window pane, such as a windshield. This allows the driver, who is still responsible for driving, to quickly determine whether external objects have been correctly identified and / or whether the vehicle is responding, controlled, and / or regulated correctly.

[0023] In this method, objects to be marked are each assigned at least one marker based on the observer's perspective, wherein the real object or the object directly visible through at least one window pane is marked on the at least one window pane by the at least one marker assigned to it, for example, superimposed and / or overlaid. If an object is marked by multiple activated light elements or multiple markers, these markers can form an area. At least one control device and / or at least one driver assistance system compares the position of the real object in the environment with the position of at least one marker assigned to it on the windshield, wherein the position of the at least one marker on the at least one window pane can be geometrically associated / correlated with the position of the marker on the at least one window pane according to the aforementioned intersection point. The marker on the at least one window pane is directly associated with the environment or surroundings and objects located at different positions therein, wherein each object is directly associated with at least one marker.

[0024] This significantly reduces the complexity of the display, the time required for the driver to compare objects, and the cognitive burden. Furthermore, the potential for driver distraction, particularly due to averted vision, is reduced. In one embodiment, a window pane, such as a windshield, serves as an information display for the driver and / or at least one driver assistance system. In this method, sensors already present on and / or in the vehicle can be used to detect the environment and / or interior. The environment or image of the environment detected by the sensors is typically analyzed by at least one control unit and / or at least one driver assistance system for the presence of critical objects.

[0025] Each marker provided as information is based on and / or relates to at least one driver assistance system, wherein the marker displays feedback from the at least one driver assistance system that is relevant to the driver. This display system and method allow for an enhanced display of the markers of objects and their corresponding states across the entire surface of the windshield. Different objects distributed in the environment can be visually emphasized by the markers displayed by light-emitting elements distributed across the windshield. If this display system or method is used for side windows or rear windows, objects located in adjacent lanes or behind the vehicle, and therefore within a 360° radius of the vehicle, and / or objects at greater distances from the vehicle, can also be displayed.

[0026] It goes without saying that the features mentioned above and those yet to be explained below can be used not only in the respectively specified combination but also in other combinations or alone without departing from the scope of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The invention is described schematically and in detail based on exemplary embodiments which are schematically illustrated in the drawings and with reference to the drawings.

[0028] Figure 1a 、 Figure 1b An embodiment of the display system according to the invention for carrying out an embodiment of the method according to the invention is shown schematically.

[0029] List of reference numerals:

[0030] 2 Inner Room

[0031] 4 Steering wheel

[0032] 6 Center console

[0033] 8 A-pillar

[0034] 10 Windshield

[0035] 12 side windows

[0036] 14 strips

[0037] 20, 22 External vehicles

[0038] 24 Traffic Signs

[0039] 26, 28 marks

[0040] 30, 32 sensors

[0041] 34 Control Device

[0042] 36 Driver Assistance Systems DETAILED DESCRIPTION

[0043] The accompanying drawings are described in relation and generally. Like reference numerals denote like parts.

[0044] Figure 1a and Figure 1b The interior 2 of a vehicle, designed here as a motor vehicle and hereinafter also referred to as the host vehicle, is shown. Furthermore, a steering wheel 4 and a center console 6 are arranged in the interior 2. Furthermore, seats (not shown further) for the vehicle occupants are also provided, namely a driver's seat for the driver and a passenger seat for the front passenger. The driver drives the vehicle using the steering wheel 4. The vehicle has two A-pillars 8 as support elements, between which a window pane designed as a windshield 10 is arranged. Figure 1a and Figure 1b Also shown are two window panes designed as side windows 12 , which are arranged on the left and right sides of the longitudinal sides of the vehicle.

[0045] An embodiment of the display system according to the present invention comprises a plurality of transparent strips 14 having light-emitting diodes as light-emitting elements, wherein the light-emitting diodes are evenly distributed over each strip 14. The strips 14 are arranged horizontally one above the other on the inside of the windshield 10 and thereby completely and / or over the entire surface of the windshield 10. In the embodiment presented here, the light-emitting diodes are distributed completely and / or over the entire surface of the windshield 10 in the strips 14, for example, with a uniform density or with a uniform density, wherein each light-emitting element is arranged between a plurality of directly adjacent light-emitting elements and has the same spacing from each directly adjacent light-emitting element.

[0046] In one embodiment, a strip 14 with light-emitting diodes can also be arranged on the inside of the side windows 12 or rear window. In addition, the display system has at least one first sensor 30 for detecting the vehicle environment outside the interior 2, such as a camera or a radar sensor, a second sensor 32 for detecting the interior 2 (here a camera), and a control device 34.

[0047] Figure 1a and Figure 1bAlso shown is a driver assistance system 36 of the vehicle, which is designed to assist the driver in manual driving, which is fully controlled by the driver, or in at least semi-automated driving, in which the vehicle is partially manually controlled by the driver and at least partially, if necessary, fully, automatically controlled by the driver assistance system 36. Driver assistance system 36 is also designed here for at least partially, if necessary, fully, automatic control of the vehicle. In the embodiment presented here, driver assistance system 36 is also designed as a component of the embodiment of the display system presented here.

[0048] In one embodiment of the method for operating a display system according to the present invention, at least one first sensor 30 for the environment detects the environment and objects located therein, here two vehicles acting as traffic participants (designated or referred to herein as external vehicles 20, 22) as the host vehicle, and traffic lights as traffic signs 24. Furthermore, these real objects in the environment are also visible to the driver as an observer from his or her driver's seat in the interior through each window pane, namely, through windshield 10, but also through each side window pane 12. A camera is used as a second sensor 32 for the interior 2 to detect the position of the head and / or the perspective, field of view, and / or gaze of at least one occupant, typically the driver, looking outward toward the environment.

[0049] In the method, driver assistance system 36 checks and / or determines, for each sensor-detected object in and / or from the environment, which of these objects is relevant for the host vehicle during or during driving, with respect to the respective current driving situation. Driver assistance system 36 also determines and / or determines the degree of relevance of the respective object. This relevance depends on at least one kinematic parameter of the respective object relative to the host vehicle, i.e., for example, the position and / or movement of the object relative to the host vehicle. The object becomes more relevant the closer the distance between the object and the host vehicle and / or if the distance between the object and the host vehicle decreases.

[0050] Here, the driver assistance system 36 determines which at least one object is to be marked. Information relating thereto is transmitted by the driver assistance system 36 to the control device 34 for monitoring (i.e., for controlling and / or regulating) the display system and the method. Taking this information into account, the control device 34 activates at least one light-emitting element on the windshield 10 . This at least one light-emitting element is assigned to the at least one object detected in the environment based on the sensor-detected viewing angle and / or head position of the driver as an observer looking through at least one window pane from the interior 2 . The at least one object is marked by the activated at least one light-emitting element.

[0051] In this case, at least one light element to be activated and / or activated is located at the point of intersection of the observer's line of sight with windshield 10, detected by a sensor and / or determined, for example, by control device 34, and calculated. A first light element is assigned a first marking 26 to a first external vehicle 20 and a second marking 28 to a traffic light as a traffic sign 24, since both objects are relevant to the driving situation. In contrast, no marking is assigned to another external vehicle 22, since it is not relevant to the driving situation.

[0052] For example, provision is made here for a driver assistance system 36 to adjust the host vehicle to a first external vehicle 20 traveling ahead, maintaining a distance to the external vehicle 20 and maintaining a speed, which can be referred to as a setpoint speed, of the host vehicle relative to the first external vehicle 20. Provision is made here for the driver assistance system 36 to function and / or be used as an Adaptive Cruise Assist (ACA) system. For this purpose, the first external vehicle 20 traveling ahead is marked green with a first marking 26. Similarly, other external vehicles in the surroundings, such as a second external vehicle 22 approaching from the left at an intersection, are detected, identified, and / or determined by at least one first sensor 30 and / or the driver assistance system 36. However, since this second external vehicle will only influence and / or could influence the host vehicle's turning maneuver in future driving situations, it is not yet marked in the current or present driving situation. At the same time, a traffic light is detected as a traffic sign 24 and its current red light is indicated; the traffic light is marked red with a second marking 28. If the traffic light switches to green, it is marked green. If the traffic light is switched to yellow, it is marked as yellow. Here, the traffic light is marked as a corresponding color corresponding to the color displayed by it and therefore corresponding to its state.

[0053] In one embodiment, this method can be used to check whether an object in the environment is detected by at least one first sensor 30 for the environment, which is designed as a camera, and / or by a driver assistance system 36, whether the object is correctly classified by, for example, the driver assistance system 36 based on its position in the environment, and whether the state and / or importance of the object is correctly colored. For example, a red traffic light can be colored red, and a green traffic light can be colored green. A first external vehicle 20 is colored green, for example, as long as it is traveling in front of the host vehicle. If the host vehicle overtakes first external vehicle 20, the first external vehicle is automatically colored differently due to the changed driving situation.

[0054] In the event of a takeover request to the driver for manual control of the initially at least semi-automatically or fully automatically controlled own vehicle, if a first external vehicle 20 traveling ahead suddenly brakes hard and the driver must take over control and driving tasks from the at least semi-automatic driving, the external vehicle 20 is automatically marked in red. When overtaking, the external vehicle 20 is temporarily marked in a neutral color, such as white, to indicate that the external vehicle is still recognized but no longer critical.

[0055] Typically, all objects in the surroundings, on which the host vehicle is controlled by the driver assistance system 36 and which are relevant for the current driving situation, at least other road users in the path of the host vehicle, are marked by selected lighting elements on the windshield 10. Depending on the driving situation, in the method, traffic signs on the roadside and other vehicles 20, 22, for example, next to the host vehicle, may also be marked by lighting elements on the side windows 12, or by lighting elements on the rear window.

[0056] The distribution and / or density of the LEDs in strip 14 generally depends on the design of the vehicle's window pane, here, for example, the windshield 10 , such as its size (particularly its surface area), its shape, its inclination relative to the vehicle's horizontal plane, and / or the vehicle type, such as a low / wide vehicle or a tall / tall vehicle. The individual LEDs can have a constant or variable spacing relative to one another in the horizontal direction and a constant or variable spacing relative to one another in the vertical direction. Typically, the driver looks out through the window pane from their seat. In this regard, the projection of the window pane perpendicular to the vehicle's forward direction of travel at the position of the driver's head or eyes can be considered. The density and / or distribution of the LEDs, and thus the density and / or distribution of the light-emitting elements on the window pane, is designed so that the distribution and / or density is uniform and / or homogeneous in a predetermined projection or projection plane perpendicular to the forward direction of travel. The window pane may be at least partially curved, if necessary. In a windshield installed at a significant angle, the light-emitting elements are distributed quite evenly. The flatter the windshield, the more the spacing between the light-emitting elements must be optimized in order to be able to mark objects in or from the surroundings well on the window pane.

Claims

1. A display system for at least one window pane of a window of an interior compartment (2) of a vehicle, wherein The display system comprises a light-emitting element arranged on at least one window pane, at least one control device (34) and at least one sensor for detecting an environment of the vehicle, wherein the at least one sensor is designed to detect at least one object in the environment of the vehicle, wherein the at least one control device (34) is designed to activate at least one light-emitting element on at least one window pane, wherein the at least one light-emitting element is assigned to at least one object detected in the environment based on the viewing angle of an observer from the interior (2) through the at least one window pane, wherein the activated at least one light-emitting element is designed to mark the at least one object.

2. The display system according to claim 1, wherein: The light-emitting elements are arranged in at least one strip (14) on at least one window pane.

3. The display system according to claim 1 or 2, characterized in that: The light-emitting element is designed as a light-emitting diode.

4. A display system according to any one of the preceding claims, characterized in that The at least one control device (34) exchanges data with at least one driver assistance system (36) of the vehicle, wherein the at least one driver assistance system (36) is designed to assist a driver of the vehicle and to determine at least one object to be marked from a plurality of objects in an environment.

5. Display system according to any one of the preceding claims, for a window pane of a vehicle designed as a windshield (10).

6. A method for operating a display system for at least one window pane of a window of an interior (2) of a vehicle, wherein: The display system comprises a light-emitting element arranged on at least one window pane, at least one control device (34) and at least one sensor for detecting an environment of the vehicle, wherein at least one object in the environment of the vehicle is detected by means of the at least one sensor, wherein at least one light-emitting element on the at least one window pane is activated by the at least one control device (34), the at least one light-emitting element being assigned to at least one object detected in the environment based on a viewing angle from an interior (2) through the at least one window pane, wherein the at least one object is marked by the at least one activated light-emitting element.

7. The method according to claim 6, characterized in that At least one driver assistance system (36) checks which object in the environment is relevant for driving the vehicle, wherein the at least one object is marked by the at least one light-emitting element.

8. The method according to claim 6 or 7, characterized in that At least one traffic participant, typically a vehicle, a pedestrian, and / or a traffic sign (24), as the at least one object is marked with at least one color.

9. The method according to any one of claims 6 to 8, characterized in that A symbol assigned to the at least one object is generated by the at least one light emitting element.

10. The method according to any one of claims 6 to 9, characterized in that At least one line of sight towards at least one object in the environment is determined based on the head of an observer in the interior (2), wherein at least one intersection point of the at least one line of sight with at least one window pane is determined, and wherein at least one light-emitting element is activated at the at least one intersection point.

Images