Method and apparatus for displaying graphic data by means of a display device in a vehicle

Abstract

Method for displaying graphic data using a display device (6) in a vehicle (8) designed to display graphic data in a three-dimensional view, wherein at least one area (1) around the vehicle (8) is detected and at least one object (5) is detected in the at least one area (1) around the vehicle (8), wherein the at least one area (1) around the vehicle (8) is visually displayed on the display device (6) in a two-dimensional view, the two-dimensional view being defined by an X and Y axis, and the detected object (5) is visually displayed in the two-dimensional representation of the at least one area (1) in a three-dimensional view, the three-dimensional view being defined by an X, Y and Z axis, wherein a distance of the vehicle (8) to the detected object (5) is determined, and the detected object (5) is visually displayed in the three-dimensional view.as soon as the distance to the detected object (5) falls below a predetermined threshold, the view of the detected object (5) is displayed shifted along the Z-axis depending on the distance of the vehicle (8) to the detected object (5).

Description

[0001] The present invention relates to a method for displaying graphic data by means of a display device in a vehicle, which is designed to display graphic data in a three-dimensional view, wherein at least one area around the vehicle is detected and at least one object in the at least one area around the vehicle is detected. The present invention further relates to a device for displaying graphic data in a vehicle, wherein the device comprises a display device, at least one first sensor, at least one second sensor, and a control device coupled to the display device and by means of which graphic data can be generated with the display device.

[0002] There are various known approaches to displaying objects on display devices and drawing the attention of a driver to objects, especially during parking maneuvers.

[0003] For example, DE 10 2004 047 475 A1 describes a method for directing a driver's attention to objects in an image recorded by a video camera. This method involves checking objects within the camera's field of view to determine their relevance to an expected movement of the vehicle. Relevant image elements are then highlighted.

[0004] Furthermore, DE 10 2008 037 073 A1 discloses a method for controlling a rearview mirror in a way that is dependent on the driving situation. This method involves detecting the immediate area around the vehicle and determining the distance to objects located in the extended immediate area of ​​the vehicle, from which a critical object is identified. The vehicle's rearview mirror is then adjusted so that the critical object moves into the driver's field of vision.

[0005] In addition, there are systems that warn the driver of objects, especially during parking maneuvers, either acoustically or via schematic color bars.

[0006] DE 10 2006 031 895 A1 discloses a display system for visualizing the distance to a vehicle ahead in road traffic. DE 10 2010 031 040 A1 further discloses a method for assisting a driver of a motor vehicle during a driving maneuver, in which the environment in the front and rear areas of the vehicle is detected and objects detected during the detection of the vehicle's environment are optically displayed in a two-dimensional or three-dimensional view in relation to the vehicle. In addition, DE 43 19 904 A1 discloses a warning device for displaying information in a motor vehicle.

[0007] With existing systems, it is difficult for a driver to understand which object in their environment poses a collision risk and triggers, for example, an acoustic warning.

[0008] The object of the invention is to provide a method for displaying graphic data by which a driver can intuitively determine which detected object in their surroundings poses a collision hazard. Furthermore, the object of the invention is to provide a corresponding device.

[0009] This problem is solved by a method according to the features of independent claim 1 and a device according to independent claim 5. Advantageous embodiments are shown in the dependent claims.

[0010] The present invention describes a method for displaying objects on a display device in a vehicle, which is designed to display an object in a three-dimensional view. For example, a stereo display, which is integrated, for instance, into a rearview mirror, a multifunction display, or an infotainment system, can be used for this purpose. A stereo display is a display device for showing stereoscopic or three-dimensional images to create a depth impression through stereoscopic vision by means of a screen or by projection. Furthermore, at least one area around the vehicle is detected. For example, a camera sensor can be used for this purpose. Additionally, at least one object is detected in the at least one area around the vehicle. For this purpose, for example, ultrasonic or radar sensors can be used.

[0011] According to the invention, the at least one area around the vehicle is visually displayed on the display device in a first and second dimension, and the detected object is visually displayed in a first, second, and third dimension. These dimensions are part of a Cartesian coordinate system. The first dimension, for example, represents the X-axis of a Cartesian coordinate system, the second dimension a Y-axis, and the third dimension a Z-axis. A two-dimensional image is displayed or projected onto the X- and Y-axes. The at least one area around the vehicle is thus visually displayed as a two-dimensional image on the X- and Y-axes of the display device. The detected object is additionally visually displayed on the Z-axis. The driver therefore perceives the detected object as if it were standing in space in front of the display device.In this way, the driver's attention is drawn to the detected object. The calculation of the object's location within at least one area is performed, for example, using an algorithm that processes graphic data and the vehicle's distance from the object in a control unit.

[0012] The distance between the vehicle and the detected obstacle is determined using a distance sensor.

[0013] The invention provides that the object is only displayed in a three-dimensional view when the distance between the vehicle and the detected object falls below a predetermined threshold. For example, the threshold is between half a meter and two meters, particularly one and a half meters.

[0014] Furthermore, the view of the detected object is shifted along the Z-axis depending on the distance between the vehicle and the detected object. For example, as the vehicle approaches the detected object, the graphic data of the detected object is shifted along the Z-axis in the direction of the driver.

[0015] According to a further development of the invention, the size of the three-dimensional view of the detected object is displayed varying depending on the distance of the vehicle to the detected object. For example, as the vehicle approaches the detected object, the graphic data of the detected object is enlarged.

[0016] In an advantageous design, the graphic data of the detected object is highlighted with a colored outline.

[0017] According to the invention, the color preferably changes depending on the distance between the vehicle and the detected object. For example, the graphic data of the detected object is displayed with a green border as soon as the vehicle is, for example, more than one meter away from the detected object. If the vehicle approaches the object to within half a meter, for example, the graphic data of the detected object is displayed with an orange border. If the vehicle approaches the detected object critically close, for example, less than half a meter, the graphic data of the detected object is displayed with a red border. According to the invention, a color change occurs depending on predetermined distances between the vehicle and the detected object. Furthermore, it is advantageous that the driver can determine the distances for the color change by entering a value into a control device.

[0018] In further training, it is inventive to provide the driver with additional acoustic signals when a color change takes place or has taken place.

[0019] The present invention further comprises a device for displaying graphic data in a vehicle, wherein the device includes a display unit designed to display graphic data in a three-dimensional view. The device further comprises at least one first sensor that detects at least one area around the vehicle and at least one second sensor that detects an object in the at least one area around the vehicle. The at least one first sensor is, for example, a camera. Preferably, already integrated camera systems can be used for this purpose, for example, a reversing camera, a camera of a lane keeping assist system and / or a traffic sign recognition system and / or a camera of an area-view system [system for displaying the vehicle's surroundings from a bird's-eye view]. The at least one second sensor is, for example, a distance sensor. Ultrasound or radar sensors are conceivable.Furthermore, the device includes a control unit that is coupled to the display unit and by means of which graphic data can be generated with the display unit. The control unit is designed such that the at least one area around the vehicle is visually displayed on the display unit in a two-dimensional view, wherein the two-dimensional view is defined by an X and Y axis, and the detected object in the two-dimensional representation of the at least one area is visually displayed in a three-dimensional view, wherein the three-dimensional view is defined by an X, Y, and Z axis.

[0020] According to the invention, the control device is designed in such a way that the distance between the vehicle and the detected object is determined.

[0021] Furthermore, the control device is designed in such a way that the graphic data is generated in such a way that the detected object is visually represented in the three-dimensional view as soon as the distance to the detected object falls below a predetermined threshold.

[0022] Furthermore, it is provided that the control device is designed in such a way that the graphic data is generated in such a way that the view of the detected object is displayed shifted along the Z-axis depending on the distance of the vehicle to the detected object.

[0023] According to the invention, the control device is preferably designed such that the graphic data is generated in such a way that the size of the three-dimensional view of the detected object is displayed varying depending on the distance of the vehicle to the detected object.

[0024] In a preferred embodiment, the control device is further designed such that the graphic data is generated in such a way that the view of the detected object is highlighted with a colored outline and that the color changes depending on the distance of the vehicle to the detected object.

[0025] The invention will now be explained using exemplary embodiments with reference to the drawings. Fig. Figure 1 schematically shows a flowchart of the process according to the invention. Fig. Figure 2 shows an illustration of the device in a vehicle Fig. Figure 3 shows a display device in a first representation. Fig. 4 shows the display device in a further illustration

[0026] With reference to the Fig. Sections 1 to 4 describe the exemplary embodiments of the method and device according to the invention:

[0027] Fig. Figure 1 shows a flowchart of the method according to the invention. The reversing camera 2 detects the area 1 around the vehicle 8 100. Furthermore, the distance sensors 3 detect the object 5 in the area 1 101. Subsequently, the control unit 4 uses an algorithm and the information from the reversing camera 2 and distance sensors 3 to evaluate the position of the object 5 in the area 1 around the vehicle 8 102. The control unit 4 transmits the evaluation to a display unit 6 in the vehicle 8 103. The area 1 around the vehicle 8 is displayed on the display unit 6 in a first and second dimension (x, y, Fig. 3) visually represented and object 5 is also displayed in a first, second and third dimension Z (x,y,z, Fig. 3) visually displayed as soon as the distance of the vehicle 8 to the object 5 falls below a threshold of one and a half meters 104. Furthermore, the displayed image of the object 5 is outlined with a color (colored border 7, Fig. 4) shown 105.

[0028] Fig. Figure 2 shows a device which is integrated into a vehicle 8. The device comprises according to Fig. 2 a display unit 6, a control unit 4, distance sensors 3 and a reversing camera 2. In addition, it is in Fig. 2 the area 1 around the vehicle 8 and the object 5 is visible, which lies within the detection range (area 1 around the vehicle 8) of the distance sensors 3 and reversing camera 2.

[0029] Fig. Figure 3 shows a display device 6 in a coordinate system with the reference dimensions x, y and z. Furthermore, in Fig. 3 the object 5 is represented in a first, second and third dimension (x,y,z), whereas the area 1 around the vehicle 8 is represented only in a first and second dimension (x,y).

[0030] Fig. Figure 4 shows the display device in a further illustration. In addition to being shown in first, second, and third dimensions, object 5 is outlined with a colored border (colored border 7). The color changes depending on the distance between object 5 and vehicle 8.

[0031] In a preferred embodiment, the reversing camera 2 captures the area 1 around the vehicle 8, and the distance sensors 3 detect the object 5 within this area 1. Preferably, the control unit 4 uses an algorithm and the information from the reversing camera 2 and distance sensors 3 to determine the position of the object 5 within the area 1 around the vehicle 8. The area 1 around the vehicle 8 is preferably displayed in a first (x) and second (y) dimension on the display unit 6. The object 5 is preferably displayed in a first (x) and second (y) dimension if the distance between the vehicle 8 and the object 5 meets a threshold value greater than 2 meters. Preferably, the object 5 is displayed in a first (x), second (y), and third (z) dimension if the distance between the vehicle 8 and the object 5 is less than 2 meters.Furthermore, object 5 is displayed with a colored border (colored outline 7) depending on the distance between vehicle 8 and object 5. Object 5 is shown with a green border if the distance between vehicle 8 and object 5 is between 1.5 and 2 meters. Preferably, object 5 is shown with an orange border if the distance between vehicle 8 and object 5 is between 0.5 and 1.5 meters. Object 5 is shown with a red border if the distance between vehicle 8 and object 5 is less than 0.5 meters.

[0032] In a further preferred embodiment, the reversing camera 2 captures the area 1 around the vehicle 8, and the distance sensors 3 detect the object 5 within this area 1. Preferably, the control unit 4 uses an algorithm and the information from the reversing camera 2 and distance sensors 3 to determine the position of the object 5 within the area 1 around the vehicle 8. The area 1 around the vehicle 8 is preferably displayed in a first (x) and second (y) dimension on the display unit 6. The object 5 is preferably displayed in a first (x) and second (y) dimension if the distance between the vehicle 8 and the object 5 meets a threshold value in a range greater than 2 meters. Preferably, the object 5 is displayed in a first (x), second (y), and third (z) dimension if the distance between the vehicle 8 and the object 5 is less than 2 meters.In addition, the view of object 5 is shifted depending on the distance between vehicle 8 and object 5 along the third (z) dimension or along the Z-axis.

[0033] In a further preferred embodiment, the reversing camera 2 captures the area 1 around the vehicle 8, and the distance sensors 3 detect the object 5 within this area 1. Preferably, the control unit 4 uses an algorithm and the information from the reversing camera 2 and distance sensors 3 to determine the position of the object 5 within the area 1 around the vehicle 8. The area 1 around the vehicle 8 is preferably displayed in a first (x) and second (y) dimension on the display unit 6. The object 5 is preferably displayed in a first (x) and second (y) dimension if the distance between the vehicle 8 and the object 5 meets a threshold value in a range greater than 2 meters. Preferably, the object 5 is displayed in a first (x), second (y), and third (z) dimension if the distance between the vehicle 8 and the object 5 is less than 2 meters.In addition, the three-dimensional view of object 5 is displayed enlarged as soon as the vehicle 8 approaches object 5 critically, preferably within a range of less than 1 meter. Reference symbol list 1. Area around the vehicle 2 reversing cameras 3 distance sensors 4 Control unit 5 objects 6 Display unit 7-color border 8 vehicles 100-104 process steps

Claims

[1] A method for displaying graphic data by means of a display device (6) in a vehicle (8) which is designed to display graphic data in a three-dimensional view, wherein at least one area (1) around the vehicle (8) is detected and at least one object (5) is detected in the at least one area (1) around the vehicle (8), wherein the at least one area (1) around the vehicle (8) is visually displayed on the display device (6) in a two-dimensional view, wherein the two-dimensional view is defined by an X and Y axis, and the detected object (5) in the two-dimensional representation of the at least one area (1) is visually displayed in a three-dimensional view, wherein the three-dimensional view is defined by an X, Y and Z axis, wherein a distance of the vehicle (8) to the detected object (5) is determined, the detected object (5) is visually displayed in the three-dimensional view,as soon as the distance to the detected object (5) falls below a predetermined threshold value, and the view of the detected object (5) is displayed shifted along the Z-axis depending on the distance of the vehicle (8) to the detected object (5). [2] Method according to claim 1, characterized by that the size of the three-dimensional view of the detected object (5) is displayed in varying manner depending on the distance of the vehicle (8) to the detected object (5). [3] Method according to one of the preceding claims, characterized by that the view of the detected object (5) is highlighted with a color border. [4] Method according to claim 3 characterized by that the color (7) changes depending on the distance of the vehicle (8) to the detected object (5). [5] Device for displaying graphic data in a vehicle (8), further comprising - a display device (6) designed to display graphic data in a three-dimensional view, - at least one first sensor (2) which detects at least one area (1) around the vehicle (8), - at least one second sensor (3) which detects an object (5) in the at least one area (1) around the vehicle (8) and - a control device (4) which is coupled to the display device (6) and by means of which graphic data can be generated with the display device (6), wherein the control device (4) is designed such that ◯ the at least one area (1) around the vehicle (8) is visually displayed on the display device (6) in a two-dimensional view, wherein the two-dimensional view is defined by an X and Y axis, and the detected object (5) in the two-dimensional representation of the at least one area (1) is visually displayed in a three-dimensional view, wherein the three-dimensional view is defined by an X, Y and Z axis, ◯ a distance of the vehicle (8) to the detected object (5) is determined, ◯ the graphic data are generated in such a way that the detected object (5) is visually displayed in the three-dimensional view as soon as the distance to the detected object (5) falls below a predetermined threshold value, and ◯ the graphic data are generated in such a way that the view of the detected object (5) is displayed shifted along the Z-axis depending on the distance of the vehicle (8) to the detected object (5). [6] Device according to claim 5, characterized by that the control device (4) is designed such that the graphic data are generated such that the size of the three-dimensional view of the detected object (5) is displayed in a varying manner depending on the distance of the vehicle from the detected object. [7] Device according to claim 5 or 6, characterized by that the control device (4) is designed such that the graphic data are generated such that the view of the detected object (5) is highlighted with a color (7) border. [8] Device according to claim 7, characterized bythat the control device (4) is designed such that the graphic data are generated such that the color (7) changes depending on the distance of the vehicle (8) to the detected object (5).

Images