TAX INDICATOR

The display control device enhances obstacle detection by adjusting vehicle representation transparency to highlight potential contact points, improving user understanding of collision risks.

DE102024112367A1Pending Publication Date: 2024-12-05FAURECIA CLARION ELECTRONICS CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
DE102024112367
Authority / Receiving Office
DE · DE
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-29
Filing Date
2024-05-02
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Existing obstacle detection systems in vehicles often obscure obstacles behind a vehicle representation, making it difficult to determine the likelihood and probability of contact, especially when the obstacle is hidden.

Method used

A display control device that generates an image from a virtual viewpoint, highlighting vehicle parts likely to come into contact with obstacles by adjusting the transparency of the vehicle representation based on the obstacle's position and coverage, ensuring that the vehicle parts are partially transparent or highlighted when covering the obstacle.

Benefits of technology

Effectively provides intuitive information about obstacles by clearly indicating potential contact points, allowing users to assess collision risks and make informed decisions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Problem to be solved by the invention: Effective provision of information about an obstacle in the vicinity of a vehicle. Solution to the problem: The display control device 30 includes the following: an image generation unit 31, which is operable in such a way that it generates an image based on an image of the environment of a vehicle, which includes the location of obstacles in a field of view, wherein the vehicle is seen from a virtual viewpoint; a drawing unit 35, which is operable in such a way that it draws a representation of the vehicle in the image in which the vehicle is seen from the virtual viewpoint, which represents the vehicle three-dimensionally;and a control unit 34, which is operable in such a way as to control a degree of transparency (hereinafter also referred to as "transparency") of the vehicle representation for individual sub-areas of the vehicle representation, wherein, if in the image the area of ​​the vehicle representation covers a predetermined proportion or more of the obstacle, the control unit 34 highlights a sub-area of ​​the vehicle representation that is likely to come into contact with the obstacle and the control unit draws the other section of the vehicle representation as the aforementioned sub-area with a predetermined transparency, not opaque.
Need to check novelty before this filing date? Find Prior Art

Description

AREA OF INVENTION

[0001] The present invention relates to a display control device for controlling a screen of a display device installed in a vehicle. STATE OF THE ART

[0002] Techniques for detecting obstacles in the vicinity of a vehicle already exist. Patent document 1 discloses "(the device), comprising: a distance measuring means 3 for determining a distance to an obstacle that is present in a direction perpendicular to a direction of travel of a vehicle; an image input means 2 for obtaining a peripheral image that includes the obstacle; a position determination means 4 for the vehicle in question for sequentially determining a position of the vehicle in question that changes during the journey of the vehicle in question; a first-plane defining means 5 for defining a surface of the obstacle that extends in the direction of travel of the vehicle as the first plane; a plane-end estimating means 6 for estimating an end of the first plane in the direction of travel of the vehicle in question;an image recognition area defining means 7 for defining an area that includes the plane end as the image recognition area; and 3D shape recognition means 9 for three-dimensional detection of the obstacle based on the first plane and a detection result of the image recognition means."; State-of-the-art documents, patent documents

[0003] Patent Document 1: JP 2007-004697 A BRIEF DESCRIPTION OF THE INVENTION Problem to be solved by the invention

[0004] Methods for outputting the result of obstacle detection to a vehicle user include a method for displaying an image seen from a virtual viewpoint. The image seen from the virtual viewpoint is generated from the image acquisition results of a multitude of cameras. An additional drawing of a representation of the vehicle (hereinafter also referred to as the "vehicle representation") within the image seen from the virtual viewpoint makes it possible to display the positional relationship between the vehicle and the obstacle in that image.

[0005] An opaque drawing of the vehicle representation, added to the image seen from the virtual viewpoint, can obscure the obstacle behind the vehicle representation. When an additional outline representation of the vehicle is displayed on the image seen from the virtual viewpoint, it is difficult to determine where the obstacle is likely to come into contact with the vehicle and how high or low the probability of the obstacle coming into contact with the vehicle is.

[0006] One object of the invention is to provide information about obstacles in the vicinity of a vehicle in an effective manner. MEANS OF SOLVING THE TASK

[0007] To fulfill the aforementioned purpose, a display control device in a typical example includes the following: an image generation unit capable of producing, based on an image of the vehicle's surroundings, an image that includes the location of obstacles in a field of view, with the vehicle being seen from a virtual viewpoint; a drawing unit capable of drawing, in the image in which the vehicle is seen from the virtual viewpoint, a representation of the vehicle that represents the vehicle in three dimensions;and a control unit capable of controlling a degree of transparency (hereinafter also referred to as "transparency") of the vehicle representation for individual sub-areas of the vehicle representation, wherein, if in the image the area of ​​the vehicle representation covers a predetermined proportion or more of the obstacle, the control unit highlights a sub-area of ​​the vehicle representation that is likely to come into contact with the obstacle and the control unit draws the other section of the vehicle representation as the above sub-area with a predetermined transparency, not opaque. IMPACT OF THE INVENTION

[0008] According to the present invention, it is possible to effectively provide information about obstacles in the vicinity of a vehicle. The following description of embodiments explains problems, configurations, and effects other than those described above. BRIEF DESCRIPTION OF THE DRAWING Fig. Figure 1 is a diagram to describe a screen generated by a display control device according to embodiment 1. Fig. Figure 2 is a diagram to describe a virtual viewpoint. Fig. Figure 3 is a configuration diagram to illustrate a configuration of the display control unit. Fig. Figure 4 is a flowchart showing the operation of a display control device. Fig. Figure 5 is a screenshot of a case where the position of an obstacle is closer to the virtual viewpoint than to the position of a vehicle. Fig. Figure 6 is a diagram describing a control for changing the viewpoint (Part 1). Fig. Figure 7 is a diagram describing a control for changing the viewpoint (Part 2). FORMS OF EXECUTION OF THE INVENTION

[0009] Next, an embodiment of the present invention will be described with reference to the drawings. Design 1

[0010] Fig. Figure 1 is a diagram describing a screen generated by a display control device according to embodiment 1. The display control device according to embodiment 1 combines images captured by a plurality of cameras mounted on a vehicle to generate an image of a predetermined position as seen from a virtual viewpoint. The display control device adds a vehicle representation 11, which represents the vehicle three-dimensionally, to an image seen from a virtual viewpoint in the direction in which the vehicle is located. A display device mounted on the vehicle displays the image generated by the display control device.

[0011] An image D1 includes an image representing an obstacle 21 and a representation of the vehicle. The obstacle 21 is detected using an image captured by a camera or by a sensor, such as a light detection and ranging (LiDAR) sensor. The shape of the obstacle 21 and its position relative to the vehicle are also included in the detection result. For the sake of simplicity, in this embodiment the obstacle 21 is graphically represented as a sphere.

[0012] Image D1 is an image that graphically represents an opaque vehicle representation 11 on an image viewed from a virtual viewpoint in the direction in which the vehicle is located. In image D1, the obstacle 21 may be hidden behind the vehicle representation 11. If the obstacle 21 is hidden behind the vehicle representation 11, this results, among other things, in the user not noticing the obstacle 21 and having difficulty estimating the probability of the obstacle 21 coming into contact with the vehicle.

[0013] With a vehicle outline that is constantly displayed, the obstacle 21 behind it is never hidden. In this case, however, it is difficult to determine where the obstacle is likely to come into contact with the vehicle and how high or low the probability of the obstacle coming into contact with the vehicle is.

[0014] In the present embodiment, the state in which “the obstacle is hidden” is a state in which “in the image D1, which contains the vehicle representation, an area of ​​the obstacle is covered which is equal to or greater than a predetermined proportion”.

[0015] The display control device according to embodiment 1 generates an image D2 when the obstacle 21 is hidden behind the vehicle representation. The image D2 is an image that graphically represents the vehicle representation, with a part that is likely to come into contact with the obstacle 21 highlighted and the rest of the vehicle representation left unobstructed; that is, the part that differs from the aforementioned part that is likely to come into contact with the obstacle 21 is graphically represented with a predetermined transparency. Fig. Part 13 is likely to come into contact with obstacle 21, the front right door of the vehicle. Figure D2 schematically shows the positions and angles of the wheels in a vehicle representation 12, next to part 13, where the length and width of the vehicle body are illustrated as a rectangle. Vehicle representation 12 is a vehicle representation that, apart from part 13 and the wheels, is graphically represented with 100% transparency.

[0016] All areas with 100% permeability are shown as completely transparent. All areas with 0% permeability are shown as opaque.

[0017] The parts are components that make up the vehicle, such as doors, bumpers, mirrors, and a lower section of the vehicle.

[0018] Since vehicle representation 12 uses a rectangle to display the length and width of the vehicle body, the image can omit information regarding the vehicle body's height, while still indicating the positional relationship between the obstacle and the vehicle body. Vehicle representation 12, which specifies the wheel positions and angles, allows the user to predict the vehicle's behavior.

[0019] All parts of the vehicle representation 12 other than part 13 and the wheels may have a permeability of less than 100%. Low permeability allows the user to easily verify the shape of the vehicle representation 12 and the relationship between the vehicle representation 12 and its environment. If the vehicle representation 12 has a permeability of less than 100%, part 13, which is likely to come into contact with the obstacle 21, preferably has a lower permeability than the vehicle representation 12. Part 13 preferably has a higher permeability than 0%, although this does not preclude the use of 0% permeability for this purpose.

[0020] The display control device highlights part 13 with a lower transmittance than the vehicle representation 12 to indicate to the user a possible contact that may occur between part 13 and the obstacle 21. The display mode of part 13 can be changed according to the distance from the obstacle 21. The display control device can set the transmittance of the part likely to come into contact with the obstacle 21 such that the section located on the inside of the part, relative to its outer edge (frame), has a higher value as the distance between the obstacle 21 and the vehicle decreases. The display control device can change the color of part 13 according to the aforementioned distance. The display control device can also make part 13 flash and change the flashing interval according to the aforementioned distance.

[0021] Fig. Figure 2 is a diagram describing a virtual viewpoint. In Fig. 2. There is a virtual camera orbit Vol around a vehicle 10. The viewpoint of the image of the vehicle's surroundings captured by a camera corresponds to the position where the camera is installed in real space. In other words, it is an image of the vehicle's surroundings as seen by the camera. The image of the vehicle's surroundings seen by the camera is transformed into a different image of the vehicle's surroundings, which appears as if seen from a position different from the camera's position in real space. In the resulting image, the viewpoint can be set at a position other than the camera's position in real space, and thus this position is a virtual viewpoint. The virtual viewpoint can be set at any point on the orbit Vol.A virtual viewpoint Vp1 is located on the left front of vehicle 10. Images D1 and D2 are images obtained by viewing the surroundings of vehicle 10 from the virtual viewpoint Vp1.

[0022] Fig. Figure 3 is a configuration diagram illustrating a configuration of the display control unit. The display control unit 30 is connected to a display device 40, a camera 50, a LiDAR unit 60, etc.

[0023] Display device 40 is, for example, provided on the vehicle's dashboard. Display device 40 is, for example, a touch panel display device.

[0024] The camera 50 images the surroundings of the vehicle 10. When using a multitude of cameras 50, each with different imaging ranges, a multitude of images are produced, which are combined in such a way that every obstacle can be depicted in every direction.

[0025] The LiDAR unit 60 is a unit that scans the area around the vehicle 10 using light or similar means to determine the position and shape of an obstacle. Radar or sonar can be used instead of or in addition to the LiDAR unit 60.

[0026] A display control device 30 includes an image generation unit 31, an obstacle information detection unit 32, a determination unit 33, a control unit 34, and a drawing unit 35. The functions of the image generation unit 31, the obstacle information detection unit 32, the determination unit 33, the control unit 34, and the drawing unit 35 can be implemented by a central processing unit (CPU) that executes the corresponding programs.

[0027] Based on the images of the vehicle 10's surroundings, captured by the multitude of cameras 50, the image generation unit 31 creates an image of the vehicle 10 as seen from a virtual viewpoint, including the position of the obstacle in the field of view.

[0028] Based on the output of the LiDAR unit 60 or the like, the obstacle information detection unit 32 detects the position of an obstacle that is present in the vicinity of the vehicle 10. Based on the position of the obstacle, which is determined by the

[0029] When the obstacle information detection unit 32 detects the obstacle, the image generation unit 31 graphically represents it in the image of the vehicle as seen from the virtual viewpoint.

[0030] Based on the position of the virtual viewpoint and the position of the obstacle, the determination unit 33 determines whether the obstacle is hidden behind the vehicle 10 or not.

[0031] Based on the position of the virtual viewpoint and the position of the obstacle, the determination unit 33 determines whether or not there is a part that is likely to come into contact with the obstacle.

[0032] The drawing unit 35 draws a vehicle representation that represents the vehicle 10 three-dimensionally in the image of the vehicle 10 as seen from the virtual viewpoint.

[0033] The control unit 34 controls the transparency of the vehicle representation for each sub-area of ​​the vehicle representation. If the vehicle representation in the image covers an area of ​​the obstacle that is equal to or larger than a predetermined proportion, the control unit 34 graphically highlights a sub-area of ​​the vehicle representation that is likely to come into contact with the obstacle and graphically displays the remaining part, which is not the highlighted sub-area, with a predetermined transparency, i.e., not opaque.

[0034] The sub-area corresponds to a part (a door, a bumper, a mirror, a floor or the like) of the vehicle 10.

[0035] If there is no obstacle that is covered by the vehicle representation to a predetermined extent or more, the control unit 34 graphically displays an opaque vehicle representation.

[0036] If the vehicle representation in the image covers an area of ​​the obstacle that is equal to or greater than a predetermined proportion, the control unit 34 sets the permeability of a sub-area of ​​the vehicle representation that is likely to come into contact with the obstacle as a permeability, not opaque, that is lower than the permeability of the sub-areas other than the aforementioned sub-area.

[0037] The control unit 34 can modify the display mode of the vehicle representation and the sub-area as appropriate. The control unit 34 can set the permeability of the sub-area likely to come into contact with the obstacle such that the portion located on the inside of the sub-area, relative to its outer edge, has a larger value as the distance between the obstacle and the vehicle decreases. If the vehicle representation covers an area of ​​the obstacle equal to or greater than a predetermined proportion, the control unit 34 can cause the sub-area likely to come into contact with the obstacle to flash.

[0038] If the obstacle is located between the vehicle and the virtual viewpoint, the control unit 34 graphically represents a portion of the vehicle representation that is unlikely to come into contact with the obstacle and whose position on the image does not overlap with the image of the obstacle, in an opaque manner. Furthermore, the control unit 34 graphically represents a portion of the vehicle representation that is likely to come into contact with the obstacle, using a transparency, not opaque, with respect to the image of the obstacle. The expression "control unit 34 graphically represents" or the like is used to mean that the control unit 34 determines the transparency of the vehicle representation or the parts of the vehicle, and the drawing unit 35 graphically represents the vehicle representation or the parts with the determined transparency.

[0039] Fig. Figure 4 is a flowchart showing the operation of the vehicle control device 30. The control device 30 performs steps S101 to S110 sequentially.

[0040] Step S101: Based on the images captured by the multitude of cameras 50, the image generation unit 31 creates an image that is seen from a virtual viewpoint. The process then continues with step S102.

[0041] Step S102: The obstacle information acquisition unit 32 receives information from the LiDAR unit 60 or the like about an obstacle present in the vicinity of the vehicle 10. The process then continues with step S103.

[0042] Step S103: Using the information about the obstacle, the image generation unit 31 arranges the vehicle representation in the image seen from the virtual viewpoint. The process then continues with step S104.

[0043] Step S104: Based on the position of the obstacle and that of the vehicle representation, the determination unit 33 determines whether an obstacle is hidden behind the vehicle representation. The process then continues with step S105.

[0044] Step S105: If no such obstacle exists ("No" in step S105), the determining unit 33 proceeds to step S106. If such an obstacle exists ("Yes" in step S105), the process proceeds to step S107.

[0045] Step S106: The control unit 34 graphically displays an opaque vehicle representation and terminates the processing.

[0046] Step S107: The control unit 34 graphically displays a transparent vehicle representation and continues with step S108.

[0047] Step S108: The determination unit 33 determines whether there is a part that is likely to come into contact with the obstacle. The process then continues with step S109.

[0048] Step S109: If such a part exists (Yes in step S109), the destination unit 33 continues with step S110. If such a part does not exist (Yes in step S110), the destination unit 33 terminates processing.

[0049] Step S 110: The control unit 34 indicates such a part, highlighting it by a predetermined permeability, and terminates the processing.

[0050] Fig. Figure 5 is an example screen for a case where an obstacle is located between the vehicle and the virtual viewpoint, and the obstacle's position is closer to the virtual viewpoint than to the vehicle's position. In this case, the control unit 34 graphically displays an opaque portion of the vehicle representation that is unlikely to come into contact with the obstacle and whose position on the screen does not overlap with the image of the obstacle. The control unit 34 graphically displays a portion of the vehicle representation that is likely to come into contact with the obstacle, with a certain degree of transparency, in contrast to the image of the obstacle.

[0051] The image D11 in Fig. Image 5 is displayed on the screen when there is no part likely to come into contact with the obstacle. Image D11 includes an opaque representation of the vehicle 11 and that of an obstacle 22. The obstacle 22 is also opaque. The control unit 34 does not graphically represent any portion of the vehicle representation 11 that is hidden behind the obstacle 22. Image D11 simply indicates that the obstacle 22 is closer to the virtual viewpoint than the vehicle.

[0052] The image D12 in Fig. 5 is an image displayed on the screen when there is a part that is likely to come into contact with an obstacle. Image D12 includes an opaque vehicle representation 11 and an image of an obstacle 22, as well as a part 14 that is likely to come into contact with the obstacle 22. The obstacle 22 is also opaque. The control unit 34 graphically represents the part 14 that is likely to come into contact with the obstacle 22, with a predetermined transparency in contrast to the image of the obstacle 22, and displays the part 14 by overlaying it on the image of the obstacle 22. For example, to display the part 14 overlapping on the image of the obstacle 22, the layer that graphically represents the part 14 is set higher than the layer that graphically represents the image of the obstacle 22. This prevents the part 14 from being hidden behind the obstacle.Image D12 indicates that obstacle 22 is closer to the virtual viewpoint than to the vehicle and that part 14 is likely to come into contact with obstacle 22. The display mode of part 14 can be appropriately changed in the same way as the display mode of part 13.

[0053] The drawing unit 35 can use any method to draw part 14 with the transparency specified by the control unit 34. The method used for the aforementioned purpose can be one in which different layers of the obstacle, the vehicle representation, and the part(s) are superimposed, or the method can be α-blending.

[0054] If one of the obstacle and the vehicle obscures the other in the image seen from the virtual viewpoint, the display control device 30 schematically indicates a part that is likely to come into contact with the obstacle. It is conceivable that, after checking the display, the user could change the viewpoint to confirm the situation. The display control device 30 can include a viewpoint change unit 36 ​​that is operative in such a way as to change the position of the virtual viewpoint when a predetermined manipulation is received in a state where a part that is likely to come into contact with an obstacle is schematically indicated. An exemplary manipulation for use as the aforementioned predetermined manipulation is, for example, a touch manipulation of a schematic display of a part that is likely to come into contact with an obstacle.

[0055] Fig. 6 and Fig. Seven diagrams describe a control mechanism for changing the viewpoint. The image seen from the virtual viewpoint Vp1, shown in Fig. As shown in figure 6, vehicle 10 conceals obstacle 21. Fig. 6. It is assumed that part 13, which is the front right door, is a part that is likely to come into contact with obstacle 21. In the state of Fig. 6 shows the display control device 30 showing image D2 of Fig. 1 on. Based on user manipulation, the

[0056] Viewpoint change unit 36 ​​searches for a virtual viewpoint from which both part 13 and obstacle 21 can be displayed without requiring viewing through the vehicle representation. An example of user manipulation is touch manipulation, where the user touches part 13 in image D2, but other manipulations are also included. The manipulation can be any manipulation indicating that the user wishes to check the positional relationship between part 13 and obstacle 21. As a result of the search, a viewpoint Vp2 is obtained from the front of vehicle 10 and a viewpoint Vp3 from the rear of vehicle 10.

[0057] The viewpoint change unit 36 ​​compares a route R2, which runs along the specified orbit Vo1 from virtual viewpoint Vp1 to virtual viewpoint Vp2, with a route R3, which runs along the specified orbit Vo1 from virtual viewpoint Vp1 to virtual viewpoint Vp3. As a result of the comparison, the viewpoint change unit 36 ​​selects route R2, which is shorter than route R3. In other words, the viewpoint change unit 36 ​​selects a virtual viewpoint Vp2 that is closest to the current virtual viewpoint Vp1, and therefore cannot display part 13 and obstacle 21 through the vehicle display. The viewpoint change unit 36 ​​changes the virtual viewpoint from virtual viewpoint Vp1 to virtual viewpoint Vp2 along route R2, which is shorter than route R3.The image generation unit 31 and the drawing unit 35 can generate an animation in which the virtual viewpoint moves continuously along route R2 and stops at virtual viewpoint Vp2. This animation allows the driver to easily understand the direction in which the virtual viewpoint is moving. Because the display control device 30 selects a shorter route to move the virtual viewpoint, the user can quickly check the condition of a part that is likely to come into contact with the obstacle.

[0058] Fig. 7 is a modified example of viewpoint-changing control. In the Fig. In the illustrated control unit 6, the display control device 30 moves the viewing point along the prescribed orbit Vo1. Fig.7. The display control device 30 generates a route R4 centered on the part 13 that is likely to come into contact with the obstacle 21, and having a radius from the part 13 to the virtual viewpoint Vp1. The display control device 30 then moves the virtual viewpoint from Vp1 along route R4 to Vp4. By moving the virtual viewpoint to a position equidistant from the part 13 and from the center, the user can inspect the part 13 more quickly than if a prescribed orbit is used.

[0059] As described above, the display control device 30 disclosed as an embodiment includes the following: an image generation unit 31 that is operable in such a way that it generates an image based on an image of the environment of a vehicle, which includes the location of obstacles in a field of view, wherein the vehicle is seen from a virtual viewpoint; a drawing unit 35 that is operable in such a way that it draws a representation of the vehicle in the image in which the vehicle is seen from the virtual viewpoint, which represents the vehicle in three dimensions;and a control unit 34, which is operable in such a way as to control a degree of transparency (hereinafter also referred to as "transparency") of the vehicle representation for individual sub-areas of the vehicle representation, wherein, if in the image the area of ​​the vehicle representation covers a predetermined proportion or more of the obstacle, the control unit 34 highlights a sub-area of ​​the vehicle representation that is likely to come into contact with the obstacle and the control unit draws the other section of the vehicle representation as the aforementioned sub-area with a predetermined transparency, not opaque.

[0060] The display control unit 30 effectively provides information about obstacles in the vehicle's vicinity. If an obstacle is visible behind the vehicle in an image viewed from a virtual viewpoint, the display control unit 30 shows an image that allows the user to intuitively identify the parts of the vehicle likely to come into contact with the obstacle.

[0061] Preferably, the sub-areas correspond to parts that make up the vehicle. By highlighting a section likely to come into contact with an obstacle, part by part, the user can assess the situation depending on the part. For example, if the part is a side mirror, the user can make a collision avoidance decision by considering the side mirror's characteristic, i.e., that it protrudes from the vehicle body. If the part is a door, the user can determine whether the door is open or closed. If it is likely that multiple parts will come into contact with the obstacle, the user can determine that the damage increases with the number of parts involved.

[0062] A viewpoint change part 36 is provided to modify the virtual viewpoint position based on user manipulation, changing it to a position where the part and obstacle are not visible through the vehicle display. Viewpoint change part 36 alters the virtual viewpoint position to a different position closest to the original virtual viewpoint position, from which the part and obstacle can be displayed without being visible through the vehicle display. With this configuration, the user can quickly check the condition of a part that is likely to come into contact with the obstacle.

[0063] In the display control device 30 of the disclosure, the control unit 34 graphically displays an opaque representation of the vehicle if no obstacle is covered to a predetermined proportion or more by the vehicle representation.

[0064] By displaying such an opaque representation of the vehicle, the display control device 30 can provide an image that closely approximates an image actually seen.

[0065] In the display control device 30 of the disclosure, if the image has an area of ​​the vehicle representation covering the obstacle which is equal to or greater than a predetermined proportion, the control unit sets the transparency of a sub-area of ​​the vehicle representation which is likely to be in contact with the obstacle as not opaque, such that its transparency is lower than that of other sub-areas.

[0066] If the transparency of the sub-area that is likely to come into contact with the obstacle is set as non-opaque such that it is lower than the transparency of other sub-areas, the display control device 30 can display the image of the obstacle and the sub-area that is likely to come into contact with the obstacle simultaneously. The disclosed display control device 30 includes a

[0067] The obstacle information acquisition unit 32 is operational in such a way that it detects a position of the obstacle, and the image generation unit 31 graphically represents the obstacle in the image of the vehicle seen from the virtual viewpoint based on the position of the obstacle.

[0068] In this configuration, the display control device 30 can show the obstacle at a more precise position.

[0069] The disclosed display control device 30 includes a determination unit 33 which determines, based on the position of the virtual viewpoint and the position of the obstacle, whether the obstacle is hidden behind the vehicle or not.

[0070] In this configuration, the display control device 30 can determine with high accuracy whether the obstacle is hidden behind the vehicle or not.

[0071] In the disclosed display control device 30, the control unit 34 displays, when the position of the obstacle is closer to the virtual viewpoint than to the position of the vehicle, a portion of the vehicle representation that is likely to come into contact with the obstacle by superimposing it on the image of the obstacle.

[0072] In this configuration, the display control device 30 can report that there is a possibility of contact at a location hidden behind an obstacle.

[0073] The control unit 34 can set the permeability of the sub-area that is likely to come into contact with the obstacle such that the section located on the inside of the sub-area from its outer edge has a larger value as the distance between the obstacle and the vehicle decreases.

[0074] In this case, if the obstacle is closer to the vehicle, part of the vehicle becomes more transparent and the obstacle is displayed more clearly.

[0075] If the vehicle display covers an area of ​​the obstacle to a proportion equal to or greater than a predetermined proportion, the control unit 34 can cause the portion of the area likely to come into contact with the obstacle to flash.

[0076] In this case, the user should be able to more easily identify a part that is likely to come into contact with the obstacle.

[0077] The disclosed embodiment is not intended to limit the invention. The present invention may include various modifications in addition to the disclosed embodiment. The foregoing embodiment has been described in detail to illustrate the present invention graphically in an easily understandable manner, and it is not necessarily limited to this one embodiment with all the components described. Furthermore, it is possible not only to omit such components, but also to replace or add them.

[0078] For example, the invention can be implemented as a vehicle-internal device with the function of the display control device 30 and the function of the display device 40. Description of the reference symbols

[0079] 10: Vehicle, 11: Vehicle representation, 12: Vehicle representation, 13 and 14: Part, 21 and 22: Obstacle, 30: Display control unit, 31: Image generation unit, 32: Obstacle information acquisition unit, 33: Determination unit, 34: Control unit, 35: Drawing unit, 36: Viewpoint change unit, 40: Display unit, 50: Camera, 60: LiDAR unit QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] JP 2007-004697 A

[0003]

Claims

[1] A display control device comprising: an image generation unit operable to generate, based on an image capture of the surroundings of a vehicle, an image of the vehicle viewed from a virtual viewpoint and including a position of an obstacle in a field of view; a drawing unit operable to graphically display a vehicle representation that represents the vehicle three-dimensionally in the image of the vehicle as seen from the virtual viewpoint; and a control unit operable to control the transparency of the vehicle representation for each partial area of the vehicle representation, wherein, when the vehicle representation covers an area of the obstacle in the image by a proportion equal to or greater than a predetermined proportion, the control unit graphically displays a portion of the vehicle image that is likely to come into contact with the obstacle, highlighting the portion, and the control unit graphically displays other parts of the vehicle representation than the part with a non-transparent translucency. [2] The display control device according to claim 1, further comprising: a viewpoint changing unit operable to change, based on a user's manipulation, a position of the virtual viewpoint to a position from which the part and the obstacle can be displayed without having to be viewed through the vehicle representation, wherein the viewpoint changing unit is operable to change the position of the virtual viewpoint to a position closest to the position of the virtual viewpoint and from which the part and the obstacle cannot be displayed through the vehicle representation. [3] The display control device according to claim 1, wherein, when there is no obstacle that is covered by the vehicle image by a predetermined proportion or more, the control unit graphically displays an opaque vehicle image. [4] A display control device according to claim 1, wherein, when the vehicle image covers a portion of the obstacle in the image to a proportion equal to or greater than a predetermined proportion, the control unit determines the transmittance of a portion of the vehicle representation likely to come into contact with the obstacle as non-opaque transmittance such that it is lower than that of portions other than the portion. [5] The display control device according to claim 1, further comprising: an obstacle information detecting unit operable to detect a position of the obstacle, wherein the image generation unit graphically displays the obstacle in the image of the vehicle seen from the virtual viewpoint based on the position of the obstacle. [6] Display control device according to claim 5, where, if the position of the obstacle is closer to the virtual viewpoint than to the position of the vehicle, the control unit displays a portion of the vehicle image that is likely to come into contact with the obstacle by overlaying the portion on the image of the obstacle. [7] A display control device according to claim 1, wherein the control unit sets the permeability of the portion likely to come into contact with the obstacle such that the portion located on the inside of the portion from the outer edge thereof has a larger value as the distance between the obstacle and the vehicle decreases. [8] Display control device according to claim 1, wherein, when the vehicle representation covers an area of the obstacle by a proportion equal to or greater than a predetermined amount, the control unit flashes the portion likely to come into contact with the obstacle.

Citation Information

Patent Citations

  • Obstacle detecting device

    JP2007004697A

  • ADAPTIVE TRANSPARENCY OF A VIRTUAL VEHICLE IN A SIMULATED IMAGING SYSTEM

    DE102020100080A1

  • Ambient image display device and display control method

    DE102021132949A1

  • JP002007004697A