Display control system and display control method thereof

By displaying the position information image of the target visual object on the screen components of the vehicle, the problem of detecting blind spot objects cannot be detected is solved, traffic safety and convenience are improved, and users can always know the location of surrounding dangerous objects.

CN118939223APending Publication Date: 2024-11-12HONDA MOTOR CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310514863.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-09
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

Existing preventive safety technologies cannot detect dangerous objects in the blind spot of vehicle detection, making it difficult for drivers to know the location of these objects, affecting traffic safety and convenience.

Method used

A display control system is designed to determine whether the user can see the target object by displaying the position information image of the target object on the screen component, and using the vehicle position recognition unit, map information and image acquisition unit to determine whether the user can see the target object. If it can be seen, the real heart will be displayed. If the image cannot be seen, a hollow transparent image will be displayed to ensure that the user can always know the location of the target object.

Benefits of technology

It greatly improves the driving safety of vehicles, provides a sustainable transportation system, improves the safety and convenience of traffic, and ensures that users can obtain their location information regardless of whether they can see the target object.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118939223A_ABST
    Figure CN118939223A_ABST
Patent Text Reader

Abstract

The invention provides a display control system and a display control method thereof. The display control device controls the display device to display the position information image on the screen part according to the current position of the vehicle, the map information, the acquired image and the position information of the target visual recognition object. When a user is able to see a target viewing object, the display control device controls the display device to display a position information image representing position information of the target viewing object on the screen member in a first mode. When the user cannot see the target visible object, the display control device controls the display device to display a position information image representing the position information of the target visible object on the screen member in a second mode.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a control device, and in particular to a display control system and a display control method thereof. Background Art

[0002] In recent years, efforts have been actively made to provide access to sustainable transportation systems that also take into account vulnerable persons among traffic participants. To achieve the above objectives, research and development efforts are being made to further improve the safety and convenience of traffic through research and development related to preventive safety technologies.

[0003] In existing preventive safety technologies, sensors and cameras installed on the vehicle can detect dangerous objects that may cause collisions and notify the driver. However, if the sensors and cameras cannot detect the dangerous objects, they will not be able to provide relevant information to the driver. This will make the driver only able to search for dangerous objects from visible information, and it will be difficult to know the dangerous objects in the detection blind spot.

[0004] Therefore, how to improve preventive safety technology to further enhance traffic safety and convenience is one of the important directions of efforts. Summary of the invention

[0005] The present invention provides a display control system and a display control method thereof, which can provide a vehicle user with position information of dangerous objects in a detection blind spot, thereby greatly improving the driving safety of the vehicle, and further providing a sustainable transportation system that can improve traffic safety and convenience.

[0006] The display control system of the present invention is applicable to vehicles, and the display control system includes a display control device. The display control device controls the display device to display a position information image representing the position information of a target visual object on a screen component in a first mode, wherein the screen component is arranged between the target visual object and a user of the vehicle. The display control device includes a vehicle position recognition unit. The vehicle position recognition unit recognizes the current position of the vehicle. The display control device controls the display device to display a position information image on the screen component based on the current position of the vehicle, map information of the road on which the vehicle is traveling, an acquired image of the exterior of the vehicle, and the position information of the target visual object. Wherein, when the user can see the target visual object, the display control device controls the display device to display a position information image representing the position information of the target visual object on the screen component in a first mode. When the user cannot see the target visual object, the display control device controls the display device to display a position information image representing the position information of the target visual object on the screen component in a second mode.

[0007] In one embodiment of the present invention, the position information image in the second mode has a hollow and transparent central portion.

[0008] In one embodiment of the present invention, the screen component is a glass of a vehicle, and the display control device controls the display device to project the position information image on the screen component, so that the user can see the position information image superimposed on the target visual object.

[0009] In one embodiment of the present invention, the screen component is a display panel, and the display control device controls the display device to display a position information image on the screen component. The position information image is located on an imaginary line between the user and the target visual object.

[0010] The present invention also provides a display control method for a display control system, which is applicable to a vehicle, and the display control method for the display control system includes the following steps. Identify the current position of the vehicle. Display a position information image representing the position information of the target visual object on a screen component based on the current position of the vehicle, map information of the road on which the vehicle is traveling, an acquired image of the outside of the vehicle, and the position information of the target visual object, wherein the screen component is arranged between the target visual object and the user of the vehicle. Determine whether the user of the vehicle can see the target visual object. When the user can see the target visual object, display a position information image representing the position information of the target visual object on the screen component in a first mode. When the user cannot see the target visual object through the screen component, display a position information image representing the position information of the target visual object on the screen component in a second mode.

[0011] In one embodiment of the present invention, the position information image in the second mode has a hollow and transparent central portion.

[0012] Based on the above, the embodiments of the present invention can display a position information image representing the position information of the target visual object on the screen component according to the current position of the vehicle, map information, acquired images, and the position information of the target visual object. When the user of the vehicle can see the target visual object, the position information image representing the position information of the target visual object is displayed on the screen component in a first mode, and when the user of the vehicle cannot see the target visual object, the position information image representing the position information of the target visual object is displayed on the screen component in a second mode. In this way, regardless of whether the user can see the target visual object, the corresponding position information image of the target visual object can be provided, so that the user of the vehicle can know the position information of the target visual object, which can greatly improve the driving safety of the vehicle, and further provide a sustainable transportation system that can improve the safety and convenience of traffic.

[0013] In order to make the above features and advantages of the present invention more clearly understood, embodiments are given below with reference to the accompanying drawings for detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1is a schematic diagram of a display control system applicable to a vehicle according to an embodiment of the present invention.

[0015] Figure 2 is a schematic diagram of a projection position information image according to an embodiment of the present invention.

[0016] Figure 3 The present invention is a schematic diagram of the positions of a vehicle and a target visual object with a display control system according to an embodiment of the present invention.

[0017] Figure 4 is a schematic diagram of a projection position information image according to another embodiment of the present invention.

[0018] Figure 5 is a schematic diagram of an image displaying position information according to an embodiment of the present invention.

[0019] Figure 6 is a schematic diagram of displaying a position information image according to another embodiment of the present invention.

[0020] Figure 7 The present invention is a flowchart of a display control method of a display control system according to an embodiment of the present invention. DETAILED DESCRIPTION

[0021] In order to make the content of the present invention more understandable, the following embodiments are specifically cited as examples on which the present invention can be implemented. In addition, wherever possible, components / parts with the same reference numerals are used in the drawings and embodiments to represent the same or similar components.

[0022] Figure 1 is a schematic diagram of a display control system suitable for a vehicle according to an embodiment of the present invention, please refer to Figure 1. The display control system may include a display control device 100, and the display control device 100 may be coupled to a display device 110, an image acquisition device 112, and a position information acquisition device 114. The display device 110 may be, for example, a head-up display (HUD), and the display device 110 may display an image by projecting a screen component, but is not limited thereto. For example, in some embodiments, the display device 110 may also be, for example, a liquid crystal display. The screen component is disposed between a user of the vehicle (e.g., a driver) and an object located outside the vehicle (e.g., other vehicles, pedestrians, bicycles, etc., but is not limited thereto), and the screen component may be, for example, a front windshield of the vehicle, but is not limited thereto. In some embodiments, the screen component may also be, for example, a rear window glass or a side window glass. Alternatively, in the case where the display device 110 is a liquid crystal display, the screen component may be, for example, a display panel of a liquid crystal display. The image acquisition device 112 may be, for example, a camera, which is disposed on the vehicle to acquire an image outside the vehicle, for example, an image may be acquired in the direction of travel of the vehicle to generate an acquired image, but is not limited thereto. In the case where the image acquisition device 112 includes multiple cameras, the image acquisition device 112 can also acquire images in different directions. The position information acquisition device 114 is used to acquire the position information of objects around the vehicle, such as the position information of other vehicles, pedestrians, bicycles, etc. around the vehicle. The position information acquisition device 114 may, for example, include a wireless communication device. In the case where the vehicle can communicate with the surrounding objects, for example, the objects around the vehicle are other vehicles or pedestrians that can communicate (for example, pedestrians communicating through mobile phones), the position information acquisition device 114 can receive the position information of other vehicles from the mobile phones of other vehicles or pedestrians through wireless communication. In the case where the vehicle cannot communicate with the surrounding objects, for example, the surrounding objects are pedestrians that cannot communicate, the position information acquisition device 114 can, for example, connect to a cloud server to acquire the information of the road monitoring camera (for example, the image information of pedestrians captured by the road monitoring camera and the position information of the road monitoring camera), and then acquire the position information of the pedestrians that cannot communicate. In some embodiments, the position information acquisition device 114 may also include the image acquisition device 112 . That is, the position information acquisition device 114 may also obtain the position information of the object photographed by the image acquisition device 112 based on the image captured by the image acquisition device 112 .

[0023] Taking the display device 110 as a head-up display as an example, the display control device 100 can control the display device 110 to project a position information image representing the position information of the target visual object on the screen component in the first mode or the second mode, wherein the target visual object can be, for example, an object with a greater probability of colliding with the vehicle, such as other vehicles, pedestrians or bicycles in the direction of the vehicle, but not limited to this, and the target visual object can also be an object within a default range around the vehicle, and not limited to the object in front of the vehicle. In addition, the first mode and the second mode correspond to different position information images, such as position information images corresponding to different shapes or colors. Further, the display control device 100 may include a vehicle position recognition unit 102, a map information acquisition unit 104, an image acquisition unit 106 and an object position acquisition unit 108, and the vehicle position recognition unit 102, the map information acquisition unit 104, the image acquisition unit 106 and the object position acquisition unit 108 can be implemented, for example, by a processor, an electronic control unit (ECU) or a microcontroller (MCU), but not limited to this.

[0024] The vehicle position identification unit 102 is used to identify the current position of the vehicle. For example, the vehicle position identification unit 102 can obtain the current position of the vehicle through a global positioning system (GPS) receiver. The map information acquisition unit 104 is used to obtain map information including information about the road on which the vehicle is traveling. The map information can be stored in a memory chip of an onboard computer, but is not limited thereto. The image acquisition unit 106 is used to obtain an image provided by the image acquisition device 112. The object position acquisition unit 108 can obtain the position information of the target visual object from the position information acquisition device 114.

[0025] The display control device 100 can control the display device 110 to project a position information image on the screen component in a first mode or a second mode according to the current position of the vehicle, map information, acquired images, and position information of the target visual object. Further, the display control device 100 can determine whether the user of the vehicle can see the target visual object through the screen component according to the current position of the vehicle, map information, acquired images, and position information of the target visual object. When it is determined that the user of the vehicle can see the target visual object through the screen component, the display control device 100 can control the display device 110 to project a position information image representing the position information of the target visual object on the screen component in a first mode. For example, if Figure 2 As shown, assuming that Figure 2In the embodiment, the screen component is the front windshield SCR1 of the vehicle, and the target visual object is another vehicle TA1 in front of the right side of the vehicle. The display control device 100 can control the display device 110 to project the first mode of the position information image PA1 representing the position information of the vehicle TA1 on the front windshield SCR1, so that the user of the vehicle can see the position information image PA1 superimposed on the vehicle TA1. In the present embodiment, the position information image PA1 is a solid circular pattern, but it is not limited to this. In other embodiments, the position information image PA1 can also be, for example, a solid triangular pattern, a square pattern, or a pattern of other shapes. It is worth noting that in some embodiments, the display control device 100 can also control the display device 110 to project the position information image PA1 at other positions on the front windshield SCR1, and it is not limited to the need to enable the user of the vehicle to see the position information image PA1 superimposed on the vehicle TA1. The display device 110 can also be controlled to project the position information image PA1 at a position near the vehicle TA1 instead of superimposing it on the vehicle TA1 (from the perspective of the user of the vehicle). Alternatively, the display device 110 may be controlled to project the position information image PA1 in other ways that can express the relative position relationship between the vehicle driven by the user and the vehicle TA1, such as projecting the position information image PA1 at any position on the right half of the front windshield SCR1, but is not limited to this.

[0026] In addition, when the display control device 100 determines that the user of the vehicle cannot see the target visual object through the screen component, the display control device 100 can control the display device 110 to project a position information image representing the position information of the target visual object on the screen component in the second mode, so that the user of the vehicle can still know the position of the target visual object through the projected position information image when the user cannot directly see the target visual object. Figure 3 As shown in FIG. 1 , assuming that vehicle CA1 is a vehicle having the display control device 100, vehicle TA1 is a target visual object, and the user of vehicle CA1 cannot see vehicle TA1 due to the obstruction of building BD1, the display control device 100 may be as follows Figure 4 As shown, the control display device 110 projects the second mode position information image PA2 representing the position information of the vehicle TA1 on the front windshield SCR1, so that the user of the vehicle can see the position information image PA2 superimposed on the vehicle TA1. In this embodiment, the position information image PA2 is a circular pattern with a hollow transparent central portion. Similarly, the pattern of the position information image PA2 is not in the form of a circle. Figure 4The embodiment is not limited to the above, and it may also be, for example, a triangular pattern, a square pattern, or a pattern of other shapes with a hollow transparent central portion. In addition, in other embodiments, the display control device 100 may also control the display device 104 to project the information image PA2 at a position that does not overlap with the vehicle TA1 (from the perspective of the vehicle user). In this way, regardless of whether the user of the vehicle CA1 can see the vehicle TA1 through the front windshield SCR1, the corresponding position information image of the vehicle TA1 can be provided, so that the user of the vehicle can know the position information of the vehicle TA1, which can greatly improve the driving safety of the vehicle CA1, and thus provide a sustainable transportation system that can improve the safety and convenience of traffic.

[0027] It is worth noting that in Figure 2 to Figure 4 In the embodiment of the invention, the front windshield is used as an example for explanation. However, in other embodiments, the screen component is not limited to the front windshield. For example, the screen component may also be a rear window. Similarly, the display control device 100 may also control the display device 110 to project a position information image representing the position information of the target visual object on the rear window in the first mode or the second mode. In this way, when the user of the vehicle performs a reversing operation, the position information of the target visual object can also be obtained through the position information image on the rear window, thereby improving the driving safety of the vehicle CA1. In addition, in Figure 3 In the embodiment, the object blocking the vehicle TA1 is the building BD1, but it is not limited thereto. In other embodiments, the object blocking the vehicle TA1 may also be, for example, other vehicles (such as a large truck) or other objects that may block the vehicle TA1. In some embodiments, the screen component may also be, for example, a side window glass, and the display control device 100 may also control the display device 110 to project a position information image representing the position information of the target visual object on the side window glass in the first mode or the second mode, so that the driver can more comprehensively understand the surrounding conditions of the vehicle CA1.

[0028] Figure 5 , Figure 6 is a schematic diagram of displaying a position information image according to an embodiment of the present invention. Figure 5 , Figure 6 The embodiment is different from the above embodiment in that Figure 5 , Figure 6 In the embodiment, the display device 110 may be implemented as a liquid crystal display, for example, and the screen component is Figure 5 , Figure 6 In the embodiment, the display panel PL1 is a liquid crystal display. Figure 5In an embodiment, a user U1 of a vehicle can see a vehicle TA1. The display control device 100 can control the display device 110 to display a position information image PA1 representing the position information of the vehicle TA1 on the screen component in a first mode. The position information image PA1 is located on an imaginary line between the user U1 and the vehicle TA1 (as shown by the dotted line between the vehicle TA1 and the user U1), so that the user U1 can see the vehicle TA1 and the position information image PA1 at the same time in his line of sight. Similarly, the position information image PA1 is not limited to a solid circular pattern. In other embodiments, the position information image PA1 may also be, for example, a solid triangular pattern, a square pattern, or a pattern of other shapes. In addition, Figure 6 In the embodiment, the user U1 of the vehicle cannot see the vehicle TA1. At this time, the display control device 100 can control the display device 110 to display the position information image PA2 representing the position information of the vehicle TA1 on the screen component in the second mode. Similarly, the position information image PA2 is located on the imaginary line between the user U1 and the vehicle TA1 (as shown by the dotted line between the vehicle TA1 and the user U1), so that the user U1 can know the relative position relationship between the vehicle TA1 and the vehicle driven by the user U1 through the display position of the position information image PA2. The pattern of the position information image PA2 is not Figure 6 The present invention is not limited to the embodiment, and it may also be, for example, a triangular pattern, a square pattern or a pattern of other shapes with a hollow transparent central portion.

[0029] Figure 7It is a flow chart of a display control method for a display control system applicable to a vehicle according to an embodiment of the present invention. It can be seen from the above embodiment that the display control method of the display control system may, for example, include the following steps. First, the current position of the vehicle is identified (step S702). Next, map information including information about the road on which the vehicle is traveling is obtained (step S704). Then, an acquired image generated by acquiring an image toward the outside of the vehicle is obtained (step S706). Thereafter, the position information of the target visual object is obtained (step S708). Then, a position information image representing the position information of the target visual object is displayed on a screen component according to the current position of the vehicle, the map information, the acquired image, and the position information of the target visual object (step S710), wherein the screen component is disposed between the target visual object and the user of the vehicle. Thereafter, it is determined whether the user of the vehicle can see the target visual object through the screen component (step S712). If the user can see the target visual object, a position information image representing the position information of the target visual object is displayed on the screen component in a first mode (step S714). If the user cannot see the target visual object, a position information image representing the position information of the target visual object is displayed on the screen component in a second mode (step S716), wherein the position information image of the first mode may, for example, be a solid pattern, and the position information image of the second mode may, for example, be a pattern with a hollow transparent central portion.

[0030] In summary, the embodiments of the present invention can display a position information image representing the position information of a target visual object on a screen component according to the current position of the vehicle, map information, acquired images, and the position information of the target visual object. When the user of the vehicle can see the target visual object, the position information image representing the position information of the target visual object is displayed on the screen component in a first mode, and when the user of the vehicle cannot see the target visual object, the position information image representing the position information of the target visual object is displayed on the screen component in a second mode. In this way, regardless of whether the user can see the target visual object or not, the corresponding position information image of the target visual object can be provided, so that the user of the vehicle can know the position information of the target visual object, which can greatly improve the driving safety of the vehicle, and further provide a sustainable transportation system that can improve the safety and convenience of traffic.

[0031] Although the present invention has been disclosed as above by way of embodiments, it is not intended to limit the present invention. Any person skilled in the art may make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, the protection scope of the present invention shall be determined by the claims.

Claims

1. A display control system, suitable for a vehicle, characterized in that: include: A display control device controls the display device to display a position information image representing position information of a target visual object on a screen component in a first mode, wherein the screen component is disposed between the target visual object and a user of the vehicle, the display control device comprising: A vehicle position identification unit, identifying the current position of the vehicle; The display control device controls the display device to display the position information image on the screen component according to the current position of the vehicle, map information of the road on which the vehicle is traveling, an image obtained from the outside of the vehicle, and the position information of the target visual object. When the user can see the target visual object, the display control device controls the display device to display the position information image representing the position information of the target visual object on the screen component in the first mode. When the user cannot see the target visual object, the display control device controls the display device to display the position information image representing the position information of the target visual object on the screen component in a second mode.

2. The display control system according to claim 1, characterized in that: The position information image of the second mode has a hollow and transparent central portion.

3. The display control system according to claim 1, characterized in that: The screen component is the glass of the vehicle, and the display control device controls the display device to project the position information image on the screen component, so that the user can see the position information image superimposed on the target visual object.

4. The display control system according to claim 1, characterized in that: The screen component is a display panel, and the display control device controls the display device to display the position information image on the screen component. The position information image is located on an imaginary line between the user and the target visual object.

5. A display control method of a display control system, applicable to a vehicle, characterized in that: include: identifying a current location of the vehicle; displaying the position information image representing the position information of the target visual object on a screen component based on the current position of the vehicle, map information of the road on which the vehicle is traveling, an acquired image of the exterior of the vehicle, and the position information of the target visual object, wherein the screen component is disposed between the target visual object and a user of the vehicle; Determining whether the user can see the target visual object; When the user can see the target visual object, displaying the position information image representing the position information of the target visual object on the screen component in a first mode; as well as When the user cannot see the target visual object, the position information image representing the position information of the target visual object is displayed on the screen component in a second mode.

6. The display control method of the display control system according to claim 5, characterized in that: The position information image of the second mode has a hollow and transparent central portion.