Display device and display method for a vehicle

By using sensor devices to detect objects around the vehicle, the control module reads and tracks object information, and provides passengers with avoidance priorities and driving paths through an information display, the problem of drivers lacking information about surrounding objects is solved, thus improving driving safety and passenger comfort.

CN112758013BActive Publication Date: 2026-01-27HYUNDAI MOTOR CO LTD +2
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202011204290.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-11-04
Filing Date
2020-11-02
Publication Date
2026-01-27
Estimated Expiration
2040-11-02

AI Technical Summary

Technical Problem

In existing technologies, vehicle drivers lack continuous display of real-time information on objects around the vehicle and avoidance priorities, resulting in insufficient driving safety and passenger comfort.

Method used

The system uses sensor devices to detect objects around the vehicle, reads and tracks these objects through a control module, and provides passengers with continuous visual information, including object avoidance priorities and driving paths, through an information display.

Benefits of technology

It improves vehicle driving safety and passenger comfort by displaying real-time information about objects around the vehicle and avoidance priorities, providing psychological relaxation and a sense of security.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112758013B_ABST
    Figure CN112758013B_ABST
Patent Text Reader

Abstract

The present disclosure relates to a display device of a vehicle. The display device of the vehicle includes a sensor device for detecting an object located around the vehicle, a control module for reading and tracking the detected object based on a detection result of the sensor device, and an information display for providing a reading and tracking result of the object of the control module as continuous visual information to an occupant of the vehicle.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Cross-references to related applications

[0002] This application claims the benefit of priority to Korean Patent Application No. 10-2019-0139697, filed with the Korean Intellectual Property Office on November 4, 2019, the entire contents of which are incorporated herein by reference. Technical Field

[0003] This disclosure relates to a display device and display method for a vehicle. Background Technology

[0004] A driver in a vehicle uses the vehicle to move in a desired direction. A car is a typical example. Currently, vehicles are equipped with various sensors and electronic devices to facilitate user operation. In particular, research on advanced driver assistance systems (ADAS) has been actively conducted to facilitate drivers, leading to the active development of autonomous vehicles. Summary of the Invention

[0005] This disclosure is made to solve the aforementioned problems that occur in the prior art, while perfectly preserving the advantages of the prior art implementation.

[0006] One aspect of this disclosure provides a display device and display method for a vehicle, which continuously provides vehicle information and information on objects with application priority within the driving radius to the vehicle's passengers based on the vehicle's driving direction and driving conditions.

[0007] The technical problems to be solved by the present invention are not limited to those described above, and any other technical problems not mentioned herein should be clearly understood by those skilled in the art to which this disclosure pertains based on the following description.

[0008] According to one aspect of this disclosure, the vehicle's display device includes: a sensor device for detecting objects located around the vehicle; a control module for reading and tracking the detected objects based on the detection results of the sensor device; and an information display for providing the reading and tracking results of the objects by the control module as continuous visual information to the vehicle's passengers.

[0009] According to another aspect of this disclosure, a vehicle object tracking display method includes the following steps: detecting objects in a sensing area around the vehicle; tracking the detected objects; selecting an object avoidance priority based on the reading and tracking results of the detected objects; determining the vehicle's driving path based on the object avoidance priority; and displaying object tracking for displaying the detected objects, the selected avoidance priority, and the determined driving path. Attached Figure Description

[0010] The above and other objects, features, and advantages of this disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings:

[0011] Figure 1 This is a diagram illustrating the configuration of a display device in a vehicle according to an embodiment of the present disclosure;

[0012] Figure 2 This shows the application. Figure 1 A diagram showing the exterior of the vehicle with the sensor device shown;

[0013] Figure 3 It is shown Figure 1 A diagram illustrating the operation of the information display shown;

[0014] Figure 4 This is a diagram illustrating the operation flow of a display device for a vehicle according to an embodiment of the present disclosure;

[0015] Figure 5 , Figure 6A and Figure 6B This is a diagram illustrating the operation of a display device for a vehicle according to an embodiment of the present disclosure;

[0016] Figure 7 A computing system is shown that performs a method according to an embodiment of the present disclosure. Detailed Implementation

[0017] In the following, some embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. When adding reference numerals to components in each drawing, it should be noted that identical or equivalent components are represented by the same numerals, even if they are shown in other drawings. Furthermore, in describing embodiments of the present disclosure, detailed descriptions related to known configurations or functions will be omitted when it is determined that such detailed descriptions would affect the understanding of the embodiments of the present disclosure.

[0018] In describing components according to embodiments of the present disclosure, terms such as first, second, A, B, (a), (b), etc., may be used. These terms are intended only to distinguish a component from other components, and they do not limit the nature, order, or sequence of the components. Unless otherwise defined, all terms used herein, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure pertains. It should be further understood that terms such as those used in general dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant art, and should not be interpreted in an idealized or overly formal sense unless expressly defined herein. When a component, apparatus, element, etc., of the present disclosure is described as having a purpose or performing an operation or function, etc., herein the component, apparatus, element should be considered as being "configured" to achieve that purpose or perform that operation or function. Furthermore, the controller described herein may include a processor programmed to perform specified operations, functions, etc.

[0019] Figure 1 This is a diagram illustrating the configuration of a display device for a vehicle according to an embodiment of the present disclosure.

[0020] The display device 100 of a vehicle according to an embodiment of the present disclosure can be implemented inside a vehicle. In this case, the display device 100 can be integrally formed with the vehicle's internal control unit, or it can be implemented as a separate device and connected to the vehicle's control unit via a separate connection device. In this case, the display device 100 can operate in connection with the vehicle's engine and motor, and can also operate in connection with the control unit that controls the operation of the engine and motor.

[0021] Reference Figure 1 The vehicle display device 100 according to embodiments of the present disclosure may include a sensor device 110, a control module 120, and an information display 130. Accordingly, the control module 120 of the vehicle display device 100 according to embodiments of the present disclosure may be implemented as at least one processor.

[0022] Sensor device 110 may include means and sensors for detecting objects located outside the vehicle to obtain driving safety information. These objects can be various objects related to vehicle movement. For example, the object may include a lane, another vehicle, a pedestrian, a two-wheeled vehicle, a traffic signal, light, a road, a building, a speed bump, terrain, an animal, etc.

[0023] A lane can be a driving lane, a lane adjacent to a driving lane, or a lane for oncoming vehicles. A lane can also include the left and right lanes that form a lane.

[0024] The other vehicle can be a vehicle traveling around the vehicle. The other vehicle can be a vehicle within a predetermined distance of the vehicle. For example, the other vehicle can be a vehicle in front of or behind the vehicle.

[0025] Pedestrians can be people located around a vehicle. Pedestrians can also be people within a predetermined distance of a vehicle. For example, pedestrians can be people located on a sidewalk or road.

[0026] A two-wheeled vehicle can be a vehicle located around a vehicle and moving using two wheels. A two-wheeled vehicle can be a vehicle with two wheels located at a predetermined distance from a vehicle. For example, a two-wheeled vehicle can include a motorcycle or bicycle located on a sidewalk or road.

[0027] Traffic signals can include traffic lights, traffic signs, patterns or text painted on the road surface.

[0028] Light can be the light produced by a lamp installed in another vehicle. Light can be the light produced by a street lamp. Light can be sunlight.

[0029] Roads can include road surfaces, curves, and slopes such as uphill and downhill sections.

[0030] A structure can be an object located around a road and fixed to the ground. For example, structures can include streetlights, street trees, buildings, utility poles, traffic lights, bridges, etc.

[0031] Terrain can include mountains, hills, etc.

[0032] In one example, objects can be categorized into moving objects and stationary objects. For instance, moving objects could include concepts such as another vehicle, a two-wheeled vehicle, a pedestrian, etc. Stationary objects could include concepts such as traffic signals, roads, buildings, etc.

[0033] The sensor device 110 may include a camera, radar, lidar, ultrasonic sensor, infrared sensor, etc.

[0034] Cameras are used to acquire external images of the vehicle to identify objects, light, and people around the vehicle, and can be implemented as multiple cameras connected in parallel with each other. For example, cameras may include mono cameras, stereo cameras, surround view monitor (AVM) cameras, and 360-degree cameras. In one example, cameras may be positioned appropriately within the vehicle to acquire images of its exterior. For example, cameras may be positioned around at least one of the vehicle's windshield, front bumper, and radiator grille to acquire images of the area in front of the vehicle. Cameras may be positioned around at least one of the rear window, rear bumper, trunk, and tailgate to acquire images of the area behind the vehicle. Cameras may be positioned around at least one of the vehicle's side windows, side mirrors, fenders, and doors to acquire images of the areas to the sides of the vehicle. The acquired images can be provided to control module 120.

[0035] Radar can detect objects using electromagnetic waves based on either time-of-flight (TOF) or phase-shift methods, and can detect the position, distance, and relative velocity of the detected object. Radar can be positioned appropriately outside a vehicle to sense objects in its vicinity.

[0036] LiDAR (Light Detection and Ranging) can detect objects using laser light as a medium, based on either a time-of-flight (TOF) or phase-shifting method. It can detect the position of the detected object, its distance, and its relative velocity. LiDAR can be positioned appropriately outside a vehicle to sense objects around it.

[0037] An ultrasonic sensor is a sensor that generates ultrasonic waves to detect distance, thickness, motion, etc. It can also detect objects and detect the position, distance, and relative speed of the detected objects.

[0038] Infrared sensors can emit and receive infrared light to detect objects and determine the position, distance, and relative speed of the detected objects.

[0039] The sensor device 110 may include cameras, radar, lidar, ultrasonic sensors, infrared sensors, etc. for detecting objects outside the vehicle, and the detection results of each component of the sensor device 110 may be provided to the control module 120.

[0040] The control module 120 can control the operation of the camera, radar, lidar, ultrasonic sensor, infrared sensor, etc., constituting the sensor device 110. Furthermore, the control module 120 can receive sensing information from the camera, radar, lidar, ultrasonic sensor, and infrared sensor to detect and read objects outside the vehicle, sense hazards based on the vehicle's direction of travel, and visually display the sensed hazards to the vehicle's passengers via the information display 130. In this way, the controller 120 can select and display the avoidance priority of the detected and read objects, and can display hazards based on the direction of travel. For example, the control module 120 can match the avoidance priority selected based on the read information of objects outside the vehicle with each object, and can provide the objects matching the avoidance priority as visual information to the passengers via the information display 130.

[0041] Furthermore, the control module 120 can detect and read objects around the vehicle to set a safe path based on the vehicle's driving direction, and can visually display the set safe path through the information display 130. For example, the control module 120 can read objects detected around the vehicle, and when the read object is a collision avoidance target, it sets the vehicle's driving direction based on the collision avoidance direction setting, and can visually display the set driving direction as a safe path through the information display 130. Thus, collision avoidance targets can include those based on information about the position, relative speed, approach distance, and yaw rate behavior of the counter vehicle, such as speeding vehicles, fatigued drivers, and other collision avoidance targets that violate driving safety.

[0042] The control module 120 can continuously track the detected objects and provide the continuously tracked objects as continuous visual information to the passenger through the information display 130.

[0043] An example of the operation of the control module 120 in selecting the avoidance priority for detected objects is disclosed below.

[0044] According to an embodiment of the present disclosure, the control module 120 of the display device can select pedestrians reflected in the vehicle's travel trajectory as having the highest avoidance priority. Furthermore, the control module 120 can highlight the selected object as having the highest avoidance priority to distinguish it from other objects, and allows the highlighted object to be displayed on the information display 130. For example, the control module 120 can display the selected object as having the highest avoidance priority in a highlighted color (e.g., red), and display warning signs such as letters, images, symbols, etc., on the information display 130 at a position adjacent to the selected object as having the highest avoidance priority.

[0045] According to an embodiment of the present disclosure, the control module 120 of the display device can select a two-wheeled vehicle carrying a user as a second avoidance priority, which is reflected in the vehicle's driving trajectory, and display the two-wheeled vehicle on the information display 130. For example, the control module 120 can display the object selected as the second avoidance priority in blue on the information display 130.

[0046] According to an embodiment of the present disclosure, the control module 120 of the display device can select an opposing vehicle reflected in the vehicle's driving trajectory as a third avoidance priority and display the opposing vehicle on the information display 130. For example, the control module 120 can display the object selected as the third avoidance priority in yellow on the information display 130.

[0047] In addition, the control module 120 can manage large trucks and vehicles suspected of speeding or fatigue driving separately based on the level of danger reflected in the vehicle's driving trajectory. For example, the control module 120 can select a large truck as the second priority object to avoid, and select an object that may cause an accident, such as a vehicle suspected of speeding or fatigue driving, as the first priority object to avoid, i.e., the highest priority object to avoid.

[0048] According to embodiments of the present disclosure, the control module 120 of the display device can display or not display detected objects on the information display 130 based on passenger switching operations. In one example, when an object is not displayed on the information display 130 via passenger switching operations, the control module 120 can display the detected object on the information display 130 if the avoidance priority of the detected object is equal to or higher than a preset avoidance priority. Additionally, when the vehicle is traveling in a hazardous area such as an accident-prone area, the control module 120 can display the detected object on the information display 130. Thus, the control module 120 can combine navigation or GPS to determine if the vehicle is traveling in a hazardous area.

[0049] Information display 130 may include a transparent display, projector, or head-up display (HUD) type information display device displayed on the vehicle glass. Vehicle glass may include a windshield, sunroof, doors, windows, rear window, interior mirror, exterior mirror, etc.

[0050] Figure 2 This shows the application. Figure 1 A diagram showing the exterior of the vehicle with the sensor device. Figure 2 The exterior of a vehicle equipped with sensor devices 110, such as cameras, lidar, and radar, capable of sensing the area around the vehicle, has been disclosed. Figure 2 This is merely an example and does not limit the location of each component of the sensor device 110.

[0051] The camera may include a front-facing camera capable of capturing the area in front of the vehicle, a rear-facing camera capable of capturing the area behind the vehicle, and a side-facing camera capable of capturing the sides of the vehicle. In this regard, at least one of the front-facing, rear-facing, and side-facing cameras may include multiple cameras connected in parallel with each other. In one embodiment, the front-facing camera for capturing the area in front of the vehicle may include multiple cameras connected in parallel with each other. The camera can identify objects, light, and people around the vehicle.

[0052] LiDAR can be used to identify components around a vehicle using laser light within a 360-degree angular range. A LiDAR that senses the area around a vehicle within a 360-degree angular range can be called a 360-degree LiDAR. Furthermore, although... Figure 2 This demonstrates a 360-degree lidar system capable of identifying the area around a vehicle within a 360-degree angular range. However, it is also possible to install lidar systems on the vehicle capable of identifying each area in front of and behind the vehicle, as well as each area on the left and right sides of the vehicle. Figure 2 In this system, LiDAR and cameras can be positioned at locations that allow for good identification of vehicles around the vehicle, such as the highest point of the vehicle (the roof).

[0053] Radar uses electromagnetic waves to identify obstacles near a vehicle. Each radar can be positioned at each of the front and rear sections of the vehicle to identify vehicles in front of the vehicle, vehicles behind the vehicle, and nearby obstacles. For example, each radar can be positioned on each of the front and rear bumpers of the vehicle.

[0054] Additionally, the vehicle may include a Global Positioning System (GPS) and a main computer. The GPS receiver, one of the components comprising the GPS, may be mounted on the roof. The main computer may be located in the vehicle's trunk, and may include a control module according to embodiments of this disclosure. Recently, there has been an increasing development of vehicles, such as Advanced Driver Assistance Systems (ADAS) for autonomous driving, which include a main computer capable of determining the current state of the vehicle based on sensor detection results for the safety and convenience of vehicle passengers.

[0055] Figure 3 This is a diagram illustrating an embodiment of an information display included in a display device of a vehicle according to an embodiment of the present disclosure. Figure 3 This is a conceptual diagram illustrating the operation of an augmented reality image displayed through a windshield by an information display 130. Further, it is assumed that the information display 130 is a head-up display (HUD).

[0056] The control module 120 can be connected to the sensor device 110 to generate image data for forming augmented reality images based on the sensing results of cameras, radar, lidar, ultrasonic sensors, infrared sensors, etc., and provide the generated image data to the information display 130.

[0057] Under the control of the control module 120, the information display 130 can project light onto the windshield to display augmented reality images.

[0058] For example, the control module 120 can detect objects present in front of the vehicle based on the forward image provided by the camera of the sensor device 110, and provide image data for forming an augmented reality image corresponding to the detected object to the information display 130.

[0059] Augmented reality images can thus be achieved using display light projected onto the windshield. Furthermore, the driver may see the augmented reality image displayed outside the display area of ​​an object (e.g., a vehicle), rather than within the windshield's display area. For example, the augmented reality image could be a graphic object providing information about the object's outline and speed, a collision warning, or similar information.

[0060] exist Figure 3 The function of the information display 130 has already been described using the example of the information display 130 as a HUD. However, when the information display 130 is a projector, similar to a HUD, the projector can provide augmented reality images to the driver by projecting display light onto the windshield. Furthermore, when the information display 130 is a transparent display, unlike HUDs and projectors that project display light onto the windshield, the augmented reality image can be directly displayed on the windshield.

[0061] Figure 4 This is a diagram illustrating the operation flow of a display device for a vehicle according to an embodiment of the present disclosure. Figure 4 The operation of the display device for a vehicle capable of autonomous driving is shown, and this operation can be the same as the operation of the display device for a vehicle equipped with an Advanced Driver Assistance System (ADAS). Therefore, the step of determining autonomous driving (S11) can be equivalent to the step of activating the Advanced Driver Assistance System.

[0062] The step of determining autonomous driving (S11) may include determining whether the vehicle is performing autonomous driving operations. The control module 120 can determine whether the vehicle is driving autonomously.

[0063] The step (S12) of detecting objects in the sensing area may include detecting objects around the vehicle by operating the sensor device 110. The sensor device 110 according to embodiments of this disclosure may include a camera, radar, lidar, ultrasonic sensor, infrared sensor, etc. Furthermore, the sensing results acquired by the camera, radar, lidar, ultrasonic sensor, infrared sensor, etc., may be transmitted to the control module 120. The control module 120 may detect objects around the vehicle based on the sensing results.

[0064] The step of tracking an object (S13) may include tracking the object until the object detected in the detection sensing area (S12) is located outside the sensing area. The control module 120 may track the detected object until, based on the sensing results of the camera, radar, lidar, ultrasonic sensor, infrared sensor, etc., the detected object moves away from the vehicle by more than a preset distance.

[0065] The step (S14) of selecting a hazard level based on tracking information may include: reading objects detected around the vehicle, and selecting an avoidance priority for an object when the read object is an object to be avoided. For example, in the step (S14) of selecting a hazard level based on tracking information, an object read as a pedestrian may be selected as a first avoidance priority (Lv1), a two-wheeled vehicle with a user may be selected as a second avoidance priority (Lv2), and other vehicles around the vehicle may be selected as a third avoidance priority (Lv3). Thereby, by applying a weight value (K = Lv weight value), an object sensed as dangerous among the objects of the third avoidance priority may be selected as a second avoidance priority, and an object that may cause an accident may be selected as a first avoidance priority by applying a weight value (K = Lv).

[0066] The step of setting a driving path based on the hazard level (S15) may include setting the driving direction of the vehicle according to the avoidance direction setting based on the object avoidance priority selected in the step of selecting the hazard level based on the tracking information (S14), where the avoidance priority is the avoidance priority of the object selected in the step of selecting the hazard level based on the tracking information (S14).

[0067] The step (S16) of setting a tracking priority and setting a zone based on the hazard level of each object may include setting the tracking priority based on the avoidance priority assigned to each object. Further, the step of setting a tracking priority and setting a zone based on the hazard level of each object may include setting a hazard zone, and automatically displaying the detected object on the information display 130 when the vehicle enters the hazard zone. In this regard, the control module 120 may be connected to a navigation or GPS system to determine whether the vehicle is traveling in a hazard zone.

[0068] The step of masking hazards based on autonomous driving judgment (S17) may include matching different indications to objects based on the avoidance priority of the detected objects. For example, objects with the first avoidance priority may be displayed in red, objects with the second avoidance priority in blue, and objects with the third avoidance priority in yellow.

[0069] The step of determining whether to display object tracking (S18) may include: providing the passenger with the tracking result of the detected object as continuous visual information via the information display 130 based on the passenger's switch operation, or continuously performing object detection and tracking without providing the tracking result as visual information to the passenger. For example, in the step of determining whether to display object tracking (S18), if it is determined that the passenger's switch operation result is receiving the tracking result of the detected object as visual information (Yes), the step of continuously displaying object tracking (S19) may be performed. On the other hand, in the step of determining whether to display object tracking (S18), if it is determined that the passenger's operation result is not receiving the tracking result of the detected object as visual information (No), tracking may be performed continuously but object tracking may not be displayed (S20). Thus, in the step of determining whether to display object tracking (S18), even if it is determined that the passenger's operation result is not receiving the tracking result of the object as visual information, and when the vehicle enters or travels to the danger zone set in the step of setting a tracking priority and setting an area for the danger level of each object (S16), the step of continuously displaying object tracking (S19) may be automatically performed.

[0070] The step of continuously displaying object tracking (S19) may include providing the tracking results of the detected objects as continuous visual information to the customer via the information display 130.

[0071] The step of continuously performing tracking but not displaying object tracking (S20) may include continuously performing object detection and tracking, but not displaying the tracking results as visual information to the passenger.

[0072] Figure 5 Figure 6 is a diagram illustrating the operation of a display device for a vehicle according to an embodiment of the present disclosure. Figure 5 Figure 6 illustrates a display device for a vehicle according to an embodiment of the present disclosure applied to the windshield of the vehicle. The windshield may be a transparent display. Alternatively, the display light from a HUD or projector may be projected onto the windshield.

[0073] Figure 5 A display device for a vehicle according to an embodiment of the present disclosure displays objects based on avoidance priority. Thus, in the display device for a vehicle according to an embodiment of the present disclosure, each detected object can be displayed in a rectangular shape surrounding each object.

[0074] When the detected object is determined to be pedestrian A, the detected object can be selected as the highest avoidance priority, i.e., the first avoidance priority. The rectangle surrounding pedestrian A can be displayed in red.

[0075] When it is determined that the detected object is a two-wheeled vehicle B being ridden by a user, the detected object can be selected as the second priority for avoidance. The rectangle surrounding the user and the two-wheeled vehicle can be displayed in blue.

[0076] When the detected object is determined to be another vehicle C, it can be selected as the third priority for avoidance. The rectangle surrounding the other vehicle can be displayed in yellow.

[0077] Figure 6A and 6B This illustrates a scenario where the avoidance priority of one of the detected objects is changed by applying weight values.

[0078] Figure 6A This is a view showing objects detected by the moving vehicle, illustrating the first through fourth opposing vehicles A, B, C, and D. In this context, the third avoidance priority Lv3 can be applied to all of the first through fourth opposing vehicles A, B, C, and D, so objects matching the first through fourth opposing vehicles A, B, C, and D can be displayed in yellow.

[0079] However, when the danger of the second opposing vehicle B is sensed, such as Figure 6B As shown, an alert can be displayed and a weight value can be applied to the second opposing vehicle B. Therefore, the avoidance priority of the second opposing vehicle B can be increased from the third avoidance priority to the second avoidance priority, and the second opposing vehicle B can be displayed in blue. Additionally, a safe driving path E based on the applied avoidance priority can be displayed. In the case of an autonomous vehicle, the steering and acceleration of the autonomous vehicle are controlled based on the path displayed as the safe driving path E, allowing the autonomous vehicle to further distance itself from the vehicle with the increased avoidance priority.

[0080] As described above, the vehicle display device according to embodiments of the present disclosure can provide passengers with psychological relaxation by providing the sensing results of environmental hazards of the vehicle as continuous visual information.

[0081] Figure 7 A computing system is shown that performs a method according to an embodiment of the present disclosure.

[0082] Reference Figure 7The computing system 1000 may include at least one processor 1100, a memory 1300, a user interface input device 1400, a user interface output device 1500, a storage device 1600, and a network interface 1700 connected via a bus 1200.

[0083] Processor 1100 may be a central processing unit (CPU) or a semiconductor device that executes processing of instructions stored in memory 1300 and / or storage device 1600. Memory 1300 and storage device 1600 may include various types of volatile or non-volatile storage media. For example, memory 1300 may include ROM (Read-Only Memory) 1310 and RAM (Random Access Memory) 1320.

[0084] Therefore, the operation of the methods or algorithms described in conjunction with the embodiments disclosed herein can be directly implemented in a hardware or software module, or a combination of hardware and software modules, run by processor 1100. The software module may reside in a storage medium such as RAM, flash memory, ROM, EPROM, EEPROM, registers, hard disk, removable disk, or CD-ROM (i.e., memory 1300 and / or memory 1600). This storage medium is coupled to processor 1100, which can read information from and write information to the storage medium. In another approach, the storage medium may be integrated with processor 1100. The processor and storage medium may reside within an application-specific integrated circuit (ASIC). The ASIC may reside within a user terminal. In yet another approach, the processor and storage medium may reside as separate components within the user terminal.

[0085] The above description is merely an illustration of the technical concept of this disclosure, and various modifications and changes can be made by those skilled in the art without departing from the basic features of this disclosure.

[0086] Therefore, specific embodiments of this disclosure are provided to explain the spirit and scope of this disclosure, and not to limit them, so that the spirit and scope of this disclosure are not limited by the embodiments. The scope of this disclosure should be interpreted based on the appended claims, and all technical concepts equivalent to the scope of the claims should be included within the scope of this disclosure.

[0087] According to this disclosure, vehicle driving information and tracking and detection of objects outside the vehicle can be displayed to passengers in a moving vehicle, thereby providing psychological relaxation to the driver.

[0088] In the foregoing, although the present disclosure has been described with reference to specific embodiments and accompanying drawings, the present disclosure is not limited thereto. Various modifications and changes can be made to the present disclosure by those skilled in the art without departing from the spirit and scope of the present disclosure as claimed in the appended claims.

Claims

1. A display device for a vehicle, comprising: Sensor devices detect objects located around the vehicle; The control module reads and tracks the detected objects based on the detection results from the sensor device; as well as The information display provides the vehicle's passengers with continuous visual information, based on the object reading and tracking results from the control module. The control module is configured as follows: Based on the detection results of the sensor device, the detected objects are read to select the avoidance priority of the read objects; Based on the readings of the detected objects, pedestrians, two-wheeled vehicles, and combat vehicles are classified; and The pedestrian is selected as the first priority to avoid, the two-wheeled vehicle as the second priority to avoid, and the opposing vehicle as the third priority to avoid. The control module will select objects with the highest avoidance priority to highlight them to distinguish them from other objects, and will allow the highlighted objects to be displayed on the information display.

2. The display device according to claim 1, wherein, The sensor device includes at least one of a camera, radar, lidar, ultrasonic sensor, and infrared sensor for detecting the object.

3. The display device according to claim 1, wherein, When a dangerous situation of the object with the selected avoidance priority is sensed, the control module applies a weight value to the selected avoidance priority to change the avoidance priority.

4. The display device according to claim 1, wherein, The control module determines the vehicle's driving path based on the avoidance priority.

5. The display device according to claim 1, further comprising: A switch is used to determine whether to provide visual information to the passenger based on the passenger's actions.

6. The display device according to claim 5, wherein, When the passenger is configured to block visual information from being provided to the passenger, the control module disables the blocking setting to automatically provide the visual information to the passenger when the vehicle enters a preset danger zone.

7. The display device according to claim 6, wherein, The control module is connected to a GPS or navigation system to measure the vehicle's position.

8. The display device according to claim 1, wherein, The information display shows the detected object on the windshield of the vehicle to achieve an augmented reality image.

9. The display device according to claim 8, wherein, The information display is one of a transparent display, a head-up display (HUD), or a projector.

10. A method for displaying object tracking of a vehicle, comprising the following steps: Detecting objects in a sensing area around the vehicle; Track detected objects; Based on the reading and tracking results of the detected objects, the avoidance priority of the objects is selected; The vehicle's travel path is determined based on the avoidance priority of the object. as well as The display shows the detected objects, the selected avoidance priority, and the object tracking of the driving path. The steps for selecting avoidance priority include: Based on the readings of the detected objects, pedestrians, two-wheeled vehicles, and combat vehicles are classified; and The pedestrian is selected as the first priority to avoid, the two-wheeled vehicle as the second priority to avoid, and the opposing vehicle as the third priority to avoid. Among these features, objects selected as having the highest avoidance priority are highlighted to distinguish them from other objects, and the highlighted objects are allowed to be displayed on the information display.

11. The method according to claim 10, wherein, The steps for selecting avoidance priorities further include: The selected avoidance priority is changed based on the tracking results of the object.

12. The method according to claim 11, wherein, The steps for selecting avoidance priorities include: The weight value is determined based on the tracking result of the object, and The avoidance priority is changed based on the weight value.

13. The method according to claim 10, wherein, The steps for displaying object tracking include: The detected objects, the selected avoidance priority, and the determined driving path are rendered as augmented reality images.

14. The method according to claim 13, wherein, The steps for displaying object tracking include: The augmented reality image is displayed on the windshield of the vehicle.

Citation Information

Patent Citations

  • Accident fault determination for autonomous vehicles

    US10319039B1

  • Display device for vehicle and control method thereof

    US20170187963A1

  • Object recognizing device and collision avoidance system

    US20180201260A1

  • Method of controlling mobile robot, apparatus for supporting the method, and delivery system using mobile robot

    US20190262992A1