Projection device for vehicle and operation method thereof

Abstract

A projection device for a vehicle and an operation method thereof are disclosed. The projection device for a vehicle, according to the present invention, comprises: a communication module which receives sensing data of a vehicle; an output unit which includes a first output module and a second output module configured to project an image onto each of a plurality of positions; and a processor which, on the basis of the received sensing data, generates a notification image to be displayed on the rear of the vehicle. The processor may determine a display position of a notification image on the basis of a degree of proximity of a rear object to the vehicle, and may control the output unit to project the notification image onto the determined display position by using at least one of the first and second output modules of the output unit. Accordingly, information related to driving safety of the vehicle can be selectively projected onto a more appropriate position in consideration of the degree of proximity of the rear object to the vehicle, so that the information can be transferred more favorably without disturbing driving of the surrounding vehicles, and thus accidents can be prevented.

Description

Projection device for a vehicle and its operating method

[0001] The present invention relates to a projection device for a vehicle and an operating method thereof, and more particularly, to a projection device for a vehicle capable of projecting an image onto the rear of a vehicle and an operating method thereof.

[0002] To ensure the safety and convenience of vehicle users, vehicles are equipped with various sensors and devices, and their functions are diversifying. These vehicle functions can be divided into convenience functions, which promote driver convenience, and safety functions, which ensure the safety of drivers and / or pedestrians.

[0003] Convenience features in vehicles are developed with driver convenience in mind, such as providing infotainment (information + entertainment) capabilities, supporting partial autonomous driving, or helping drivers secure their field of vision, such as at night or in blind spots. Examples include active cruise control (ACC), smart parking assist system (SPAS), night vision (NV), head-up display (HUD), around view monitor (AVM), and adaptive headlight system (AHS).

[0004] Additionally, the vehicle's safety features are technologies that ensure the safety of the driver and / or pedestrians, such as the lane departure warning system (LDWS), lane keeping assist system (LKAS), and autonomous emergency braking (AEB).

[0005] Recently, technologies are being studied to display and share various guidance information related to safe driving and driver safety on the exterior of a vehicle.

[0006] In this regard, U.S. Patent No. 9,481,287 (hereinafter, "Prior Art 1") describes a road projection system that projects images onto the road on which a vehicle is driving based on a specific driving scenario. However, in the case of Prior Art 1, when projecting images onto the road in congested traffic, not only is it difficult to recognize the images on the road, but it also interferes with the safe driving of surrounding vehicles.

[0007] Furthermore, U.S. Patent No. 9,267,656 (hereinafter, "Prior Art 2") discloses a technology that uses vehicle headlamps to indicate lane markings, enabling drivers to clearly recognize their vehicles. However, Prior Art 2 suffers from limitations in that it fails to reflect diverse information beyond the driving lane. Furthermore, useful information is provided only to the driver, and is not shared or extended to surrounding vehicles.

[0008] The present invention aims to solve the above-mentioned problems and other problems.

[0009] According to some embodiments of the present invention, the purpose is to provide a projection device for a vehicle and an operating method thereof that can visually transmit information related to the driving safety of the vehicle to surrounding vehicles or people while the vehicle is driving.

[0010] In addition, according to some embodiments of the present invention, the purpose is to provide a projection device for a vehicle and an operating method thereof that operate so as to project information at an appropriate location, taking into account the field of vision of surrounding vehicles or people receiving information related to driving safety of the vehicle.

[0011] In addition, according to some embodiments of the present invention, the purpose is to provide a projection device for a vehicle and an operating method thereof that can simultaneously project and provide images of the same or different forms containing information related to driving safety of the vehicle in multiple directions.

[0012] In addition, according to some embodiments of the present invention, the purpose is to provide a projection device for a vehicle and an operating method thereof that can provide more diverse information to a rear vehicle or a person in the vicinity in addition to information related to driving safety of the vehicle.

[0013] To this end, the projection device of the vehicle according to the present invention can project an image related to driving safety toward the rear of the vehicle based on sensing data of the vehicle.

[0014] At this time, the image related to driving safety can be selectively projected onto the rear window of the vehicle, the rear road surface, or both.

[0015] Specifically, a projection device for a vehicle according to an embodiment of the present invention may include: a communication module for receiving sensing data of the vehicle; an output unit including a first output module and a second output module configured to project images at a plurality of locations, respectively; and a processor for generating a notification image to be displayed at the rear of the vehicle based on the sensing data. At this time, the processor may determine a display position of the notification image based on a degree of approach of a rear object, and control the output unit to project the notification image at the determined display position using at least one of the first and second output modules.

[0016] According to an embodiment, the projection device is disposed at the rear of the vehicle, and the display position determined by the processor may include one or more positions specified using one or both of the first and second output modules of the output unit.

[0017] According to an embodiment, the processor may control the output unit so that at least one of the determined display position and the notification image changes in response to a change in the degree of approach of the rear object after projecting the notification image on the determined display position.

[0018] According to an embodiment, the notification image is associated with driving safety information based on the sensing data, and the associated driving safety information may be projected as different images on a first display position corresponding to the first output module and a second display position corresponding to the second output module.

[0019] According to an embodiment, the notification image includes different first and second notification images when projected at each display position, and the processor can adjust the output module to project the first notification image on the rear window of the vehicle using at least one of the first and second output modules and to project the second notification image on the rear road surface of the vehicle using the other one.

[0020] In an embodiment, the processor calculates a distance between the vehicle and the rear object based on the sensing data, and if the distance between the vehicle and the rear object satisfies a first reference distance or more and a second reference distance or less, the processor may project first and second notification images onto the rear window and the rear road surface of the vehicle, respectively, using both the first and second output modules. Here, the first reference distance is a distance shorter than the second reference distance.

[0021] According to an embodiment, the processor may deactivate the second output module and project the first notification image onto the rear window of the vehicle through the first output module when the distance between the vehicle and the rear object becomes less than the first reference distance.

[0022] According to an embodiment, the processor may project the second notification image onto the rear road surface of the vehicle through the second output module when the distance between the vehicle and the rear object becomes greater than or equal to the second reference distance.

[0023] According to an embodiment, the processor may control the operations of the first and second output modules to generate different output paths and project the notification images at different display locations through the generated different output paths.

[0024] According to an embodiment, the output unit comprises a light source and a DMD, a plurality of optical lenses, and a plurality of mirrors, and, under the control of the processor: when the first output module operates, a first output path is generated toward the first optical lens using the first mirror; when the second output module operates, a second output path is generated toward a second optical lens positioned at a different location from the first optical lens; and when both the first and second output modules operate, the first and second output paths are simultaneously generated toward the first and second optical lenses, respectively, using a second mirror different from the first mirror. In this case, the notification images are projected at different locations through different output paths.

[0025] According to an embodiment, the sensing data may include data related to driving safety sensed through the vehicle's ADAS sensor and data related to the position of a rear object.

[0026] According to an embodiment, the processor activates a display function of the notification image based on a user input, and determines whether to deactivate at least one of the first and second output modules based on context information related to driving, wherein the context information related to driving may include one or more of weather information and a driving road condition.

[0027] In addition, an operating method of a projection device of a vehicle according to an embodiment of the present invention may include the following steps. The operating method may include: a step of receiving sensing data of the vehicle; a step of generating a notification image to be displayed at the rear of the vehicle based on the sensing data; a step of determining a display position of the notification image based on a degree of approach of a rear object; and a step of projecting the notification image at the determined display position using at least one of first and second output modules configured to project images at a plurality of positions, respectively.

[0028]

[0029] The effects of the vehicle projection device and its operating method according to the present invention are described as follows.

[0030] According to a projection device of a vehicle and an operating method thereof according to some embodiments of the present invention, while the vehicle is driving, information related to the driving safety of the vehicle, including the situation in front of the vehicle, is transmitted to surrounding vehicles or people in the form of image projection, thereby preventing accidents in advance.

[0031] In addition, according to a projection device of a vehicle and an operating method thereof according to some embodiments of the present invention, information related to driving safety of the vehicle can be selectively projected at a more appropriate location by considering the degree to which a rear object is close to the vehicle, thereby enabling better recognition of information without interfering with the driving of surrounding vehicles.

[0032] For example, if a rear object is sufficiently far from the vehicle, relevant information is provided to the road surface behind the vehicle. Conversely, if the rear object is close to the vehicle, relevant information is projected onto the vehicle's rear window so as not to obstruct the driving of the driver of the vehicle behind. Alternatively, if the rear object is within an appropriate distance from the vehicle, information can be provided simultaneously to the vehicle's rear road surface and rear window.

[0033] Furthermore, according to some embodiments of the present invention, a vehicle projection device and its operating method can appropriately change the size, shape, brightness, number, etc. of images corresponding to information related to vehicle driving safety based on various sensing data of the vehicle. Accordingly, vehicles or people behind the vehicle can more accurately and reliably grasp the driving situation ahead of the vehicle.

[0034] Furthermore, according to some embodiments of the present invention, a vehicle projection device and its operating method can display, in addition to information related to vehicle driving safety, POI advertisements related to the vehicle's current location, driver-customized images, and the like, on the exterior of the vehicle. Accordingly, usability can be further expanded.

[0035] FIG. 1 is a drawing illustrating an example of a vehicle related to an embodiment of the present invention.

[0036] FIG. 2 is a drawing of a vehicle related to an embodiment of the present invention viewed from various angles.

[0037] FIGS. 3 and 4 are drawings showing the interior of a vehicle related to an embodiment of the present invention.

[0038] FIG. 5 and FIG. 6 are drawings for reference in explaining various objects related to driving of a vehicle related to an embodiment of the present invention.

[0039] FIG. 7 is a block diagram for reference in explaining a vehicle and projection device related to an embodiment of the present invention.

[0040] Figure 8 is a detailed block diagram related to the configuration and operation of a projection device according to an embodiment of the present invention.

[0041] FIG. 9A and FIG. 9B are drawings for reference in explaining that a projection device according to an embodiment of the present invention projects images at different locations at the rear of a vehicle.

[0042] Figure 10 is a representative flowchart for explaining an operating method of a projection device according to an embodiment of the present invention.

[0043] FIGS. 11a, 11b, and 11c are drawings for explaining various embodiments in which the display position of a notification image changes depending on the distance between a vehicle and a rear object according to an embodiment of the present invention.

[0044] FIGS. 12a, 12b, and 12c are examples for explaining the structure of a projection device in which notification images are projected through different output paths according to an embodiment of the present invention.

[0045] FIG. 13 is a drawing for explaining whether to simultaneously project onto the rear window of a vehicle and the road surface based on the visibility distance of the driver of the rear vehicle according to an embodiment of the present invention.

[0046] FIG. 14 is a flowchart illustrating a process of determining whether to project in dual mode by calculating the distance between the front situation of the vehicle and the rear object based on sensing data according to an embodiment of the present invention.

[0047] FIGS. 15a, 15b, 16a, and 16b are various examples of generating and projecting corresponding notification images according to driving safety information identified based on sensing data according to an embodiment of the present invention.

[0048] FIG. 17, FIG. 18a, and FIG. 18b are examples of adjusting the road surface display position of a notification image according to the driving conditions of a vehicle and examples of operation of a device therefor, according to an embodiment of the present invention.

[0049] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Regardless of the drawing numbers, identical or similar components will be given the same reference numbers and redundant descriptions thereof will be omitted. The suffixes "module" and "part" used for components in the following description are assigned or used interchangeably only for the convenience of writing the specification, and do not in themselves have distinct meanings or roles. In addition, when describing the embodiments disclosed in this specification, if it is determined that a specific description of a related known technology may obscure the gist of the embodiments disclosed in this specification, a detailed description thereof will be omitted. In addition, the attached drawings are only intended to facilitate easy understanding of the embodiments disclosed in this specification, and the technical ideas disclosed in this specification are not limited by the attached drawings, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and technical scope of the present invention.

[0050] Terms that include ordinal numbers, such as first, second, etc., may be used to describe various components, but the components are not limited by these terms. These terms are used solely to distinguish one component from another.

[0051] When a component is referred to as being "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but that there may be other components intervening. Conversely, when a component is referred to as being "directly connected" or "connected" to another component, it should be understood that there are no other components intervening.

[0052] Singular expressions include plural expressions unless the context clearly indicates otherwise.

[0053] In this application, terms such as “include” or “have” are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in the specification, but should be understood not to exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

[0054] The vehicle described in this specification may include a concept that includes automobiles and motorcycles. In the following, the vehicle will be described primarily with automobiles.

[0055] The vehicle described in this specification may be a concept that includes all types of vehicles, such as internal combustion engine vehicles equipped with an engine as a power source, hybrid vehicles equipped with an engine and an electric motor as a power source, and electric vehicles equipped with an electric motor as a power source.

[0056] In the following description, the left side of the vehicle means the left side of the vehicle's driving direction, and the right side of the vehicle means the right side of the vehicle's driving direction.

[0057] FIGS. 1 and 2 are views showing the exterior of a vehicle related to an embodiment of the present invention, and FIGS. 3 and 4 are views showing the interior of a vehicle related to an embodiment of the present invention.

[0058] FIGS. 5 and 6 are drawings illustrating various objects related to driving of a vehicle according to an embodiment of the present invention.

[0059] Fig. 7 is a block diagram used for reference in explaining a vehicle related to an embodiment of the present invention. Fig. 7 is a block diagram used for reference in explaining a vehicle according to an embodiment of the present invention.

[0060] Referring to FIGS. 1 to 7, the vehicle (100) may include wheels that rotate by a power source and a steering input device (510) for controlling the direction of travel of the vehicle (100).

[0061] The vehicle (100) may be an autonomous vehicle. The vehicle (100) may be switched between an autonomous driving mode and a manual driving mode based on user input. For example, the vehicle (100) may be switched from a manual mode to an autonomous driving mode, or from an autonomous driving mode to a manual mode, based on user input received through a user interface device (hereinafter, referred to as a "user terminal") (200).

[0062] The vehicle (100) can be switched to autonomous driving mode or manual driving mode based on driving situation information. The driving situation information can be generated based on object information provided by the object detection device (300). For example, the vehicle (100) can be switched from manual mode to autonomous driving mode or from autonomous driving mode to manual mode based on the driving situation information generated by the object detection device (300). For example, the vehicle (100) can be switched from manual mode to autonomous driving mode or from autonomous driving mode to manual mode based on driving situation information received through the communication device (400).

[0063] The vehicle (100) can be switched from manual mode to autonomous driving mode or from autonomous driving mode to manual mode based on information, data, and signals provided from an external device.

[0064] When the vehicle (100) is operated in autonomous driving mode, the autonomous vehicle (100) may be operated based on the driving system (700). For example, the autonomous vehicle (100) may be operated based on information, data, or signals generated from the driving system (710), the exit system (740), and the parking system (750).

[0065] When the vehicle (100) is driven in manual mode, the autonomous vehicle (100) can receive user input for driving through the driving control device (500). Based on the user input received through the driving control device (500), the vehicle (100) can be driven.

[0066] The overall length refers to the length from the front to the rear of the vehicle (100), the overall width refers to the width of the vehicle (100), and the overall height refers to the length from the bottom of the wheel to the roof. In the following description, the overall length direction (L) may refer to the direction that serves as a reference for measuring the overall length of the vehicle (100), the overall width direction (W) may refer to the direction that serves as a reference for measuring the overall width of the vehicle (100), and the overall height direction (H) may refer to the direction that serves as a reference for measuring the overall height of the vehicle (100).

[0067] As illustrated in FIG. 7, the vehicle (100) may include a user interface device (hereinafter, referred to as a 'user terminal') (200), an object detection device (300), a communication device (400), a driving operation device (500), a vehicle driving device (600), a driving system (700), a navigation system (770), a sensing unit (120), a vehicle interface unit (130), a memory (140), a control unit (170), and a power supply unit (190).

[0068] Depending on the embodiment, the vehicle (100) may include other components in addition to the components described herein, or may not include some of the components described herein.

[0069] The user interface device (200) is a device for communication between a vehicle (100) and a user. The user interface device (200) can receive user input and provide information generated in the vehicle (100) to the user. The vehicle (100) can implement a UI (User Interfaces) or UX (User Experience) through the user interface device (hereinafter, referred to as a 'user terminal') (200).

[0070] The user interface device (200) may include an input unit (210), an internal camera (220), a biometric detection unit (230), an output unit (250), and a processor (270). Depending on the embodiment, the user interface device (200) may include other components in addition to the described components, or may not include some of the described components.

[0071] The input unit (210) is for receiving information from a user, and data collected from the input unit (210) can be analyzed by a processor (270) and processed into a user's control command.

[0072] The input unit (210) may be placed inside the vehicle. For example, the input unit (210) may be placed in an area of ​​a steering wheel, an area of ​​an instrument panel, an area of ​​a seat, an area of ​​each pillar, an area of ​​a door, an area of ​​a center console, an area of ​​a head lining, an area of ​​a sun visor, an area of ​​a windshield, or an area of ​​a window.

[0073] The input unit (210) may include a voice input unit (211), a gesture input unit (212), a touch input unit (213), and a mechanical input unit (214).

[0074] The voice input unit (211) can convert a user's voice input into an electrical signal. The converted electrical signal can be provided to a processor (270) or a control unit (170). The voice input unit (211) can include one or more microphones.

[0075] The gesture input unit (212) can convert a user's gesture input into an electrical signal. The converted electrical signal can be provided to a processor (270) or a control unit (170).

[0076] The gesture input unit (212) may include at least one of an infrared sensor and an image sensor for detecting a user's gesture input. According to an embodiment, the gesture input unit (212) may detect a user's three-dimensional gesture input. To this end, the gesture input unit (212) may include a light output unit that outputs a plurality of infrared lights or a plurality of image sensors.

[0077] The gesture input unit (212) can detect a user's 3D gesture input through a TOF (Time of Flight) method, a structured light method, or a disparity method.

[0078] The touch input unit (213) can convert a user's touch input into an electrical signal. The converted electrical signal can be provided to a processor (270) or a control unit (170).

[0079] The touch input unit (213) may include a touch sensor for detecting a user's touch input. In some embodiments, the touch input unit (213) may be formed integrally with the display unit (251), thereby implementing a touch screen. Such a touch screen may provide both an input interface and an output interface between the vehicle (100) and the user.

[0080] The mechanical input unit (214) may include at least one of a button, a dome switch, a jog wheel, and a jog switch. An electrical signal generated by the mechanical input unit (214) may be provided to a processor (270) or a control unit (170). The mechanical input unit (214) may be placed on a steering wheel, a center fascia, a center console, a cockpit module, a door, etc.

[0081] The internal camera (220) can capture images of the vehicle interior. The processor (270) can detect the user's status based on the images of the vehicle interior. The processor (270) can obtain information about the user's gaze from the images of the vehicle interior. The processor (270) can detect the user's gestures from the images of the vehicle interior.

[0082] The biometric detection unit (230) can obtain the user's biometric information. The biometric detection unit (230) includes a sensor capable of obtaining the user's biometric information, and can use the sensor to obtain the user's fingerprint information, heartbeat information, etc. The biometric information can be used for user authentication.

[0083] The output unit (250) is for generating output related to visual, auditory, or tactile sensations. The output unit (250) may include at least one of a display unit (251), an audio output unit (252), and a haptic output unit (253).

[0084] The display unit (251) can display graphic objects corresponding to various pieces of information. The display unit (251) can include at least one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, a 3D display, and an e-ink display.

[0085] The display unit (251) can implement a touch screen by forming a mutual layer structure with the touch input unit (213) or forming it as an integral part.

[0086] The display unit (251) may be implemented as a HUD (Head Up Display). When the display unit (251) is implemented as a HUD, the display unit (251) may be equipped with a projection module to output information through an image projected onto a windshield or window.

[0087] The display unit (251) may include a transparent display. The transparent display may be attached to a windshield or a window. The transparent display may have a predetermined transparency and display a predetermined screen. In order to have transparency, the transparent display may include at least one of a transparent TFEL (Thin Film Electroluminescent), a transparent OLED (Organic Light-Emitting Diode), a transparent LCD (Liquid Crystal Display), a transparent display, and a transparent LED (Light Emitting Diode) display. The transparency of the transparent display may be adjusted.

[0088] Meanwhile, the user interface device (200) may include a plurality of display units (251a to 251g).

[0089] The display unit (251) may be arranged in one area of ​​the steering wheel, one area of ​​the instrument panel (521a, 251b, 251e), one area of ​​the seat (251d), one area of ​​each pillar (251f), one area of ​​the door (251g), one area of ​​the center console, one area of ​​the head lining, one area of ​​the sun visor, or may be implemented in one area of ​​the windshield (251c), one area of ​​the window (251h).

[0090] The audio output unit (252) converts an electric signal provided from the processor (270) or the control unit (170) into an audio signal and outputs the converted signal. To this end, the audio output unit (252) may include one or more speakers.

[0091] The haptic output unit (253) generates a tactile output. For example, the haptic output unit (253) can operate by vibrating a steering wheel, a seat belt, or a seat (110FL, 110FR, 110RL, 110RR) so that the user can perceive the output.

[0092] The processor (hereinafter, referred to as a “control unit”) (270) can control the overall operation of each unit of the user interface device (200). Depending on the embodiment, the user interface device (200) may include a plurality of processors (270) or may not include a processor (270).

[0093] If the user interface device (200) does not include a processor (270), the user interface device (200) may be operated under the control of a processor or control unit (170) of another device in the vehicle (100).

[0094] Meanwhile, the user interface device (200) may be referred to as a vehicle display device. The user interface device (200) may be operated under the control of the control unit (170).

[0095] The object detection device (300) is a device for detecting an object located outside a vehicle (100). The object may be various objects related to the operation of the vehicle (100). Referring to FIGS. 5 and 6, the object (O) may include a lane (OB10), another vehicle (OB11), a pedestrian (OB12), a two-wheeled vehicle (OB13), a traffic signal (OB14, OB15), a light, a road, a structure, a speed bump, a terrain, an animal, etc.

[0096] A lane (OB10) may be a driving lane, a lane adjacent to a driving lane, or a lane in which opposing vehicles drive. A lane (OB10) may be a concept that includes lines on the left and right sides that form a lane.

[0097] Another vehicle (OB11) may be a vehicle driving around the vehicle (100). The other vehicle may be a vehicle located within a predetermined distance from the vehicle (100). For example, the other vehicle (OB11) may be a vehicle preceding or following the vehicle (100).

[0098] A pedestrian (OB12) may be a person located around a vehicle (100). A pedestrian (OB12) may be a person located within a predetermined distance from a vehicle (100). For example, a pedestrian (OB12) may be a person located on a sidewalk or roadway.

[0099] A two-wheeled vehicle (OB12) may refer to a vehicle that is positioned around a vehicle (100) and moves using two wheels. The two-wheeled vehicle (OB12) may be a vehicle with two wheels that is positioned within a predetermined distance from the vehicle (100). For example, the two-wheeled vehicle (OB13) may be a motorcycle or bicycle positioned on a sidewalk or roadway.

[0100] Traffic signals may include traffic lights (OB15), traffic signs (OB14), and patterns or text painted on the road surface.

[0101] The light may be generated from a lamp installed in another vehicle. The light may be generated from a streetlight. The light may be sunlight.

[0102] A road may include slopes such as road surfaces, curves, uphill and downhill slopes, etc.

[0103] Structures may be objects located along roads and fixed to the ground. For example, structures may include streetlights, street trees, buildings, utility poles, traffic lights, and bridges.

[0104] Landforms may include mountains, hills, etc.

[0105] Meanwhile, objects can be classified into moving objects and fixed objects. For example, moving objects may include concepts such as other vehicles and pedestrians. For example, fixed objects may include concepts such as traffic signals, roads, and structures.

[0106] The object detection device (300) may include a camera (310), a radar (320), a lidar (330), an ultrasonic sensor (340), an infrared sensor (350), and a processor (370).

[0107] Depending on the embodiment, the object detection device (300) may include other components in addition to the described components, or may not include some of the described components.

[0108] The camera (310) may be positioned at an appropriate location outside the vehicle to capture images of the vehicle's exterior. The camera (310) may be a mono camera, a stereo camera (310a), an AVM (Around View Monitoring) camera (310b), or a 360-degree camera.

[0109] For example, the camera (310) may be positioned inside the vehicle, close to the front windshield, to capture an image of the front of the vehicle. Alternatively, the camera (310) may be positioned around the front bumper or radiator grill.

[0110] For example, the camera (310) may be positioned inside the vehicle, close to the rear glass, to capture images of the rear of the vehicle. Alternatively, the camera (310) may be positioned around the rear bumper, trunk, or tailgate.

[0111] For example, the camera (310) may be positioned close to at least one of the side windows inside the vehicle to obtain an image of the side of the vehicle. Alternatively, the camera (310) may be positioned around a side mirror, fender, or door.

[0112] The camera (310) can provide the acquired image to the processor (370).

[0113] The radar (320) may include an electromagnetic wave transmitter and receiver. The radar (320) may be implemented in a pulse radar or continuous wave radar manner based on the principle of radio wave emission. Among continuous wave radar methods, the radar (320) may be implemented in a frequency modulated continuous wave (FMCW) manner or a frequency shift keying (FSK) manner depending on the signal waveform.

[0114] The radar (320) can detect an object using electromagnetic waves, based on a TOF (Time of Flight) method or a phase-shift method, and can detect the location of the detected object, the distance to the detected object, and the relative speed.

[0115] The radar (320) can be placed at an appropriate location outside the vehicle to detect objects located in front, rear, or to the side of the vehicle.

[0116] The lidar (330) may include a laser transmitter and receiver. The lidar (330) may be implemented using a TOF (Time of Flight) method or a phase-shift method.

[0117] The lidar (330) can be implemented as a driven or non-driven type.

[0118] When implemented as a drive type, the lidar (330) is rotated by a motor and can detect objects around the vehicle (100).

[0119] When implemented in a non-driven manner, the lidar (330) can detect an object located within a predetermined range relative to the vehicle (100) through optical steering. The vehicle (100) can include a plurality of non-driven lidars (330).

[0120] Lidar (330) can detect an object based on a time-of-flight (TOF) method or a phase-shift method using laser light as a parameter, and can detect the position of the detected object, the distance to the detected object, and the relative speed.

[0121] The lidar (330) can be placed at an appropriate location outside the vehicle to detect objects located in front, behind, or to the side of the vehicle.

[0122] The ultrasonic sensor (340) may include an ultrasonic transmitter and a receiver. The ultrasonic sensor (340) may detect an object based on ultrasonic waves, and may detect the location of the detected object, the distance to the detected object, and the relative speed.

[0123] The ultrasonic sensor (340) can be placed at an appropriate location outside the vehicle to detect objects located in front, rear, or to the side of the vehicle.

[0124] The infrared sensor (350) may include an infrared transmitter and a receiver. The infrared sensor (340) may detect an object based on infrared light, and may detect the location of the detected object, the distance to the detected object, and the relative speed.

[0125] The infrared sensor (350) can be placed at an appropriate location outside the vehicle to detect objects located in front, rear, or to the side of the vehicle.

[0126] The processor (370) can control the overall operation of each unit of the object detection device (300).

[0127] The processor (370) can detect and track an object based on the acquired image. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed with the object through an image processing algorithm.

[0128] The processor (370) can detect and track an object based on the reflected electromagnetic waves that are returned when the transmitted electromagnetic waves are reflected by the object. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed with the object based on the electromagnetic waves.

[0129] The processor (370) can detect and track an object based on the reflected laser light that is reflected back by the transmitted laser beam from the object. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed with the object based on the laser light.

[0130] The processor (370) can detect and track an object based on the reflected ultrasonic waves that are returned when the transmitted ultrasonic waves are reflected off the object. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed with the object based on the ultrasonic waves.

[0131] The processor (370) can detect and track an object based on the reflected infrared light that is reflected back by the transmitted infrared light from the object. The processor (370) can perform operations such as calculating the distance to the object and calculating the relative speed with the object based on the infrared light.

[0132] Depending on the embodiment, the object detection device (300) may include multiple processors (370) or may not include a processor (370). For example, each of the camera (310), radar (320), lidar (330), ultrasonic sensor (340), and infrared sensor (350) may individually include a processor.

[0133] If the object detection device (300) does not include a processor (370), the object detection device (300) can be operated under the control of the processor or control unit (170) of the device in the vehicle (100).

[0134] The object detection device (400) can be operated under the control of the control unit (170).

[0135] The communication device (400) is a device for communicating with an external device. Here, the external device may be another vehicle, a mobile terminal, or a server.

[0136] The communication device (400) may include at least one of a transmitting antenna, a receiving antenna, an RF (Radio Frequency) circuit capable of implementing various communication protocols, and an RF element to perform communication.

[0137] The communication device (400) may include a short-range communication unit (410), a location information unit (420), a V2X communication unit (430), an optical communication unit (440), a broadcast transmission / reception unit (450), and a processor (470).

[0138] Depending on the embodiment, the communication device (400) may include additional components other than the described components, or may not include some of the described components.

[0139] The short-range communication unit (410) is a unit for short-range communication. The short-range communication unit (410) can support short-range communication using at least one of Bluetooth™, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies.

[0140] The short-range communication unit (410) can form a short-range wireless communication network (Wireless Area Network) to perform short-range communication between the vehicle (100) and at least one external device.

[0141] The location information unit (420) is a unit for obtaining location information of a vehicle (100). For example, the location information unit (420) may include a GPS (Global Positioning System) module or a DGPS (Differential Global Positioning System) module.

[0142] The V2X communication unit (430) is a unit for performing wireless communication with a server (V2I: Vehicle to Infrastructure), another vehicle (V2V: Vehicle to Vehicle), or a pedestrian (V2P: Vehicle to Pedestrian). The V2X communication unit (430) may include an RF circuit capable of implementing protocols for communication with infrastructure (V2I), communication between vehicles (V2V), and communication with pedestrians (V2P).

[0143] The optical communication unit (440) is a unit for communicating with an external device via light. The optical communication unit (440) may include an optical transmission unit that converts an electrical signal into an optical signal and transmits it to the outside, and an optical reception unit that converts a received optical signal into an electrical signal.

[0144] According to an embodiment, the light transmitting unit may be formed to be integrated with a lamp included in the vehicle (100).

[0145] The broadcast transmitter / receiver (450) is a unit for receiving broadcast signals from an external broadcast management server via a broadcast channel, or transmitting broadcast signals to the broadcast management server. The broadcast channels may include satellite channels and terrestrial channels. The broadcast signals may include TV broadcast signals, radio broadcast signals, and data broadcast signals.

[0146] The processor (470) can control the overall operation of each unit of the communication device (400).

[0147] Depending on the embodiment, the communication device (400) may include a plurality of processors (470) or may not include a processor (470).

[0148] If the communication device (400) does not include a processor (470), the communication device (400) may be operated under the control of a processor or control unit (170) of another device in the vehicle (100).

[0149] Meanwhile, the communication device (400) may implement a vehicle display device together with the user interface device (200). In this case, the vehicle display device may be referred to as a telematics device or an AVN (Audio Video Navigation) device.

[0150] The communication device (400) can be operated under the control of the control unit (170).

[0151] The driving control device (500) is a device that receives user input for driving.

[0152] When in manual mode, the vehicle (100) can be driven based on signals provided by the driving control device (500).

[0153] The driving control device (500) may include a steering input device (510), an acceleration input device (530), and a brake input device (570).

[0154] The steering input device (510) can receive input for the direction of travel of the vehicle (100) from the user. The steering input device (510) is preferably formed in the form of a wheel so that steering input can be provided by rotation. Depending on the embodiment, the steering input device may be formed in the form of a touch screen, a touch pad, or a button.

[0155] The acceleration input device (530) can receive an input from a user for accelerating the vehicle (100). The brake input device (570) can receive an input from a user for decelerating the vehicle (100). The acceleration input device (530) and the brake input device (570) are preferably formed in the form of a pedal. Depending on the embodiment, the acceleration input device or the brake input device may also be formed in the form of a touch screen, a touch pad, or a button.

[0156] The driving operation device (500) can be operated under the control of the control unit (170).

[0157] The vehicle driving device (600) is a device that electrically controls the driving of various devices in the vehicle (100).

[0158] The vehicle driving device (600) may include a power train driving unit (610), a chassis driving unit (620), a door / window driving unit (630), a safety device driving unit (640), a lamp driving unit (650), and an air conditioning driving unit (660).

[0159] Depending on the embodiment, the vehicle drive device (600) may include additional components other than the described components, or may not include some of the described components.

[0160] Meanwhile, the vehicle driving device (600) may include a processor. Each unit of the vehicle driving device (600) may individually include a processor.

[0161] The power train drive unit (610) can control the operation of the power train device.

[0162] The power train drive unit (610) may include a power source drive unit (611) and a transmission drive unit (612).

[0163] The power source driving unit (611) can perform control over the power source of the vehicle (100).

[0164] For example, if a fossil fuel-based engine is the power source, the power source drive unit (610) can perform electronic control of the engine. This can control the engine output torque, etc. The power source drive unit (611) can adjust the engine output torque according to the control of the control unit (170).

[0165] For example, if an electric energy-based motor is the power source, the power source driving unit (610) can perform control over the motor. The power source driving unit (610) can adjust the rotation speed, torque, etc. of the motor according to the control of the control unit (170).

[0166] The transmission drive unit (612) can perform control over the transmission. The transmission drive unit (612) can adjust the state of the transmission. The transmission drive unit (612) can adjust the state of the transmission to forward (D), reverse (R), neutral (N), or parking (P).

[0167] Meanwhile, when the engine is the power source, the transmission drive unit (612) can adjust the gear engagement state in the forward (D) state.

[0168] The chassis drive unit (620) can control the operation of the chassis device. The chassis drive unit (620) can include a steering drive unit (621), a brake drive unit (622), and a suspension drive unit (623).

[0169] The steering drive unit (621) can perform electronic control of the steering apparatus within the vehicle (100). The steering drive unit (621) can change the direction of travel of the vehicle.

[0170] The brake drive unit (622) can perform electronic control of the brake apparatus within the vehicle (100). For example, the speed of the vehicle (100) can be reduced by controlling the operation of the brakes placed on the wheels.

[0171] Meanwhile, the brake driving unit (622) can individually control each of the plurality of brakes. The brake driving unit (622) can control the braking force applied to the plurality of wheels differently.

[0172] The suspension drive unit (623) can perform electronic control of the suspension apparatus within the vehicle (100). For example, when there is a curve in the road surface, the suspension drive unit (623) can control the suspension apparatus to reduce vibration of the vehicle (100). Meanwhile, the suspension drive unit (623) can individually control each of the plurality of suspensions.

[0173] The door / window actuator (630) can perform electronic control of a door apparatus or window apparatus in a vehicle (100).

[0174] The door / window driving unit (630) may include a door driving unit (631) and a window driving unit (632).

[0175] The door driving unit (631) can control the door device. The door driving unit (631) can control the opening and closing of a plurality of doors included in the vehicle (100). The door driving unit (631) can control the opening or closing of a trunk or tail gate. The door driving unit (631) can control the opening or closing of a sunroof.

[0176] The window driving unit (632) can perform electronic control of a window apparatus. It can control the opening or closing of a plurality of windows included in a vehicle (100).

[0177] The safety device driving unit (640) can perform electronic control of various safety devices in the vehicle (100).

[0178] The safety device drive unit (640) may include an airbag drive unit (641), a seat belt drive unit (642), and a pedestrian protection device drive unit (643).

[0179] The airbag driving unit (641) can perform electronic control of the airbag apparatus within the vehicle (100). For example, the airbag driving unit (641) can control the airbag to deploy when a danger is detected.

[0180] The seat belt drive unit (642) can perform electronic control of the seat belt apparatus within the vehicle (100). For example, the seat belt drive unit (642) can control the passenger to be secured to the seat (110FL, 110FR, 110RL, 110RR) using the seat belt when a danger is detected.

[0181] The pedestrian protection device drive unit (643) can perform electronic control of the hood lift and pedestrian airbag. For example, the pedestrian protection device drive unit (643) can control the hood lift up and the pedestrian airbag to deploy when a collision with a pedestrian is detected.

[0182] The lamp driving unit (650) can perform electronic control of various lamp apparatuses within the vehicle (100).

[0183] The air conditioning drive unit (660) can perform electronic control of the air conditioning device (air cinditioner) within the vehicle (100). For example, the air conditioning drive unit (660) can control the air conditioning device to operate and supply cool air to the vehicle when the temperature inside the vehicle is high.

[0184] The vehicle driving device (600) may include a processor. Each unit of the vehicle driving device (600) may individually include a processor.

[0185] The vehicle driving device (600) can be operated under the control of the control unit (170).

[0186] The driving system (700) is a system that controls various operations of the vehicle (100). The driving system (700) can be operated in autonomous driving mode.

[0187] The driving system (700) may include a driving system (710), an exit system (740), and a parking system (750).

[0188] Depending on the embodiment, the driving system (700) may include other components in addition to the described components, or may not include some of the described components.

[0189] Meanwhile, the driving system (700) may include a processor. Each unit of the driving system (700) may individually include a processor.

[0190] Meanwhile, depending on the embodiment, if the driving system (700) is implemented in software, it may be a sub-concept of the control unit (170).

[0191] Meanwhile, according to an embodiment, the driving system (700) may be a concept including at least one of a user interface device (200), an object detection device (300), a communication device (400), a vehicle driving device (600), and a control unit (170).

[0192] The driving system (710) can drive the vehicle (100).

[0193] The driving system (710) can receive navigation information from the navigation system (770) and provide a control signal to the vehicle driving device (600) to drive the vehicle (100). The driving system (710) can receive object information from the object detection device (300) and provide a control signal to the vehicle driving device (600) to drive the vehicle (100). The driving system (710) can receive a signal from an external device through the communication device (400) and provide a control signal to the vehicle driving device (600) to drive the vehicle (100).

[0194] The exit system (740) can perform exit of a vehicle (100).

[0195] The exit system (740) can receive navigation information from the navigation system (770) and provide a control signal to the vehicle driving device (600) to perform exit of the vehicle (100). The exit system (740) can receive object information from the object detection device (300) and provide a control signal to the vehicle driving device (600) to perform exit of the vehicle (100). The exit system (740) can receive a signal from an external device through the communication device (400) and provide a control signal to the vehicle driving device (600) to perform exit of the vehicle (100).

[0196] The parking system (750) can perform parking of a vehicle (100).

[0197] The parking system (750) can receive navigation information from the navigation system (770) and provide a control signal to the vehicle driving device (600) to perform parking of the vehicle (100). The parking system (750) can receive object information from the object detection device (300) and provide a control signal to the vehicle driving device (600) to perform parking of the vehicle (100). The parking system (750) can receive a signal from an external device through the communication device (400) and provide a control signal to the vehicle driving device (600) to perform parking of the vehicle (100).

[0198] A navigation system (770) can provide navigation information. The navigation information can include at least one of map information, set destination information, route information based on the set destination, information on various objects along the route, lane information, and current vehicle location information.

[0199] The navigation system (770) may include memory and a processor. The memory may store navigation information. The processor may control the operation of the navigation system (770).

[0200] According to an embodiment, the navigation system (770) may receive information from an external device via the communication device (400) and update previously stored information.

[0201] Depending on the embodiment, the navigation system (770) may be classified as a subcomponent of the user interface device (200).

[0202] The sensing unit (120) can sense the status of the vehicle. The sensing unit (120) can include a posture sensor (e.g., a yaw sensor, a roll sensor, a pitch sensor), a collision sensor, a wheel sensor, a speed sensor, an inclination sensor, a weight detection sensor, a heading sensor, a yaw sensor, a gyro sensor, a position module, a vehicle forward / backward sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor by steering wheel rotation, a vehicle interior temperature sensor, a vehicle interior humidity sensor, an ultrasonic sensor, an illuminance sensor, an accelerator pedal position sensor, a brake pedal position sensor, etc.

[0203] The sensing unit (120) can obtain sensing signals for vehicle attitude information, vehicle collision information, vehicle direction information, vehicle location information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle inclination information, vehicle forward / backward information, battery information, fuel information, tire information, vehicle lamp information, vehicle internal temperature information, vehicle internal humidity information, steering wheel rotation angle, vehicle external illumination, pressure applied to an accelerator pedal, pressure applied to a brake pedal, etc.

[0204] The sensing unit (120) may further include, in addition, an accelerator pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor (AFS), an intake temperature sensor (ATS), a water temperature sensor (WTS), a throttle position sensor (TPS), a TDC sensor, a crank angle sensor (CAS), etc.

[0205] The vehicle interface unit (130) can serve as a conduit for various types of external devices connected to the vehicle (100). For example, the vehicle interface unit (130) may be equipped with a port capable of connecting to a mobile terminal, and may be connected to the mobile terminal through the port. In this case, the vehicle interface unit (130) can exchange data with the mobile terminal.

[0206] Meanwhile, the vehicle interface unit (130) may serve as a conduit for supplying electrical energy to a connected mobile terminal. When the mobile terminal is electrically connected to the vehicle interface unit (130), the vehicle interface unit (130) may provide the mobile terminal with electrical energy supplied from the power supply unit (190) under the control of the control unit (170).

[0207] The memory (140) is electrically connected to the control unit (170). The memory (140) can store basic data for the unit, control data for controlling the operation of the unit, and input / output data. The memory (140) can be various storage devices such as ROM, RAM, EPROM, flash drive, hard drive, etc. in terms of hardware. The memory (140) can store various data for the overall operation of the vehicle (100), such as programs for processing or controlling the control unit (170).

[0208] Depending on the embodiment, the memory (140) may be formed integrally with the control unit (170) or implemented as a sub-component of the control unit (170).

[0209] The control unit (170) can control the overall operation of each unit within the vehicle (100). The control unit (170) can be referred to as an ECU (Electronic Control Unit).

[0210] The power supply unit (190) can supply power required for the operation of each component under the control of the control unit (170). In particular, the power supply unit (190) can receive power from a battery or the like inside the vehicle.

[0211] One or more processors and control units (170) included in the vehicle (100) may be implemented using at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, micro-controllers, microprocessors, and other electrical units for performing functions.

[0212] Meanwhile, a projection device (800) of a vehicle according to the present invention may be configured to include a communication module (810), a processor (820), and an output unit (830) including first and second output modules each configured to project an image at different locations.

[0213] The projection device (800) can generate a safety-related notification image of the vehicle while the vehicle is driving and project it onto the rear road surface, rear window, or both of the vehicle.

[0214] The projection device (800) may be formed on the rear roof or spoiler of the vehicle. Specifically, the projection device (800) may be detachably positioned at the center of the rear roof of the vehicle or the center of a structure such as the rear spoiler of the vehicle, or may be formed integrally with the vehicle.

[0215] The projection device (800) can generate a notification image to be projected on the rear of the vehicle based on sensing data of the vehicle, for example, sensing data collected by the ADAS system (hereinafter also referred to as “ADAS sensing data”). Specifically, the projection device (800) selects a function related to driving safety of the vehicle by the processor (820) based on the sensing data of the vehicle received through the communication module (810), and determines an image to be projected on the exterior of the vehicle, i.e., the rear of the vehicle, corresponding to the selected function.

[0216] The projection device (800) can determine one or more display positions on which to project the determined image based on the degree of approach of the rear object of the vehicle. Specifically, the processor (820) of the projection device (800) can calculate the presence and degree of approach of the rear object of the vehicle based on, for example, ADAS sensing data, and determine the display position on which to project the image based on the calculated degree of approach of the rear object.

[0217] The projection device (800) can control the operation of the output unit (830) to project a determined image on a determined display location. The output unit (830) can project the image transmitted from the processor (820) on a first display location or a second display location ('single mode') or on both the first and second display locations ('dual mode').

[0218] In an embodiment, at least one of the first display position and the second display position may be variable depending on the position of the rear object. In this case, the processor (820) of the projection device (800) may transmit a control signal to the output unit (830) for adjusting at least one of the first display position and the second display position depending on the position of the rear object.

[0219] The projection device (800) can change the image to be projected on the rear of the vehicle and / or change the display position when the approaching object behind the vehicle becomes closer or farther away than before. This is to visually inform the driver of the rear vehicle of the safety-related situation ahead by considering the visibility distance of the rear object, e.g., the driver of the rear vehicle.

[0220] Figure 8 is a detailed block diagram related to the configuration and operation of a projection device according to an embodiment of the present invention.

[0221] The communication module (810) of the projection device (800) can receive each sensing data sensed by ADAS sensors (121) positioned on all sides of the vehicle, for example, the vehicle's front camera, front Lidar / Radar, rear camera, and rear Lidar / Radar. The communication module (810) transmits the received sensing data to the processor (820).

[0222] Additionally, the communication module (810) receives data sensed / detected by other vehicle sensors (122), user input units such as displays, and / or vehicle telematics, and transmits the same to the processor (820).

[0223] The processor (820) of the projection device (800) selects a function to be displayed at the rear of the vehicle by combining the vehicle sensing data received through the communication module (810), determines a display position to project a notification image corresponding to the selected function, and controls the output unit (830) to project the notification image at the determined position.

[0224] At this time, the display position determined by the processor (820) may be one or more. If the determined display position is one, projection #1 or projection #2 of the output unit (830) is used, which means that the output unit (830) operates in single mode. If the determined display positions are multiple, projections #1 and #2 of the output unit (830) are both used, which means that the output unit (830) operates in dual mode.

[0225] The sensor fusion (821) of the processor (820) transmits driving-related information collected based on sensing data, for example, ADAS sensing data, received through the communication module (810) to the manager (822) of the processor (820). The manager (822) determines a function to be displayed at the rear of the vehicle, a projection position (Position) of a notification image corresponding to the function, and a size (Size) based on the collected driving-related information.

[0226] Once the function to be displayed, projection position, and size are determined in this manner, the projector beam controller (823) performs a single mode (Single) to operate either one of projections #1 and #2 of the output unit (830) or a dual mode (Dual) to operate both projections #1 and #2.

[0227] According to an embodiment, projection #1 of the output unit (830) may be configured to project an image onto the rear window of the vehicle, and projection #2 may be configured to project an image onto the rear road surface of the vehicle.

[0228] Specifically, when the distance between the vehicle and the rear object is close, the output unit (830) operates in a single mode that projects an image onto the rear window of the vehicle through projection #1. In addition, when the distance between the vehicle and the rear object is sufficiently far, the output unit (830) operates in a single mode that projects an image onto the rear road surface of the vehicle, or operates in a dual mode that simultaneously projects an image onto the rear window of the vehicle and the rear road surface using both projections #1 and #2.

[0229] In this case, the image projected through projection #1 and / or projection #2 will fall within the field of view of objects located behind the vehicle, for example, within the field of view of the driver of the rear vehicle looking forward.

[0230] The projector beam controller (823) may receive an event (or 'signal') indicating that one of the function to be displayed at the rear of the vehicle, the projection position of the notification image, and / or the size of the notification image has changed by the manager (822). In this case, the projector beam controller (823) may provide a control signal to the output unit (830) for changing the operation of projections #1 and #2.

[0231] Specifically, the projector beam controller (823) can change the output unit (830) from dual mode to single mode based on an event received from the manager (822).

[0232] For example, it is assumed that an event for changing the projection position of a notification image from the manager (822) is received by the projector beam controller (823) because the distance between the vehicle and the rear object has become closer than the reference distance. In this case, the projector beam controller (823) can change the output unit (830) from dual mode to single mode (e.g., single mode for projecting an image only on the rear window of the vehicle through projection #1).

[0233] For example, it is assumed that an event for changing the projection position of a notification image from the manager (822) is received by the projector beam controller (823) because the distance between the vehicle and the rear object has become sufficiently farther than the reference distance. In this case, the projector beam controller (823) can change the output unit (830) from dual mode to single mode (e.g., single mode for projecting an image only on the rear road surface of the vehicle through projection #2).

[0234] For example, assume that an event for projecting a new notification image from the manager (822) is received by the projector beam controller (823) due to the appearance of an obstacle around the vehicle. In this case, the projector beam controller (823) can control the current operation mode of the output unit (830) to add an operation for projecting a new notification image onto the rear window of the vehicle through projection #1.

[0235] Meanwhile, in most embodiments of the present invention, the image projected through projection #2 is directed toward the rear road surface in the same driving lane as the vehicle. And, the image projected through projection #1 is directed toward the center of the rear window of the vehicle.

[0236] However, in some embodiments, the projector beam controller (823) may further adjust the display position, brightness, size, etc. of the image projected through at least one of projections #1 and #2 by adjusting the focal length, refractive index, use of additional components, etc. of at least one of projections #1 and #2.

[0237] The projector beam controller (823) can control the operation of at least one of projections #1 and #2 of the output unit (830) (e.g., activation of projections #1 and #2, projection position, focal length, refractive index, etc.) by considering the position, speed, and level of danger of the rear object of the vehicle.

[0238] For example, if a rear object is located in the driving lane next to the vehicle, the projector beam controller (823) can adjust the refractive index of the projection #2 of the output unit (830) to project an image onto the road surface of the driving lane next to the rear of the vehicle.

[0239] Alternatively, for example, the projector beam controller (823) may additionally place a separate projection lens or prism to project an image onto the road surface of the rear side lane of the vehicle through projection #3 when the rear object is located in the driving lane next to the vehicle. In this case, projection #3 may be implemented in a separate operating mode by utilizing a single light source (i.e., a lamp) and a DMD rather than a physically independent projector, as described with reference to FIGS. 12A to 12C below.

[0240] To enhance the recognition of rear objects, the projector beam controller (823) can change the operation mode (single mode, dual mode) of projections #1 and #2 of the output unit (830) by considering situational information related to the rear objects, such as the current position of the rear objects, the approach speed to the vehicle, the degree of danger, etc.

[0241] In addition, the projector beam controller (823) can change functions related to the driving safety of the vehicle by considering situational information related to the rear object, such as the current position of the rear object, the approach speed to the vehicle, the level of danger, etc., and change the projection image accordingly.

[0242] In addition, the projector beam controller (823) may change at least one of the shape, size, and brightness of the projection image differently, although the function related to the driving safety of the vehicle is the same, by considering situational information related to the rear object, such as the current position of the rear object, the approach speed to the vehicle, and the level of danger.

[0243] In this way, a projection device of a vehicle according to some embodiments of the present invention can prevent accidents in advance by transmitting information related to the driving safety of the vehicle, including the situation in front of the vehicle, to surrounding vehicles or people in the form of image projection while the vehicle is driving.

[0244] FIGS. 9A and 9B are drawings illustrating a projection device (800) positioned at the rear of a vehicle to project images at different locations at the rear of the vehicle, according to an embodiment of the present invention.

[0245] As illustrated in FIG. 9a, the projection device (800) may be implemented to be integrated with or mountable to the rear of the vehicle (100). Specifically, the projection device (800) may be mounted utilizing the space of a vehicle attachment, such as a roof or spoiler, at the rear of the vehicle.

[0246] The projection device (800) can project images at each of a plurality of locations. Here, the projected images can be implemented as text, images, or a combination thereof. The projection device (800) can project information related to the driving safety of the vehicle onto the rear window (910) or the rear road surface (920) of the vehicle. The projection device (800) can simultaneously project information related to the driving safety of the vehicle onto the rear window (910) and the rear road surface (920) of the vehicle.

[0247] By the projection device (800), the image projected on the rear window (910) of the vehicle and the image projected on the rear road surface (920) may be different from each other.

[0248] For example, when a danger occurs in front of a vehicle (e.g., when a pedestrian, ball, animal, etc. suddenly appears), a first notification image may be projected on the rear window (910) for the same situation, and a second notification image different from the first notification image may be projected on the rear road surface (920).

[0249] Activation of the projection device (800) may be determined based on input from a user (e.g., a vehicle driver). In some embodiments, certain functions of the projection device (800) may be deactivated based on user input. For example, based on user input, projection #2 operation of FIG. 8 may be deactivated and only projection #1 may be activated. Accordingly, information related to vehicle driving safety may be configured to be projected only through the rear window (910).

[0250] Unless otherwise specified, the projection device (800) may provide driving safety-related information to the rear window (910), the rear road surface (920), or both, based on the proximity of a rear object. This is related to the location at which the rear object can perceive the driving safety-related information.

[0251] Whether to project the first notification image on the rear window (910) of the vehicle by the projection device (800), the second notification image on the rear road surface (920), or to project the first and second notification images using both of them can be determined based on the proximity of the rear object of the vehicle. This is related to the range in which the information conveyed through the first and second notification images is recognized by the rear object of the vehicle.

[0252] Additionally, although not shown, in some embodiments, the projection device (800) may be installed on the side or front of the exterior of the vehicle (100).

[0253] In this case, the projection device (800) can project information related to the driving safety of the vehicle onto at least one of the vehicle's window (e.g., the vehicle's side / front window) and the road surface (e.g., the vehicle's side / front road surface) corresponding to the installed location. At this time, whether to project onto one of the window and the road surface or both will be determined based on the distance from the vehicle's side / front object.

[0254] Fig. 9b illustrates a projection device (800) installed using a spoiler structure at the rear of a vehicle (100). The projection device (800) implements information related to the driving safety of the vehicle, i.e., a notification image, and projects it onto a projection area (901) of the rear window (RW) of the vehicle.

[0255] The projection area (901) may be located at the center of the rear window (RW), but is not necessarily limited thereto. The notification image projected on the projection area (901) may have its detailed location (e.g., left / right / center / top / bottom of the projection area (901), etc.), size, brightness, highlight effect, etc. adjusted according to the corresponding function. For example, when a vehicle is moving slowly, a slow-motion notification image to notify the vehicle behind may be projected on the center of the projection area (901), and a highlight effect may be displayed at the same time.

[0256] Meanwhile, even with reference to FIG. 9a, a projection area (hereinafter, “road projection area”) on which a notification image is to be projected on the rear road surface of the vehicle can be predetermined.

[0257] The road projection area may be distributed more widely than the projection area (901) of the window. The road projection area may be implemented to correspond to the field of view of objects (e.g., rear vehicles / people, etc.) located behind the vehicle. For example, the road projection area may be narrower closer to the rear of the vehicle and wider farther away from the rear of the vehicle (i.e., closer to objects located behind the vehicle).

[0258] Below, FIG. 10 is a representative flowchart for explaining the operation method of the projection device (800) according to an embodiment of the present invention. Each process of the flowchart of FIG. 10 may be performed by the processor (820) of the projection device (800) unless otherwise described. In some embodiments, when the vehicle and the projection device (800) are implemented as one unit, each process of the flowchart of FIG. 10 may also be performed by a controller / processor that controls the operation of the vehicle.

[0259] According to an embodiment, the operation of the projection device (800) may be activated based on user input. That is, the following operation of the projection device (800) may be executed when the projection device (800) is turned on based on user input.

[0260] Referring to FIG. 10, the projection device (800) can receive sensing data of the vehicle through the communication module (810) and generate a notification image to be displayed at the rear of the vehicle based on the received sensing data (1010).

[0261] Here, the vehicle's sensing data may include ADAS sensing data. The ADAS sensing data may include sensing data collected through the vehicle's front camera, front Lidar / Radar, rear camera, and rear Lidar / Radar.

[0262] Additionally, the vehicle's sensing data may include other vehicle sensing information (e.g., vehicle door opening / closing (vehicle exit information)), user input information (e.g., driver information), information received via telematics (e.g., information on shared vehicle users), etc. In such cases, by combining the ADAS sensing data, a wider variety of information (e.g., advertising information, customized driver information) can be externally displayed in addition to vehicle driving safety-related information.

[0263] Generating a notification image to be displayed on the rear of a vehicle means selecting a (notification) function corresponding to a situation recognized through the ADAS sensing data and implementing a notification image corresponding to the selected function. The notification image may be text, an image, or a combination thereof.

[0264] For example, in response to the detection of situational information related to vehicle driving safety among data collected through ADAS sensing data, a notification function appropriate to the detected situational information is selected and implemented in a form that can be recognized by rear objects (e.g., rear vehicles / people).

[0265] At this time, situational information related to the driving safety of the vehicle may include, for example, traffic signal information in front of the vehicle, traffic congestion information, accident occurrence information, road condition information, slow-down information, disembarkation information, and the appearance of obstacles.

[0266] The project device (800) can select a notification image corresponding to a predicted dangerous situation based on sensing data. For example, if a possibility of a forward collision is predicted based on sensing data, the project device (800) can select from memory (not shown) symbols, text, images, etc. including "Caution: Collision" corresponding to a warning notification function corresponding to the predicted dangerous situation.

[0267] According to an embodiment, the projection device (800) may operate to generate a notification image only when it is determined that a notification is necessary for a rear object. For example, the notification image may be implemented when a predetermined notification is required among the forward driving situation of the vehicle (e.g., pedestrian detection, driving caution, traffic signal change, etc.), the distance to the rear object, and driving operation information (e.g., reverse driving, sudden braking, door opening, etc.) detected through the vehicle's sensing data (e.g., ADAS sensing data).

[0268] The above notification image is created by expressing a function that indicates situational information related to the driving safety of a vehicle in the form of an image, text, or a combination thereof.

[0269] Continuing, the projection device (800) determines the display position on which to project the notification image based on the degree of vehicle approach of the rear object (1020).

[0270] Here, the rear object includes a vehicle, person, animal, etc. located at the rear based on the driving direction of the vehicle (100), and is assumed to be movable. In other words, the rear object refers to a vehicle, person, animal, etc. located at the rear that can perform an appropriate action / movement upon seeing a notification image that calls attention, and does not necessarily have to be located in the same driving lane as the vehicle.

[0271] According to an embodiment, the degree of approach of a rear object can be calculated based on sensing data from a vehicle sensor, for example, ADAS sensing data.

[0272] The above display position may be either a first display position corresponding to the rear window of the vehicle or a second display position corresponding to the rear road surface of the vehicle, or both. That is, the projection device (800) may determine to display the notification image at the first display position, the second display position, or both, depending on the degree of approach of the rear object.

[0273] According to an embodiment, if the proximity of the rear object is greater than or equal to the first reference distance and less than or equal to the second reference distance, the display position may be determined so that the notification image is projected on both the rear window of the vehicle and the rear road surface.

[0274] Here, the first and second reference distances refer to the distance between the vehicle and the rear object. The first reference distance may be shorter than the second reference distance, for example, 10 m. In addition, the second reference distance may be longer than the first reference distance, for example, 30 m.

[0275] The first reference distance may be changed in consideration of the installation location of the projection device (800), the height of the vehicle, etc. The starting position of the road projection area varies depending on the installation location of the projection device (800), the height of the vehicle, etc., and this is also related to the recognition range of the rear object. For example, if the projection device (800) is installed higher than the reference height or in the case of a vehicle such as an SUV or wagon, the first reference distance may be changed to be shorter than the initial setting value.

[0276] The second reference distance can be adjusted to account for the height of the rear object (e.g., if the rear vehicle is an SUV, wagon, or a tall person). This is because the angle at which the rear object views the road changes depending on the rear object's height, which is also related to the rear object's range of perception. For example, if the rear vehicle is an SUV or wagon, the second reference distance may be adjusted to be longer than the default value.

[0277] In some embodiments, if the approaching rear object is less than the first reference distance, the display position may be determined so that the notification image is projected only on the rear window of the vehicle. This is to take into account that when a rear object (looking forward) approaches the vehicle, the information projected on the road surface becomes difficult to perceive as it is outside the field of view.

[0278] In some embodiments, when the approaching rear object is greater than the second reference distance, the display position may be determined so that the notification image is projected onto the road surface behind the vehicle. This is to take into account that the recognition ability of information projected onto the rear window of the vehicle is reduced when the rear object (looking forward) moves away from the vehicle.

[0279] However, if the rear object is far enough away from the second reference distance and thus exceeds the threshold distance, the projection device (800) may determine not to display a notification image, as there is no need to provide a notification to the rear object. Thereafter, if the rear object is detected and approaches within the second reference distance, the rear window of the vehicle, the rear road surface, or both may be determined as the display location.

[0280] The projection device (800) projects a notification image on the determined display position using at least one of the first and second output modules (e.g., projection #1, #2) capable of projecting an image on each of a plurality of positions (1030).

[0281] To this end, the projection device (800) is placed at the rear of the vehicle, and the display position determined by the processor may include one or more positions specified using one or both of the first and second output modules of the output unit (830).

[0282] At this time, the location designated using the first output module may be the rear window of the vehicle. Additionally, the location designated using the second output module may be the rear road surface of the vehicle. In some embodiments, the detailed locations of the rear window and the rear road surface may vary depending on the type of notification image to be projected.

[0283] According to an embodiment, in the single mode of the projection device (800), a notification image is projected at a display position determined using either the first or second output modules. At this time, which of the first or second output modules is used is determined based on the distance between the vehicle and the rear object.

[0284] For example, if the distance to the rear object is sufficiently close, the operation of the first output module is activated to project a notification image onto the rear window. At this time, the second output module may be deactivated so as not to interfere with the forward gaze of the rear object.

[0285] Additionally, for example, when the distance to the rear object becomes sufficiently large and the information recognition capability for the rear window decreases, the operation of the second output module is activated to project a notification image onto the rear road surface. At this time, the first output module may be deactivated or remain activated.

[0286] According to an embodiment, in the dual mode of the projection device (800), notification images are projected at different display locations using both the first and second output modules. In this case, the first notification image projected on the rear window of the vehicle using the first output module and the second notification image projected on the rear road surface of the vehicle using the second output module may be different images.

[0287] According to an embodiment, the processor (820) of the projection device (800) may continuously monitor the degree of approach of a rear object after projecting a notification image at a determined display position, and may change at least one of the determined display position and notification image based on the monitoring result. At this time, the degree of approach of the rear object may be calculated based on vehicle sensing data, for example, ADAS sensing data.

[0288] For example, since the projection device (800) has a different field of view (i.e., field of view and visible distance) for the front depending on the degree of approach of a rear object to the vehicle, the display location of a notification image notifying the situation ahead may be changed to the rear window / rear road surface or both as the rear object approaches or moves away.

[0289] Additionally, for example, when the degree to which a rear object approaches the vehicle changes, the size, shape, brightness, etc. of the notification image may change. For example, if a rear object approaches the vehicle while the notification image is projected on the rear window of the vehicle, the size / brightness of the image may be increased or a highlight effect may be displayed to further draw attention to the rear object.

[0290] According to an embodiment, the notification image is associated with driving safety information based on sensing data, and the associated driving safety information may be projected as different images on a first display position corresponding to a first output module of the output unit (830) and a second display position corresponding to a second output module of the output unit (830).

[0291] That is, even if the notification image indicates the same driving safety information (e.g., driving speed reduction / "slow down"), the image can be generated and projected differently when displayed on the rear window of the vehicle and when displayed on the rear road surface.

[0292] Specifically, the notification image may include different first and second notification images when projected at each display location.

[0293] In this case, the processor (820) of the projection device (800) can control to project a first notification image on the rear window of the vehicle using at least one of the first and second output modules of the output unit (830) and to project a second notification image on the rear road surface of the vehicle using the other one.

[0294] The first and second notification images may be a combination of one or more of a symbol, an image, and text. When the first and second notification images are displayed simultaneously, the first and second notification images may be implemented by including one or more of the same or similar symbols, images, and text corresponding to the same function.

[0295] Here, the processor (820) can adjust the focal length of each of the output units (830), i.e., the first and second output modules. In addition, the processor (820) can adjust the refractive index of each of the output units (830), i.e., the first and second output modules.

[0296] For example, when the second notification image is projected onto the rear road surface of the vehicle using the second output module, the processor (820) can adjust the refraction range, focal length, etc. to change the size and output range of the second notification image based on the distance between the rear object and the vehicle.

[0297] As described above, the projection device of a vehicle according to an embodiment of the present invention allows information related to the driving safety of a vehicle to be selectively projected at a more appropriate location by considering the degree to which a rear object is close to the vehicle, thereby enabling better recognition of information without interfering with the driving of surrounding vehicles.

[0298] Below, FIGS. 11a, 11b, and 11c illustrate various embodiments in which the display position of a notification image changes depending on the distance between a vehicle and a rear object according to an embodiment of the present invention.

[0299] Here, a rear vehicle is shown as an example of a rear object, but this is not necessarily the case. Furthermore, for explanatory purposes, the image corresponding to the slow-motion notification function is shown as an example when the vehicle is moving slowly or the rear vehicle is traveling faster than the reference speed. However, various other examples can be implemented. Furthermore, the first and second reference distances described below may be variable.

[0300] Specifically, FIG. 11a is an example in which a notification image is displayed only on the rear window of a vehicle when the distance from the rear vehicle is less than the first reference distance.

[0301] Figure 11b is an example in which a notification image is displayed on the road surface behind the vehicle when the distance from the rear vehicle is greater than the second reference distance, which is longer than the first reference distance.

[0302] Figure 11c is an example in which a notification image is displayed simultaneously on the rear window of the vehicle and on the road surface when the distance from the rear vehicle is greater than or equal to the first reference distance and less than the second reference distance.

[0303] When the projection device (800) operates in single mode, it performs one of a short-range operation mode in which a notification image is projected using the first output module and a long-range operation mode in which a notification image is projected using the second output module.

[0304] In the near-range operation mode, the processor (820) of the projection device (800) uses the first output module to project a notification image only onto the rear window of the vehicle. Accordingly, rear objects located close to the vehicle can recognize the vehicle's forward situation or driving status through the notification image on the rear window. For example, this can enhance the information recognition ability of a rear vehicle approaching the vehicle.

[0305] According to an embodiment, the processor (820) of the projection device (800) deactivates the second output module and projects the first notification image onto the rear window of the vehicle through the first output module when the distance between the vehicle and the rear object becomes less than the first reference distance. At this time, the first reference distance may be, for example, 10 m, and may change depending on the height of the vehicle or the position of the projection device (800).

[0306] Referring to FIG. 11a, when the distance between the vehicle (100) and the rear vehicle (RC) becomes closer to less than the first reference distance (L1), the projection device (800) can project a first notification image (1110) warning 'SLOW DOWN!' on the rear window (RW) of the vehicle.

[0307] In the long-distance operation mode, the processor (820) of the projection device (800) uses the second output module to project a notification image only on the road surface behind the vehicle. Accordingly, a rear object located relatively far from the vehicle can recognize the situation ahead of the vehicle or the driving status of the vehicle through the notification image on the rear window. For example, when the distance between the vehicle and the vehicle behind is far due to highway driving, the road is used as a screen so that the vehicle behind can recognize the situation ahead of the vehicle or the driving status of the vehicle from a distance.

[0308] According to an embodiment, the processor (820) of the projection device (800) projects a second notification image onto the rear road surface of the vehicle through the second output module when the distance between the vehicle and the rear object becomes greater than the second reference distance.

[0309] At this time, the second reference distance may be, for example, 30 m, and this value may change depending on the height / viewing angle of the rear object (e.g., rear vehicle).

[0310] Additionally, the second notification image may include an image that is the same as or different from the first notification image. Furthermore, the second notification image may change depending on the distance between the vehicle and the rear object. For example, the projection pattern of the second notification image may change and / or the number of projections may increase or decrease based on the distance between the vehicle and the rear object.

[0311] Referring to FIG. 11b, when the distance between the vehicle (100) and the rear vehicle (RC) is greater than or equal to the second reference distance (L2), the projection device (800) can project a second notification image (1120) indicating 'SLOW DOWN!' on the rear road surface (RAD) of the vehicle.

[0312] Meanwhile, if the distance between the vehicle (100) and the rear vehicle (RC) becomes excessively large, for example, if the distance exceeds the second reference distance described above and goes beyond the critical distance, the projection device (800) may be switched to idle mode or off state.

[0313] Thereafter, when the distance between the vehicle (100) and the rear vehicle (RC) approaches a range that satisfies the second reference distance or more within the critical distance, the projection device (800) can be switched to the idle mode release or on state.

[0314] When the projection device (800) operates in dual mode, both the first and second output modules can be used to project notification images onto different locations, i.e., the rear window of the vehicle and the rear road surface, respectively. For example, when a certain level of distance between vehicles is secured on a general road or at high speeds with heavy traffic, the projection device (800) can operate in dual mode.

[0315] According to an embodiment, a processor (820) of a projection device (800) calculates a distance between a vehicle and a rear object based on sensing data of the vehicle (e.g., ADAS sensing data). Based on the calculated distance, in response to a distance between the vehicle and the rear object satisfying a range greater than or equal to a first reference distance and less than a second reference distance, the processor (820) projects a notification image at a plurality of locations using both the first and second output modules of the output unit (830).

[0316] That is, the processor (820) controls the output unit (830) to simultaneously project the first and second notification images onto the rear window of the vehicle, which is a location corresponding to the first output module, and onto the rear road surface, which is a location corresponding to the second output module.

[0317] At this time, the first reference distance is shorter than the second reference distance, and the range of the first reference distance or more and the second reference distance or less may be, for example, 10 m or more and less than 30 m.

[0318] Referring to FIG. 11c, while the distance between the vehicle (100) and the rear vehicle (RC) satisfies a range (L3) that is greater than or equal to the first reference distance and less than or equal to the second reference distance, the projection device (800) can simultaneously project a first notification image (1110) indicating 'SlOW DOWN' on the rear window of the vehicle and a second notification image (1120') indicating 'SLOW DOWN!' on the rear road surface.

[0319] At this time, the second notification image (1120') may be different from the notification image projected on the rear road surface of the vehicle when the projection device (800) operates in single mode. For example, the second notification image (1120') projected in dual mode may be implemented and projected in the form of a smaller size or smaller number of images, since the visibility distance of the driver of the rear vehicle is shorter than that of the second notification image (1120) projected in single mode.

[0320] When the projection device (800) operates in dual mode, the driver of the rear vehicle (RC) can simultaneously perceive both the image (1120') projected in the above range (L3) and the image (1110) projected on the rear window while looking forward.

[0321] In this way, according to the projection device according to an embodiment of the present invention, accidents and secondary accidents can be prevented by visually and intuitively transmitting the forward situation or driving situation related to the safety of the vehicle to the vehicle driving behind while the vehicle is driving.

[0322] For example, the projection device (800) can prevent rear-end collisions, etc. by transmitting information on traffic signals and congestion conditions ahead, whether an accident has occurred, whether there are pedestrians, road condition information (e.g., caution for slipping, etc.), and whether a child has gotten off the vehicle to the rear vehicle.

[0323] Additionally, the projection device (800) can perform switching between the aforementioned single close-range operation mode, single long-range operation mode, and dual mode while the vehicle is driving. At this time, switching between each operation mode can be actively performed based on driving environmental conditions such as external illumination (e.g., at night), display size, road conditions, and weather conditions, in addition to changes in the distance between the vehicle and rear objects.

[0324] For example, even if the distance to the rear object satisfies the single long-distance operation mode or dual mode, if the visibility of the rear road surface is below a standard (e.g., when the visibility of the road surface display is poor when the vehicle is driven during the day), the vehicle may operate in single short-distance mode using the vehicle's rear window as a screen to improve visibility.

[0325] Meanwhile, although not illustrated, the examples of Figures 11a to 11c can be similarly applied based on the driving speed of the rear vehicle. For example, if the rear vehicle is approaching at a high speed, the image can be projected onto the rear window of the vehicle (or along with the rear road surface). Conversely, if the rear vehicle is traveling at a slow speed and the distance from the front vehicle gradually increases, the image can be projected onto the rear window of the vehicle (or along with the rear road surface).

[0326] FIGS. 12a, 12b, and 12c are examples for explaining the structure of a projection device that projects images through different output paths according to an embodiment of the present invention.

[0327] In the embodiment of the present invention, the first and second output modules (e.g., projectors #1 and #2) of the output unit (830) are described as using a DLP projector (Digital Lighting Processing), but are not necessarily limited thereto.

[0328] DLP projectors (Digital Lighting Processing) use a DMD (Digital Micromirror Device) as their display element. A DMD is a chip that features countless microscopic mirrors, each corresponding to a pixel. In other words, this technology allows for the reflection angle of a 14-16㎛-sized ultra-small mirror per pixel to be adjusted based on a signal to create an image. Typically, a DLP projector consists of a DMD element, which adjusts the reflection angle of light emitted from a light source for each pixel to form an image, and a projection lens (optical lens) for projecting the image formed by the DMD element.

[0329] Meanwhile, in order to project images in multiple directions simultaneously, multiple beam projectors were generally used to project the images.

[0330] In such cases, in order to simultaneously project images onto the rear window and the rear road surface of the vehicle as in the present invention, a projector for the rear window display and a projector for the rear window display are provided as separate sets. In this case, each set can be operated in single mode operation, and both sets can be operated in dual mode operation.

[0331] In some embodiments, images can be projected simultaneously in multiple directions using a single beam projector. Specifically, a single light source and a single DMD can be provided, and mirrors can be selectively used to direct light along output paths suitable for a preset operating mode, thereby simultaneously projecting images to different locations and / or multiple locations.

[0332] Referring to FIGS. 12A to 12C, a DLP projector including one light source and one DMD projects images at different locations or in multiple directions by changing (or adding) an output path using a mirror depending on the operating mode.

[0333] Specifically, Fig. 12a illustrates an operation mode corresponding to projector #1 in single mode, and an output path in which an image is projected only on the rear window of a vehicle.

[0334] Figure 12b is an operation mode corresponding to projector #2 in single mode, showing an output path in which an image is projected only on the rear road surface of the vehicle.

[0335] Figure 12c illustrates a dual mode corresponding to projectors #1 and #2, with multiple output paths in which images are simultaneously projected onto the rear window of the vehicle and the rear road surface.

[0336] According to an embodiment, the processor (820) of the projection device (800) controls the operations of the first and second output modules (i.e., projections #1, #2) of the output unit (830) to generate different output paths. The processor (820) controls the output unit (830) to project notification images at different display locations through the generated different output paths.

[0337] As illustrated in FIGS. 12A to 12C, the first and second output modules (i.e., projections #1 and #2) according to an embodiment of the present invention generate different output paths using a set of beam projectors depending on the operation mode.

[0338] In other words, the first and second output modules (i.e., projections #1, #2) disclosed in the present specification do not mean physically separate sets of beam projectors. That is, the first and second output modules (i.e., projections #1, #2) operate in single mode (projection #1 or projection #2) and dual mode using one set of beam projectors.

[0339] The output unit (830) of the projection device (800) is configured to include one light source (1201), i.e., a lamp, and one DMD (1202). The output unit (830) additionally includes a plurality of optical lenses (1210, 1220) and a plurality of mirrors (1203, 1204) for changing the output path. Meanwhile, it is assumed that the "optical lenses (1210, 1220)" and the "projection lenses (1210, 1220)" disclosed in the following description are used as the same concept.

[0340] The processor (820) of the projection device (800) can generate a first output path toward the first optical lens using the first mirror when the first output module (projector #1) of the output unit (830) operates.

[0341] Referring to Fig. 12a, when the first output module is in operation, an image implemented through a light source (1201), i.e., a lamp, and a DMD (1202) is reflected through a first mirror, i.e., a full reflection mirror (1203), and a first light output path (1231) is generated toward a first projection lens (1210). By projecting light through the first projection lens (1210) along the generated first light output path (1231), a notification image is implemented on the rear window of the vehicle.

[0342] The processor (820) of the projection device (800) can generate a second output path toward a second optical lens positioned at a different location from the first optical lens when the second output module (projector #2) of the output unit (830) operates.

[0343] Referring to Fig. 12b, when the second output module is in operation, a second light output path (1232) is generated in which an image implemented through a light source (1201), i.e., a lamp, and a DMD (1202) is directed directly to a second projection lens (1220) without a mirror (i.e., without reflection). By projecting light through the second projection lens (1220) along the generated second light output path (1232), a notification image is implemented on the road surface at the rear of the vehicle.

[0344] The processor (820) of the projection device (800) can simultaneously generate first and second output paths directed toward the first and second optical lenses, respectively, using a second mirror different from the first mirror when both the first and second output modules (projectors #1, #2) of the output unit (830) are in operation.

[0345] Referring to FIG. 12c, in the dual mode operation in which both the first and second output modules are in operation, an image implemented through a light source (1201), i.e., a lamp, and a DMD (1202) is reflected in two directions through a second mirror, i.e., a half reflection mirror (1204), thereby generating first and second output paths (1231, 1232) that respectively direct to the first and second optical lenses (1210, 1220). Light is projected through the first and second optical lenses (1210, 1220) along the generated first and second output paths (1231, 1232), respectively, thereby simultaneously implementing a notification image on the rear window and the rear road surface of the vehicle.

[0346] When mirrors are used as in FIGS. 12A and 12C, the change between a full reflection mirror (1203) and a half reflection mirror (1204) can be switched / repositioned in such a way that the corresponding mirror suitable for each operation mode is pulled out through rotation, etc. In this case, a configuration such as a motor (not shown) may be added at an appropriate location for the mirror rotation.

[0347] As described, the notification images generated / selected by the processor (820) are projected to different locations via different output paths.

[0348] When the notification image is simultaneously projected onto the rear window and rear road surface of the vehicle along the first and second output paths (1231, 1232), the brightness of the image is less than when it is projected along one output path.

[0349] Accordingly, in some embodiments, depending on the proximity of the rear object, the system operates in single mode, selectively using only either projection #1 or projection #2, and dual mode can be disabled. In this case, the driver of the rear vehicle will be able to recognize the notification image more clearly.

[0350] Figure 13 is a diagram illustrating a method for determining whether to simultaneously project onto the rear window of a vehicle and the road surface based on the visibility distance of the driver of the rear vehicle, according to an embodiment of the present invention. Here, the rear object is described as a rear vehicle, but this is not necessarily limited to this.

[0351] Referring to Fig. 13, as the distance between the rear vehicle (RC) and the vehicle (100) increases, the driver of the rear vehicle (RC)'s visibility (or information recognition ability) of the rear window of the vehicle (100) decreases. Therefore, in this case, projecting a notification image onto the road surface at the rear of the vehicle (100) makes it easier for the driver of the rear vehicle (RC) to recognize the information.

[0352] Conversely, as the distance between the rear vehicle (RC) and the vehicle (100) decreases, the driver of the rear vehicle (RC) must keep his / her eyes on the road ahead, making it difficult for him / her to keep an eye on the road surface. Therefore, in this case, projecting a notification image onto the rear window of the vehicle (100) makes it easier for the driver of the rear vehicle (RC) to perceive the information.

[0353] In addition, when the notification image is projected on the rear road surface, the starting point of the notification image (i.e., the second notification image) should be located at a minimum distance corresponding to the minimum outer circumference standard of the vehicle (100), for example, 2 m, so as not to be obscured by the trunk of the front vehicle (100). However, the minimum distance corresponding to the minimum outer circumference standard may change depending on the vehicle type. For example, the minimum distance may be set to be shorter than 2 m for vehicle types such as SUVs and wagons, since the rear is structurally short.

[0354] In addition, when the notification image is projected on the rear road surface, the end point of the notification image (i.e., the second notification image) should be located at a minimum distance corresponding to the front standard of the rear vehicle (RC), for example, 4 m in front, so as not to be blocked by the hood of the rear vehicle (RC). However, the minimum distance corresponding to the front standard of the rear vehicle (RC) may change depending on the vehicle type. For example, when the rear vehicle (RC) has a high driver's seat or a short hood, such as an SUV, wagon, or bus, the distance may be changed to a distance at which the driver of the rear vehicle (RC) can stably see the image.

[0355] Continuing with reference to FIG. 13, when the distance between the vehicle (100) and the rear vehicle (RC) increases, the visibility of the driver of the rear vehicle (RC) when looking at the rear window of the vehicle (100) with a forward field of view (V3) decreases. On the other hand, when the distance between the vehicle (100) and the rear vehicle (RC) decreases, the field of view (V2) of the driver of the rear vehicle (RC) looking at the road surface decreases excessively, making it difficult to look ahead. This, in turn, interferes with the driving of the driver of the rear vehicle (RC).

[0356] Accordingly, the projection device (800) can change the operation mode to operate the notification image in a single mode, i.e., a short-range single mode or a long-range single mode, or a dual mode, within a range where visibility is maintained without interfering with the driving of the driver of the rear vehicle (RC), taking into account the viewing angle (V2, V3).

[0357] When projecting a notification image onto the rear window of a vehicle using the first output module, it must be satisfied that the distance between the two vehicles (100, RC) is within a distance at which the driver of the rear vehicle (RC) can recognize the notification image.

[0358] When projecting a notification image onto the road surface at the rear of a vehicle using a second output module, the distance between the two vehicles (100, RC) must be such that the field of view (V2) of the driver of the rear vehicle (RC) looking at the road surface is almost the same as that of the driver looking forward.

[0359] In addition, when the notification image is projected onto the rear road surface of the vehicle (100), the starting point of the notification image projected onto the road surface must satisfy the minimum distance (D1) corresponding to the aforementioned minimum outer angle criterion that meets the angle (V1) toward the ground at the height of the rear trunk of the vehicle (100). In addition, the ending point of the notification image projected onto the road surface must satisfy the minimum distance (D2) corresponding to the front criterion of the aforementioned rear vehicle (RC).

[0360] When these conditions are met, the driver of the rear vehicle (RC) can intuitively recognize the information without interference from driving, whether the notification image is projected on the rear window of the vehicle (100) or on the rear road surface.

[0361] FIG. 14 is a flowchart illustrating a process of determining whether to project in dual mode by calculating the distance between the front situation of the vehicle and the rear object based on sensing data according to an embodiment of the present invention.

[0362] The projection device (800) can receive various ADAS sensing data from the ADAS sensor through the communication module and collect the same (1401).

[0363] ADAS sensing data may include data related to the driving safety of a vehicle sensed through an ADAS sensor (1402) and data related to the location of a rear object (e.g., a rear vehicle). The ADAS sensor (1402) may include, for example, a front camera of the vehicle, a front LIDAR / RADAR, a rear camera, and a rear LIDAR / RADAR.

[0364] The above driving safety-related data may include, for example, data related to dangerous situations caused by vehicle speed, driving, and the appearance of emergency obstacles, as well as data related to the vehicle's forward driving situation (e.g., signals, traffic information, accident information, etc.).

[0365] Additionally, data related to the position of the rear object may include data regarding the current driving speed of the vehicle, real-time position change amount with respect to the rear object, possibility of collision, etc.

[0366] The collected information of ADAS sensing data is transmitted to a processor (820) (e.g., MCU). The processor (820) can simultaneously perform forward information processing and rear information processing based on the vehicle's ADAS sensing data (1402).

[0367] As a forward information processor, the processor (820) can determine forward signal information, traffic information, and whether there is an obstacle based on the information collected from ADAS sensing data.

[0368] As a rear information processing, the processor (820) can calculate the distance between the vehicle and the rear vehicle based on information collected from ADAS sensing data.

[0369] The processor (820) can determine whether to operate the output unit (830) of the projection device (800) based on the results of the forward information processing and the backward information processing (1403).

[0370] Specifically, the processor (820) can determine whether information needs to be provided to a rear vehicle based on the result of the forward information processing, and can determine whether to activate the output unit (830) based on the determination. The processor (820) can determine whether to operate the first output module of the output unit (830), the second output module, or both the first and second output modules based on the result of the rear information processing.

[0371] If the forward information processing result does not require information provision to the rear vehicle, the output unit (830) is not activated (1404). That is, a notification image may not be projected on the rear window and rear road surface of the vehicle.

[0372] If it is determined as a result of the forward information processing that information needs to be provided to the rear vehicle, the operation mode of the output unit (830) is determined based on the result of the rear information processing (1405).

[0373] Specifically, if the distance from the rear vehicle is greater than or equal to the second reference distance or greater than or equal to the first reference distance and less than the second reference distance, a long-distance single mode or dual mode using the second output module is determined, and a notification image is projected on the road surface behind the vehicle (1407).

[0374] On the other hand, if the distance to the rear vehicle is shorter than the first reference distance or satisfies the condition of greater than or equal to the first reference distance and less than the second reference distance, the short-range single mode or dual mode using the first output module is determined, and a notification image is projected on the rear window of the vehicle (1406).

[0375] According to an embodiment, the projection device (800) can activate the display function of a notification image based on a user input. That is, the projection device (800) can be turned on or off by a user input.

[0376] According to an embodiment, the projection device (800) may determine whether to deactivate at least one of the first and second output modules of the output unit (830) based on context information related to driving or glass characteristics of the rear window. Here, the context information related to driving may include one or more of weather information and the condition of the driving road.

[0377] For example, even if it is determined as a long-distance single mode or dual mode through step (1405) of FIG. 14, if the condition of the driving road is determined to be such that the recognition ability of the notification image is very low, the second output module can be deactivated.

[0378] Also, even if it is determined as a short-range single mode or dual mode through step (1405) of FIG. 14, for example, if the reflectivity of the glass of the rear window is low, the information recognition ability of the driver of the rear vehicle is reduced even at a short distance, so the first output module can be deactivated.

[0379] FIGS. 15a, 15b, 16a, and 16b are various examples of generating and projecting corresponding notification images according to driving safety information identified based on sensing data according to an embodiment of the present invention.

[0380] Referring to Fig. 15a, when an obstacle (OB) suddenly appears in front of a vehicle while the vehicle is driving, this can be sensed through ADAS sensing data and transmitted to a projection device (800). Then, the projection device (800) projects a warning notification image (e.g., 'CAUTION') (1520) corresponding to the obstacle (OB) onto the rear road surface, thereby allowing the driver of the rear vehicle (RC) to visually recognize the situation ahead through the road surface.

[0381] At this time, the size of the notification image (1520) projected onto the rear road surface can be determined by considering the maximum vehicle width, and the length can be determined based on the performance of the projection device (800) and the distance between vehicles. When the notification image is projected onto the road surface, a larger image can be obtained than when it is projected onto the rear window, making it easier for rear objects to recognize the notification image.

[0382] Referring to Fig. 15b, when a vehicle (100) is about to exit a parking lot, a projection device (800) can project a warning image (1520) indicating a reverse movement warning (e.g., 'MOVING BACK') onto the road surface corresponding to the vehicle's driving direction (e.g., backward direction) based on such driving information. Then, a person (RP) or a vehicle (RC) in the vicinity can recognize the vehicle (100) exiting the parking lot through the road surface.

[0383] The projection device (800) can project a notification image by warping the main body of the projection device (800) or the projection lens module to correspond to the glass curve and the irradiation angle of the rear window of the vehicle (100).

[0384] Referring to Fig. 16a, when a pedestrian crosses a crosswalk in front of a vehicle (100), this is sensed through ADAS sensing data and transmitted to a projection device (800). Then, the projection device (800) can project a notification image (1610A) indicating a forward situation in which a pedestrian (OB) is crossing a crosswalk onto the rear window of the vehicle (100).

[0385] Referring to Fig. 16b, when a signal change (TS) occurs in front of a vehicle (100), this can be sensed through ADAS sensing data and transmitted to a projection device (800). Then, the projection device (800) can project a notification image (1610B) indicating the changed signal onto the rear window of the vehicle. Accordingly, even if the signal light is obscured due to the height of the vehicle ahead, the driver of the rear vehicle can sense the change in the signal ahead.

[0386] FIG. 17, FIG. 18a, and FIG. 18b are examples of adjusting the road surface display position of a notification image according to the driving conditions of a vehicle and examples of operation of a device therefor, according to an embodiment of the present invention.

[0387] In normal operation, the projection device (800) projects a notification image onto the rear road surface in a straight line with the vehicle. However, in some examples, the notification image may be projected onto the rear side road surface.

[0388] According to an embodiment, the projection device (800) can change the detailed projection position on the road surface based on the collected ADAS sensing data, if the notification image to be projected on the road surface is related to a rear object located to the side, by associating it with the position of the rear object.

[0389] Referring to FIG. 17, when the notification image (1720) to be provided is a change in driving lane of a vehicle (100), the second output module of the output unit (830) of the projection device (800) can be adjusted so that the notification image (1720) notifying of the lane change is positioned between the rear vehicle (RC2) of the lane to which the vehicle (100) is to change and the rear vehicle (RC1) of the current lane.

[0390] To this end, the projection device (800) can project a notification image between the rear vehicle (RC2) of the current lane and the rear vehicle (RC1) of the current lane via the second output module after rotating by a certain angle. For example, as illustrated in FIG. 18a, the projection device (800) itself can be rotated from the first position to the second position, and then the notification image can be projected onto the road surface behind the vehicle.

[0391] Alternatively, the output unit (830) of the projection device (800) may be provided with a third light-transmitting lens or a separate prism, and may project a notification image between the rear vehicle (RC2) of the lane and the rear vehicle (RC1) of the current lane based on the control of the processor (820). For example, as illustrated in FIG. 18b, the main body of the projection device (800) may be maintained while the light-transmitting lens (L) constituting the second output module is rotated by a certain angle, and then the notification image may be projected onto the road surface at the rear of the vehicle.

[0392] Meanwhile, although not shown, the projection device (800) can project a notification image indicating boarding and disembarking of the school bus onto the rear window and / or the rear road surface in the front view of the vehicle.

[0393] In addition, the projection device (800) can receive sensing data regarding a dangerous situation of the vehicle driver (e.g., the driver's heart attack, etc.) and project an alert image indicating an SOS signal onto the rear window and / or the rear road surface.

[0394] Additionally, the projection device (800) can project a preset image (e.g., an advertising image, a personalized image) onto the vehicle's rear window, regardless of the vehicle's safe driving or driving conditions. In this case, the projection device can operate in single mode, projecting the image only onto the vehicle's rear window, so as not to disturb other drivers.

[0395] Additionally, the projection device (800) can be adjusted to project a notification image in a highly recognizable color depending on the road condition.

[0396] For example, in the case where the driving road is made of dark asphalt, the projection device (800) can project a notification image in white based on the road condition. In addition, for example, in the case where snow has accumulated on the driving road, the projection device (800) can project a notification image by correcting the color series based on the R, G, B primary colors based on the road condition. In addition, for example, in rainy weather, since the reflectivity of the road surface increases, the projection device (800) can lower the brightness of the projection device (800) based on the weather and road condition and project the notification image.

[0397] Additionally, the projection device (800) may be operated to increase the reflectivity (based on user input) and then project the notification image to improve visibility according to the glass characteristics of the rear window.

[0398] For example, the reflectivity can be increased by using technologies such as PDLC, SPD, and ECM to change the glass of the vehicle's rear window to a color-changing color. In the case of PDLC, the glass of the vehicle's rear window is changed to a white background, and in this case, the reflectivity of the first output module of the projection device (800) can be increased. Meanwhile, in the case of changing the vehicle's rear window to an opaque color-changing color, the rear view can be secured by using a digital room mirror or the like in the projection device (800).

[0399] Additionally, the projection device (800) can project notification images related to the driver's customized image, shared vehicle user information, etc., which can be utilized for driver authentication or vehicle following. For example, the driver of a rear-facing vehicle can easily follow the vehicle by checking the customized image projected onto the vehicle's rear window.

[0400] As described above, the vehicle projection device and its operating method according to an embodiment of the present invention can prevent accidents by transmitting information related to the vehicle's driving safety, including the vehicle's forward situation, to surrounding vehicles or people in the form of projected images while the vehicle is driving. Furthermore, by considering the proximity of rear objects to the vehicle, information related to the vehicle's driving safety can be selectively projected at a more appropriate location, thereby enabling better recognition of the information without interfering with the driving of surrounding vehicles. Furthermore, the size, shape, brightness, number, etc. of images corresponding to the vehicle's driving safety information can be appropriately modified based on various sensing data from the vehicle. Accordingly, vehicles or people behind the vehicle can more accurately and reliably perceive the driving situation ahead of the vehicle. Furthermore, in addition to information related to the vehicle's driving safety, POI advertisements related to the vehicle's current location, customized driver images, etc. can be displayed on the exterior of the vehicle. Consequently, usability can be further expanded.

[0401] The present invention described above can be implemented as computer-readable code (or application or software) on a program-recorded medium. The above-described method for controlling an autonomous vehicle can be realized by code stored in memory or the like.

[0402] A computer-readable medium includes any type of recording device that stores data that can be read by a computer system. Examples of computer-readable media include hard disk drives (HDDs), solid-state disks (SSDs), silicon disk drives (SDDs), ROMs, RAMs, CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, and also includes media implemented in the form of carrier waves (e.g., transmission via the Internet). In addition, the computer may include a processor or a control unit. Accordingly, the above detailed description should not be construed as limiting in all respects, but rather as illustrative. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all changes coming within the equivalent scope of the present invention are intended to be included in the scope of the present invention.

Claims

1. A communication module that receives vehicle sensing data; An output unit including a first output module and a second output module configured to project images to a plurality of locations, respectively; and A processor is included that generates a notification image to be displayed at the rear of the vehicle based on the sensing data, The above processor, Determine the display position of the notification image based on the degree of approach of the rear object, and control the output unit to project the notification image at the determined display position using at least one of the first and second output modules. Projection device for vehicles.

2. In paragraph 1, The above projection device is placed at the rear of the vehicle, The display position determined by the processor includes one or more positions specified using one or both of the first and second output modules of the output unit. Projection device for vehicles.

3. In paragraph 2, The above processor, After projecting the above notification image on the above determined display location, Controlling the output unit so that at least one of the determined display position and the notification image changes in response to a change in the degree of approach of the rear object; Projection device for vehicles.

4. In paragraph 3, The above notification image is, It is related to driving safety information based on the above sensing data, and the related driving stability information is projected as different images on a first display position corresponding to the first output module and a second display position corresponding to the second output module. Projection device for vehicles.

5. In paragraph 1, The above notification image includes different first and second notification images when projected at each display location, The above processor, Controlling the output unit to project a first notification image on the rear window of the vehicle using at least one of the first and second output modules and to project a second notification image on the rear road surface of the vehicle using the other one; Projection device for vehicles.

6. In paragraph 5, The above processor, Calculate the distance between the vehicle and the rear object based on the above sensing data, If the distance between the vehicle and the rear object satisfies the first reference distance or more and the second reference distance or less, the first and second notification images are projected onto the rear window and the rear road surface of the vehicle, respectively, using both the first and second output modules. The above first reference distance is shorter than the above second reference distance, Projection device for vehicles.

7. In paragraph 6, The above processor, When the distance between the vehicle and the rear object becomes less than the first reference distance, the second output module is deactivated and the first notification image is projected onto the rear window of the vehicle through the first output module. Projection device for vehicles.

8. In paragraph 6, The above processor, When the distance between the vehicle and the rear object becomes greater than the second reference distance, the second notification image is projected onto the rear road surface of the vehicle through the second output module. Projection device for vehicles.

9. In paragraph 1, The above processor, Controlling the operations of the first and second output modules to generate different output paths, and projecting the notification images at different display locations through the generated different output paths. Projection device for vehicles.

10. In paragraph 9, The above output unit is configured to include one light source and DMD, a plurality of optical lenses, and a plurality of mirrors, Under the control of the above processor: When the first output module is operated, a first output path toward the first optical lens is generated using the first mirror, When the second output module is operated, a second output path is created toward a second optical lens positioned at a different location from the first optical lens, When both the first and second output modules are in operation, first and second output paths directed to the first and second optical lenses are simultaneously generated using a second mirror different from the first mirror, The above notification images are projected to different locations through different output paths. Projection device for vehicles.

11. In paragraph 1, The above sensing data includes data related to driving safety sensed through the vehicle's ADAS sensor and data related to the location of rear objects. Projection device for vehicles.

12. In paragraph 1, The above processor, Activating the display function of the notification image based on user input, and determining whether to deactivate at least one of the first and second output modules based on context information related to driving, The context information related to the above driving includes one or more of weather information and driving road conditions. Projection device for vehicles.

13. As an operating method of a vehicle projection device, A step of receiving sensing data of a vehicle; A step of generating a notification image to be displayed at the rear of the vehicle based on the sensing data; A step of determining the display position of the notification image based on the degree of approach of the rear object; and A step of projecting the notification image at the determined display location using at least one of the first and second output modules configured to project images at each of a plurality of locations, Method of operation of a vehicle projection device.

14. In paragraph 13, The projection device of the above vehicle is placed at the rear of the vehicle, The step of determining the above display position is: A step of determining one or more locations specified using one or both of the first and second output modules, Method of operation of a vehicle projection device.

15. In paragraph 14, After the step of projecting the above notification image, Further comprising a step of differently changing at least one of the display position of the notification image and the shape of the notification image based on the change in the degree of proximity of the rear object. Method of operation of a vehicle projection device.

16. In paragraph 15, The above notification image is, It is related to driving safety information based on the above sensing data, The step of projecting the above notification image is a step of projecting the related driving stability information as different images on a first display position corresponding to the first output module and a second display position corresponding to the second output module. Method of operation of a vehicle projection device.

Images