DEVICE AND METHOD FOR DETECTING AND NOTIFYING A PEDESTRIAN
Patent Information
- Application Number
- DE102017124304
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2016-12-15
- Filing Date
- 2017-10-18
- Publication Date
- 2024-11-21
- Estimated Expiration
- 2037-10-18
AI Technical Summary
In autonomous vehicles, pedestrians may feel uncomfortable and mistrustful due to the lack of communication with the vehicle, leading to unpredictable behavior and reduced safety, as they cannot determine if the vehicle recognizes them.
A vehicle system that includes sensors, a display unit, speaker, and lighting unit to detect pedestrians and provide notifications such as symbols, sounds, and directional lights to inform them of the vehicle's movement and direction, enhancing communication and safety.
The system improves pedestrian confidence and safety by clearly communicating the vehicle's intentions, reducing unpredictable pedestrian behavior and enhancing overall driving safety.
Smart Images

Figure 00000012_0000 
Figure 00000013_0000 
Figure 00000014_0000
Abstract
Description
FIELD OF THE INVENTION
[0001] The application relates to a vehicle or a device installed in the vehicle, and in particular to a device and method for detecting and notifying a pedestrian. BACKGROUND OF THE INVENTION
[0002] Generally, in a case when no one is driving a vehicle because there is no driver in the vehicle or the vehicle performs autonomous driving and / or parking although there is a driver in the vehicle, a pedestrian near the vehicle cannot predict a traveling direction of the vehicle, so he or she feels uncomfortable around the vehicle.
[0003] When a vehicle is driven by a driver, a pedestrian can communicate with the driver through hand signals or eye contact, allowing the driver and pedestrian to recognize each other. As a result, the pedestrian can assume that the driver is paying attention to the pedestrian in order to drive the vehicle safely. Common sense suggests that the pedestrian and driver can form a psychological relationship of trust, thereby avoiding a collision and ensuring safe driving.
[0004] However, in cases where vehicles are controlled using automatic steering / unmanned steering, remote steering, and autonomous driving, it may not be possible to determine whether the vehicles detect (or are aware of) a pedestrian. If there is no driver, the pedestrian has no other party to communicate with. Furthermore, even if there is a driver in the vehicle, the pedestrian cannot determine whether the driver detects the pedestrian because the driver is not involved in driving.
[0005] In the situations described above, the pedestrian may feel uncomfortable and distrust an autonomous vehicle. A pedestrian's fear or anxiety may cause their random actions or movements, which the autonomous vehicle cannot predict or handle based on its algorithm. This phenomenon may increase unsafe factors for achieving autonomous driving, and the driving safety of the autonomous vehicle would be reduced.
[0006] Accordingly, an autonomous vehicle may be required to inform a pedestrian about its driving status. This includes detecting the pedestrian and safely controlling the autonomous vehicle through its algorithm or function, allowing the autonomous vehicle to respond to the pedestrian by providing the pedestrian with information about the vehicle's direction of travel and speed, as well as driving safety or stability. It is therefore necessary to develop technology that could improve the reliability between a pedestrian and an autonomous vehicle and ensure safety through predictable / calculable movement (relative) to each other.
[0007] The disclosure of this section is intended to provide background information to the invention. Applicant acknowledges that this section may contain information available prior to this application. However, by providing this section, applicant does not admit that any information contained in this section constitutes prior art.
[0008] DE 10 2013 216 490 A1 discloses a system for providing a signal to an object in the environment of the system.
[0009] DE 10 2013 217 057 A1 discloses a pedestrian information device.
[0010] DE 10 2014 226 254 A1 discloses a method for operating a motor vehicle, in particular one that drives / can be driven autonomously or semi-autonomously, a signaling device and a motor vehicle.
[0011] DE 102011 011 870 A1 discloses a component-based detection, classification, tracking and prediction of objects.
[0012] DE 102014 011 811 A1 discloses informing a road user about an autopilot-controlled journey. EXPLANATION OF THE INVENTION
[0013] The present invention has for its object to provide a device installed in a vehicle (e.g., a motor vehicle) and its pedestrian detection notification method, which can display a detection notification for a pedestrian, thereby providing psychological stability or safety to the pedestrian.
[0014] For this purpose, the invention provides a vehicle (e.g. a motor vehicle) comprising: a sensor unit configured to perceive (e.g. detect) an object in a surrounding area of the vehicle, an output unit configured to output a notification about a pedestrian (e.g.concerning a pedestrian) that is / is detected in the surrounding area, and a control unit that is configured to detect whether the object is the pedestrian based on sensor signals supplied by the sensor unit and to control the output unit to thereby output the notification when the pedestrian is / is detected, wherein the output unit comprises: a display unit that is configured to display at least one of a symbol, a message, or a sign corresponding to the notification about the pedestrian in response to a control signal that is / is output from the control unit, a speaker unit that is configured to output a notification sound (e.g., a notification tone or, e.g.,a notification sound) corresponding to the notification of the pedestrian in response to the control signal outputted from the control unit, and a lighting unit (e.g., a illuminating unit) configured to illuminate the pedestrian or a peripheral area of the pedestrian in response to the control signal outputted from the control unit, wherein the control unit controls the display unit to display, on the display screen, a direction indicator indicating a traveling direction of the vehicle when the pedestrian is detected, wherein, when the pedestrian is detected, the control unit causes the lighting unit to emit a notification light so that the notification light is displayed on (e.g., on) a front hood (e.g.,hood) of the vehicle according to a direction of movement of the pedestrian, wherein, when the pedestrian is detected, the control unit causes the lighting unit to emit a notification light so that the notification light is pointed toward the pedestrian and moved along with the pedestrian.
[0012] .
[0015] The display unit may be configured to display the pedestrian notification toward a front area of the vehicle. The speaker unit may be configured to emit the notification sound toward the front area of the vehicle. The lighting unit may be configured to emit a light toward the front area of the vehicle.
[0016] The vehicle may further include a camera unit configured to film a front portion of the vehicle in response to a control signal output from the control unit.
[0017] The control unit can detect whether the object is movable based on the sensor signals, and can determine whether a movable object is the pedestrian based on an image captured by the camera unit.
[0018] The sensor unit may include a front sensor configured to sense a front portion of the vehicle, a rear sensor configured to sense a rear portion of the vehicle, and a side sensor configured to sense side portions of the vehicle.
[0019] When the pedestrian is detected, the control unit causes the display unit to display a symbol (e.g. a pictogram) of a specific shape following the pedestrian.
[0020] The specific shape of the symbol can be an eye or a pupil of the eye.
[0021] The notification light may have a special shape or a special color, which (in each case) is distinguishable from a front light (e.g. a headlight).
[0022] The control unit may cause the output unit to generate a light or a sound (e.g. a tone or e.g. a noise) having (each) directional characteristics toward the pedestrian when the pedestrian is detected.
[0023] The light or sound, which has (respectively) the directional characteristic, can be moved along a direction of movement of the pedestrian.
[0024] Furthermore, the invention provides a method for providing a perception of a vehicle (e.g., a motor vehicle) to a pedestrian, comprising: perceiving (e.g., detecting) an object in a surrounding area of the vehicle, recognizing whether the object is the pedestrian, and issuing a notification about the pedestrian (e.g., concerning the pedestrian) that is / is detected in the surrounding area, wherein issuing the notification comprises: checking whether the notification is previously set (e.g., preset) when the pedestrian is / is detected, showing a list of notification symbols (e.g., notification icons) about the pedestrian if no notification is preset, recognizing a selected notification symbol and displaying (e.g.,Displaying) the notification corresponding to the selected notification icon, wherein displaying the notification comprises: displaying, on a display unit, a direction indicator indicating a direction of travel of the vehicle when the pedestrian is detected, and emitting, on a ground around the pedestrian, a direction indicator indicating a direction of travel of the vehicle when the pedestrian is detected.
[0025] Issuing the notification may further comprise presenting (e.g., displaying) the notification corresponding to the pedestrian if the notification is preset.
[0026] The notification may be moved along with the movement of the pedestrian, and the notification may comprise at least one of an icon, a message, a sign, a sound (e.g., tone or noise), a light, or a combination thereof.
[0027] Detecting whether the object is the pedestrian may include determining whether the object is movable based on sensor signals provided by at least one sensor and determining whether a movable object is the pedestrian based on an image provided by a camera.
[0028] The invention further provides: a device for providing a perception of a vehicle (e.g., a motor vehicle) to a pedestrian, which is installed in a vehicle (e.g., a motor vehicle), which device comprises a processing system (e.g., a processor system) comprising at least one data processor and at least one computer-readable memory storing a computer program. Herein, the processing system is configured to cause the device to: perceive an object in a surrounding area of the vehicle, detect whether the object is the pedestrian, and output a notification about a pedestrian (e.g., concerning a pedestrian) that is / is detected in the surrounding area, wherein the output of the notification comprises: displaying at least one of a symbol, a message, or a sign corresponding to the notification about the pedestrian in response to a control signal,output from a control unit, outputting a notification sound corresponding to the notification of the pedestrian in response to the control signal output from the control unit, and illuminating the pedestrian or a peripheral area of the pedestrian in response to the control signal output from the control unit, wherein the at least one of a symbol, a message, or a sign corresponding to the notification comprises: displaying, on a display unit, a direction indicator indicating a traveling direction of the vehicle when the pedestrian is detected, and emitting, on a ground around the pedestrian, a direction indicator indicating a traveling direction of the vehicle when the pedestrian is detected.
[0029] Advantages, objects, and features of the invention will be set forth in part in the description which follows, and in part will become apparent to those skilled in the art upon examination of the following or may be learned by practice of the invention. The objects and other advantages of the invention may be realized and attained by means of the structure particularly pointed out in the written description and claims hereof, as well as the appended drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0030] The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiments of the invention and together with the description serve to explain features of the invention. Fig. 1 is a block diagram showing an example of a vehicle according to an embodiment of the present invention. Fig. 2 shows positions of many components installed in a vehicle. Fig. 3 shows a pedestrian detection and notification process in a vehicle. Fig. 4 to 9 show various embodiments of a pedestrian notification (e.g., concerning a pedestrian) that may be generated by a vehicle. Fig. 10 is a flowchart showing a pedestrian detection and notification method performed by a vehicle according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION
[0031] Reference will now be made in detail to embodiments of the invention, examples of which are illustrated in the accompanying drawings. Throughout the drawings, like elements are designated by like reference numerals, and repeated explanations thereof will not be given. The terms "module" and "unit" of elements herein are used for convenience of description and may therefore be used interchangeably and have no distinguishable meanings or functions.
[0032] The terms "a" or "an" as used herein are defined as a single one or more than one. The term "another" or "another further" as used herein is defined as at least a second one or more. The terms "include" and / or "have" as used herein are defined as having (i.e., an open transition). The term "coupled" or "operatively coupled" as used herein is defined as being connected, although not necessarily directly or not necessarily mechanically.
[0033] In describing features of the invention, certain detailed explanations of related art are omitted when deemed to unnecessarily obscure the essence of the invention. The features of the invention will be clearly understood from the accompanying drawings and should not be limited by the accompanying drawings. It should be recognized that all changes, modifications, and substitutions that do not depart from the technical scope of the invention are encompassed by the invention.
[0034] Hereinafter, in a vehicle (e.g. a motor vehicle) traveling in an autonomous state regardless of whether a driver is in the vehicle, with reference to the Fig. 1 to 10 describe in detail an apparatus and method for detecting a pedestrian in the vicinity of the vehicle and providing the vehicle with a perception to the pedestrian that the vehicle detects the pedestrian and is safely operated to respond to the movement or behavior of the pedestrian, which may be applicable to the embodiments of the application.
[0035] According to one aspect of the present invention, a system and method for providing a notification to a pedestrian near a stopped vehicle (e.g., motor vehicle) are disclosed. When a vehicle is stopped at an intersection of a road and a pedestrian crosses the road in front of the vehicle, a computing system (e.g., a computer system) (a controller) identifies the pedestrian using signals from at least one sensor installed in the vehicle.
[0036] In embodiments, when, for example, the system monitors a position or movement of the pedestrian (a distance and a direction from a point of the vehicle), the system (the controller) generates signals to cause at least one display, a light, or a speaker to provide the pedestrian with a notification that he or she has been identified and is recognized by the vehicle. In embodiments, when the controller identifies a pedestrian in front of the vehicle, the vehicle presents (e.g., displays) a visual cue using a display mounted on the windshield (e.g., windscreen) (1), illuminating the ground (e.g., the terrain) where the pedestrian is standing or walking, or the ground (e.g.,the terrain) in front of the pedestrian, taking into account the expected direction of movement of the pedestrian, using at least one lamp other than a headlight (2), and / or generates sound (e.g. tones or e.g. noises) in the direction of the pedestrian (3).
[0037] In embodiments, when the vehicle illuminates and provides a visual cue (marker (e.g., illuminated marker)) on the ground, the vehicle provides a visual representation indicating the intended direction of travel of the vehicle after the current stop. In one embodiment, the vehicle moves the visual representation according to the expected direction of movement of the pedestrian. As such, when the pedestrian crosses in front of the vehicle (e.g., crosses a street), the controller tracks the pedestrian's movement and adjusts at least one property of the notification (location / angle / intensity of the visual cue, volume / direction of the sound alert) accordingly.
[0038] Fig. 1 is a block diagram showing an example of a vehicle (e.g., a motor vehicle) according to an embodiment of the application, and Fig. 2 shows positions of many components installed in a vehicle.
[0039] As in the Fig. 1 and Fig. 2, the vehicle 100 may include a sensor unit 10, an output unit, and a control unit 60.
[0040] Herein, the output unit configured to output a notification about a pedestrian (e.g., concerning a pedestrian) located near the vehicle 100 may include a display unit 20, a speaker unit 30, and a lighting unit 40.
[0041] In some cases, the vehicle 100 may further include a camera unit 50.
[0042] Herein, the sensor unit 10 can sense a surrounding area of the vehicle 100 in accordance with a control signal of the control unit 60.
[0043] In one example, but not limited to, the sensor unit 10 may include a front sensor 12 configured to sense a front portion of the vehicle 100, a rear sensor 16 configured to sense a rear portion of the vehicle 100, and a side sensor 14 configured to sense (a left and / or a right) side portions of the vehicle 100.
[0044] The display unit 20 can display the notification of the pedestrian who is near the vehicle in accordance with a control signal of the control unit 60.
[0045] Herein, the display unit 20 may be arranged to display the pedestrian notification toward a front area of the vehicle 100. In one example, but not limited to, the display unit 20 may be arranged within a windshield (e.g., a front windshield). According to one embodiment, the display unit 20 may be arranged on (e.g., on) a front hood (e.g., engine hood) of the vehicle 100.
[0046] The speaker unit 30 may output a notification sound (e.g., a notification tone or, e.g., a notification noise) to the pedestrian according to a control signal from the control unit 60. The notification sound should be distinguishable from a vehicle horn sound (e.g., a vehicle horn tone or, e.g., a vehicle horn noise). While the vehicle horn sound is used to warn others of the approach or presence of the vehicle or to draw attention to some hazard, the notification sound is used to provide the pedestrian with a perception of the vehicle that the vehicle detects the pedestrian's movement or behavior. Therefore, the notification sound, e.g., music, may be easier to hear than the vehicle horn sound.
[0047] Herein, the speaker unit 30 may be arranged to output the detection notification sound toward the front of the vehicle 100.
[0048] The lighting unit 40 can illuminate the pedestrian or a peripheral area of the pedestrian according to a control signal from the control unit 60.
[0049] The lighting unit 40 can be arranged here so that lighting is emitted towards the front of the vehicle.
[0050] The camera unit 50 can photograph or film a front area of the vehicle in accordance with a control signal from the control unit 60.
[0051] The camera unit 50 can be arranged here to take a photo in front of the vehicle.
[0052] The control unit 60 can control the sensor unit 10, the display unit 20, the speaker unit 30, the lighting unit 40 and the camera unit 50.
[0053] The control unit 60 receives sensor signals provided by the sensor unit 10. In one embodiment, the control unit 60 may analyze the sensor signals and detect whether there is an object near the vehicle 100 and / or whether a detected object is movable. The control unit 60 may determine whether the detected object is a pedestrian based on at least one of a size, movement, speed, or distance of the object.
[0054] In another embodiment, the control unit 60 receiving the sensor signals may determine whether an object is present. If the object may be detected, the control unit 60 may review or inspect images captured by the camera unit 50 to determine whether the object is a pedestrian. The control unit 60 may use computer image processing to recognize a pedestrian from (e.g., on) an image depending on at least one of a size, a shape, a movement, or a position of the object.
[0055] Herein, the control unit 60 may control the display unit 20 to display the notification of a pedestrian when the pedestrian is / is detected, based at least in part on the sensor signals received from the sensor unit 10.
[0056] When the pedestrian is detected, the controller 60 (or the control unit) can control the display unit 20 to track the pedestrian's movement and display a symbol (e.g., a pictogram) having a specific shape toward the pedestrian. Here, the symbol can be moved along with the pedestrian's movement.
[0057] For example, the shape of the symbol can be a shape of a person's eye or pupil, but this is not limited to that.
[0058] When a pedestrian is / is detected, the control unit 60 may control the lighting unit 40 to emit a notification light on (e.g., on) the front hood (e.g., hood) of the vehicle in the direction of the detected pedestrian.
[0059] In addition, when the pedestrian is detected, the control unit 60 may control the lighting unit 40 so that a notification light having a specific shape in a planar (e.g., plane) view is emitted toward the pedestrian and moved along with a moving direction of the pedestrian.
[0060] Herein, the notification light having a specific shape may be emitted toward a specific area around the pedestrian's position, but it is not limited thereto.
[0061] The control unit 60 may control the lighting unit 40 and the speaker unit 30 so that light or a sound (e.g., tone or e.g., noise), both of which have a directional characteristic, is output toward a moving direction of the pedestrian when the pedestrian is / is detected.
[0062] In one embodiment, when the pedestrian is detected, the control unit 60 may control the lighting unit 40 to display a direction indicator, e.g., a light indicating a traveling direction of the vehicle, on a front surface of the vehicle.
[0063] When the pedestrian is detected, the controller 60 may control the display unit 20 to display a direction indicator, e.g., a symbol, a sign, or a message, representing the direction of travel of the vehicle on the display screen mounted on (e.g., on) a front portion of the vehicle.
[0064] Further, when the pedestrian is detected, the control unit 60 may control the speaker unit 30 to radiate (e.g., output) a sound (e.g., a tone or, e.g., a noise) having a directional characteristic according to a traveling direction of the vehicle.
[0065] In the embodiments described above, an autonomously driving vehicle (e.g., motor vehicle) may detect an ambient environment using at least one of various types of sensors. Depending on the collected information, a computing device (e.g., a computer device) may determine how to control the autonomously driving vehicle and / or how to drive the autonomously driving vehicle. In one embodiment, an autonomously driving vehicle (e.g., motor vehicle) may be equipped with a controller (e.g., a control unit) comprising a processing system (e.g., a processor system) comprising at least one data processor and at least one computer-readable memory storing a computer program.
[0066] In particular, an autonomously driving vehicle (e.g., motor vehicle) may use a camera unit and computer image processing to detect an object, a sign (e.g., a road sign), another vehicle, and a pedestrian, and use (e.g., process) detected information for a suitable algorithm for controlling a journey, avoiding an accident (e.g., avoiding an accident), or stabilizing, in order to achieve autonomous driving.
[0067] Further, in one embodiment, an autonomously driving vehicle (e.g., motor vehicle) may include a device capable of communicating with a pedestrian, ie, a person outside the vehicle, thereby informing the pedestrian that the autonomously driving vehicle recognizes the pedestrian in order to perform safe driving and operation.
[0068] In one embodiment, when an object detected by various sensors is deemed to be a pedestrian, or when reversing or autonomous parking is in progress, a notification may be given to the pedestrian via an information display device, a projecting device, or a sound generating device (e.g., a tone generating device or, for example, a noise generating device). According to one embodiment, a vehicle (e.g., a motor vehicle) may display a safe distance to be secured for autonomous driving, thereby providing a pedestrian with the safe distance, e.g., avoidance information (e.g., accident avoidance information), so that the pedestrian is provided with psychological stability and security.
[0069] Fig. 3 shows a pedestrian detection and notification method in a vehicle (e.g., a motor vehicle).
[0070] As in Fig. 3, the vehicle 100 can perceive the surroundings of the vehicle by means of the sensor unit 10 while it is operating.
[0071] When a pedestrian 80 located at the periphery of the vehicle 100 is detected, the vehicle 100 may display a notification about the pedestrian (e.g., concerning the pedestrian) on a display screen provided in the display unit 20 or cause the lighting unit 40 to emit a notification light onto the ground (e.g., the terrain) around the pedestrian.
[0072] Herein, the notification light may include a direction indicator 72 indicating a traveling direction of the vehicle 100 or a boundary line 74 indicating a safe distance for avoiding collision with the vehicle 100.
[0073] Also, when a pedestrian is detected, an autonomous vehicle (e.g., motor vehicle) according to an embodiment may inform the pedestrian by means of a display device that the autonomous vehicle detects the pedestrian, and may show a traveling direction of the vehicle and a range of a safe distance by means of a notification projecting device.
[0074] In addition, the autonomous vehicle may inform the pedestrian about the vehicle's perception of the pedestrian by means of a display device mounted on a front portion of the vehicle, as well as a sound (e.g., tone or noise) having a directional characteristic toward the pedestrian.
[0075] Fig. 4 to 9 show various embodiments of a pedestrian notification (e.g., concerning a pedestrian) that can be generated by a vehicle.
[0076] As in Fig. 4, when the pedestrian 80 is detected, the vehicle 100 may display a specific symbol 22 (e.g., pictogram) on a display screen of the display unit 20.
[0077] Herein, the symbol 22, which has a specific shape, can be moved along with the pedestrian 80 on the display screen of the display unit so as to track the moving direction 23 of the pedestrian.
[0078] Therefore, when the pedestrian 80 moves, the symbol 22 of the specific shape can be moved along with the moving direction of the pedestrian 80.
[0079] In one example, the symbol 22 of a particular shape may be a shape of a human eye, but is not limited thereto.
[0080] In some cases, such as Fig. 5, the vehicle 100 may display (e.g., indicate) a notification light 42 on (e.g., on) a front hood (e.g., hood) of the vehicle when the pedestrian 80-1 is / is detected.
[0081] Herein, the notification light 42 can be presented (e.g. displayed) in a direction toward the pedestrian.
[0082] Therefore, when the pedestrian 80-1 moves, the notification light 42 can move along the direction of movement of the pedestrian.
[0083] Further, when the pedestrian 80-2 is detected, the vehicle 100 may emit the notification light 44 of a specific shape in a direction from the detected pedestrian.
[0084] Herein, the notification light 44 may have a circular shape in a plan view, but is not limited thereto.
[0085] The notification light 44, which has a specific shape, may be presented (e.g., displayed) on the ground (e.g., the terrain) around where the pedestrian is located, but is not limited thereto.
[0086] Therefore, when the pedestrian 80-2 moves, the notification light 44 may move along a moving direction of the pedestrian 80-2.
[0087] In another embodiment, as in Fig. 6, the vehicle 100 may emit a notification light 46 or generate a notification sound (e.g., a notification tone or, e.g., a notification noise) 35, each having a directional characteristic toward the perceived pedestrian, when the pedestrian 80 is perceived.
[0088] As another example, as in Fig. 7, when the pedestrian 80 is detected, the vehicle 100 may display a direction indicator 72 indicating a direction of travel of the vehicle on the front surface of the vehicle.
[0089] As another example, as in Fig. 8, when the pedestrian 80 is detected, the vehicle 100 may control the display unit 20, thereby displaying a direction indicator 25 that indicates a traveling direction of the vehicle on the display screen.
[0090] As another example, as in Fig. 9, when the pedestrian 80 is detected, the vehicle 100 may emit a sound (e.g., a tone or, e.g., a noise) 35 having a directional characteristic and change a direction of the sound according to a traveling direction of the vehicle.
[0091] As previously described, according to an embodiment as described in Fig. 4, a pupil-shaped symbol (e.g., a pupil-shaped pictogram) may be depicted and may be continuously tracked in the direction of movement of the pedestrian. According to another embodiment, the vehicle may output a projection in the direction of the pedestrian or a circular projection onto the ground (e.g., the terrain) around the position of the pedestrian, as shown in Fig. 5. As shown in Fig. 6, in another embodiment, a light or a sound (e.g., tone or e.g., noise), which (both) have a directional characteristic, may be emitted or generated toward a pedestrian, or a pedestrian may be informed of a direction in which the vehicle is moving in an autonomous driving mode, thereby ensuring pedestrian safety. In another embodiment, as shown in Fig. 7, the vehicle may project a direction of travel or a corner direction (e.g., a turning direction) onto the ground. Furthermore, in another embodiment, as shown in Fig. 8, the vehicle may display a direction of travel by means of a display device mounted on a front portion of the vehicle. In another embodiment, as shown in Fig. 9, the vehicle may emit a notification sound (e.g., a notification tone or, e.g., a notification noise) in a direction in which the vehicle is traveling, thereby informing the pedestrian of the vehicle's traveling direction.
[0092] Fig. 10 is a flowchart illustrating a pedestrian detection and notification method performed by a vehicle according to an embodiment of the present invention.
[0093] As in Fig.10, according to one embodiment, the vehicle may perceive the periphery of the vehicle.
[0094] The vehicle can then determine whether a pedestrian around the vehicle has been detected.
[0095] Then the vehicle can issue a pedestrian notification (e.g. concerning the pedestrian) when a pedestrian who is near the vehicle is / is detected.
[0096] Herein, when a notification about the pedestrian (e.g., concerning the pedestrian) is presented, the vehicle can check whether the notification is preset. If no notification is preset, the vehicle can display a list of notification icons (e.g., notification icons) about the pedestrian (e.g., concerning the pedestrian) and recognize a selected notification icon (e.g., notification icon). If the selected notification icon is recognized, the vehicle can display the notification corresponding to the selected notification icon.
[0097] Furthermore, if the notification is preset, the vehicle can display the notification corresponding to the pedestrian.
[0098] Here, the notification can move along with the pedestrian's movement. The notification can comprise at least one of an icon, a message, a sign, a sound (e.g., tone or noise), a light, or a combination thereof.
[0099] Further, to detect whether the object is the pedestrian, the vehicle may determine whether the object is movable based on the sensor signals provided by at least one sensor and determine whether a movable object is the pedestrian based on an image provided by a camera.
[0100] As described above, an embodiment is to implement a technique for improving pedestrian safety by increasing pedestrian trust in an autonomously driving vehicle (e.g., motor vehicle) through communication between the pedestrian and the autonomously driving vehicle.
[0101] When a sensor required for autonomous driving detects a pedestrian around a vehicle (e.g. a motor vehicle), the vehicle detects the pedestrian and clearly informs the pedestrian that the vehicle can safely operate and react to the pedestrian, for driving safety.
[0102] As a result, pedestrians are less likely to make unexpected movements that deviate from the algorithms used in autonomous vehicles, as pedestrians can be provided with the vehicle's direction of travel and a safe distance from the vehicle.
[0103] Therefore, an embodiment can improve the reliability and safety of a pedestrian with respect to an autonomously driving vehicle (e.g., motor vehicle).
[0104] In at least one embodiment of the invention, an apparatus and method for detecting a pedestrian and providing notification to the pedestrian, which are expressed (e.g., used) in a vehicle, may have an effect on psychological safety and / or stability of the pedestrian by representing the perception of the vehicle so that the pedestrian recognizes the operation or status of the vehicle.
[0105] Further, according to one embodiment, a vehicle (e.g., a motor vehicle) may provide a pedestrian with the vehicle's perception indicating that the autonomous vehicle recognizes the pedestrian, so that the pedestrian recognizes that the vehicle can safely operate even without the driver during autonomous driving, and safety and / or stability may be provided to the pedestrian who is near the vehicle.
[0106] In addition, according to an embodiment, a vehicle (e.g., a motor vehicle) that provides a pedestrian with the perception of the vehicle can reduce or prevent unpredictable behavior of the pedestrian in a front area of the vehicle, so that driving safety can be improved because the vehicle is unlikely to encounter an unpredictable situation, and a conducive environment for autonomous driving can be brought about.
[0107] Furthermore, an embodiment may reduce people's mistrust of an autonomous vehicle and spread a positive perception about the autonomous vehicle, so that the autonomous vehicle could be spread.
[0108] The aforementioned embodiments are achieved by means of an invention in a predetermined manner. Any structural combination of structural elements and features of the elements or features may be considered optional unless otherwise stated. Each of the structural elements or features may be implemented without being combined with other structural elements or features. Also, some structural elements and / or features may be combined with each other to form embodiments of the invention. The order of operations described in the embodiments of the invention may be changed. Some structural elements or features from one embodiment may be present in another embodiment or may be interchanged with corresponding structural elements or features from other embodiments.Furthermore, it will be appreciated that some claims relating to specific claims may be combined with other claims relating to the other claims other than the specific claims to form an embodiment or to add new claims by amendment after the application is filed.
[0109] Logic blocks, modules, or units described in connection with embodiments disclosed herein may be implemented or performed by a computing device / computer device having at least one processor, at least one memory, and at least one communication interface. The elements of a method, process, or algorithm described in connection with embodiments disclosed herein may be embodied directly in hardware, in a software module executed by at least one processor, or in a combination of the two. Computer-executable instructions for implementing a method, process, or algorithm described in connection with embodiments disclosed herein may be stored in a non-transitory computer-readable storage medium.
[0110] Various embodiments may be implemented using a machine-readable medium having instructions stored thereon for execution by a processor to perform various methods presented herein. Examples of possible machine-readable media include an HDD (Hard Disk Drive), an SSD (Solid State Disk), SDD (Silicon Disk Drive), ROM, RAM, CD-ROM, magnetic tape, a floppy disk, an optical data storage device, the other types of storage media presented herein, and combinations thereof. If desired, the machine-readable medium may be implemented in the form of a carrier wave (e.g., a carrier signal) (e.g., a transmission over the Internet).
Claims
[1] A vehicle (100), comprising: a sensor unit (10) configured to detect an object in a surrounding area of the vehicle (100), an output unit configured to output a notification about a pedestrian (80) detected in the surrounding area, and a control unit (60) configured to detect whether the object is the pedestrian based on sensor signals supplied by the sensor unit (10) and to control the output unit to thereby output the notification when the pedestrian is detected, where the output unit comprises: a display unit (20) configured to display at least one of a symbol, a message, or a sign corresponding to the notification of the pedestrian (80) in response to a control signal output from the control unit (60), a speaker unit (30) configured to output a notification sound corresponding to the notification of the pedestrian (80) in response to the control signal output from the control unit (60), and a lighting unit (40) configured to illuminate the pedestrian (80) or a peripheral area of the pedestrian (80) in response to the control signal output by the control unit (60), wherein the control unit (60) controls the display unit (20) to display, on the display screen, a direction indicator indicating a direction of travel of the vehicle (100) when the pedestrian (80) is detected, wherein, when the pedestrian (80) is detected, the control unit (60) causes the lighting unit (40) to emit a notification light so that the notification light is displayed on a front hood of the vehicle (100) according to a moving direction of the pedestrian (80), and wherein, when the pedestrian (80) is detected, the control unit (60) causes the lighting unit (40) to emit a notification light so that the notification light is pointed toward the pedestrian (80) and moved along with the pedestrian. [2] Vehicle according to claim 1, wherein: the display unit (20) is arranged to display the notification of the pedestrian (80) towards a front area of the vehicle (100), the loudspeaker unit (30) is arranged to output the notification sound towards the front area of the vehicle (100), and the lighting unit (40) is arranged to emit a light towards the front area of the vehicle (100). [3] Vehicle according to one of claims 1-2, further comprising: a camera unit (50) configured to film a front area of the vehicle (100) in response to a control signal output from the control unit (60). [4] The vehicle according to claim 3, wherein the control unit (60) detects whether the object is movable based on the sensor signals, and determines whether a movable object is the pedestrian (80) based on an image captured by the camera unit (50). [5] Vehicle according to one of claims 1-4, wherein the sensor unit (10) comprises: a front sensor (12) configured to sense a front area of the vehicle (100), a rear sensor (16) configured to sense a rear portion of the vehicle (100), and a side sensor (14) configured to sense side areas of the vehicle (100). [6] A vehicle according to any one of claims 1-5, wherein when the pedestrian (80) is detected, the control unit (60) causes the display unit (20) to display that a symbol (22) of a specific shape follows the pedestrian (80). [7] A vehicle according to claim 6, wherein the specific shape of the symbol (22) is an eye or a pupil of the eye. [8] The vehicle according to claim 1, wherein the notification light has a particular shape or color distinguishable from a front light. [9] The vehicle according to any one of claims 1-8, wherein the control unit (60) causes the output unit to generate a light or a sound having directional characteristics toward the pedestrian (80) when the pedestrian (80) is detected. [10] The vehicle according to claim 9, wherein the light or sound having the directional characteristic is moved along with a moving direction of the pedestrian (80). [11] A method for providing a perception of a vehicle (100) to a pedestrian (80), comprising: Detecting an object in an area surrounding the vehicle (100), Detecting whether the object is the pedestrian (80), and issuing a notification about the pedestrian (80) detected in the surrounding area, where issuing the notification comprises: when the pedestrian (80) is detected, check whether the notification is set beforehand, if no notification is preset, displaying a list of notification icons about the pedestrian (80), Detecting a selected notification icon, and Displaying the notification corresponding to the selected notification icon, where the display of the notification comprises: Displaying, on a display unit (20), a direction indicator indicating a direction of travel of the vehicle (100) when the pedestrian (80) is detected, and Emitting, onto a ground around the pedestrian (80), a direction indicator indicating a direction of travel of the vehicle (100) when the pedestrian (80) is detected. [12] The method of claim 11, wherein issuing the notification further comprises: if the notification is preset, displaying the notification corresponding to the pedestrian (80). [13] The method of any of claims 11-12, wherein the notification is moved along with the movement of the pedestrian (80) and the notification comprises at least one of a symbol, a message, a sign, a sound, a light, or a combination thereof. [14] The method of any of claims 11-13, wherein detecting whether the object is the pedestrian (80) comprises: Determining whether the object is movable based on sensor signals provided by at least one sensor (12, 14, 16), and Determining whether a movable object is the pedestrian (80) based on an image provided by a camera. [15] A device for providing a perception of a vehicle (100) to a pedestrian (80), which device is installed in a vehicle (100), comprising a processing system having at least one data processor and at least one computer-readable memory storing a computer program, the processing system being configured to cause the device to: to perceive an object in a surrounding area of the vehicle (100), to recognize whether the object is the pedestrian (80), and to issue a notification about a pedestrian (80) detected in the surrounding area, where the notification output has: Displaying at least one of a symbol, a message or a sign corresponding to the notification of the pedestrian (80) in response to a control signal output from a control unit (60), Outputting a notification sound corresponding to the notification of the pedestrian (80) in response to the control signal output from the control unit (60), and Illuminating the pedestrian (80) or a peripheral area of the pedestrian (80) in response to the control signal output by the control unit (60), wherein the at least one of a symbol, message, or character corresponding to the notification comprises: Displaying, on a display unit (20), a direction indicator indicating a direction of travel of the vehicle (100) when the pedestrian (80) is detected, and Emitting, onto a ground around the pedestrian (80), a direction indicator indicating a direction of travel of the vehicle (100) when the pedestrian (80) is detected.
Citation Information
Patent Citations
Method for detecting, classifying, tracking and predicating pedestrians in environment of motor car for implementing assistance function in e.g. driver assistance system utilized for protecting pedestrian, involves detecting components
DE102011011870A1
System for providing a signal to an object in the system's environment
DE102013216490A1
PEDESTRIAN TRAINING DEVICE
DE102013217057A1
inform a road user about an autopilot-controlled journey
DE102014011811A1
Method for operating a motor vehicle, in particular an autonomously or semi-autonomously driving / drivable motor vehicle, signaling device, motor vehicle
DE102014226254A1
