Method and device for supporting the operation of a motor vehicle designed for autonomous driving
The method and device for projecting a virtual driver in autonomous vehicles address confusion by creating a visible and communicative driver avatar, enhancing traffic safety through clear signaling.
Patent Information
- Application Number
- DE102014221821
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2014-10-27
- Publication Date
- 2024-11-07
- Estimated Expiration
- 2034-10-27
AI Technical Summary
As autonomous vehicles become more prevalent, road users may become disoriented due to the absence of a driver, leading to confusing or irritating situations, such as a parked vehicle starting unexpectedly or stopping without clear communication with pedestrians or other drivers.
A method and device that generate a virtual driver representation visible to external observers, allowing communication and signaling through a virtual driver avatar projected onto the vehicle, using technologies like holograms or head-up displays to create a three-dimensional illusion of a driver present.
Enhances traffic safety by providing clear communication and reducing confusion or irritation from autonomous vehicle operations, ensuring road users understand the vehicle's intentions and actions.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The invention relates to a method and a device for supporting the operation of a motor vehicle designed for autonomous driving.
[0002] Road users are generally accustomed to looking at the position of the driver's seat of a motor vehicle to determine whether the vehicle in question is currently in operation. When a person is sitting in the driver's seat of a motor vehicle, everyone is usually aware that the vehicle is controlled by a driver and can move, change direction, brake, accelerate, or turn.
[0003] However, with the expected increasing market introduction of autonomous vehicles, the problem may increasingly arise that road users may be disoriented by the fact that such autonomous vehicles move or react to their surroundings without anyone on board, and in particular without anyone sitting in the driver's seat of the vehicle in question.
[0004] For example, a situation where a parked autonomous vehicle starts its engine and leaves the parking space may be surprising to a cyclist or a pedestrian on the adjacent curb, especially if it is an electric vehicle that does not produce engine noise.
[0005] Furthermore, a situation in which a vehicle stops in the area of a roadway crossing without anyone on board can be confusing for pedestrians crossing the roadway in question, who are unaware of the autonomous vehicle's intentions. In contrast, a normal driver would typically make eye contact and, for example, give a sign or signal requesting the pedestrian to cross the roadway, indicating that they may proceed.
[0006] Furthermore, situations are also conceivable in which a vehicle designed for autonomous driving stops with its engine still running, for example, to wait for a person (e.g., in an autonomous taxi service). In such situations, other road users, such as approaching drivers, may be irritated if they observe that the vehicle in question, with no one on board, suddenly starts moving.
[0007] From DE 10 2012 015 002 A1, among other things, a method for assisted parking of a motor vehicle in a parking space and a device for carrying out the method are known, wherein, based on the information of a parking device of the motor vehicle, an avatar in the form of a virtual parking pilot is generated and projected into the driver's field of vision during parking, wherein this virtual parking pilot directs the driver into the parking space by means of virtual gestures adapted to the current driving situation.
[0008] From DE 10 2011 089 018 A1, inter alia, a control system of a vehicle is known, wherein the control system adjusts a seat, a steering wheel, a side mirror and a rearview mirror according to the shape of a virtual avatar generated by converting an image captured by the driver with an image capturing section.
[0009] For further prior art, reference is made to US 2011 / 0298808 A1 and US 2014 / 0139676 A1.
[0010] DE 10 2013 216 490 A1 discloses an autonomously driving vehicle equipped with a system for providing a signal for an object in the system's surroundings. For example, the system can display a smiling face on the windshield in the direction of a pedestrian's gaze, indicating to the pedestrian that the system has recognized her intention and recommends crossing the street. However, the disclosed system only enables selective communication.
[0011] DE 10 2013 226 336 A1 discloses a system for providing a signal for an object in the system's surroundings. A signal can be provided for an object in the surroundings of a vehicle suitable for autonomous driving.
[0012] US 2011 / 0140 919 A1 discloses a vehicle assistance system for assisting a person in safely crossing streets and a method for assisting a person in crossing streets. A vehicle serves as a traffic light or traffic signal for pedestrians.
[0013] DE 10 2011112 577 A1 describes a method and a device for an assistance system used to perform an autonomous or semi-autonomous driving maneuver of a vehicle. At least one light signal device indicates at least one direction in which the vehicle is moving during the maneuver.
[0014] DE 102 53 502 A1 proposes a device for projecting an object into a space within a vehicle. This object is preferably projected holographically and is associated with voice input and output. This creates an artificial co-driver for a driver.
[0015] It is an object of the present invention to provide a method and a device for supporting the operation of a motor vehicle designed for autonomous driving, which enable increased road safety during the autonomous operation of a motor vehicle while mitigating or avoiding the problems described above.
[0016] This object is achieved by the method according to the features of independent patent claim 1 or the device according to the features of independent claim 10.
[0017] In a method according to the invention for supporting the operation of a motor vehicle designed for autonomous driving, wherein the motor vehicle has a driver's seat and is designed for autonomous operation of the motor vehicle, in which the motor vehicle can be moved independently of the presence of a driver, in an operating phase of the motor vehicle in which no driver is in the driver's seat, an indication of autonomous operation of the motor vehicle that is perceptible to a road user outside the motor vehicle is generated at least temporarily.
[0018] The present invention is based in particular on the concept of representing or displaying a virtual driver in a motor vehicle designed for autonomous driving, which driver is visible to external observers such as other road users and, in further embodiments of the invention, can in particular also be able to communicate with such external observers or to transmit signs or signals - such as a hand signal requesting to cross the roadway.
[0019] According to one embodiment, the notification is generated by generating an image symbolizing a virtual driver, visible from outside the motor vehicle. The virtual driver can be represented in any desired form. In particular, representing the virtual driver as an avatar is suitable for establishing contact with external observers.
[0020] According to one embodiment, the image is generated by projection onto at least one display surface visible from outside the motor vehicle. Advantageously, the vehicle has multiple projection surfaces so that the image can be viewed from all sides of the vehicle.
[0021] According to one embodiment, the indication is generated at least temporarily when the motor vehicle is stationary.
[0022] In embodiments of the invention, a "head-up display" can be used, in particular, to indicate or display a virtual driver, especially since such a "head-up display," which may already be present in conventional vehicles, is not needed in situations where no driver is on board. Such a "head-up display" can be used to represent or display a virtual driver visible from outside the vehicle. In embodiments of the invention, this virtual driver can be capable of communicating with external observers or transmitting signs or signals to them.
[0023] In further embodiments of the invention, the visual representation of a virtual driver can also be achieved in other ways, e.g. via holographic mirrors, the projection of an image onto the driver's seat, etc.
[0024] According to one embodiment, the indication is generated in such a way that a request to perform an action, in particular to cross the roadway, is transmitted at least temporarily to a road user located outside the motor vehicle.
[0025] According to one embodiment, the indication is generated in such a way that it characterizes a driving maneuver provided in the autonomous operation of the motor vehicle.
[0026] According to one embodiment, the notice is visible to a road user outside the motor vehicle from any viewing direction.
[0027] According to one embodiment, the image symbolizing a virtual driver, visible from outside the motor vehicle, is generated in such a way that a three-dimensional impression of the virtual driver is generated for a road user located outside the motor vehicle.
[0028] The invention further relates to a device for supporting the operation of a motor vehicle designed for autonomous driving, the device having a control unit which is designed to generate, at least temporarily during operation of the motor vehicle, an indication of autonomous operation of the motor vehicle which is perceptible to a road user located outside the motor vehicle.
[0029] According to one embodiment, the device further comprises a display surface, wherein the indication is generated by projecting an image symbolizing a virtual driver, visible from outside the motor vehicle, onto this display surface.
[0030] According to one embodiment, the device is designed to carry out a method having the features described above. For preferred embodiments and advantages of the device, reference is made to the above explanations in connection with the method according to the invention.
[0031] Further embodiments of the invention can be found in the description and the dependent claims.
[0032] The invention is explained in more detail below with reference to an embodiment shown in the accompanying drawings. The only Fig. 1 shows a schematic representation to explain essential components of the invention in one embodiment.
[0033] The invention particularly includes the concept of representing or displaying a virtual driver in a vehicle designed for autonomous driving in such a way that an observer outside the vehicle in question has the impression or illusion that someone is inside the vehicle. In the following, essential components of the present invention are described with reference to the Fig. 1 described schematic overview diagram.
[0034] The device according to the invention comprises Fig.1, in particular, a display device 1, which in the exemplary embodiment is arranged in the area of the driver's seat or in the area of the driver's side of the windshield of the vehicle. Any technology suitable for displaying an image can be used to implement the display device 1, with the preferred aim of creating the impression or illusion for an external observer that the image is three-dimensional. Suitable image generation technologies include, for example, a hologram, a stereoscopic image, laser interference, a head-up display, etc.
[0035] "2" denotes a virtual driver represented or displayed by the display device 1. Without limiting the invention to this, the virtual driver 2 in the exemplary embodiment has a human form and can, in particular, have arms and a face, via which he can optionally communicate with external observers or transmit signs or signals to them.
[0036] Preferably, the virtual driver 2 should be visible to any external observer from any viewing direction. Furthermore, "3" denotes a light source (e.g., in the form of a projector, laser, mirror, etc.) for illuminating the display device 1.
[0037] A central control unit 4 serves to monitor the various components of the device according to the invention and, in particular, to decide whether the device is activated. A suitable criterion for activating the device can be, for example, that no driver is in the driver's seat and that an operating mode of the vehicle is activated in which the vehicle can move or participate in traffic.
[0038] A group of sensors 5 serves to monitor the vehicle's surroundings and, in particular, other road users (not shown), such as pedestrians. These sensors 5 are required in case the virtual driver 2 is to interact with such external road users.
[0039] A signal processing unit 6 is designed to interpret whether the virtual driver 2 should communicate with external road users. This signal processing unit 6 is required in the event that such an exchange between the virtual driver 2 and the relevant external road users is desired or required.
[0040] "7" denotes a controller for the display device 1. The controller 7 serves to control the manner in which the virtual driver 2 is displayed (e.g., regarding its shape, movement, direction of view, etc.). Furthermore, "8" denotes the information parameters used for activating or deactivating the device (e.g., speed, status, position).
Claims
[1] A method for supporting the operation of a motor vehicle designed for autonomous driving, wherein the motor vehicle has a driver's seat and is designed for autonomous operation in which the motor vehicle can be moved independently of the presence of a driver, wherein in an operating phase of the motor vehicle in which no driver is in the driver's seat, an indication of autonomous operation of the motor vehicle is generated at least temporarily, which is perceptible to a road user outside the motor vehicle, characterized by that the generation of an image visible from outside the motor vehicle and symbolising a virtual driver is activated as soon as there is no driver in the driver's seat during autonomous operation of the motor vehicle. [2] Method according to claim 1, characterized bythat the virtual driver is displayed in such a way that a road user outside the motor vehicle has the impression that there is someone inside the motor vehicle. [3] Method according to claim 1 or 2, characterized by that the image symbolising a virtual driver, visible from outside the motor vehicle, is generated in such a way that a three-dimensional impression of the virtual driver is created for a road user outside the motor vehicle. [4] Method according to one of claims 1 to 3, characterized by that this image is generated by projection onto at least one display surface visible from outside the motor vehicle. [5] Method according to one of the preceding claims, characterized by that this warning is generated at least temporarily when the motor vehicle is stationary. [6] Method according to one of the preceding claims, characterized bythat this information is generated using a head-up display of the motor vehicle. [7] Method according to one of the preceding claims, characterized by that this information is generated in such a way that, at least temporarily, a road user outside the motor vehicle is given an invitation to perform an action, in particular to cross the roadway. [8] Method according to one of the preceding claims, characterized by that this indication is generated in such a way that it characterises a driving manoeuvre provided for in the autonomous operation of the motor vehicle. [9] Method according to one of the preceding claims, characterized by that this information is visible to a road user outside the vehicle from any viewing direction. [10] A device for supporting the operation of a motor vehicle designed for autonomous driving, the device comprising a display surface and a control unit which is designed to generate, at least temporarily during the operation of the motor vehicle, an indication of autonomous operation of the motor vehicle which is perceptible to a road user located outside the motor vehicle by projecting an image visible from outside the motor vehicle onto the display surface, characterized by that the control unit is configured to activate the generation of an image visible from outside the motor vehicle and symbolising a virtual driver as soon as there is no driver in the driver's seat during autonomous operation of the motor vehicle.
Citation Information
Patent Citations
VEHICLE CONTROL SYSTEM FOR DRIVER-BASED SETTINGS
DE102011089018A1
Method and device for an assistance system in a vehicle for carrying out an autonomous or semi-autonomous driving maneuver
DE102011112577A1
Method for assisted-parking of vehicle e.g. motor car in parking space, involves projecting rider field of view when parking the vehicle, and instructing rider with virtual gestures about current driving condition in parking space
DE102012015002A1
System for providing a signal to an object in the system's environment
DE102013216490A1
Communication between autonomous vehicles and people
DE102013226336A1
