Method for performing an interaction
The method and system allow vehicles to interact with passer-bys through sensor-based signal detection and analysis, addressing the lack of passer-by interaction in existing technologies, offering emergency services and social benefits.
Patent Information
- Application Number
- DE102018200138
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2018-01-08
- Publication Date
- 2024-12-05
- Estimated Expiration
- 2038-01-08
AI Technical Summary
Existing technologies do not facilitate effective interaction between a passer-by and a vehicle, limiting the vehicle's functionality to only driver interactions.
A method and system utilizing external sensors and computing units in vehicles to detect and analyze acoustic and optical signals from the environment, enabling interaction with passer-bys through voice recognition and gesture detection, and allowing authorized access to vehicle functions.
Enables audiovisual communication and functional interaction between vehicles and passer-bys, providing emergency assistance, convenience services, and social networking, while ensuring security and privacy.
Smart Images

Figure 00000000_0001_ABST 
Figure 00000000_0000_ABST 
Figure 00000000_0002_ABST 
Figure 00000000_0004_ABST 
Figure 00000000_0003_ABST
Abstract
Description
[0001] The invention relates to a method and a system for performing an interaction between at least one vehicle and at least one person.
[0002] A driver of a vehicle can interact with the vehicle by operating its devices, thus using it for transportation as well as other functions. Interaction by a pedestrian with a vehicle or use of such a vehicle to which they otherwise have no connection is not typically intended.
[0003] A method and a device for voice control of a motor vehicle are known from the document DE 10 2016 200 815 A1.
[0004] The document DE 10 2014 110 958 A1 shows a vehicle-pedestrian communication system.
[0005] A head-up display of a vehicle with outwardly visible projection is described in the document DE 20 2015 003 921 U1.
[0006] GB 2 512 313 A describes a system for controlling vehicle functions using voice commands. A number of voice commands are provided, with each voice command being executed when certain conditions are met.
[0007] A system for a vehicle is known from document DE 11 2015 006 380 T5. The system measures the distance between the vehicle and an object. If this distance remains unchanged for a predetermined period of time, a vocalization command is issued from an external loudspeaker of the system.
[0008] A method for operating a user interface for a vehicle user is known from DE 10 2010 034 959 A1. In this method, a vehicle control unit detects a usage request for a vehicle function of a functional device located in the vehicle.
[0009] A voice recognition device is described in US 2017 / 0084278 A1. It stores a threshold value for speech recognition in a memory that can be adjusted.
[0010] A virtual personal assistant is known from the publication US 2017 / 0160813 A1. This assistant is designed to communicate with a person.
[0011] Against this background, one task was to enable interaction between a pedestrian and a vehicle.
[0012] This problem is solved by a method and a system having the features of the independent patent claims. Embodiments of the method and system are set out in the dependent patent claims.
[0013] The method is provided for carrying out an interaction, for example communication, usually for exchanging information via signals, between at least one vehicle, for example a motor vehicle, and at least one person outside the at least one vehicle using at least one external sensor of the at least one vehicle and at least one computing unit of the at least one vehicle. This at least one external sensor is arranged, for example, on an external wall or in an interior of the at least one vehicle and is designed to detect an environment and / or an surroundings of the vehicle. In this case, acoustic and / or optical or visual signals from the environment orthe environment outside the at least one vehicle, transmitted to the at least one computing unit, and analyzed by the at least one computing unit, wherein the at least one computing unit checks whether the signals from the environment include human signals. Furthermore, it is checked whether these human signals include at least one piece of information designed and / or to be designated as a message and / or message that is directed to the at least one vehicle and / or relates to the at least one vehicle, wherein the at least one computing unit reacts to the at least one piece of information.
[0014] At least one external microphone as a possible external sensor is arranged, for example, on the outer wall or in the interior of at least one vehicle and is designed to acoustically detect an environment and / or surroundings of the vehicle. Acoustic signals, for example noises and / or sounds, from the environment or surroundings outside of at least one vehicle are recorded using the at least one external microphone, transmitted to the at least one computing unit, and analyzed by the at least one computing unit. It is checked whether the acoustic signals are human acoustic signals, for example,human sounds, which are based on a human voice of the at least one person and / or are generated orally by the at least one person, wherein it is checked whether these acoustic human signals comprise at least one piece of information which is designed and / or to be designated as a message and / or message and which is directed to the at least one vehicle or relates to the at least one vehicle, wherein the at least one computing unit reacts to the at least one piece of information.
[0015] Alternatively or additionally, signals based on electromagnetic waves from the environment outside the at least one vehicle are recorded using at least one sensor for detecting electromagnetic waves, for example arranged on an outer wall of the at least one vehicle as the at least one external sensor, transmitted to the at least one computing unit and analyzed by the at least one computing unit, wherein it is checked whether the signals based on electromagnetic waves comprise human gestures, wherein it is checked whether these human gestures comprise at least one piece of information that is directed at the at least one vehicle, wherein the at least one computing unit reacts to the at least one piece of information.
[0016] It is possible to optically record the surroundings and / or the environment of the vehicle using the at least one external camera as a possible external sensor for detecting electromagnetic waves. This external camera is arranged, for example, on the external wall or in the interior of the at least one vehicle. Optical signals, which are generated, for example, by objects outside the at least one vehicle, are recorded by the at least one external camera, transmitted to the at least one computing unit, and analyzed by the at least one computing unit. It is checked whether the optical signals are human optical signals, for example,human gestures, which are based on a movement of the at least one person and / or are generated by the at least one person, wherein it is checked whether these human signals comprise at least one piece of information which is designed and / or to be designated as a message and / or message and which is directed to the at least one vehicle or relates to the at least one vehicle, wherein the at least one computing unit reacts to the at least one piece of information.
[0017] However, it is also possible for the at least one external sensor to be designed to detect electromagnetic waves, for example, as a radar sensor or radar scanner, or as a laser sensor or laser scanner (lidar). Thus, with different external sensors for detecting electromagnetic waves, it is possible to detect invisible signals based on electromagnetic waves as well as visible or optical signals from the environment or surroundings, thus taking a broad spectrum of electromagnetic waves into account.
[0018] In this case, it is possible for the at least one external sensor, i.e. the at least one external microphone or the at least one external camera with which the surroundings of the at least one vehicle are recorded and / or captured, and the at least one computing unit to be designed as components of a recognition system. In this case, such a recognition system, provided it comprises the at least one external camera, is also designed and / or to be referred to as a gesture recognition system. The at least one external sensor is arranged, for example, in an interior designed as an engine compartment, in an external wall designed as the front or bow and / or as the rear and / or, for example, in an area of a rain sensor, it being possible for the at least one external sensor to be designed and / or to be referred to as a rain sensor.
[0019] In this case, the at least one processing unit checks whether a function, and if so, which function, that can be performed by at least one device of the at least one vehicle is associated with the message or notification addressed to the vehicle. The at least one processing unit initiates the at least one function being performed by the at least one device of the at least one processing unit of the at least one vehicle, for example, the execution of this at least one function being triggered by the at least one device.
[0020] As a rule, the at least one computing unit checks whether the message contains a question or request, wherein the at least one computing unit determines an answer to the question or request, e.g. using a database and / or by accessing a database of a usually external server and / or by accessing a cloud and / or by queries via the Internet, and communicates this to the person using at least one acoustic and / or optical output device or display device of the at least one vehicle, e.g. audiovisually, wherein the at least one output device generates an acoustic and / or optical signal containing the answer. It is possible that the at least one database is stored and / or filed in at least one memory of the at least one vehicle.Alternatively or additionally, it is possible for the at least one database to be stored and / or filed on an external server. The at least one vehicle has at least one communication unit, e.g., an antenna, via which the at least one computing unit communicates, typically via the internet, with the external server by exchanging signals via electromagnetic waves and / or accesses the external server and thus the at least one database, or accesses publicly accessible data from the internet.
[0021] As part of the process, data and thus information are exchanged between the at least one computing unit and the at least one external server and / or the cloud.
[0022] The method is implemented when at least one vehicle is parked without a driver.
[0023] Furthermore, it is provided that the at least one computing unit only responds to the message if it contains an acoustic code word and / or an identifier, e.g., a predefined and / or defined term, and / or a gesture of the person registered by the gesture recognition system comprising the at least one external camera, e.g., a wave, a hand signal, and / or a facial expression. This measure generally assesses whether the message and / or at least the acoustic human sound of the at least one person is actually directed at the at least one vehicle.
[0024] In this case, it is also possible for the at least one person to be authorized via the code word, e.g. a password, and / or the usually registered gesture and to be legitimized to carry out the interaction with the at least one vehicle. If or as soon as the at least one person is authorized to do so, the question or request is answered with a response and / or the at least one function of the at least one device is carried out, wherein the execution of the at least one function by the at least one device is initiated, i.e. triggered, by the at least one computing unit. A code word is, for example, displayed or represented on and / or on the vehicle, e.g. its outer wall, and includes, for example, a vehicle registration number or a type designation of a respective vehicle. Optionally, the gesture recognition system can register orRegistered gestures that also justify authorization alternatively or additionally are also displayed and / or described on the outer wall.
[0025] It is also conceivable to use an external camera within the scope of the method, which is arranged, for example, on an external wall, for example the front or a front end, and / or in the area of the rain sensor of the at least one vehicle and is designed to optically capture an environment and / or surroundings of the vehicle. Information, such as optical signals, recorded from the environment by the at least one external camera are also transmitted to the at least one computing unit, wherein the at least one computing unit checks whether at least one person is actually present in the environment or surroundings of the at least one vehicle. This is optionally possible in conjunction with defined gestures based on human optical signals.By jointly analyzing and / or checking the acoustic and / or optical signals, at least one computing unit can check and thus determine whether the acoustic and / or optical signals recorded from the environment also include human signals.
[0026] The method is carried out in an embodiment with at least one first vehicle, wherein the at least one acoustic and / or optical human signal, e.g. human noise, from the environment of the at least one first vehicle is detected by the at least one external microphone of the at least one first vehicle, wherein the at least one function is carried out by at least one device of the at least one first vehicle.
[0027] In addition, it is possible for the method to be carried out with at least one second vehicle and thus with a plurality of vehicles, wherein the at least one first vehicle and the at least one second vehicle each have at least one communication unit and at least one computing unit, wherein their computing units exchange data and thus the at least one message with one another via the communication interfaces and / or via the at least one server, which can be accessed using the Internet access, wherein the at least one function is carried out alternatively or additionally by at least one device of the at least one second vehicle.
[0028] The system according to the invention is designed to carry out an interaction between at least one vehicle and at least one person outside the at least one vehicle and has at least one external sensor of the at least one vehicle and at least one computing unit of the at least one vehicle. The at least one external sensor is designed to record signals from an environment outside the at least one vehicle and to transmit them to the at least one computing unit. The at least one computing unit is designed to analyze the signals and to check whether the signals comprise human signals from the at least one person, wherein the at least one computing unit is designed to check whether these human signals contain at least one piece of information, e.g.at least one message and / or message directed to the at least one vehicle, wherein the at least one computing unit is configured to respond to the at least one piece of information.
[0029] The at least one external sensor for detecting signals outside the at least one vehicle is designed as an external microphone and / or external camera. It is possible to detect acoustic and / or optical or visual signals. The at least one processing unit makes it possible to analyze the at least one acoustic signal or the at least one optical signal. It is also possible for the at least one optical signal and the at least one acoustic signal, if they are usually generated synchronously, to be analyzed and evaluated together.
[0030] The system has at least one external microphone and / or at least one external camera, e.g. of a gesture recognition system, of the at least one vehicle. The at least one external sensor is designed to record acoustic signals, e.g. noises and / or sounds, and / or optical signals from the environment. The at least one computing unit is designed to analyze the acoustic and / or optical signals and to check whether these signals comprise human acoustic and / or optical signals from the at least one person that are based on a human voice and / or human movements. The at least one computing unit is designed to check whether these human acoustic and / or optical signals comprise the at least one piece of information, e.g. at least one message and / or message, that is directed to the at least one vehicle.which relates to at least one vehicle, wherein the at least one computing unit is designed to react to the at least one piece of information.
[0031] With one embodiment of the system, and by carrying out an embodiment of the method, it is possible to carry out a situation-dependent, audiovisual interaction and / or communication between the at least one vehicle and the at least one person, for example a passer-by. In this case, the surroundings of the at least one vehicle are audiovisually recorded using the at least one external microphone and the at least one external camera. In addition, the answer to the question or request is displayed or provided to the at least one person via signals using an optical output or display device, for example designed as a monitor and / or as a projector, and / or at least one acoustic output device designed as a loudspeaker. The at least one optical output device, for example designed as a projector, comprises, for example, a matrix LED or a laser light spotlight, with which orwhich it is possible to project an optical signal for the at least one person onto a flat surface outside the vehicle, e.g. onto the street or a parking lot. In one embodiment, it is possible for the at least one computing unit of the at least one vehicle to optionally interact with the at least one, usually external, server. If in one embodiment of the method it is provided that the at least one computing unit causes the at least one device to perform the at least one function, it is optionally possible for the at least one computing unit to consult with the at least one server and thus interact. The at least one computing unit and the at least one server thus check whether the function that can be performed with the at least one device of the at least one vehicle is connected to the information directed to the at least one vehicle.
[0032] It is also checked whether the at least one piece of information includes the question and / or a request. It is possible that the answer to the question or request is verified by the at least one server through interaction with the Internet. The answer to the question or request is communicated using the at least one display or output device.
[0033] In a further embodiment, the at least one computing unit, taking into account an optional interaction with the at least one server, only reacts to the at least one piece of information if it contains the code word and / or a specifically defined or definable, usually registered gesture.
[0034] If the method is carried out with several vehicles, it is possible for their computing units to exchange data with each other directly or indirectly, whereby it is possible for the computing units of the vehicles to communicate via at least one server and / or via the cloud.
[0035] Furthermore, it is possible for the at least one computing unit to react to the at least one piece of information from the person outside the vehicle, possibly based on communication or interaction with the at least one server.
[0036] In one embodiment, the system comprises at least one communication interface which comprises the at least one external microphone and the at least one computing unit, with which acoustic signals, e.g. speech, as human acoustic signals, are detected via the at least one external microphone and processed and / or analyzed and checked by the at least one computing unit. The person, e.g. the passerby, is given access to certain functions of the at least one vehicle after authorization. This is possible, for example, in an emergency situation in which the at least one person is located. Thus, as the at least one function, an emergency call can be carried out, for example, by at least one device designed as a telephone of the at least one vehicle. It is also possible to activate at least one headlight as a device of the at least one vehicle and to illuminate the surroundings.The at least one loudspeaker and / or headlight of the at least one vehicle generates, for example, an acoustic and / or visual alarm, e.g., an anti-theft sound or noise. A vehicle horn is also designed and / or designated as a loudspeaker. This makes it possible, for example, to deter attackers in the surrounding area and / or to provoke attention. A reaction or feedback from the at least one computing unit and / or the at least one output or display device is acoustic and / or visual. Furthermore, it is possible for the at least one communication interface to have at least one external camera.
[0037] Regardless of the emergency situation or emergency, society can also be provided with social added value by making current and future planned interactions between a vehicle and a person inside the vehicle, usually the driver, available to passers-by and thus people outside the vehicle. This applies, for example, to weather forecasts (severe weather warnings) or sports results, generally information that is determined or obtained by at least one computing unit, e.g. via a search engine and / or access to the Internet, taking into account the question, query or request in response to the question or request. It is also possible that an answer includes technical details about the vehicle and / or a product of a vehicle manufacturer. A question in this regard would be, for example: "Vehicle, what performance does your vehicle have?"
[0038] When checking and / or analyzing the acoustic and / or optical signals and thus also the human acoustic signals, the at least one computing unit executes software for recognizing and / or processing human, naturally spoken language and / or gestures.
[0039] When implementing the method, it is possible, among other things, to use a vehicle as an emergency call box to make an emergency call to an emergency doctor, e.g. in the event of a medical emergency, or to the police or fire brigade as an authority. In this case, if an emergency call is made and the person or company is in danger, for example, in addition to a voice message from the person recorded by the at least one external microphone, at least one image of the surroundings recorded by the at least one external camera is transmitted to the relevant authority. It is also possible to use a vehicle or its headlights as a street lamp for passers-by, who can be detected at least based on their noise using the at least one external microphone and the at least one external camera as environmental sensors. By using the at least one output device, e.g.the horn and / or headlights, it is possible to deter criminals through acoustic and / or visual signals.
[0040] It is also possible to provide the at least one person with a convenience function of the at least one device. This is analogous to an acoustic, voice-assisted search for information from the internet, e.g., weather or news information, whereby a question for conducting such a voice-assisted search for information is asked by the at least one person to the at least one vehicle.
[0041] It is also possible to present an advertisement for a particular vehicle to at least one person as information. It is also possible for the vehicle to be asked further questions about the vehicle and / or its manufacturer and answered as part of the process. Such questions could be, for example, "Are you also available as a sedan?" If the at least one vehicle is integrated into a model or project such as "car sharing with fully automated driving," a second vehicle can be ordered, analogous to a taxi call for passenger transport via a first vehicle, whereby these vehicles are manufactured by the same manufacturer or group.
[0042] The interaction, e.g. communication, between the at least one person and the at least one vehicle enables networking or the establishment of a network between the at least one person and various vehicles, whereby the at least one person has access to functions or a range of functions of all nearby, networkable vehicles. This applies, for example, to the illumination of a sidewalk by headlights of several vehicles, which is controlled via or through the interaction, e.g. communication, of the at least one person with just one vehicle. It is also possible to use a vehicle as a navigation aid for passers-by, whereby in this case the message, formulated as a question, refers to a location, e.g.: "Vehicle, where is the Sistine Chapel?", and a possible response from a vehicle to this is: "My front is facing southwest, walk 300 m in this direction."Accordingly, it is possible that the response is communicated taking into account a position and / or orientation of the vehicle relative to the location and / or an object.
[0043] The acoustic and / or optical communication interface is provided via the at least one external microphone and / or the at least one external camera of the at least one vehicle, wherein the interaction can be activated, for example, by a code word, e.g. "Hello vehicle". By communicating between the vehicle and at least one server, it is possible to provide a passerby with selected functions of the vehicle or neighboring vehicles. The vehicle's response is based on acoustic and / or visual feedback. It is also possible, for example, that in an emergency, an unlocking function of the vehicle is activated, an external door of the vehicle is opened and the at least one person is given access to the interior of the vehicle, wherein an emergency call is made simultaneously if such an emergency arises, for example due to a danger from criminal offenses, vandalism, sexual assault, robbery, physical injury, theft, violence orTerrorism. This makes it possible to use the vehicle as a safe haven or bunker in the event of a chemical and / or biological attack. In this case, the vehicle can also perform an air filtration function using a device designed as an air filter.
[0044] The process enables a pedestrian to interact with another person's vehicle as a means of transport in a socially beneficial and / or social manner. The pedestrian is granted access to the vehicle's functions and existing hardware devices if, depending on the situation, it could be beneficial to individuals, groups of people, or society.
[0045] It is understood that the features mentioned above and those to be explained below can be used not only in the combination specified in each case, but also in other combinations or on their own, without departing from the scope of the present invention.
[0046] The invention is illustrated schematically in the drawing using embodiments and is described schematically and in detail with reference to the drawing. Fig. 1 shows a schematic representation of an embodiment of the system according to the invention when carrying out an embodiment of the method according to the invention.
[0047] Fig. 1 shows a schematic representation of a vehicle 2, designed here as a motor vehicle, which is located in an environment and is parked in this environment and has as components an external microphone 4, an external camera 6, a computing unit 8, an acoustic output device 10 designed as a loudspeaker, an optical output device 12 designed as a monitor, which is visible from the outside, and a communication unit 16 designed as an antenna.
[0048] Fig. 1 also shows a schematic representation of a person 20 located in the environment outside the vehicle 2.
[0049] Furthermore, Fig. 1 a server 26, which also has a communication module 28 designed as an antenna and / or is generally accessible via the Internet, for example, and a further second vehicle 30, which is designed and / or to be designated here as a third-party vehicle, usually a motor vehicle.
[0050] In the embodiment of the system 32 according to the invention presented here, the vehicle 2 and its components, i.e., the external microphone 4, the external camera 6, the computing unit 8, and the communication module 16, are also simultaneously configured as components of the system 32. The second vehicle 30 and the server 26 are also configured as components of the system 32. The external microphone 4 and the external camera 6 are configured as external sensors of the vehicle 2.
[0051] In the embodiment of the method according to the invention, it is provided that the person 20 outside the vehicle 2 wishes to communicate and thus interact with it. In this case, regardless of the embodiment of the method, the surroundings of the vehicle 2 are recorded acoustically by the external microphone 4 and also optically by the external camera 6 and thus monitored. In this case, noises from the environment are recorded by the external microphone 4, forwarded to the computing unit 8, and analyzed and / or evaluated by the latter. Images of the surroundings which are also recorded by the external camera 6 and which contain optical signals are also transmitted to the computing unit 8 and evaluated by the latter. In this case, the acoustic signals, e.g. noises and / or sounds, as well as the images with optical signals are evaluated together in a possible embodiment.
[0052] When analyzing the acoustic signals, the computing unit 8 checks either directly or indirectly whether these acoustic signals also contain human acoustic signals based on a human voice of the person 20. In the case of an indirect check, the computing unit 8 communicates via the communication unit 16 with the server 26 as the backend and / or a cloud. In addition, it is checked whether these acoustic signals include at least one piece of information directed to the vehicle 2. If this is the case, the computing unit 8 checks whether a function that can be carried out with at least one component and / or at least one device of the vehicle 2 is linked to the at least one piece of information directed to the vehicle 2. In addition, the computing unit 8 causes the at least one function to be carried out by the at least one device.Optical signals are recorded, evaluated and analyzed accordingly.
[0053] Furthermore, the computing unit 8 checks directly or indirectly, for example through communication between the computing unit 8 and the server 26 as the backend and / or the cloud, whether the at least one piece of information comprises a question and / or request. The computing unit 8 determines an answer to this question using an internal database of the computing unit 8 and / or by communicating with an external database, which is stored, for example, in the server 26, and / or by using information from data from the Internet. The question is displayed to the person 20 by providing an acoustic signal generated by the acoustic output device 10 embodied as a loudspeaker and / or by providing an optical signal provided by the optical display or output device 12 embodied as a monitor.This output device 12 is designed as a monitor or projector with which the optical signal is projected onto a surface, for example a surface, which is formed from asphalt of the road.
[0054] In an embodiment of the method, it is also possible for the computing unit 8 of the first vehicle 2 to exchange information with a computing unit (not shown in further detail) of the second vehicle 30 directly or indirectly via a server 26 and / or via the Internet and / or via the cloud. Alternatively or additionally, it is possible for the computing unit of the second vehicle 30 to cause the at least one intended function associated with the information sent to the first vehicle 2 by the person 20 with the human acoustic and / or optical signals to be carried out, alternatively or additionally, by at least one device of the second vehicle 30.
Claims
[1] Method for carrying out an interaction between at least one vehicle (2, 30) and at least one person (20) outside the at least one vehicle (2, 30) by means of at least one external sensor of the at least one vehicle (2, 30) and at least one computing unit (8) of the at least one vehicle (2, 30), in which acoustic signals from an environment outside the at least one vehicle (2, 30) are recorded by the at least one external sensor, transmitted to the at least one computing unit (8) and analyzed by the at least one computing unit (8), wherein it is checked whether the acoustic signals comprise human signals, wherein it is checked whether these human signals comprise at least one piece of information directed to the at least one vehicle (2, 30), wherein the at least one computing unit (8) only reacts to the at least one piece of information embodied as a message if it comprises a code word,which is shown on an outer wall of the at least one vehicle (2, 30)., [2] Method according to claim 1, wherein acoustic signals from the environment outside the at least one vehicle (2, 30) are recorded using at least one external microphone (4) as the at least one external sensor, are transmitted to the at least one computing unit (8) and are analyzed by the at least one computing unit (8), wherein it is checked whether the acoustic signals comprise human acoustic signals based on a human voice, wherein it is checked whether these human acoustic signals comprise the at least one piece of information directed to the at least one vehicle (2, 30), wherein the at least one computing unit (8) reacts to the at least one piece of information.| [3] Method according to claim 1 or 2, in which signals based on electromagnetic waves from the environment outside the at least one vehicle (2, 30) are recorded with at least one sensor for detecting electromagnetic waves as the at least one external sensor, are transmitted to the at least one computing unit (8) and are analyzed by the at least one computing unit (8), wherein it is checked whether the signals based on electromagnetic waves comprise human gestures, wherein it is checked whether these human gestures comprise at least one piece of information which is directed to the at least one vehicle (2, 30), wherein the at least one computing unit (8) reacts to the at least one piece of information. [4] Method according to one of the preceding claims, in which optical signals from the environment outside the at least one vehicle (2, 30) are recorded with at least one external camera (6) as the at least one external sensor, transmitted to the at least one computing unit (8) and analyzed by the at least one computing unit (8), wherein it is checked whether the optical signals comprise human gestures, wherein it is checked whether these human gestures comprise at least one piece of information which is directed to the at least one vehicle (2, 30), wherein the at least one computing unit (8) reacts to the at least one piece of information. [5] Method according to one of the preceding claims, in which the at least one computing unit (8) checks whether a function which can be carried out with at least one device of the at least one vehicle (2, 30) is linked to the at least one piece of information directed to the vehicle (2, 30), wherein the at least one computing unit (8) causes the at least one function to be carried out by the at least one device of the at least one vehicle (2, 30). [6] Method according to one of the preceding claims, in which it is checked whether the at least one piece of information comprises a question or request, wherein an answer to the question or request is determined by the at least one computing unit (8) and communicated to the person (20) with at least one output device (10, 12) of the at least one vehicle (2, 30). [7] Method according to one of the preceding claims, in which data is exchanged between the at least one computing unit (8) and at least one server (26) and / or a cloud. [8] Method according to one of the preceding claims, which is carried out with at least one first vehicle (2), wherein the at least one acoustic signal from the surroundings of the at least one first vehicle (2) is detected by the at least one external sensor of the at least one first vehicle (2), wherein the at least one function is carried out by at least one device of the at least one first vehicle (2). [9] Method according to claim 8, which is carried out with at least one second vehicle (30), wherein the at least one first vehicle (2) and the at least one second vehicle (30) have communication units (16) via which the computing units (8) of the vehicles (2, 30) exchange data with each other, wherein the at least one function is carried out by at least one device of the at least one second vehicle (30). [10] System for carrying out an interaction between at least one vehicle (2, 30) and at least one person (20) outside the at least one vehicle (2, 30), wherein the system (32) has at least one external sensor and at least one computing unit (8) of the at least one vehicle (2, 30), wherein the at least one external sensor is designed to record acoustic signals from an environment outside the at least one vehicle (2, 30) and to transmit them to the at least one computing unit (8), wherein the at least one computing unit (8) is designed to analyze the acoustic signals and to check whether the signals comprise human signals, wherein the at least one computing unit (8) is designed to check whether these human signals comprise at least one piece of information directed to the at least one vehicle (2, 30), wherein the at least one computing unit (8) is designed toto react to the at least one piece of information, wherein the at least one computing unit (8) only reacts to the at least one piece of information formed as a message if it comprises a code word displayed on an outer wall of the at least one vehicle (2, 30).
Citation Information
Patent Citations
Method for operating user interface for user of motor vehicle to exchange data between stationary vehicle and user, involves transmitting message from control unit to user terminal based on unpredictable result if relevance test is failure
DE102010034959A1
Vehicle-pedestrian communication system and procedures
DE102014110958A1
Method and device for voice control of a motor vehicle
DE102016200815A1
intelligent voice assistant system, apparatus and method for a vehicle
DE112015006380T5
Head-up display with outwardly visible projection
DE202015003921U1
