Method and system for communication between a vehicle and a user, and vehicle for this purpose

Abstract

The invention relates to a method for communication between a vehicle (100) and a user (200), comprising at least the following steps: detecting the user (200) in the vicinity of the vehicle (100) by means of sensors (101, 102) on the vehicle (100) and / or wireless communication means (103), automatically executing predetermined comfort functions of the vehicle (100), and providing input means for the user (200) to control the vehicle (100), wherein the input means are provided by the vehicle (100) itself. The invention also relates to a communication system for carrying out the method and to a vehicle (100) as part of the communication system.

Description

The invention relates to a method and a system for communication between a vehicle and a user, and to a vehicle for this purpose. With current technology, the main ways for a user standing outside the vehicle to communicate with it are: via a mobile app, enabling remote control through active operation of the phone (requiring an internet connection to the vehicle); with a key, for example, using keyless entry or a remote key; and via a virtual pedal to open the tailgate with a foot movement. However, these methods either require the user to be close to the vehicle (keyless entry) or require active operation of the mobile app to trigger an action from a greater distance, either by holding the phone in the hand or by using voice commands. DE 10 2014 224 99 A1 describes a method for user proximity detection via Bluetooth, mobile communication or WiFi connections for activating vehicle comfort functions, such as switching on the vehicle lighting. DE 10 2015 116 832 A1 describes a method for identifying a person approaching a vehicle using various identification methods, such as voice, face, fingerprint or telephone recognition. EP 0 059 985 B1 describes a voice-controlled door locking device for motor vehicles. US Patent 11,072,311 B2 and US Patent 11,436,864 B2 describe methods for user identification by a vehicle with linked activation of comfort functions of the vehicle, such as entertainment, seat heating, etc. The purpose of the invention is to provide improved communication between a user and a vehicle. The problem is solved by a method with the features of claim 1, by a communication system with the features of claim 9, and by a vehicle with the features of claim 10. Advantageous embodiments with expedient further developments of the invention are specified in the dependent claims. The invention comprises communication in the short to medium near field (5m - 10km) of the vehicle, so to speak "on approach," via the introduction of sensors, for example, cameras, lidar, radar, microphones, etc., and input devices, for example, projectors, gesture recognition, etc. The user can optionally carry their own communication devices such as a mobile phone, smartwatch, or smart key, which enable (remote) communication with the vehicle. A variant of the invention involves the user's communication devices communicating with the vehicle and, for example, sharing the user's position. As soon as the user enters the vehicle's "field of view," the user is detected by environmental sensors on the vehicle.This can also be combined with enhanced long-range vision (zoom function) to identify and authenticate the user at greater distances using facial recognition, gait / posture analysis, gesture / facial expression recognition, and voice recognition. Once the user is authenticated as the vehicle's driver, optional input options can be provided. For example, an input field projected onto the ground, which the user can actively step on while walking towards the vehicle to, for instance, issue a command such as "please park automatically." The user would then arrive at the vehicle, which would already be parked. Additionally, it is possible to actively issue acoustic or visual prompts, for example, on a mobile phone or screen, to which the user can respond via voice, gesture, facial expression, or character input. The latter can be further enhanced by AI / pattern recognition algorithms.Another variant of the invention involves the authentication and communication chain spanning multiple units, for example, other vehicles, the remaining traffic infrastructure such as streetlights or charging stations, etc. A further variant of the invention allows the user to communicate with the vehicle via touch or voice input using a mobile phone, smartwatch, or similar device. Yet another variant of the invention enables communication with the vehicle based on the user's expected arrival time. If the timeframe within which a user intends to begin their journey is known, then the decisive criterion is not the distance, but the time until arrival at the vehicle. The communication options described above can thus be optimized for the calculated arrival time.A control / monitoring device or server is required to moderate and execute the authentication and communication of the user via their smart devices and, if applicable, infrastructure or other vehicles, up to and including their own vehicle. Overall, the invention offers the advantages of intuitive and barrier-free communication with the vehicle for preparing the driving task and initializing comfort functions, such as in particular wake up infotainment, connecting the mobile phone, seat / interior heating, uploading a navigation destination to navigation, etc. The method according to the invention serves for communication between a vehicle and a user and comprises the following steps: - Detecting the user in the vicinity of the vehicle by means of sensors on the vehicle and / or wireless connection means, - Automatically executing predetermined comfort functions of the vehicle and - Providing input means for controlling the vehicle by the user, wherein the input means are provided by the vehicle itself. It is already known from the prior art that a vehicle activates certain comfort functions when a user approaches and is detected. However, it is not yet known that the user can control the vehicle upon approach by having the vehicle provide specific input options that go beyond normal control of the vehicle via a mobile app. According to the invention, the input means are provided by the vehicle itself. In a first step, the user is detected in the vicinity of the vehicle. Preferably, this detection serves both identification and authentication purposes, since, for example, different functions or operating and access rights to vehicle functions may be assigned to multiple users of a vehicle. This can be achieved, firstly, using sensors on the vehicle that detect the user as soon as they are in the immediate vicinity. Accordingly, one embodiment of the method provides for the user to be detected using visual and / or acoustic sensors and / or lidar and / or radar systems.Such sensors can be, for example, cameras or microphones that perform an image or voice comparison of the approaching user with data stored in a database, particularly for facial recognition, gait / posture analysis, gesture / facial expression recognition, voice identification, etc. The approaching user can also be detected via radar or lidar systems on the vehicle. Alternatively, detection can optionally be carried out using wireless communication methods, whereby the vehicle establishes a wireless connection to the user's mobile device as soon as the user is within range or the vicinity of the connection. Accordingly, one embodiment of the method provides for the user to be detected via a Bluetooth, Wi-Fi, and / or cellular connection between the vehicle and a mobile device carried by the user.Mobile devices that can be detected via a wireless connection include, for example, cell phones, smartwatches, smart keys, and similar devices. Detecting the user via a mobile device is advantageously optional, as while the range of the wireless connection and the radius within which the user can be detected is significantly greater, this method is considerably less secure against deception. Preferably, the approaching user should be detected exclusively via sensors on the vehicle. Once the user has been identified and authenticated, certain user-specific comfort functions of the vehicle are automatically executed, such as activating the seat heating, setting a specific seat or mirror position, climate control of the vehicle, etc. According to the invention, in a further step, input devices for controlling the vehicle are provided to the user. In one embodiment of the method, the input devices for controlling the vehicle are provided depending on a detected distance of the user to the vehicle and / or the user's expected arrival time at the vehicle. The input devices can be operated in various ways. Advantageously, the user can operate the input devices directly without any aids or via a mobile device. For example, gestures or voice commands can be used without additional aids. Alternatively, the user can use their mobile phone to control the vehicle. Preferably, the following input devices can be provided for controlling the vehicle: projection of an input field, acoustic and / or visual input options, voice, gestures, touch gestures, facial expressions, and the like. It should be noted that this list is not exhaustive and that all control and input options are within the scope of the invention. One variant provides that the vehicle projects a type of input field onto the ground as soon as the user has approached to within a certain distance.The user can then step on a specific area of ​​the input field to control a function of the car, for example, automatically parking the vehicle. Furthermore, there are various options for communication between the user and the vehicle. In one option, communication between the user and the vehicle is direct and immediate. In another option, communication between the user and the vehicle takes place via additional communication units. These additional communication units can be, for example, other vehicles or other traffic control infrastructure such as streetlights, traffic lights, charging stations, etc.—essentially anything that is integrated into a wireless communication network, especially via Car2Car or Car2X communication. It is possible that the user is detected by a charging station next to the vehicle, and that comfort functions are activated and input options are made available in the vehicle.It is also possible that the user is detected by a first vehicle located in the wider vicinity of the user's vehicle, and thus communication with the user's vehicle initially takes place via the first vehicle until the user has approached their vehicle sufficiently. The communication system according to the invention serves for communication between a vehicle and a user and comprises at least: - wireless connection means and / or sensors on the vehicle for detecting the user in the vicinity of the vehicle, - input means for controlling the vehicle, - at least one control unit which has a wireless connection at least to the vehicle, - wherein the control unit is configured to carry out a method according to the invention as described above. Furthermore, the invention relates to a vehicle as part of a communication system according to the invention. The advantages, advantageous embodiments and effects mentioned above in connection with the method also apply to the communication system and the vehicle according to the invention. The features and combinations of features mentioned above in the description, as well as those subsequently mentioned in the figure description and / or shown in the figures alone, can be used not only in the combinations specified, but also in other combinations or on their own, without departing from the scope of the invention. Thus, embodiments that are not explicitly shown or explained in the figures, but which can be derived and generated from the explained embodiments by separate combinations of features, are also to be considered as encompassed and disclosed by the invention. Further advantages, features, and details of the invention will become apparent from the claims, the following description of preferred embodiments, and the drawings. Figure 1 shows a simplified schematic representation of one embodiment of the communication system according to the invention; Figure 2 shows a simplified schematic representation of another embodiment of the communication system according to the invention; Figure 3 shows a simplified schematic representation of a further embodiment of the communication system according to the invention; Figure 4 shows a simplified schematic representation of yet another embodiment of the communication system according to the invention; Figure 5 shows another schematic representation of a first embodiment of the communication system according to the invention; Figure 6 shows another schematic representation of a second embodiment of the communication system according to the invention.Fig. 7 shows another schematic representation of a third embodiment of the communication system according to the invention, Fig. 8 shows another schematic representation of a fourth embodiment of the communication system according to the invention, and Fig. 9 shows another schematic representation of a fifth embodiment of the communication system according to the invention. Figures 1, 2, 3 to 4 each show different embodiments of the communication system according to the invention. The communication system serves for communication between a vehicle 100 and a user 200. In step S1, the user 200 is detected as they approach the vehicle 100, whereupon comfort functions such as air conditioning or the like are automatically started in the vehicle 100 (step 2). This can occur either depending on the distance E of the user 200 from the vehicle 100 or depending on the expected arrival time T of the user 200 at the vehicle 100. In step S3, the vehicle 100 provides and activates input options, for example, an input field projected onto the floor by means of a projector or a voice recognition unit, so that the user 200 can control the vehicle 100 as soon as they approach it, for example, by issuing a command for automatic parking.The communication system and method according to the invention is controlled via a central control unit 300, on which, among other things, databases are stored and which has an AI or pattern recognition algorithm. In the following, only the differences between the illustrated embodiments will be discussed with regard to the individual figures. According to Fig. 1, the vehicle 100 has sensors for detecting the user 200, namely camera 101 and microphone 102. The user 200 can therefore be identified and authenticated by means of image and / or voice recognition. According to Fig. 2, the vehicle 100 also has a Bluetooth receiver 103, which can establish a wireless connection to a mobile device 201 carried by the user 200 as soon as the user 200 is within range of the Bluetooth connection. According to Figures 3 and 4, communication between the vehicle 100 and the user 200 takes place via further communication units 400, 500. In the embodiment shown in Figure 4, the user is detected by another vehicle 400 equipped with sensors 101, 102 and a Bluetooth receiver 103, which communicates with the user's actual vehicle 100 via Car2Car communication. Figure 4 also shows an embodiment in which a mobile device 201 belonging to the user 200 is detected by a street lamp 500 as further traffic infrastructure, which then communicates with the user's vehicle 100 via Car2X communication. Figures 5, 6, 7, 8 to 9 each show different embodiments of the communication system according to the invention in a different representation. The same reference numerals are used for the same components, i.e., as the components shown and described in Figures 1, 2, 3 to 4. The embodiment shown in Fig. 5 illustrates the communication between the vehicle 100 and various terminal devices 201 of the user 200 as soon as the user 200 has approached the vehicle 100 within a certain distance E. As soon as the user 200 enters the "field of view" of the vehicle 100's camera 101, the user 200 is identified and authenticated by means of facial recognition, gait / posture analysis, gesture / facial expression recognition, voice identification, or other methods. If the user 200 is recognized as the driver of the vehicle 100, optional input options are displayed. Here, an input field is projected onto the ground by means of a projector 104, onto which the user 200 can actively step on their way to the vehicle 100 and thus, for example, give the command for automated parking. The embodiment according to Fig.Figure 6 illustrates how an authentication and communication chain can be established across multiple units, namely the user's own vehicle 100 and another vehicle 400. The embodiment according to Figure 7 illustrates how an authentication and communication chain can be established across the user's own vehicle 100 and another vehicle 400, as well as via the user's smartwatch 201. The user 200 can use their smartwatch 201 as an input device via touch or voice input. The embodiment according to Figure 8 illustrates an authentication and communication chain across multiple units, namely the user's own vehicle 100, another vehicle 400, and a street lamp 500 as additional infrastructure. Communication between vehicles 100 and 400 can be via Car2Car, and communication with the street lamp as additional infrastructure can be via Car2X. The embodiment according to Figure 8 illustrates how the user 200 can use their smartwatch 201 as an input device.Figure 9 illustrates authentication and communication depending on a specific arrival time T of user 200 at vehicle 100. If it is known within what time frame user 200 will arrive at vehicle 100 or want to start their journey, then the decisive criterion is not the distance E, but the time T until arrival at vehicle 100. The implementation examples described above can therefore be optimized for a specific arrival time T. REFERENCE MARK LIST: 100 Vehicle 101 Camera 102 Microphone 103 Bluetooth Receiver 104 Projector 200 User 201 User's Mobile Device 300 Control Unit 400 Additional Vehicle 500 Street Lamp E Distance between User and Vehicle S1 - S3 Procedure Steps T User's Arrival Time at Vehicle QUOTES INCLUDED IN THE DESCRIPTION This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature DE 10 2014 224 99 A1

[0003] DE 10 2015 116 832 A1

[0004] EP 0 059 985 B1

[0005] US 11,072,311 B2

[0006] US 11,436,864 B2

[0006]

Claims

Method for communication between a vehicle (100) and a user (200), comprising at least the following steps: - Detecting the user (200) in the vicinity of the vehicle (100) by means of sensors (101, 102) on the vehicle (100) and / or wireless communication means (103), - Automatically executing predetermined comfort functions of the vehicle (100) and - Providing input means for the user (200) to control the vehicle (100), wherein the input means are provided by the vehicle (100) itself. Method according to claim 1, characterized in that the user (200) is detected by means of visual and / or acoustic sensors and / or lidar and / or radar systems. Method according to claim 1 or 2, characterized in that the user (200) is detected via a Bluetooth, WLAN and / or mobile communication connection of the vehicle (100) to a mobile device (201) which the user (200) carries with them. Method according to one of claims 1 to 3, characterized in that the input means for controlling the vehicle (100) are provided depending on a detected distance (E) of the user (200) to the vehicle (100) and / or an expected arrival time (T) of the user (200) at the vehicle (100). Method according to one of claims 1 to 4, characterized in that the input means are operated directly without aids or via a mobile terminal device (201). Method according to one of claims 1 to 5, characterized in that the following input means are provided for controlling the vehicle (100): projection of an input field, acoustic and / or visual input options, voice, gestures, touch gestures, facial expressions and the like. Method according to one of claims 1 to 6, characterized in that the communication between the user (200) and the vehicle (100) takes place directly. Method according to one of claims 1 to 6, characterized in that the communication between the user (200) and the vehicle (100) takes place via further communication units (400, 500). Communication system for communication between a vehicle (100) and a user (200), comprising at least: - wireless connection means (103) and / or sensors (101, 102) on the vehicle (100) for detecting the user (200) in the vicinity of the vehicle (100), - input means for controlling the vehicle (100) by the user (200), - at least one control unit (300) which has a wireless connection at least to the vehicle (100), - wherein the control unit (300) is configured to perform a method according to any one of claims 1 to 8. Vehicle (100) as part of a communication system according to claim 9.

Images