Method for controlling a motor vehicle and vehicle-external electronic computing device

Abstract

The invention relates to a method for controlling a motor vehicle that can be operated at least partially automatically, in which an individual marking of the motor vehicle arranged on the motor vehicle is determined by means of a mobile electronic terminal (V1), a request comprising the individual marking to enable the control of the motor vehicle is transmitted to a higher-level computing device external to the vehicle by means of the mobile electronic terminal (V2), whether a user operating the mobile electronic terminal has authorization to control the motor vehicle is determined by means of the higher-level computing device (V3), and if it is determined that authorization exists, the computing device triggers the authorization for control of the motor vehicle by the mobile electronic terminal, whereby the motor vehicle can be controlled by means of the mobile electronic terminal (V4).

Description

[0001] The invention relates to a method for controlling a motor vehicle that can be operated at least partially automatically and to an electronic computing device external to the vehicle.

[0002] US 2022 / 0121197 A1 discloses a remote assistance system that offers assistance to an autonomous driving system of a vehicle in response to an assistance request. The assistance request can be triggered via a control button on a user interface or by scanning a barcode, QR code, or RFID chip associated with the motor vehicle using a device that sends vehicle information to the remote assistance system.

[0003] Furthermore, a method for remotely assisting an autonomous vehicle is known from US 2017 / 0192423 A1. The method includes collecting sensor data from the autonomous vehicle, identifying a scenario in which assistance is desired, generating an assistance request based on the sensor data, transmitting the assistance request to a remote assistance interface, and receiving and processing a response to the assistance request.

[0004] Furthermore, US 2020 / 0019166 A1 discloses a method that enables an autonomous vehicle to request assistance from a remote operator when the vehicle's confidence in its operation is low.

[0005] The object of the present invention is to provide a solution which enables a particularly simple and reliable control of a motor vehicle by means of a device external to the vehicle.

[0006] This object is achieved according to the invention by the subject matter of the independent claims. Further possible embodiments of the invention are disclosed in the subclaims, the description, and the figures. Features, advantages, and possible embodiments presented in the description for one of the subject matter of the independent claims are to be regarded at least analogously as features, advantages, and possible embodiments of the respective subject matter of the other independent claims, as well as any possible combination of the subject matter of the independent claims, optionally in conjunction with one or more of the subclaims.

[0007] The invention relates to a method for controlling an at least partially automated motor vehicle, in particular a motor vehicle, in particular a passenger car or a truck. In particular, the motor vehicle is designed to be operated at least in level 3 according to the SAE J3016 standard. In particular, the motor vehicle is designed to be operated fully automatically. The method provides that an individual marking of the motor vehicle arranged in or on the motor vehicle is determined by means of a mobile electronic terminal. The motor vehicle is uniquely characterized by the marking. The mobile electronic terminal can be, for example, a smartphone, a smartwatch, or a tablet computer.A person who is in the immediate vicinity of the motor vehicle can therefore read the individual marking of the motor vehicle using a mobile electronic device carried by the person. This allows the motor vehicle to be uniquely identified. The method further provides that a request comprising the individual marking to enable the control of the motor vehicle is transmitted to a higher-level computing device external to the vehicle using the mobile electronic device. The higher-level electronic computing device is in particular a server device, which can also be referred to as a so-called backend. The request thus characterizes that the mobile electronic device wishes to be permitted to control the motor vehicle characterized by the individual marking or to take over control of this motor vehicle.

[0008] The method further provides for the higher-level computing device to determine whether the user operating the mobile electronic device is authorized to drive the motor vehicle. The electronic computing device therefore checks whether the user has permission to drive the motor vehicle. For example, the computing device can store information that only certain users are authorized to drive the motor vehicle. Alternatively, the computing device can store information that any user who can identify themselves or who can be clearly identified is authorized to drive the motor vehicle. If the method determines that the user is authorized, the computing device triggers permission for the mobile electronic device to drive the motor vehicle.This allows the motor vehicle to be controlled using the mobile electronic device. If it is determined that authorization is not present, the computing device can be used to prevent or not trigger the control of the motor vehicle by the mobile electronic device. The electronic computing device can therefore decide whether the mobile electronic device may take over control of the motor vehicle characterized by the request. The computing device can therefore enable the motor vehicle to be controlled using the mobile electronic device, for example to move the motor vehicle out of a dangerous driving situation. For example, it may happen that the motor vehicle blocks an intersection or a police or emergency service vehicle.It may happen that the motor vehicle is unable to maneuver itself out of this situation. Furthermore, the case may arise that the motor vehicle cannot be controlled using the electronic computing device to resolve the dangerous driving situation. As a result, the user in the vicinity of the motor vehicle can be requested to take over control of the motor vehicle using the mobile electronic device. If the electronic computing device triggers that the motor vehicle can be controlled using the mobile electronic device, the user can control the motor vehicle using the respective operating inputs on the mobile electronic device and, in particular, maneuver out of the driving situation. As part of the control, the user can trigger or control a movement of the motor vehicle using the respective operating inputs on the mobile electronic device.Because the motor vehicle is controlled by the user located in the vicinity of the motor vehicle using the mobile electronic device, the motor vehicle can be controlled particularly easily by the user, who has a particularly good overview of the driving situation. Furthermore, due to the arrangement of the mobile electronic device in the vicinity of the motor vehicle, there are particularly short latency times with regard to the transmission of a control signal from the mobile electronic device to a reaction characterized by the control signal being carried out by the motor vehicle. The motor vehicle can thus be controlled particularly easily, reliably and precisely within the scope of the method using the mobile electronic device.Due to the release by the electronic computer, it can be ensured that only users authorized to drive the vehicle can drive the vehicle. Another example of an application for the method is on a production site or at a central transshipment point, which can also be referred to as a hub. As part of the control of the vehicle using the mobile electronic device, the vehicle could then be moved or the user could initiate tests, including switching on the lights, honking the horn, flashing the indicators, triggering a diagnosis, or initiating a maintenance function. The method enables a transshipment point operator, for example, to carry out daily checkups and manually re-park their fleet.On the production site, an authorized worker as a user can easily record and move a large number of motor vehicles using the APP via the marking on the vehicle, for example via a production code on the windshield, which can save time.

[0009] In a possible development of the invention, it is provided that the individual marking is determined by means of the mobile electronic device by reading a QR code and / or a barcode and / or an RFID chip. The QR code is a two-dimensional code which is particularly robust due to automatic error correction. The QR code consists of a square matrix of black and white squares or dots, called modules, which represent the encoded data in binary form. A special marking in three of the four corners of the square specifies the orientation. A barcode can also be referred to as a bar code and refers to an optoelectronically readable font consisting of parallel lines and spaces of varying widths. The data is represented in binary symbols.RFID (Radio Frequency Identification) is a technology for transmitter-receiver systems for the automatic, contactless identification and localization of objects using radio waves. An RFID system consists of a transponder located on or in the vehicle, which identifies the vehicle's unique marking, for example, in the form of a sequence of numbers, and a reader for reading this marking. This reader is part of the mobile electronic device. RFID transponders can be particularly small, allowing the RFID chip to be integrated into the vehicle particularly easily and in a space-saving manner. The QR code or barcode can be applied to an external surface of the vehicle, making these codes particularly easy to capture, for example, scan, using the mobile electronic device.Alternatively or additionally, a vehicle-specific telephone number can be visibly assigned to the motor vehicle. The vehicle-specific telephone number can be called using the mobile electronic device, which allows the computer to easily determine which motor vehicle the request is based on the vehicle-specific telephone number when the call is accepted. The methods described enable a particularly simple and error-free determination of the vehicle's unique identification by the mobile electronic device.

[0010] In a further possible embodiment of the invention, the computing device provides a virtual key for the mobile electronic terminal, by means of which the mobile electronic terminal can establish a radio connection with a control device of the motor vehicle. In other words, within the scope of the method, if it is determined that the user is authorized, the virtual key is transmitted from the electronic computing device to the mobile electronic terminal. Using the virtual key, the mobile electronic terminal can establish the radio connection with the control device of the motor vehicle, via which radio connection the mobile electronic terminal can transmit control signals to the motor vehicle. The mobile electronic terminal can control the motor vehicle using the control signals.It can be provided that the motor vehicle can only be controlled using electronic devices that have the virtual key. As a result, the risk of an unauthorized user remotely controlling the motor vehicle can be kept particularly low.

[0011] In a further possible embodiment of the invention, it is provided that the motor vehicle is controlled by means of the mobile electronic device via Bluetooth and / or WLAN. This means that the radio connection is a Bluetooth connection and / or a WLAN connection. WLAN stands for Wireless Local Area Network and refers to a local radio network. Bluetooth is an industry standard for data transmission between devices over short distances using radio technology. In other words, the motor vehicle is controlled by means of the mobile electronic device via a short-range radio connection. This makes it possible to control the motor vehicle with particularly low latency using the mobile electronic device.

[0012] In a further possible embodiment of the invention, it is provided that at least one image characterizing the user is captured by means of a camera device of the motor vehicle and made available to the electronic computing device. The user must therefore be in the immediate vicinity of the motor vehicle so that the image characterizing the user can be captured by means of the camera device of the motor vehicle. This ensures that only a user who is in the immediate vicinity of the motor vehicle can be authorized to drive the motor vehicle. This makes it possible to prevent the motor vehicle from being hijacked remotely. Furthermore, it is provided that the computing device is used to determine, on the basis of the at least one image, whether the user is authorized to drive the motor vehicle.The electronic computing device can comprise an image processing device, by means of which the image received from the camera device can be evaluated or analyzed. The electronic computing device can extract a representation of the user from the image and compare this representation with a database of individually stored users.

[0013] In this context, it can be provided in particular that the electronic computing device is used to determine that the user is authorized to drive the motor vehicle if it is determined from the at least one image that the user belongs to the police or an emergency service. The method can therefore ensure that members of the police or the emergency services can drive the motor vehicle using the mobile electronic terminal, whereby the motor vehicle can be moved out of a dangerous driving situation particularly easily and quickly. For example, the electronic computing device can be used to determine an identifying feature of the user from the image, such as a uniform worn by the user which is assigned to the police or an emergency service.Furthermore, the electronic computer can compare the emergency services identified based on the uniform or the police identified based on the uniform with the organizations or professional groups stored in the computer that are authorized to drive the vehicle. This allows the electronic computer to determine that the user is authorized, provided that the electronic computer determines from the image that the user is a member of the fire department or police.

[0014] In a further possible embodiment of the invention, the motor vehicle moves at a maximum of a predetermined maximum speed when movements are triggered by the mobile electronic device. In particular, it can be provided that the motor vehicle is configured to move only in a crawling motion while being controlled by the mobile electronic device, and thus, for example, only at walking speed. This makes it possible to minimize the risk of the motor vehicle colliding with an obstacle while being controlled by the mobile electronic device.

[0015] In a further possible embodiment of the invention, at least one detection device of the motor vehicle is activated, by means of which data is captured at least during control by means of the mobile electronic terminal and stored in a storage device. For example, at least one microphone and / or at least one camera device of the motor vehicle can be activated to record data at least during control by means of the mobile electronic terminal, in particular additionally during the verification of the user's authorization. This data can be used as possible evidence at a later time due to its storage in the storage device.The control of the motor vehicle by means of the mobile electronic terminal can thus be particularly well documented by means of the at least one detection device and by storing the data detected by the detection device in the storage device.

[0016] The invention further relates to a vehicle-external electronic computing device, which is in particular a server device that can also be referred to as a so-called backend. The computing device is configured to receive a request from a mobile electronic terminal to enable the control of a motor vehicle. The motor vehicle is uniquely identifiable by an individual marking characterized by the request. This means that the individual marking of the motor vehicle arranged on the motor vehicle has been detected by means of the mobile electronic terminal, and this detected individual marking has been sent to the computing device as part of the request. The electronic computing device is further configured to determine whether a user operating the mobile electronic terminal is authorized to control the motor vehicle.In this case, the electronic computing device can determine the user's authorization in the manner already described in connection with the method according to the invention for controlling the motor vehicle. Furthermore, the electronic computing device is configured, if authorization has been determined, to trigger the authorization for controlling the motor vehicle by the mobile electronic device, thereby allowing the motor vehicle to be controlled by means of the mobile electronic device.

[0017] Further features of the invention can be derived from the following description of the figures and from the drawings. The features and combinations of features mentioned above in the description, as well as the features and combinations of features shown below in the description of the figures and / or in the figures alone, can be used not only in the respective combinations specified, but also in other combinations or on their own, without departing from the scope of the invention.

[0018] The drawing shows: Fig. 1 a process diagram for a method for controlling a motor vehicle that can be operated at least partially automatically.

[0019] In Fig.Figure 1 shows a process diagram for a method for controlling an at least partially automated motor vehicle, comprising four process steps V1 to V4. The method enables emergency intervention in autonomously operated motor vehicles. In particular, the method is used when the motor vehicle is blocking an intersection or obstructing an emergency vehicle. The method serves to avert danger and enables rapid on-site intervention by external parties.

[0020] Within the scope of the method, it is provided in the first method step V1 that an individual marking of the motor vehicle arranged in the motor vehicle is determined by means of a mobile electronic device. The individual marking can be determined by means of the mobile electronic device by reading a QR code and / or a barcode and / or an RFID chip. Within the scope of the second method step V2, the method is provided that, by means of the mobile electronic device, a request comprising the individual marking is transmitted to a higher-level computing device external to the vehicle in order to enable the control of the motor vehicle. The computing device can give the request comprising the individual marking a higher priority than at least one other request.

[0021] In the third method step V3 of the method, it is provided that the higher-level computing device determines whether a user operating the mobile electronic terminal is authorized to drive the motor vehicle. For this purpose, at least one image characterizing the user can be captured by a camera device of the motor vehicle and made available to the computing device. The electronic computing device can use the at least one image to determine whether the user is authorized to drive the motor vehicle. In this case, the computing device can determine that the user is authorized to drive the motor vehicle if it is determined from the at least one image that the user belongs to the police or an emergency service.Alternatively, the computing device can determine that the user is authorized to drive the motor vehicle if it is determined from the at least one image that the user is a first responder, an operator of a transfer point where the motor vehicle is located, or workshop personnel. Identification of the user can be achieved by comparing identifiers, for example, using the user's ID card.

[0022] In the fourth method step V4 of the method, it is provided that, if it is determined that the user is authorized, control of the motor vehicle by the mobile electronic device is triggered by means of the computing device, whereby the motor vehicle can be controlled by means of the mobile electronic device. For this purpose, the electronic computing device can provide a virtual key for the mobile electronic device. Using this virtual key, the mobile electronic device can establish a radio connection with a control device of the motor vehicle. The motor vehicle can be controlled by means of the mobile electronic device via Bluetooth and / or WLAN. It can be provided that the motor vehicle moves at a maximum predetermined maximum speed when movements are triggered by means of the mobile electronic device.It is possible for the electronic computing device to trigger the termination or prevention of control of the motor vehicle by the mobile electronic device. Control of the motor vehicle can therefore be withdrawn from the mobile electronic device. Control of the motor vehicle by means of the mobile electronic device can be limited by the electronic computing device, for example by means of a time limit and / or by providing pauses between movements of the motor vehicle. It is possible for the electronic computing device to trigger a break in contact between the control connection between the mobile electronic device and the motor vehicle or to trigger a withdrawal of authorization for the mobile electronic device.

[0023] It can further be provided that at least one detection device of the motor vehicle is activated, for example, by the electronic computing device, wherein data is detected by the detection device at least during the control of the motor vehicle by means of the mobile electronic terminal and stored in a storage device. In this case, the data can be stored, in particular, in a storage device of the motor vehicle and / or in a storage device of the electronic computing device and / or in a storage device of the mobile electronic terminal.

[0024] Thus, an electronic computing device external to the vehicle can be provided, which is configured to receive the request from the mobile electronic terminal to enable control of the motor vehicle. Furthermore, the electronic computing device can be configured to determine whether the user operating the mobile electronic terminal has authorization to control the motor vehicle. Furthermore, the electronic computing device can be configured to trigger, if it is determined that authorization exists, the authorization to allow control of the motor vehicle by the mobile electronic terminal.

[0025] As part of the process, a rescue team, the police, or a rescuer can use a vehicle-specific QR code on the motor vehicle to directly contact the computing device, which can be part of a remote guidance system. The remote guidance system can comprise a person who operates or controls the electronic computing device. The remote guidance system can thus connect to the motor vehicle identified by the individual marking and communicate with the user via the mobile electronic device. Depending on the situation, the remote guidance system can itself instruct and thereby control the motor vehicle, or, after authentication of the user who contacted the computing device via the electronic device, enable a crawling function of the motor vehicle via the mobile electronic device.This function allows the vehicle to be maneuvered slowly, thus crawling, on-site using the mobile electronic device. Contacting the electronic computing device via the request containing the individual marking can be prioritized by the electronic computing device as an emergency. As part of the process, the crawling function is activated for the user on-site using the electronic device, including user authentication via the vehicle's camera system. The vehicle can be operated using the mobile electronic device via Wi-Fi or Bluetooth to avoid delays in operation.A technical function can be enabled through a virtual key exchange between the mobile electronic device and the motor vehicle, whereby the mobile electronic device has provided the virtual key for the mobile electronic device and / or the motor vehicle. This virtual key can have a limited validity period.

[0026] Furthermore, a conversation can be recorded and the recorded conversation can be synchronised with images, in particular a recorded video, captured by the vehicle's recording device for later evidence gathering.

[0027] Within the framework of the method, an application can be activated on the mobile electronic device using a QR code, which enables direct contact between the mobile electronic device and the electronic computing device. The control of the motor vehicle can be activated via the application by the computing device after user authentication. To avoid delays, the motor vehicle is controlled directly via Bluetooth or Wi-Fi and not via the computing device. The method enables particularly simple and intuitive control of the motor vehicle using the mobile electronic device. List of reference symbols V1 to V4 respective process steps QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] US 2022 / 0121197 A1

[0002] US 2017 / 0192423 A1

[0003] US 2020 / 0019166 A1

[0004]

Claims

[1] Method for controlling an at least partially automated motor vehicle, in which - an individual marking of the motor vehicle arranged on the motor vehicle is determined by means of a mobile electronic terminal (V1), - a request comprising the individual marking is transmitted to a higher-level computing device external to the vehicle by means of the mobile electronic terminal device to enable the control of the motor vehicle (V2), - the higher-level computing device determines whether a user operating the mobile electronic device has authorization to drive the motor vehicle (V3), and - if it is determined that the authorization exists, the computing device is used to trigger the control of the motor vehicle by the mobile electronic device, whereby the motor vehicle can be controlled by means of the mobile electronic device (V4). [2] Method according to claim 1, wherein the individual marking is determined by means of the mobile electronic terminal by reading a QR code and / or a barcode and / or an RFID chip (V1). [3] Method according to claim 1 or 2, wherein the computing device provides a virtual key for the mobile electronic terminal, by means of which the mobile electronic terminal can establish a radio connection with a control device of the motor vehicle (V4). [4] Method according to one of the preceding claims, wherein the motor vehicle is controlled by means of the mobile electronic terminal via Bluetooth and / or via WLAN. [5] Method according to one of the preceding claims, wherein the computing device gives higher priority to the request comprising the individual marking than to at least one further request (V3). [6] Method according to one of the preceding claims, wherein at least one image characterising the user is captured by means of a camera device of the motor vehicle and made available to the computing device, and the computing device determines on the basis of the at least one image whether the user is authorised to control the motor vehicle (V3). [7] Method according to claim 6, wherein the computing device determines that the user has the authorization to control the motor vehicle if it is determined from the at least one image that the user belongs to the police or to an emergency service (V3). [8] Method according to one of the preceding claims, wherein the motor vehicle moves at most at a predetermined maximum speed during movements triggered by the mobile electronic terminal. [9] Method according to one of the preceding claims, wherein at least one detection device of the motor vehicle is activated, by means of which data are detected at least during the control of the motor vehicle by means of the mobile electronic terminal and are stored in a storage device. [10] Vehicle-external electronic computing device which is designed to: - to receive a request from a mobile electronic terminal to enable the control of a motor vehicle, whereby the motor vehicle is clearly identifiable by an individual marking characterised by the request, - to determine whether a user operating the mobile electronic device is authorized to drive the motor vehicle, and - if it is determined that the authorization exists, to trigger that control of the motor vehicle by the mobile electronic device is permitted, whereby the motor vehicle can be controlled by means of the mobile electronic device.

Images