Method for operating a steer-by-wire steering system of a vehicle, and steer-by-wire steering system

The method uses interior cameras to detect steering efforts and convert them into wheel steering angles, addressing the challenge of maintaining steerability during sensor or actuator failures in steer-by-wire systems, ensuring reliable and cost-effective operation.

WO2024227473A1PCT designated stage expired Publication Date: 2024-11-07BAYERISCHE MOTOREN WERKE AG
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
PCT/DE2024/100303
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-03
Filing Date
2024-04-11
Publication Date
2024-11-07

AI Technical Summary

Technical Problem

Existing steer-by-wire steering systems face challenges in ensuring safe operation during malfunctions, particularly when the sensor or actuator systems fail, as they lack reliable fallback mechanisms to maintain vehicle steerability.

Method used

The method employs an interior camera to detect and record the steering effort of a vehicle occupant, converting this data into a wheel steering angle using a control unit, even when the primary sensor system fails, thereby enabling continued steering functionality through a redundancy level without additional hardware costs.

Benefits of technology

This approach provides a reliable and cost-effective fallback mechanism that ensures vehicle steerability during system failures, utilizing existing interior cameras for redundancy, thus maintaining safe operation without additional effort or expense.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 000001
    Figure 000001
  • Figure 000002
    Figure 000002
  • Figure 000003
    Figure 000003
Patent Text Reader

Abstract

The invention relates to a method for operating a steer-by-wire steering system of a vehicle, wherein the steering desire of a vehicle occupant is sensed by a steering yoke being actuated and, in response to that, is set in the form of a wheel steering angle at at least one vehicle wheel, whereas, if a malfunction is detected, the steer-by-wire steering system is operated on a fallback level, wherein, on the fallback level, the steering desire of the vehicle occupant is sensed by at least one interior camera.
Need to check novelty before this filing date? Find Prior Art

Description

[0001]Description Method for operating a steer-by-wire steering system of a vehicle and steer-by-wire steering system The invention relates to a method for operating a steer-by-wire steering system of a vehicle according to the preamble of claim 1 and to a steer-by-wire steering system according to the preamble of the independent claim 6. With regard to the prior art, reference is made, by way of example, to WO 2019 / 243300 A1. So-called steer-by-wire steering systems of vehicles are already known in various forms from the prior art. Such a system differs from conventional steering systems in that the steering of the wheels is completely decoupled from the mechanical steering movement of the driver and only takes place via a purely electronic transmission. The conventional mechanical transmission devices are omitted; instead, the driver generates the steering movement on the so-called steering handle orat the steering wheel data which is fed to an electronic control unit. This control module evaluates the data and converts it into corresponding steering commands. This controls the steering gear or the actuator for setting a wheel steering angle, which executes the desired steering movement. The requirements for the reliability of such a steering system are particularly high. The steerability of the vehicle must be guaranteed in the event of any malfunction. Redundancies or fallback levels are provided for this purpose. For example, it is known to provide redundancy in the actuators and sensors of the steered wheels of the vehicle. The operation of the steering system with a so-called redundancy is referred to as the redundancy level. If a malfunction or a so-called initial error occurs in the actuators or sensors, a further error initiated by the driver orThe steering angle requested by the vehicle can be implemented at the wheels of the vehicle. WO 2019 / 243300 A1, for example, shows a steer-by-wire steering system with a redundant steering angle sensor. The object of the invention is to demonstrate a method for the safe operation of a steer-by-wire steering system in the event of a malfunction. The solution to this problem is provided by a method for operating a steer-by-wire steering system with the features of claim 1 and by a steer-by-wire steering system with the features of claim 6. Advantageous embodiments and further developments are the subject of the subclaims. A method for operating a steer-by-wire steering system of a vehicle is proposed. The steering request of a vehicle occupant is detected by the vehicle occupant actuating a steering handle. If the vehicle occupant actuates the steering handle, for example by turning a steering wheel, this actuation is detected by corresponding sensors.Such a sensor system can, for example, be a steering angle sensor on the steering handle. In response to this actuation and the detection of the steering input, a wheel steering angle is implemented or adjusted on at least one vehicle wheel in accordance with the steering input (in particular by a corresponding control unit). It is further provided that the steering system is operated in a fallback or redundancy level upon detection or recognition of a fault. If, for example, the sensor system for detecting the actuation of the steering handle (for example the steering angle sensor system) or the actuator on the steering handle fails or a fault occurs, steering is still possible. It is provided that the steering input of the vehicle occupant is detected by at least one interior camera while the steering system is operating in the aforementioned fallback level.This particularly applies to the case when the system is in the fallback mode because the sensors for detecting the steering input, in particular the steering angle sensors on the steering handle, are malfunctioning or failing. An interior camera then advantageously detects the vehicle occupant's steering input. The detected data is then evaluated by a corresponding control unit and converted into a corresponding wheel steering angle of at least one vehicle wheel. For example, the interior camera can detect the changed position of the steering handle while the vehicle occupant is operating the steering handle. By evaluating the change in position of the steering handle (for example, by a corresponding control unit), for example, by comparing stored steering handle positions, a specific steering input of the vehicle occupant can then be calculated.For example, a steering wheel rotation can be detected by the interior camera, and a steering angle can be calculated or evaluated based on the stored steering wheel shape or position. Alternatively or additionally, the interior camera can detect the steering input by detecting and evaluating a hand movement of at least one of the vehicle occupants' hands while operating the steering handle. Thus, if the vehicle occupant operates the steering handle with their hands, for example, by turning a steering wheel, the interior camera detects the hand movement. By comparing this with stored data and evaluating it with a suitable control unit, a steering input, for example in the form of a steering angle, can be derived. This process can also be referred to as "hand tracking."Alternatively or additionally, it is also possible for the interior camera to detect the steering input by detecting and evaluating at least one reflector and / or pattern arranged on the steering handle during movement of the steering handle. Thus, if a corresponding pattern to which the camera reacts, or one or more corresponding reflectors, is arranged on the surface of the steering handle, their position can be detected by the camera, and a steering input (using a corresponding control unit) can be derived from their change in position during operation of the steering handle. The method provides a reliable and cost-effective fallback or redundancy level in the event of a malfunction or failure in the steer-by-wire steering system. It is particularly advantageous because existing interior cameras can be used, which saves additional effort and costs.Furthermore, a steer-by-wire steering system of a vehicle for carrying out the method according to one of claims 1 to 5 is proposed. The steer-by-wire steering system (steering system for short) comprises a steering handle for the manual input of a steering command by a vehicle occupant. This can in particular be a steering wheel, which the vehicle occupant turns with their hands to express a steering command in the form of a steering angle. The steering system further comprises a sensor unit that detects the vehicle occupant's input. For example, this can be a steering angle sensor on the steering handle. A control unit is provided for evaluating the input data so that, in response to the input of the steering command, a corresponding wheel steering angle is implemented on at least one vehicle wheel.The steering system further comprises at least one interior camera configured to detect the vehicle occupant's steering input during a malfunction of the steer-by-wire steering system. How this detection can occur has already been explained above. The interior camera can be one or more cameras, each located in the vehicle interior. These are particularly preferably also used for other functions and assistance systems in the vehicle, such as fatigue detection or gesture recognition. For example, an RGB camera and / or an infrared camera and / or a depth camera (for example using a TOF method) can be used, which detects at least part of the steering wheel or part of the hands. The camera can be installed, for example, in the instrument cluster behind the steering handle or in other positions, such as on the vehicle's interior mirror, in the roof module, on the A-pillar, etc.As explained above, the interior camera can detect a steering input, for example, using a reflector and / or a pattern. For this purpose, the steering handle comprises at least one reflector and / or a pattern on its surface, the position of which can be detected by the interior camera, thus allowing the vehicle occupant's steering input to be evaluated. For example, the pattern could be a QR code located on the surface of the steering handle, for example, in the fabric. One or more other patterns are also suitable for precise localization. Light reflectors are also conceivable, which represent specific markers for the interior camera to detect the position.

Claims

Patent claims 1. A method for operating a steer-by-wire steering system of a vehicle, wherein the steering input of a vehicle occupant is detected by actuating a steering handle and, in response thereto, is adjusted on at least one vehicle wheel in the form of a wheel steering angle, wherein the steer-by-wire steering system is operated in a fallback level upon detection of a fault, characterized in that, in the fallback level, the steering input of the vehicle occupant is detected by at least one interior camera.

2. The method according to claim 1, wherein the interior camera detects the steering input by detecting and evaluating the changed position of the steering handle during actuation of the steering handle.

3. The method according to claim 1 or 2, wherein the interior camera detects the steering input by detecting and evaluating a hand movement of at least one hand of the vehicle occupant during actuation of the steering handle. 4.Method according to one of the preceding claims, wherein the interior camera detects the steering input by detecting and evaluating at least one reflector and / or pattern arranged on the steering handle during a movement of the steering handle.

5. Method according to one of the preceding claims, wherein a steering angle is calculated after detecting the steering input of the vehicle occupant.

6. A steer-by-wire steering system of a vehicle for carrying out the method according to one of claims 1 to 5, comprising: - a steering handle for manually inputting a steering command by a vehicle occupant, - at least one sensor unit for detecting the input, - at least one control unit for evaluating the input and for setting a wheel steering angle on at least one wheel of the vehicle in response to the input, characterized in that the steering system comprises at least one interior camera configured to detect the steering command of the vehicle occupant during a malfunction of the steer-by-wire steering system. Steer-by-wire steering system according to claim 6, wherein the interior camera is an RGB camera, an infrared camera, and / or a depth camera. Steer-by-wire steering system according to claim 6 or 7, wherein the steering handle comprises at least one reflector and / or a pattern on its surface, the position of which can be detected by the interior camera, and thus the steering command of the vehicle occupant can be evaluated.Steer-by-wire steering system according to claim 8, wherein the pattern is a QR code arranged on the surface of the steering handle.

Citation Information

Patent Citations

  • Steer-by-wire architectures having a second steering angle sensor

    WO2019243300A1

  • Vehicle control system for controlling steering of vehicle

    EP3070762A1

  • METHOD AND DEVICE FOR CONTROLLING AN ELECTRIC POWER STEERING SYSTEM OF A VEHICLE WITH A CABLE-DRIVEN STEERING COLUMN, BY COMPARISON OF STEERING WHEEL ANGLES

    FR3084743A1

  • Vehicular steering device

    JP2009090687A