A control system and a procedure for evaluating a parking space for a vehicle

Abstract

The control unit 102 evaluates the parking space 104 for the vehicle 100. The control unit 102 is designed to detect the parking space 104 using at least one camera installed in the vehicle 100. The control unit 102 determines the virtual parked position of the vehicle 100 based on trajectory planning. The trajectory planning takes into account predetermined parameters of the vehicle 100. The control unit 102 determines characteristics of the parking space 104 using at least one perception sensor installed in the vehicle 100. The control unit 102 determines the possibility of obstruction when opening at least one door 304 of the vehicle 100 in the virtual parked position using the characteristics of the parking space 104 and notifies the driver accordingly. The control unit 102 determines the obstruction before the vehicle 100 is parked in the parking space 104.Making a timely decision by the driver avoids unnecessary effort and saves fuel.

Description

Full patent specification

[0001] The following patent specification describes and identifies the nature of this invention and the manner in which it is to be carried out. Field of invention

[0002] The present invention relates to a control system and a method for evaluating a parking space for a vehicle. Background of the invention

[0003] Currently, drivers face numerous challenges in many scenarios when trying to find and properly park their vehicles. Once parked, drivers often find it difficult to open the doors due to obstructions. Because of these obstructions, drivers may move the vehicle and search for another parking space, only to encounter the same problem. This results in wasted time, dents in the doors, wasted fuel, and other issues.

[0004] According to a prior art patent in US2023016676, a vehicle with a parking assist system includes a plurality of powered closing doors, each door having an actuator for moving the door between a closed and open position, a plurality of sensors located on the vehicle for detecting objects relative to the vehicle and generating detected signals indicating the detected objects, and a transceiver for communicating with a parked vehicle. The vehicle also includes a controller that processes the detected signals, determines the distance and location of the detected objects relative to the doors, and identifies a parking space for the vehicle in a garage when the closing doors are not in contact with an object in the garage when in the open position and are not in contact with powered closing doors on the parked vehicle.An output is provided to assist the driver of the vehicle in parking the vehicle in the garage in the designated parking space. Brief description of the accompanying drawings

[0005] One embodiment of the disclosure is described with reference to the following accompanying drawings. Fig. Figure 1 illustrates a block diagram of a control system for evaluating a parking space for a vehicle according to an embodiment of the present invention, and Fig. Figure 2 illustrates different stages that are carried out during the entire process of evaluating a parking space for a vehicle, according to the present invention, and Fig. Figure 3 illustrates a vehicle, with a disability highlighted on one of the doors, according to an embodiment of the present invention. Detailed description of the embodiments

[0006] Fig. Figure 1 illustrates a block diagram of a controller for evaluating a parking space for a vehicle according to an embodiment of the present invention. The controller 102 is designed to detect the parking space 104 using at least one camera installed in the vehicle 100. The controller 102 determines a virtual parked position of the vehicle 100 in the parking space 104 based on real-time trajectory planning, and the trajectory planning takes into account predetermined parameters of the vehicle 100, characterized in that the controller 102 is designed to determine characteristics of the parking space 104 using at least one perception sensor installed in the vehicle 100.The control unit 102 is designed to determine, using a characteristic of the parking space 104, the possibility of an obstruction when opening at least one door 304 of the vehicle 100 in the virtual parked position and to notify a driver accordingly. The notification is displayed on the display screen of the vehicle 100 or on a connected device such as a smartphone or tablet.

[0007] The at least one camera is installed on one or more different parts of the vehicle 100, e.g., on the front of the vehicle 100, on the rear of the vehicle 100, on both mirrors, on any other part of the vehicle 100, etc. The at least one camera is part of a surround-view or 360-degree camera system. The perception sensor is designed to detect one or more instances of an object, e.g., another vehicle, a stationary object, etc., in the vicinity of the vehicle 100. The perception sensor detects a situation in and around the vehicle 100, and the controller 102 communicates with the proximity sensor, with reference to which the controller 102 evaluates the parking space 104 and determines the possibility of obstruction when opening at least one door 304 of the vehicle 100.The perception sensor can include, or be composed of, a camera, radar, lidar, microphone, or any combination thereof. Control unit 102 notifies the driver, who then makes a timely decision.

[0008] According to the embodiment of the present invention, the control unit 102 determines the obstruction before the vehicle 100 is parked in the parking space 104. Determining obstructions in a timely manner helps the driver decide whether to park the vehicle 100 or find a new parking space 104. Making this timely decision avoids unnecessary effort and saves fuel.

[0009] According to the embodiment of the present invention, the predetermined vehicle parameter is selected from a group that includes a vehicle length 306, a vehicle width 308, a vehicle door length 304, a vehicle door width 304, a trunk door of the vehicle 100, and a ground clearance, etc. Based on these vehicle parameters, the controller 102 determines an obstruction to opening the door 304 before the vehicle 100 is parked. The controller 102 uses augmented reality to display a three-dimensional (3D) model of the virtual parked vehicle. The three-dimensional model of the vehicle 100 can be viewed from different angles. The augmented reality-based program or application uses cameras and sensor technology installed in the vehicle 100 and adds virtual objects to the real world, overlaying information from the road view onto a display in the vehicle.The information is viewed on any of the following devices: the windshield, an infotainment display, any additional screen installed in the vehicle 100, etc. This gives the driver the option to zoom in and out on any section of the three-dimensional view of the parked vehicle 100. The option to view the vehicle 100 from different angles helps the driver determine which door 304 is obstructed once the vehicle 100 is parked. For example, if the obstruction is on the rear left door 304 and a passenger is seated on the rear right side, the driver can confidently make this decision based on the three-dimensional view.

[0010] According to the embodiment of the present invention, the door 304 in the virtual vehicle, which is positioned in the parked position, is highlighted with several colors 302 based on the severity of the obstruction and the space available for opening the door 304, which is displayed to the driver in the three-dimensional view. The door 304 that exhibits an obstruction during opening is highlighted with color 302. The door 304 highlighted with red color 302 indicates a high probability of striking another car, the adjacent car, or an object. The door 304 highlighted with yellow color 302 indicates that the probability of striking is moderate, and in the case of green color 302 or no color, that there is no probability of the door 304 striking and that there is sufficient space to open the door 304.The color code for 302 can be changed on a case-by-case basis and according to user preference. The color code for 302 helps the driver make decisions easily. Color 302 is displayed on the virtual parked car for quick and easy real-time decision-making.

[0011] According to one embodiment of the present invention, the controller 102 is provided with the necessary signal detection, acquisition, and processing circuits. The controller 102 comprises input interfaces, output interfaces with pins or ports, a memory element such as random access memory (RAM) and / or read-only memory (ROM), analog-to-digital converters (ADCs) and digital-to-analog converters (DACs), clocks, timers, counters, and at least one processor (capable of implementing machine learning), which are interconnected and connected to other components via communication bus channels. Logic, instructions, programs, applications, modules / models, and / or thresholds / ranges, reference values, predefined / predetermined criteria / conditions are pre-stored in the memory element (not shown), which the at least one processor accesses according to the defined routines.The internal components of the Controller 102 are not described, as they are state-of-the-art, and this need not be interpreted restrictively. The Controller 102 may also include communication units, such as transceivers for communication via wireless or wired means, such as Global System for Mobile Communications (GSM), 3G, 4G, 5G, WiFi, Bluetooth, Ethernet, serial networks, and the like. The Controller 102 can be implemented as a System-in-Package (SiP), System-on-Chip (SOC), or any other known type. Examples of the Controller 102 include, but are not limited to, microcontrollers, microprocessors, microcomputers, electronic control units (ECUs), etc.

[0012] According to the embodiment of the present invention, a mode of operation for the control unit 102 is envisaged. Consider that a vehicle 100, such as a car, is driven into a parking space. The car's control unit 102 is activated to evaluate the parking space 104 for the vehicle 100. As the car enters the parking space, the control unit 102 detects the parking space 104 (or multiple parking spaces) using at least one camera installed in the vehicle 100. After detection, the control unit 102 determines the virtual parked position of the vehicle 100 in the parking space 104 based on trajectory planning. The control unit 102 determines characteristics of the parking space 104 using at least one perception sensor installed in the vehicle 100. The perception sensor identifies the object in the vicinity of the vehicle 100.Based on the output of the perception sensor, the control unit 102 calculates the possibility of obstruction while opening at least one door 304 of the vehicle 100 in the virtual parked position and notifies the driver accordingly.

[0013] According to the present invention, the controller 102 uses augmented reality to display a three-dimensional model of the virtually parked vehicle 100, with the three-dimensional model showing the vehicle 100 from different angles. The three-dimensional display provides an option to zoom in or out of any section of the view. The display indicates obstructions during the opening of the door 304 using a color code 302. If there is no space or insufficient space while opening the door 304, the door 304 is highlighted in red 302. If there is sufficient space, the door 304 is highlighted in green 302. This information helps the driver make decisions while driving the vehicle 100 to the parking space 104.If vehicle 100 is equipped with a remote parking feature, control unit 102 recommends that the driver use a remote parking feature to park vehicle 100. If the remote parking feature is not available, control unit 102 provides the driver with an appropriate warning message to help the driver make an informed decision and avoid unnecessary effort.

[0014] According to the present invention, the parking space 104 is located indoors or outdoors, i.e., inside a building, a house, an office, a property, outside a shop, a shopping center, a theater, etc. These parking spaces have walls surrounding the parking space 104, vehicles in and around the parking space 104, and any other type of temporary or permanent structure or object, which act as an obstruction when opening any of the vehicle doors 304. Due to these obstructions, the space for opening the door 304 is insufficient, a fact the driver cannot determine until the vehicle 100 is parked. If the driver is unaware of the situation, it takes time, once the vehicle 100 has been parked, to move the vehicle 100 out of the parking space and find a new parking space 104. This problem persists until the driver finds a new parking space 104 with sufficient space.

[0015] According to the present invention, the controller 102 detects the parking space 104 using at least one camera installed in the vehicle 100. The parking space 104 is also detected using another perception sensor installed in the vehicle 100, or a combination of information received using the camera and the perception sensor. The perception sensors are selected from a group including ultrasonic sensors, radar, or sensors of a driver assistance system (DAS), etc. The controller 102 receives an input and evaluates the parking space 104 before the vehicle 100 is positioned in the parking space 104.

[0016] According to the present invention, the controller 102 and the predictive method for evaluating the parking space 104 for the vehicle 100 are disclosed. The controller 102 detects the parking space 104 using at least one camera installed in the vehicle 100 and determines the possibility of obstruction when opening at least one door 304 of the vehicle 100 in the virtual parked position using the characteristics of the parking space 104, and notifies the driver accordingly. The controller 102 determines the obstruction before the vehicle 100 is parked in the parking space 104 and uses augmented reality to display a three-dimensional model of the virtual parked vehicle 100 to the driver from different angles. The controller 102 provides the driver with warning messages in the event of insufficient space to open the door 304.The information helps the driver make informed decisions and avoid unnecessary effort. This saves time and prevents collisions and dents to the vehicle 100 in the case of an inadequate parking space 104.

[0017] Fig. Figure 2 illustrates different stages performed during the entire process of evaluating the parking space for vehicle 100 according to the present invention. The method comprises a plurality of steps, with step 202 comprising the detection, by the controller 102, of the parking space 104 using at least one camera installed in vehicle 100. Step 204 comprises the determination, by the controller 102, of the virtual parking position of vehicle 100 in the parking space 104 based on trajectory planning, wherein the trajectory planning takes into account predetermined parameters of vehicle 100. The method is characterized by step 206, which comprises the determination, by the controller 102, of characteristics of the parking space 104 using at least one of the perception sensors installed in vehicle 100.Step 208 includes calculating, by the control 102, the possibility of obstruction when opening at least one door 304 of the vehicle 100 in the specified virtual parked position using the characteristics of the parking space 104 and notifying the driver accordingly.

[0018] According to the procedure, step 208 involves determining the obstruction before vehicle 100 is parked in parking space 104. The procedure includes determining, by control 102, the virtual parking position of vehicle 100 in parking space 104 based on trajectory planning, which takes into account predetermined vehicle parameters. These predetermined vehicle parameters are selected from a group that includes vehicle length 306 and vehicle width 308, the length and width of vehicle door 304, the height of the vehicle trunk door, ground clearance, etc. The procedure further includes using, by control 102, augmented reality to display the three-dimensional model of the virtually parked vehicle 100. The three-dimensional model of vehicle 100 can be viewed from different angles.The procedure further includes highlighting, by control 102, the door 304 with several colors based on the severity of the obstruction during the opening of at least the door 304 and the space available for opening the door 304. This information is displayed to the driver, which aids in decision-making before the vehicle 100 is parked in the parking space 104. This decision avoids unnecessary effort when parking the vehicle 100 in the parking space 104 with insufficient space while opening the door 304.

[0019] Fig.Figure 3 illustrates the vehicle 100 with an obstruction at door 304 according to an embodiment of the present invention. The highlighted part of door 304 shows the obstructions during the opening of the door 304. These obstructions are displayed to the driver, indicating insufficient space. For illustrative purposes, only one side of door 304 is shown in the figure, and the control unit 102 displays the information to the driver. This information helps the driver to make timely decisions and avoid unnecessarily parking the vehicle 100 in the parking space 104 with insufficient space.

[0020] It should be understood that the embodiments described above are for illustrative purposes only and do not limit the scope of protection of this invention. Many such embodiments and other modifications and changes to the embodiment described are considered. The scope of protection of the invention is limited only by the scope of protection of the claims. QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] US 2023016676

[0004]

Claims

[1] Control unit (102) for evaluating a parking space (104) for a vehicle (100), wherein the control unit (102) is designed to: a. Detecting the parking space (104) using at least one camera installed in the vehicle (100), b. Determining a virtual parked position of the vehicle (100) in the parking space (104) based on trajectory planning, wherein the trajectory planning takes into account predetermined parameters of the vehicle (100), characterized by c. Determining a characteristic of the parking space (104) using at least one perception sensor installed in the vehicle (100); d. Determining a possibility of obstruction in opening at least one door (304) of the vehicle (100) in the virtual parked position using the characteristics of the parking space (104) and notifying a driver accordingly. [2] Control (102) according to claim 1, which determines the obstruction before the vehicle (100) is parked in the parking space (104). [3] Control (102) according to claim 1, wherein the predetermined vehicle parameters are selected from a group comprising a vehicle length (306) and a vehicle width (308), a length and width of the side door (304) of the vehicle (100), opening height of the trunk door of the vehicle (100). [4] Control (102) according to claim 1, which uses augmented reality to display a three-dimensional model of the virtual parked vehicle (100) on a display screen, wherein the three-dimensional model of the vehicle (100) can be viewed from different angles. [5] Control (102) according to claim 4, wherein within the three-dimensional model the door (304) is highlighted with several colors (302) based on the severity of the disability and the space available to open the door (304). [6] Method for evaluating a parking space (104) for a vehicle (100), wherein the method is carried out by a controller (102), the method comprising the following steps: a. Detecting a parking space (104) using at least one camera installed in the vehicle (100), b. Determining a virtual parking position of the vehicle (100) in the parking space (104) based on trajectory planning, wherein the trajectory planning takes into account predetermined vehicle parameters, characterized by c. Determining characteristics of the parking space (104) using at least one perception sensor installed in the vehicle (100); d. Determining a possibility of obstruction in the opening of at least one door (304) of the vehicle (100) in the specified virtual parked position using the characteristics of the parking space (104) and notifying a driver accordingly. [7] Method according to claim 6, comprising determining the obstruction before the vehicle (100) is parked in the parking space (104). [8] Method according to claim 6, wherein the predetermined vehicle parameters are selected from a group comprising a vehicle length (306) and a vehicle width (308), a length and width of the side door (304) of the vehicle (100), and the opening height of the trunk door of the vehicle (100). [9] Method according to claim 6, comprising using augmented reality to display a three-dimensional model of the virtually parked vehicle (100) on a display screen, wherein the three-dimensional model of the vehicle (100) can be viewed from different angles. [10] Method according to claim 9, comprising highlighting the door (304) with multiple colours (302) based on the severity of the obstruction and the space available to open the door (304).

Images