Wheel hub warning method, device, vehicle and storage medium
Through the principle of high-precision map and camera distance measurement, the distance between the wheel and the obstacle is accurately detected and alarms are sent, which solves the monitoring blind spots and fuzzy problems of the wheel hub alarm device in the prior art, and improves the accuracy and safety of the wheel hub warning.
Patent Information
- Application Number
- CN202211394833.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-11-08
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2042-11-08
AI Technical Summary
The existing wheel hub alarm device cannot accurately detect the distance between the wheel and the obstacle due to the blind spots of ultrasonic radar and the blurred image edges of the surround camera, resulting in failure to issue an alarm in time, causing damage to the wheel hub.
Using high-precision maps combined with vehicle location and reference objects, the distance between the wheel hub and the obstacle is indirectly determined through the camera distance measurement principle, and alarm signals are sent to remind the driver of possible collision risks, and through the host display screen, steering wheel vibration and seat vibration, etc. Method to enhance the driver's attention.
It effectively avoids collision between wheel hubs and obstacles, improves driving safety, and saves additional sensor costs through the use of high-precision maps.
Smart Images

Figure CN115891827B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of vehicle safety, and more specifically, to a method, a device, a vehicle and a storage medium for wheel hub warning in the field of vehicle safety. Background Art
[0002] With the development of my country's economy and the vehicle industry, people's living standards have gradually improved, and vehicles have become an important means of transportation for people. During the driving process, due to the driver's blind spot, the wheel hub of the vehicle may scrape against various obstacles (such as curbs), which may cause irreparable damage to the wheel hub and bring economic losses to the driver.
[0003] In the related technology, the environmental information around the wheels is mainly monitored by ultrasonic radar and surround-view cameras on the vehicle during driving. When the wheels are close to obstacles, the wheel hub alarm device sends out an alarm signal.
[0004] In the above wheel hub alarm device, there is a blind spot in the ultrasonic radar, which makes it unable to monitor certain obstacles; when the surround view camera monitors all obstacles near the vehicle, the edges of the obstacle images taken are likely to be blurred, so the surround view camera cannot monitor certain obstacles. In this regard, the above wheel hub alarm device may implement an alarm in the following ways: the wheel is very close to the obstacle, but the wheel hub alarm device does not alarm, and the wheel hub is damaged. Summary of the invention
[0005] The present application provides a wheel hub early warning method, device, vehicle and storage medium, which can prevent the wheel hub from colliding with an obstacle.
[0006] In a first aspect, a method for wheel hub warning is provided, the method comprising: determining environmental information around the vehicle based on the position of the vehicle and a high-precision map; processing the environmental information to determine obstacles and at least one reference object around a target wheel of the vehicle; determining the relative position between the at least one reference object and the wheel hub when the distance between the wheel hub of the target wheel and the obstacle is less than a first preset distance; determining the distance between the wheel hub and the obstacle based on the relative position between the at least one reference object and the wheel hub, and the positions of the at least one reference object and the obstacle in the high-precision map; sending an alarm signal when the distance between the wheel hub and the obstacle is less than a second preset distance, the alarm signal being used to prompt the driver of the vehicle that there is a potential collision risk between the wheel hub and the obstacle.
[0007] In the above technical solution, based on the high-precision map, the environmental information around the vehicle is accurately obtained based on the position of the vehicle in the high-precision map; the environmental information is processed to determine the obstacles and at least one reference object around the target wheel; when the hub of the target wheel is close to the obstacle (the distance between the hub and the obstacle is less than the first preset distance), since the camera adjacent to the hub is close to the obstacle, the field of view of the camera may be blocked and the accurate distance between the hub and the obstacle cannot be detected, so the relative position between at least one reference object and the hub can be determined; and then based on the position of at least one reference object and the obstacle in the high-precision map, the distance between the hub and the obstacle can be accurately calculated. In this application, when the distance between the hub and the obstacle is less than the second preset distance, an alarm signal is sent to prompt the driver of the vehicle that the hub may collide with the obstacle. This allows the driver to take corresponding collision avoidance measures to avoid collision between the hub and the obstacle.
[0008] It should be understood that the "high-precision map" in the above solution can be understood as an image with high precision, high dynamics and multiple dimensions containing road information. Among them, the high precision of the high-precision map can reach the centimeter level. High dynamics refers to the real-time nature of the high-precision map. Multi-dimensionality means that the high-precision map contains information of multiple dimensions. For example, the high-precision map contains various road marking lines, traffic lights, guardrails, roadside buildings, various road signs, speed bumps, no parking areas and curbs, etc.
[0009] It should be understood that a reference object can be understood as an object that serves as a reference in order to prevent a device on the vehicle from colliding with an object during the driving process of the vehicle. For example, the relative positions of the curb and the street lamp are known. In the scenario where the vehicle is backing into a garage, in order to prevent the wheels of the vehicle from colliding with the curb on the side of the road, the driver can refer to the position of the street lamp and park the vehicle in the garage. Among them, the reference object is the street lamp. Obstacles can be understood as objects that the device on the vehicle collides with during the driving process of the vehicle and have a destructive effect on the device. For example, curbs, guardrails, etc.
[0010] It should also be understood that there is no clear-cut distinction between reference objects and obstacles. In some cases, obstacles can also serve as reference objects; and in other cases, reference objects can also serve as obstacles.
[0011] In combination with the first aspect, in some possible implementations, environmental information around the vehicle is determined based on the vehicle's position and a high-precision map, including: determining the position of the vehicle in the high-precision map based on the vehicle's position and the high-precision map; determining the environmental information around the vehicle in the high-precision map based on the vehicle's position in the high-precision map.
[0012] In the above technical solution, due to the high-precision characteristics of the high-precision map, the environmental information around the vehicle can be determined in the high-precision map by determining the position of the vehicle in the high-precision map. In this way, the environmental information of various objects around the vehicle can be accurately determined, for example, the position information of various reference objects around the vehicle and the position information of obstacles can be determined.
[0013] In combination with the first aspect and the above-mentioned implementation methods, in some possible implementation methods, determining the relative position between the at least one reference object and the wheel hub includes: obtaining the relative position between the at least one reference object and a camera that captures an image of the at least one reference object; based on the relative position between the wheel hub and the camera, and the relative position between the at least one reference object and the camera, determining the relative position between the at least one reference object and the wheel hub.
[0014] In the above technical solution, since the installation position of the camera that collects the image of the at least one reference object on the vehicle is determined, the relative position between the at least one reference object detected by the camera and the camera can be obtained based on the ranging principle of the camera; furthermore, the installation position of the target wheel on the vehicle is also determined, and the wheel hub is on the target wheel, so the relative position between the at least one reference object and the wheel hub can be determined based on the relative position between the wheel hub and the camera, and the relative position between the at least one reference object and the camera. In other words, the relative position between the at least one reference object and the wheel hub can be indirectly determined by the camera originally installed on the vehicle without the need for additional sensors, which can save costs.
[0015] In combination with the first aspect and the above-mentioned implementation methods, in some possible implementation methods, based on the relative position between the at least one reference object and the wheel hub, and the positions of the at least one reference object and the obstacle in the high-precision map, the distance between the wheel hub and the obstacle is determined, including: based on the relative position between the at least one reference object and the wheel hub, and the position of the at least one reference object in the high-precision map, determining the position of the wheel hub in the high-precision map; based on the position of the wheel hub in the high-precision map and the position of the obstacle in the high-precision map, determining the distance between the wheel hub and the obstacle.
[0016] In the above technical scheme, under the conclusion that the position of another object (the second object or the first object) can be uniquely determined by knowing the relative position between the first object and the second object and the position of any object (the first object or the second object), the above scheme determines the position of the wheel hub in the high-precision map based on the relative position between at least one reference object and the wheel hub, and the position of at least one reference object in the high-precision map; since the high-precision map is unique, the relative position between the wheel hub and the obstacle can be accurately calculated in the high-precision map based on the position of the obstacle in the high-precision map, and the distance between the wheel hub and the obstacle can be accurately obtained.
[0017] In combination with the first aspect and the above-mentioned implementation methods, in some possible implementation methods, environmental information around the vehicle is determined based on the vehicle's position and a high-precision map, including: when the vehicle's driving speed is less than a preset speed, environmental information around the vehicle is determined based on the vehicle's position and a high-precision map.
[0018] In the above technical solution, in the scenario where the vehicle is parked on the side of the road, when the vehicle's driving speed is less than a preset speed, the environmental information around the vehicle can be accurately determined based on the high-precision map and the vehicle's position, and it can be determined based on the environmental information whether the device on the vehicle will scrape against an obstacle. If the vehicle's driving speed is very high, the vehicle's position changes faster, and when the vehicle is parked on the side of the road, the device on the vehicle will easily scrape against obstacles in the vehicle's surrounding environment.
[0019] In combination with the first aspect and the above-mentioned implementation methods, in some possible implementation methods, after sending the alarm signal, the method also includes: displaying information corresponding to the alarm signal on the host display screen of the vehicle, the information being used to indicate that the wheel hub is away from the obstacle when the vehicle is driving based on the adjustment parameters; and / or, controlling the steering wheel of the vehicle to vibrate based on the alarm signal; and / or, controlling the seat of the vehicle to vibrate based on the alarm signal.
[0020] In the above technical solution, after sending the alarm signal, the collision between the wheel hub and the obstacle can be further avoided. The adjustment parameters of the vehicle driving can be displayed on the host display screen, and the adjustment parameters can keep the wheel hub away from the obstacle when the vehicle is driving; the alarm signal of the steering wheel vibration and the alarm signal of the seat vibration can increase the probability that the driver will notice that the wheel hub may collide with the obstacle, so that the driver can take corresponding collision avoidance measures, which is more conducive to safe driving.
[0021] In combination with the first aspect and the above-mentioned implementations, in some possible implementations, the method further includes: controlling the vehicle to stop driving when the distance between the wheel hub and the obstacle is less than a third preset distance.
[0022] In the above technical solution, when the distance between the wheel hub and the obstacle is less than the third preset distance, the position of the target wheel is not adjusted, but the vehicle is directly controlled to stop running, so as to avoid the situation that the wheel hub collides with the obstacle when the position of the target wheel is adjusted.
[0023] In summary, the present application proposes a method for wheel hub warning, which uses a high-precision map as a basis, and based on the position of the vehicle in the high-precision map, accurately obtains environmental information around the vehicle; processes the environmental information to determine obstacles and at least one reference object around the target wheel; when the wheel hub of the target wheel is close to the obstacle (the distance between the wheel hub and the obstacle is less than the first preset distance), since the camera adjacent to the wheel hub is relatively close to the obstacle, the field of view of the camera may be blocked and the accurate distance between the wheel hub and the obstacle cannot be detected, so the relative position between at least one reference object and the wheel hub can be determined; and then based on the position of at least one reference object and the obstacle in the high-precision map, the distance between the wheel hub and the obstacle can be accurately calculated. In the present application, when the distance between the wheel hub and the obstacle is less than the second preset distance, an alarm signal is sent to prompt the driver of the vehicle that the wheel hub may collide with the obstacle. This allows the driver to take corresponding collision avoidance measures to avoid collision between the wheel hub and the obstacle.
[0024] In addition, since the installation position of the camera for collecting the image of at least one reference object on the vehicle is determined, the relative position between at least one reference object detected by the camera and the camera can be obtained based on the ranging principle of the camera; furthermore, the installation position of the target wheel on the vehicle is also determined, and the wheel hub is on the target wheel, so the relative position between at least one reference object and the target wheel can be determined based on the relative position between the wheel hub and the camera, and the relative position between at least one reference object and the camera. In other words, the relative position between at least one reference object and the wheel hub can be indirectly determined by the camera originally installed on the vehicle without the need for additional sensors, which can save costs.
[0025] Furthermore, under the conclusion that the position of another object (the second object or the first object) can be uniquely determined by knowing the relative position between the first object and the second object and the position of any object (the first object or the second object), the above scheme determines the position of the wheel hub in the high-precision map based on the relative position between at least one reference object and the wheel hub and the position of at least one reference object in the high-precision map; since the high-precision map is unique, the relative position between the wheel hub and the obstacle can be accurately calculated in the high-precision map based on the position of the obstacle in the high-precision map, and the distance between the wheel hub and the obstacle can be accurately obtained.
[0026] Finally, when the distance between the wheel hub and the obstacle is less than the first preset distance, an alarm signal can be sent; that is, when the wheel hub is close to an obstacle, an alarm signal can be sent, and the alarm signal can prompt the driver of the vehicle that the wheel hub of the target wheel may collide with the obstacle, so that the driver can take corresponding collision avoidance measures, etc.
[0027] In a second aspect, a wheel hub warning device is provided, which includes: a determination module, which is used to: determine environmental information around the vehicle based on the vehicle's position and a high-precision map; process the environmental information to determine obstacles and at least one reference object around a target wheel of the vehicle; determine the relative position between the at least one reference object and the wheel hub when the distance between the wheel hub of the target wheel and the obstacle is less than a first preset distance; determine the distance between the wheel hub and the obstacle based on the relative position between the at least one reference object and the target wheel, and the positions of the at least one reference object and the obstacle in the high-precision map; a sending module, which is used to send an alarm signal when the distance between the wheel hub and the obstacle is less than a second preset distance, and the alarm signal is used to prompt the driver of the vehicle that there is a collision hazard between the wheel hub and the obstacle.
[0028] In combination with the second aspect, in some possible implementations, the determination module is specifically used to determine the position of the vehicle in the high-precision map based on the position of the vehicle and the high-precision map; and determine the environmental information around the vehicle in the high-precision map based on the position of the vehicle in the high-precision map.
[0029] In combination with the second aspect and the above-mentioned implementation methods, in some possible implementation methods, the determination module is specifically used to obtain the relative position between the at least one reference object and the camera that captures the image of the at least one reference object; based on the relative position between the wheel hub and the camera, and the relative position between the at least one reference object and the camera, determine the relative position between the at least one reference object and the wheel hub.
[0030] In combination with the second aspect and the above-mentioned implementation methods, in some possible implementation methods, the determination module is specifically used to determine the position of the wheel hub in the high-precision map based on the relative position between at least one reference object and the wheel hub and the position of the at least one reference object in the high-precision map; and determine the distance between the wheel hub and the obstacle based on the position of the wheel hub in the high-precision map and the position of the obstacle in the high-precision map.
[0031] In combination with the second aspect and the above-mentioned implementation methods, in some possible implementation methods, the determination module is specifically used to determine the environmental information around the vehicle based on the vehicle's position and high-precision map when the vehicle's driving speed is less than a preset speed.
[0032] In combination with the second aspect and the above-mentioned implementation methods, in some possible implementation methods, the device also includes: a control module, used to: display information corresponding to the alarm signal on the host display screen of the vehicle, the information being used to indicate that the wheel hub is away from the obstacle when the vehicle is driving based on the adjustment parameters; and / or, controlling the steering wheel of the vehicle to vibrate based on the alarm signal; and / or, controlling the seat of the vehicle to vibrate based on the alarm signal.
[0033] In combination with the second aspect and the above-mentioned implementations, in some possible implementations, the control module is further used to control the vehicle to stop driving when the distance between the wheel hub and the obstacle is less than a third preset distance.
[0034] In a third aspect, a vehicle is provided, comprising a memory, a processor, and a computer program stored in the memory and running on the processor, wherein when the processor executes the computer program, the vehicle executes the method in the above-mentioned first aspect or any possible implementation of the first aspect.
[0035] In a fourth aspect, a computer-readable storage medium is provided, which stores instructions. When the instructions are executed on a computer or a processor, the computer or the processor executes the method in the first aspect or any possible implementation of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0036] Figure 1 is a scene diagram of vehicle driving provided by an embodiment of the present application;
[0037] Figure 2 is a schematic flow chart of a wheel hub early warning method provided in an embodiment of the present application;
[0038] Figure 3 is a schematic diagram of determining a relative position between at least one reference object and a wheel hub provided by an embodiment of the present application;
[0039] Figure 4 is a schematic diagram of determining the distance between a wheel hub and an obstacle provided in an embodiment of the present application;
[0040] Figure 5 It is a structural schematic diagram of a wheel hub early warning device provided in an embodiment of the present application;
[0041] Figure 6 It is a structural schematic diagram of a vehicle provided in an embodiment of the present application. DETAILED DESCRIPTION
[0042] The technical solutions in the present application will be described clearly and in detail below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, "multiple" refers to two or more than two. The terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of technical features indicated. Thus, features defined as "first", "second", "third" and "fourth" may explicitly or implicitly include one or more of the features.
[0043] Figure 1 It is a vehicle driving scene diagram provided in an embodiment of the present application.
[0044] For example, Figure 1 In the scene diagram shown, when the driver parks the vehicle from the left side of the garage, the ultrasonic radar installed on the vehicle has a visual blind spot or the distance between the first surround-view camera M and the curb is too close (causing the image of the curb captured by the first surround-view camera to be blurred and the curb to be unable to be detected). As a result, the ultrasonic radar or the first surround-view camera on the vehicle may not detect that the left front wheel C is about to approach the curb, causing the left front wheel to collide with the curb and damage the wheel hub of the left front wheel.
[0045] It should be understood that the surround-view camera refers to multiple cameras installed around the vehicle body. For example, the surround-view camera includes 4 cameras (a first surround-view camera, a second surround-view camera, a third surround-view camera and a fourth surround-view camera). The 4 cameras can be installed above the front and rear license plates of the vehicle and on the left and right mirrors of the vehicle, respectively.
[0046] Figure 2 It is a schematic flow chart of a wheel hub warning method provided in an embodiment of the present application.
[0047] It should be understood that the wheel hub warning method provided in the embodiment of the present application can be applied to Figure 1 The vehicle shown can obtain the high-precision map required for vehicle driving; specifically, the method of sending an alarm signal is applied to a controller included in the vehicle, which can obtain the high-precision map required for vehicle driving.
[0048] For example, Figure 2 As shown, the method includes:
[0049] 201, the controller determines the environmental information around the vehicle based on the vehicle's position and the high-precision map.
[0050] It should be understood that the "high-precision map" in the above step 201 can be understood as an image containing road information with high precision, high dynamics and multiple dimensions. Among them, the high precision of the high-precision map can reach the centimeter level. High dynamics refers to the real-time nature of the high-precision map. For example, the high-precision map can reflect the changes of vehicles on different roads in real time. Multi-dimensionality means that the high-precision map contains information of multiple dimensions. For example, the high-precision map contains various road marking lines, traffic lights, guardrails, roadside buildings, various road signs, speed bumps, no parking areas and curbs, etc.
[0051] As follows, the process of determining the position of a vehicle is discussed in two implementations.
[0052] In a possible implementation, the controller obtains the position of the vehicle through a positioning device on the vehicle.
[0053] Optionally, in some embodiments, the positioning device may be a device that performs positioning based on the Global Positioning System (GPS) technology, or a device that performs positioning based on Beidou satellites.
[0054] In another possible implementation, the controller obtains the location of the vehicle through application software on an onboard terminal of the vehicle.
[0055] Optionally, the location of the vehicle is obtained by inputting the vehicle information into application software, and the vehicle information is used to identify a vehicle.
[0056] It should be understood that the vehicle information may be the vehicle number of the vehicle, or the identity information of the vehicle owner, etc.
[0057] In one possible implementation, step 201 includes: when the vehicle's driving speed is less than a preset speed, the controller determines environmental information around the vehicle based on the vehicle's position and a high-precision map.
[0058] It should be understood that the "environmental information" in the above embodiments can be understood as information about various objects around the vehicle in the high-precision map, which can be information about various marking lines on the road, such as semantic information (give way to pedestrians) or shape information (zebra crossing) or position information of crosswalks; it can also be information about various objects on the curb, such as semantic information (night lighting) or shape information (height of street lights, etc.) or position information of street lamps.
[0059] In the above technical solution, in the scenario where the vehicle is parked on the side of the road, when the vehicle's driving speed is less than a preset speed, the environmental information around the vehicle can be accurately determined based on the high-precision map and the vehicle's position, and it can be determined based on the environmental information whether the device on the vehicle will scrape against an obstacle. If the vehicle's driving speed is very high, the vehicle's position changes faster, and when the vehicle is parked on the side of the road, the device on the vehicle will easily scrape against obstacles in the vehicle's surrounding environment.
[0060] In one possible implementation, the controller determines environmental information around the vehicle based on the position of the vehicle and a high-precision map, including: the controller determines the position of the vehicle in the high-precision map based on the position of the vehicle and the high-precision map; the controller determines the environmental information around the vehicle in the high-precision map based on the position of the vehicle in the high-precision map.
[0061] In the above technical solution, due to the high-precision characteristics of the high-precision map, the environmental information around the vehicle can be determined in the high-precision map by determining the position of the vehicle in the high-precision map. In this way, the environmental information of various objects around the vehicle can be accurately determined, for example, the position information of various reference objects around the vehicle and the position information of obstacles can be determined.
[0062] 202 : The controller processes the environmental information to determine obstacles and at least one reference object around a target wheel of the vehicle.
[0063] It should be understood that the "obstacle" in the above step 202 can be understood as an object that the device on the vehicle collides with and has a destructive effect on the device during the driving of the vehicle. For example, a curb, a guardrail, etc. The "reference object" in step 202 can be understood as an object that serves as a reference in order to prevent the device on the vehicle from colliding with a certain object during the driving of the vehicle. For example, the relative position of the curb and the street lamp is known. In the scenario where the vehicle is backing into the garage, in order to prevent the wheel hub of the vehicle wheel from colliding with the curb on the roadside, the driver can refer to the position of the street lamp and park the vehicle in the garage, where the reference object is the street lamp and the obstacle is the curb.
[0064] It should also be understood that there is no clear-cut distinction between reference objects and obstacles. In some cases, obstacles can also serve as reference objects; and in other cases, reference objects can also serve as obstacles.
[0065] In one possible implementation, step 202 includes: the controller identifies multiple objects indicated by the environmental information and determines the properties of the multiple objects; when the properties of any object indicate that the object will cause damage to the hub of the target wheel, the object is determined to be an obstacle; when the properties of any object indicate that the object will not cause damage to the hub of the target wheel, the object is determined to be a reference object.
[0066] In the above technical scheme, the controller identifies the multiple objects and can determine the properties of the multiple objects. The properties of each object in the multiple objects can be used to accurately distinguish each object as an obstacle or a reference object. Then, in the subsequent scheme, the driving trajectory of the target wheel can be adjusted to avoid the collision between the wheel hub of the target wheel and the obstacle, rather than avoiding the collision between the wheel hub of the target wheel and the reference object, which can reduce the damage to the wheel hub.
[0067] 203 , when the distance between the hub of the target wheel and the obstacle is less than a first preset distance, the controller determines a relative position between the at least one reference object and the hub.
[0068] In one possible implementation, the controller determines the relative position between the at least one reference object and the wheel hub, including: the controller obtains the relative position between the at least one reference object and a camera that captures an image of the at least one reference object; the controller determines the relative position between the at least one reference object and the wheel hub based on the relative position between the wheel hub and the camera, and the relative position between the at least one reference object and the camera.
[0069] The camera that captures the image of the at least one reference object is not a camera adjacent to the target wheel. Therefore, when the target wheel approaches an obstacle, the camera adjacent to the target wheel has a blind spot and may not detect any object.
[0070] It should be understood that in the embodiments of the present application, "relative position" can be understood as information used to determine the position of things around an object with the position of the object itself as a reference point. For example, with the vehicle as the reference point, the street lamp is at the 2 o'clock direction of the vehicle and the distance from the vehicle is 1.5 meters, which is the relative position between the street lamp and the vehicle; for another example, with the street lamp as the reference point, the vehicle is at the 8 o'clock direction of the street lamp and the distance from the street lamp is 1.5 meters, which is the relative position between the vehicle and the street lamp.
[0071] Optionally, the type of the camera for capturing the image of the at least one reference object in the above embodiment may be monocular or binocular.
[0072] The installation position of the camera for collecting the image of the at least one reference object on the vehicle is determined. When the height of an object is known, the monocular camera can obtain the relative position between the object and the monocular camera based on the principle of pinhole imaging. The structure of the binocular camera is similar to that of human eyes, and it can obtain the relative position between the object and the binocular camera based on the principle of parallax.
[0073] It should be understood that no matter the camera that captures the image of the at least one reference object is a monocular camera or a binocular camera, the camera only determines the relative position with respect to one reference object at a time.
[0074] In the above technical solution, since the installation position of the camera that collects the image of the at least one reference object on the vehicle is determined, the camera (monocular camera or binocular camera) can determine the relative position between the at least one reference object and the camera; furthermore, since the installation position of the target wheel on the vehicle is also determined, the position of the wheel hub on the target wheel is also determined, so the relative position between the at least one reference object and the wheel hub can be accurately calculated based on the relative position between the wheel hub and the camera, and the relative position between the at least one reference object and the camera. In other words, the relative position between the wheel hub of at least one reference object can be determined by the camera originally installed on the vehicle, without the need to install additional sensors on the vehicle, which can save costs.
[0075] It should be understood that the camera that captures the image of the at least one reference object can be a surround view camera, a side view camera, or a front and rear view camera, and the camera can capture images of various objects at least 4 meters away from the camera. Among them, the surround view camera includes multiple cameras, which can be installed at the four corners of the vehicle body respectively; the side view camera includes a left view camera and a right view camera, the left view camera can be installed on the left rearview mirror, and the right view camera can be installed on the right rearview mirror; the front and rear view cameras include a front view camera and a rear view camera, the front view camera can be installed above the front windshield of the vehicle, and the rear view camera can be installed above the rear windshield of the vehicle.
[0076] In one possible implementation, the camera that captures the image of the at least one reference object is a monocular camera, and the controller obtains the relative position between the at least one reference object and the camera, including: the controller obtains the angle of the at least one reference object through the camera that captures the image of the at least one reference object, and determines the direction of the at least one reference object relative to the camera; the controller determines the distance between the at least one reference object and the camera through the pinhole imaging principle and the similar triangle principle of the camera, and the relative position between the at least one reference object and the camera is the direction of the at least one reference object relative to the camera and the distance between the at least one reference object and the camera.
[0077] The process of “determining the relative position between the at least one reference object and the wheel hub” is described below in a possible implementation manner.
[0078] Figure 3 It is a schematic diagram of determining the relative position between at least one reference object and the hub of a target wheel provided in an embodiment of the present application.
[0079] For example, Figure 3 As shown in Figure (a), a vehicle is parked in a garage. Figure 3 When the vehicle is in the position shown in Figure (a), the obstacle is the curb next to the garage, the reference object is street lamp A, the target wheel is the left front wheel of the vehicle, and the wheel hub on the left front wheel is wheel hub C.
[0080] It is known that camera B is a monocular camera, and the camera B is located above the front windshield of the vehicle.
[0081] like Figure 3 As shown in Figure (a), when the hub C of the left front wheel is close to the curb (the distance between the hub C and the curb is less than 1 meter), based on the angle at which the camera B obtains the street lamp image, the camera B can determine the direction of the street lamp at 1 point of the camera B; and based on Figure 3 The pinhole imaging principle shown in Figure (b) is Figure 3 In Figure (b), the height of the street lamp's image in camera B is h, and the focal length of camera B is f. Based on the principle of similar triangles, camera B can determine that the distance L1 between the street lamp and camera B is (H*f / h) meters, so that the relative position between the street lamp and camera B is the direction of the street lamp at point 1 of camera B, and the distance between the street lamp and camera B is L1.
[0082] Based on the relative position between wheel hub C and camera B (wheel hub C is at 12:30 of camera B and the distance from camera B is L2 meters), and the relative position between street lamp and camera B, the controller can obtain the following: Figure 3 The wheel hub C, camera B and street lamp A shown in Figure (c) constitute triangle ABC, right triangle BOC and right triangle BOA. Figure 3In Figure (c), DE is parallel to GH, GH is parallel to FI, ∠FBG = ∠BAI, and the size of ∠ABG and ∠BAI is 30° (based on the street lamp at the 1 o'clock direction of camera B), ∠DCB = ∠CBH, and the size of ∠DCB and ∠CBH is 15° (based on the hub C at the 12:30 direction of camera B), AB is L1, and BC is L2. In triangle ABC, based on the size of ∠ABC (180° minus the size of ∠ABG plus the size of ∠CBH), the length of AB is L1, and the length of BC is L2, it can be determined that the length of AC is L3; in right triangles BOC and BOA, based on the lengths of AB, BC, and AC, the length of OC can be obtained; in right triangles BOC, based on the lengths of BC and OC, the size of ∠BCO can be obtained, and thus the size of ∠ACD (the sum of the size of ∠DCB and the size of ∠BCO) can be obtained. Therefore, the relative position between the street lamp A and the wheel hub C is determined as follows: the distance between the street lamp A and the wheel hub C is L3, the street lamp A is at the upper right corner of the wheel hub C, and the angle between the street lamp A and the wheel hub C in the vertical direction is ∠ACD.
[0083] 204. Based on the relative position between the at least one reference object and the wheel hub, and the positions of the at least one reference object and the obstacle in the high-precision map, the controller determines the distance between the wheel hub and the obstacle.
[0084] It should be understood that the position of at least one reference object and obstacle in a high-precision map can be determined by using high-precision positioning. "High-precision positioning" is a decimeter or centimeter-level positioning, which is a high-precision positioning technology that uses global satellite navigation technology, inertial measurement unit and carrier phase differential technology.
[0085] In one possible implementation, step 203 includes: the controller determines the position of the wheel hub in the high-precision map based on the relative position between the at least one reference object and the wheel hub and the position of the at least one reference object in the high-precision map; the controller determines the distance between the wheel hub and the obstacle based on the position of the wheel hub in the high-precision map and the position of the obstacle in the high-precision map.
[0086] In the above technical scheme, under the conclusion that the position of another object (the second object or the first object) can be uniquely determined by knowing the relative position between the first object and the second object and the position of any object (the first object or the second object), the above scheme determines the position of the wheel hub in the high-precision map based on the relative position between at least one reference object and the wheel hub, and the position of at least one reference object in the high-precision map; since the high-precision map is unique, the relative position between the wheel hub and the obstacle can be accurately calculated in the high-precision map based on the position of the obstacle in the high-precision map, and the distance between the wheel hub and the obstacle can be accurately obtained.
[0087] In one possible implementation, step 203 includes: the controller establishes a spatial rectangular coordinate system with the position of any object as the center in the high-precision map; the controller determines the coordinates of the wheel hub in the spatial rectangular coordinate system based on the relative position between the at least one reference object and the wheel hub and the coordinates of the at least one reference object in the spatial rectangular coordinate system; the controller determines the distance between the wheel hub and the obstacle based on the coordinates of the wheel hub and the coordinates of the obstacle in the spatial rectangular coordinate system.
[0088] The process of “determining the distance between the wheel hub and the obstacle” is described as follows in a possible implementation manner.
[0089] Figure 4 It is a schematic diagram of determining the distance between a wheel hub and an obstacle provided in an embodiment of the present application.
[0090] Exemplarily, taking the reference object as a street lamp, the obstacle as a curb, the target wheel as the left front wheel of the vehicle, and the wheel hub C on the left front wheel as an example, the distance between the wheel hub C and the curb is described.
[0091] by Figure 3 Take the scene shown in Figure (a) as an example, Figure 3 The relative position between the street lamp and the wheel hub determined by camera B in (a) is that the distance between the street lamp and the wheel hub is L3, the street lamp is at the upper right corner of the wheel hub, and the angle between the street lamp and the vertical direction of the wheel hub is ∠ACD. Figure 4 In the high-precision map shown, a spatial rectangular coordinate system is established with camera B as the center. Based on the relative position between the street lamp and the wheel hub, and the coordinates of the street lamp in the spatial rectangular coordinate system (a, b), the coordinates of the wheel hub in the spatial rectangular coordinate system (c, d) can be determined; the controller can then determine the distance between the wheel hub and the curb based on the coordinates of the curb in the spatial rectangular coordinate system (e, f).
[0092] 205. When the distance between the wheel hub and the obstacle is less than a second preset distance, the controller sends an alarm signal, which is used to remind the driver of the vehicle that there is a potential collision risk between the wheel hub and the obstacle.
[0093] In a possible implementation, the controller sends the alarm signal, including: the controller sends the alarm signal in the form of voice broadcast.
[0094] In the above technical solution, in some embodiments, the alarm signal can be broadcast in a loud voice, which can increase the warning effect, prompt the driver to drive the vehicle carefully, prompt the driver that the hub of the target wheel is too close to the obstacle, and the trajectory of the target wheel needs to be adjusted, etc.
[0095] In a possible implementation, after step 205, the following steps include: the controller displays information corresponding to the alarm signal on the host display screen of the vehicle, where the information is used to indicate that the hub of the target wheel is away from the obstacle when the vehicle is driving based on the adjusted parameters; and / or the controller controls the steering wheel of the vehicle to vibrate based on the alarm signal; and / or the controller controls the seat of the vehicle to vibrate based on the alarm signal.
[0096] In the above technical solution, the solution after the controller sends an alarm signal is described. After the controller sends the alarm signal, the controller can display the adjustment parameters of the vehicle driving on the host display screen, and the adjustment parameters can keep the wheel hub away from obstacles when the vehicle is driving; the alarm signal of the steering wheel vibration and the alarm signal of the seat vibration can increase the probability that the driver notices that the wheel hub may collide with an obstacle, so that the driver can take corresponding collision avoidance measures, which is more conducive to safe driving.
[0097] In a possible implementation, after step 205, the method further includes: when the distance between the wheel hub and the obstacle is less than a third preset distance, the controller controls the vehicle to stop traveling.
[0098] In the above technical solution, when the distance between the wheel hub and the obstacle is less than the third preset distance, the position of the target wheel is not adjusted, and the vehicle can be directly controlled to stop running. This can avoid the situation where the wheel hub of the target wheel collides with the obstacle during the process of adjusting the position of the target wheel.
[0099] It should be understood that the third preset distance is smaller than the second preset distance.
[0100] In the above technical solution, a severe situation is described in which the hub of the target wheel is very close to an obstacle (more severe than the situation in which the distance between the hub and the obstacle is less than the second preset distance). The vehicle can be directly controlled to stop to prevent the hub from colliding with the obstacle during the driver's adjustment of the target wheel's driving route after the controller sends an alarm signal.
[0101] Figure 5 It is a structural schematic diagram of a wheel hub warning device provided in an embodiment of the present application.
[0102] For example, Figure 5 As shown, the device comprises:
[0103] The determination module 501 is used to:
[0104] Determine the environmental information around the vehicle based on the vehicle's location and high-precision map;
[0105] Processing the environmental information to determine obstacles and at least one reference object around a target wheel of the vehicle;
[0106] When the distance between the hub of the target wheel and the obstacle is less than a first preset distance, determining a relative position between the at least one reference object and the hub;
[0107] Determining a distance between the wheel hub and the obstacle based on a relative position between at least one reference object and the wheel hub, and positions of the at least one reference object and the obstacle in the high-precision map;
[0108] The sending module 502 is used to send an alarm signal when the distance between the wheel hub and the obstacle is less than a second preset distance. The alarm signal is used to remind the driver of the vehicle that there is a potential collision risk between the wheel hub and the obstacle.
[0109] Optionally, the determination module 501 is specifically used to determine the position of the vehicle in the high-precision map based on the position of the vehicle and the high-precision map; based on the position of the vehicle in the high-precision map, determine the environmental information around the vehicle in the high-precision map.
[0110] Optionally, the determination module 501 is further specifically used to obtain the relative position between the at least one reference object and the camera that captures the image of the at least one reference object through a camera on the vehicle; based on the relative position between the wheel hub and the camera, and the relative position between the at least one reference object and the camera, determine the relative position between the at least one reference object and the wheel hub.
[0111] Optionally, the determination module 501 is further specifically used to determine the position of the wheel hub in the high-precision map based on the relative position between at least one reference object and the wheel hub and the position of the at least one reference object in the high-precision map; and determine the distance between the wheel hub and the obstacle based on the position of the wheel hub in the high-precision map and the position of the obstacle in the high-precision map.
[0112] Optionally, the determination module 501 is further specifically used to determine environmental information around the vehicle based on the vehicle's position and a high-precision map when the vehicle's driving speed is less than a preset speed.
[0113] Optionally, the device also includes: a control module, used to: display information corresponding to the alarm signal on the host display screen of the vehicle, the information being used to indicate that the wheel hub is away from the obstacle when the vehicle is traveling based on the adjusted parameters; and / or, controlling the steering wheel of the vehicle to vibrate based on the alarm signal; and / or, controlling the seat of the vehicle to vibrate based on the alarm signal.
[0114] Optionally, the control module is further used to control the vehicle to stop running when the distance between the wheel hub and the obstacle is less than a third preset distance.
[0115] Figure 6 It is a structural schematic diagram of a vehicle provided in an embodiment of the present application.
[0116] For example, Figure 6 As shown, the vehicle includes: a memory 601, a processor 602, and a computer program 603 stored in the memory 601 and running on the processor 602, wherein when the processor 602 executes the computer program 603, the vehicle can execute any one of the wheel hub warning methods introduced above.
[0117] In this embodiment, the functional modules of the vehicle can be divided according to the above method example. For example, each functional module can be corresponded, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.
[0118] In the case of dividing each functional module according to each function, the vehicle may include: a determination module, a trigger module, a control module, etc. It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, which will not be repeated here.
[0119] The vehicle provided in this embodiment is used to execute the above-mentioned wheel hub warning method, and thus can achieve the same effect as the above-mentioned implementation method.
[0120] In the case of an integrated unit, the vehicle may include a processing module and a storage module. The processing module may be used to control and manage the actions of the vehicle. The storage module may be used to support the vehicle to execute mutual program codes and data.
[0121] The processing module may be a processor or a controller, which may implement or execute various exemplary logic blocks, modules and circuits disclosed in the present application. The processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, etc. The storage module may be a memory.
[0122] This embodiment provides a computer-readable storage medium, in which instructions are stored. When the instructions are executed on a computer or a processor, the computer or the processor executes any one of the wheel hub warning methods described above.
[0123] This embodiment also provides a computer program product including instructions. When the computer program product is executed on a computer or a processor, the computer or the processor executes the above-mentioned related steps to implement any one of the wheel hub warning methods introduced above.
[0124] Among them, the vehicle, computer-readable storage medium, computer program product or chip containing instructions provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.
[0125] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0126] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0127] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A wheel hub early warning method, characterized in that: The method comprises: Determine the environment information around the vehicle based on the location of the vehicle and the high-precision map; Processing the environmental information to determine obstacles and at least one reference object around a target wheel of the vehicle; When the distance between the hub of the target wheel and the obstacle is less than a first preset distance, determining a relative position between the at least one reference object and the hub; Determining a distance between the wheel hub and the obstacle based on a relative position between at least one reference object and the wheel hub, and positions of the at least one reference object and the obstacle in the high-precision map; When the distance between the wheel hub and the obstacle is less than a second preset distance, an alarm signal is sent, wherein the alarm signal is used to remind the driver of the vehicle that there is a potential collision risk between the wheel hub and the obstacle.
2. The method according to claim 1, characterized in that The determining of the environmental information around the vehicle based on the position of the vehicle and the high-precision map includes: Based on the position of the vehicle and the high-precision map, determining the position of the vehicle in the high-precision map; Based on the position of the vehicle in the high-precision map, environmental information around the vehicle is determined in the high-precision map.
3. The method according to claim 1 or 2, characterized in that: Determining the relative position between the at least one reference object and the wheel hub comprises: Acquiring a relative position between the at least one reference object and a camera that captures an image of the at least one reference object; Based on the relative position between the wheel hub and the camera and the relative position between the at least one reference object and the camera, the relative position between the at least one reference object and the wheel hub is determined.
4. The method according to claim 1, characterized in that The determining the distance between the wheel hub and the obstacle based on the relative position between at least one reference object and the wheel hub, and the positions of the at least one reference object and the obstacle in the high-precision map, comprises: Determining the position of the wheel hub in the high-precision map based on the relative position between at least one reference object and the wheel hub and the position of the at least one reference object in the high-precision map; Based on the position of the wheel hub in the high-precision map and the position of the obstacle in the high-precision map, the distance between the wheel hub and the obstacle is determined.
5. The method according to claim 1, characterized in that The determining of the environmental information around the vehicle based on the position of the vehicle and the high-precision map includes: When the driving speed of the vehicle is less than a preset speed, environmental information around the vehicle is determined based on the vehicle's position and a high-precision map.
6. The method according to claim 1, characterized in that After sending the alarm signal, the method further includes: Displaying information corresponding to the alarm signal on a host display screen of the vehicle, the information being used to indicate that the wheel hub is away from the obstacle when the vehicle is traveling based on the adjustment parameters; and / or, Controlling the steering wheel of the vehicle to vibrate based on the alarm signal; and / or, The seat of the vehicle is controlled to vibrate based on the alarm signal.
7. The method according to claim 5 or 6, characterized in that: The method further comprises: When the distance between the wheel hub and the obstacle is less than a third preset distance, the vehicle is controlled to stop traveling.
8. A wheel hub early warning device, characterized in that: The device comprises: Identify modules for: Determine the environment information around the vehicle based on the location of the vehicle and the high-precision map; Processing the environmental information to determine obstacles and at least one reference object around a target wheel of the vehicle; When the distance between the hub of the target wheel and the obstacle is less than a first preset distance, determining a relative position between the at least one reference object and the hub; Determining a distance between the wheel hub and the obstacle based on a relative position between at least one reference object and the wheel hub, and positions of the at least one reference object and the obstacle in the high-precision map; The sending module is used to send an alarm signal when the distance between the wheel hub and the obstacle is less than a second preset distance, wherein the alarm signal is used to prompt the driver of the vehicle that there is a potential collision risk between the wheel hub and the obstacle.
9. A vehicle, characterized in that: It comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the vehicle executes the wheel hub warning method as described in any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, and when the instructions are executed on a computer or a processor, the computer or the processor executes the wheel hub warning method as described in any one of claims 1 to 7.
