Lidar device, cleaning method and vehicle

The lidar device employs a control unit to determine and clean specific areas on the window based on obstruction positions, addressing inefficiencies in existing systems by reducing resource waste and improving cleaning efficiency and detection performance.

JP2024543329AActive Publication Date: 2024-11-21YINWANG INTELLIGENT TECHNOLOGIES CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2024525503
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2021-10-29
Publication Date
2024-11-21
Estimated Expiration
2041-10-29

AI Technical Summary

Technical Problem

Existing lidar devices face inefficiencies in cleaning due to fixed or movable nozzle systems, leading to resource wastage and reduced detection performance when obstructions like dirt or leaves cover the window, necessitating a targeted cleaning solution.

Method used

A lidar device with a control unit that determines the cleaning target area based on positional information of obstructions on the window, using a combination of a detection unit, motor, and nozzle system to perform targeted cleaning, reducing resource consumption and improving efficiency.

Benefits of technology

The targeted cleaning method enhances the efficiency of lidar window cleaning by minimizing the use of resources and reducing the duration of cleaning intervals, thereby maintaining optimal lidar performance and extending the service life of the cleaning system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024543329000001_ABST
    Figure 2024543329000001_ABST
Patent Text Reader

Abstract

The embodiments of the present application provide a lidar device, a lidar cleaning method, and a vehicle. The lidar device includes a cleaning device and a control unit. The control unit is configured to determine a cleaning target area of ​​the lidar window based on position information of an obstruction on the lidar window, and control the cleaning device to clean the cleaning target area of ​​the lidar window. Compared with a conventional lidar device and a cleaning device of the lidar device, the embodiments of the present application can clean the obstruction in a targeted manner, thereby improving the lidar cleaning efficiency.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] TECHNICAL FIELD Embodiments of this application relate to the field of sensors, and more particularly, to LIDAR devices, LIDAR cleaning methods, and vehicles. [Background technology]

[0002] During the use of LIDAR, the window of the LIDAR is easily blocked by dirt, dust, or leaves in the environment. As a result, the detection performance of the LIDAR is reduced or the LIDAR is disabled. These obstructions attached to the window are usually removed by jetting water or air. The water jet cleaning system includes two solutions, namely fixed nozzle and movable nozzle. The fixed nozzle has a simple structure but a large volume and poor cleaning effect. The movable nozzle can scan and cover the window to achieve a good cleaning effect, but the nozzle system is complicated and the life is short.

[0003] In practical applications, whether using a fixed nozzle or a movable nozzle, a fixed program of the cleaning system is executed to clean the lidar. When the fixed program cleaning mode is started, the entire lidar window is cleaned. In the cleaning process, the cleaning mode requires a certain duration and a certain amount of cleaning agent, which is inefficient and causes a waste of resources. Summary of the Invention

[0004] Embodiments of the present application provide a lidar device, a lidar cleaning method, and a vehicle that can perform targeted cleaning based on the location of an obstruction on a lidar window, thereby improving the efficiency of cleaning the lidar window and reducing resource waste. [Means for solving the problem]

[0005] According to a first aspect, a lidar device is provided. The lidar device includes a cleaning device and a control unit. The control unit determines a cleaning target area of ​​the lidar window based on position information of an obstruction on the lidar window, and controls the cleaning device to clean the cleaning target area of ​​the lidar window.

[0006] In this embodiment of the application, a cleaning target area of ​​the lidar window may be determined based on the position information of the obstruction on the lidar window, and the cleaning device is controlled to perform specific area cleaning on the cleaning target area. Compared with the full cleaning mode in the conventional fixed mode, in this embodiment of the application, the obstruction can be cleaned in a targeted manner, thereby improving the cleaning efficiency of the lidar window and reducing the waste of resources.

[0007] Specifically, a conventional lidar cleaning device can only be used to clean the entire lidar window by a fixed program. In the full cleaning mode, once the mode is started, it takes a certain duration and a certain amount of cleaning agent. However, in most cases, the occlusion may only occupy a small range of the lidar window. In this case, the occlusion will affect the lidar signal and still need to be cleaned. If the lidar is still cleaned over a large range, the efficiency is low. In addition, since the lidar cannot operate during cleaning, the lidar operation interval will be long, thereby bringing safety risks to the operation of the vehicle. In another aspect, resources are wasted and cleaning agent is used excessively. In this embodiment of the application, targeted cleaning can be performed only on a part of the area related to the occlusion on the lidar window (e.g., the cleaning target area), so that the cleaning efficiency of the cleaning device can be improved, the lidar operation interval caused by the window cleaning can be shortened as much as possible, and only a small amount of cleaning agent is required, reducing resource waste.

[0008] In connection with the first aspect, in some implementations of the first aspect, the position information of the shield on the rider window includes the coordinate range of the shield on the rider window. The control unit determines the coordinate range of the cleaning target area based on the coordinate range of the shield on the rider window.

[0009] The shape of the shield is generally irregular. The position information of the shield and the cleaning target area are determined based on the coordinate range, whereby the processing can be simplified and the operation of the cleaning device can be facilitated in order to improve the cleaning efficiency of the rider window.

[0010] For example, the coordinate range may refer to the upper and lower limits of the coordinate values occupied by the shield or the cleaning target area in a specific coordinate system. For example, in a Cartesian coordinate system [X, Y], the coordinate range may be [X1, X2], [Y1, Y2], or a combination thereof, where X1 < X2 and Y1 < Y2. [X1, X2] is used as an example. X1 may be the minimum X coordinate value of the range occupied by the shield / cleaning target area, and X2 may be the maximum X coordinate value of the range occupied by the shield / cleaning target area. As another example, in a polar coordinate system [r, θ], the coordinate range may be [r1, r2], [θ1, θ2], or a combination thereof, where r1 < r2 and θ1 < θ2. It should be understood that the specific forms of the coordinate range of the shield and the coordinate range of the cleaning target area are not limited in this application.

[0011] In connection with the first aspect, in some implementations of the first aspect, the coordinate range of the cleaning target area is greater than or equal to the coordinate range of the shield on the rider window.

[0012] In this embodiment of the application, the determined coordinate range of the cleaning target area may be equal to or greater than the coordinate range of the obstruction on the lidar window based on the actual cleaning requirements. For example, the coordinate range of the cleaning target area may be essentially equal to the coordinate range of the obstruction on the lidar window, so as to perform cleaning of the lidar window in a targeted manner. As another example, the cleaning area of ​​the cleaning device may also be appropriately expanded so that the coordinate range of the cleaning target area is slightly larger than the coordinate range of the obstruction on the lidar window, so as to further improve the cleaning effect.

[0013] In relation to the first aspect, in some implementation forms of the first aspect, the lidar device further includes a detection unit, and the detection unit can acquire position information of an obstruction on the lidar window.

[0014] In this embodiment of the application, the detection unit may be located in the lidar body within the lidar device and connected to the control unit via a signal cable, or may be located outside the lidar body and connected to the control unit via a signal cable.

[0015] In relation to the first aspect, in some implementation forms of the first aspect, the cleaning device further includes a nozzle, a screw rod, a motor, and a guide rail, the motor being rotatably disposed on the screw rod to drive the nozzle to move along a defined trajectory of the guide rail.

[0016] In this embodiment of the application, the cleaning device uses a combined structure of a motor, a screw rod and a guide rail, which allows the nozzle to perform a scanning motion along the lidar window, and the structure of the cleaning system is more compact.

[0017] In relation to the first aspect, in some implementations of the first aspect, the control unit determines motor parameters based on a coordinate range of an obstruction on the lidar window, and controls the motor to rotate based on the motor parameters to drive the nozzle to clean the cleaning target area of ​​the lidar window.

[0018] In this embodiment of the application, the control unit can determine motor parameters based on the coordinate range of the obstruction on the lidar window, and control the motor to rotate based on the motor parameters to drive the nozzle to clean the lidar window, thus performing cleaning in a targeted manner and improving the cleaning efficiency of the lidar window.

[0019] In relation to the first aspect, in some implementations of the first aspect, the motor parameter includes a motor rotation angle or a motor rotation speed.

[0020] There may be a correspondence between the motor rotation angle and the position (e.g., coordinate position) of the nozzle, i.e., the nozzle may be positioned by adjusting the motor rotation angle.

[0021] It should be understood that the motor parameters are not limited in this embodiment of the application. The motor parameters may be any parameters that indicate the state of the motor, such as the rotation angle of the motor or the rotation speed of the motor. The motor parameters may be a specified specific value, or may be a specific range of values, etc.

[0022] In relation to the first aspect, in some implementations of the first aspect, when the number of times the cleaning device has consecutively performed cleaning is less than a first threshold, the control unit controls the cleaning device to perform cleaning.

[0023] In this embodiment of the application, the cleaning device is controlled to perform cleaning only when the number of consecutive cleaning runs is less than a first threshold value. In this way, the number of times the cleaning device performs cleaning can be controlled, thereby improving the operation stability of the cleaning system.

[0024] It should be understood that in this embodiment of the application, the first threshold value may be a preset number of lidar washes before the wash starts, or may be the number of times the obstruction needs to be washed in the actual washing process. The number of times the wash is performed continuously may refer to the number of times the washing device performs the wash continuously under the control of the control unit, or may refer to the number of times the whole process from obtaining the obstruction position information to controlling the washing device to perform the wash is performed continuously.

[0025] In relation to the first aspect, in some implementations of the first aspect, if the number of times the cleaning device has performed consecutive cleanings is greater than a first threshold, the transceiver unit sends an alarm signal to the cockpit controller, and the alarm signal is used to request manual intervention.

[0026] In this embodiment of the application, if the number of consecutive cleaning runs is greater than a first threshold, the lidar device sends an alarm signal to the cockpit controller to request manual intervention. In this way, if the number of consecutive cleaning runs is large, it indicates that the general cleaning method of the cleaning device may not be able to effectively clean the obstruction. In this case, manual intervention is required. In this way, the operation stability of the cleaning system can be improved, and the cleaning efficiency of the lidar is improved.

[0027] In relation to the first aspect, in some implementations of the first aspect, if the duration during which the cleaning device continuously performs cleaning is shorter than a second threshold, the control unit controls the cleaning device to clean the cleaning target area of ​​the lidar window.

[0028] In this embodiment of the present application, the cleaning device is controlled to perform cleaning only when the duration for which the cleaning device continuously performs cleaning is shorter than the second threshold value. In this way, the cleaning duration of the cleaning device can be controlled, thereby improving the operation stability of the cleaning system.

[0029] It should be understood that in this embodiment of the application, the second threshold may be a preset lidar wash duration before cleaning begins, or may be the lidar wash duration after which the obstruction needs to be cleaned in the actual cleaning process.

[0030] In relation to the first aspect, in some implementations of the first aspect, when the duration during which the cleaning device continuously performs cleaning is longer than a second threshold, the control unit controls the nozzle to move to the end of the guide rail, where the end of the guide rail is positioned outside the visible range of the lidar window.

[0031] In this embodiment of the application, when the duration of cleaning is longer than the second threshold, the control unit controls the nozzle to move to the end of the guide rail. Since the end of the guide rail is located outside the visible range of the rider window, the nozzle can be hidden from the rider window. In this way, the nozzle can be prevented from being directly exposed to the environment after the cleaning device performs cleaning, thereby extending the service life of the nozzle.

[0032] In relation to the first aspect, in some implementations of the first aspect, the lidar device further includes a lidar body, the lidar body includes a controller area network interface, and the washing apparatus further includes a water pump control module and a motor drive module. The controller area network interface is connected to the water pump control module and / or the motor drive module via a controller area network bus.

[0033] In this embodiment of the application, the lidar body controls the motor drive module and the water pump control module via a controller area network interface (CAN interface) to control and operate the motor and the water pump. In this way, the washing device can be directly controlled by the lidar body, thereby avoiding the adaptation between the washing system and a third-party controller. For the lidar user, the cable routing inside the vehicle body can be reduced and the software adjustment duration can be shortened.

[0034] According to a second aspect, a lidar cleaning method is provided, the method including the steps of acquiring position information of an obstruction on a lidar window, determining a cleaning target area of ​​the lidar window based on the position information of the obstruction on the lidar window, and controlling a cleaning device to clean the cleaning target area of ​​the lidar window.

[0035] In relation to the second aspect, in some implementations of the second aspect, the position information of the obstructing object on the lidar window includes a coordinate range of the obstructing object on the lidar window, and determining the cleaning target area based on the position information of the obstructing object on the lidar window includes determining a coordinate range of the cleaning target area based on the coordinate range of the obstructing object on the lidar window.

[0036] In relation to the second aspect, in some implementation forms of the second aspect, the coordinate range of the area to be cleaned is equal to or greater than the coordinate range of the obstruction on the lidar window.

[0037] In relation to the second aspect, in some implementation forms of the second aspect, the method further includes a step of determining a motor parameter based on a coordinate range of the obstruction on the lidar window, and a step of controlling the motor to rotate based on the motor parameter to drive the cleaning device and clean the cleaning target area of ​​the lidar window.

[0038] In relation to the second aspect, in some implementations of the second aspect, the motor parameter includes a motor rotation angle or a motor rotation speed.

[0039] In relation to the second aspect, in some implementations of the second aspect, the step of controlling the cleaning device to clean the cleaning target area of ​​the lidar window includes a step of controlling the cleaning device to perform cleaning if the number of times the cleaning device has consecutively performed cleaning is less than a first threshold value.

[0040] In relation to the second aspect, in some implementations of the second aspect, the method further includes a step of sending an alarm signal if the number of times the cleaning device has performed consecutive cleanings is greater than a first threshold, the alarm signal being used to request manual intervention.

[0041] In relation to the second aspect, in some implementations of the second aspect, controlling the cleaning device to clean the cleaning target area of ​​the lidar window includes controlling the cleaning device to clean the cleaning target area of ​​the lidar window when the duration for which the cleaning device continuously performs cleaning is less than a second threshold.

[0042] In relation to the second aspect, in some implementations of the second aspect, the method further includes controlling the cleaning device to be positioned outside the visible range of the lidar window if the duration during which the cleaning device continuously performs cleaning is longer than a second threshold.

[0043] It should be understood that in this embodiment of the application, the manner of controlling the cleaning device to hide outside the visible range of the lidar window is not limited. The hiding manner may be to control the cleaning device to return to an initial position to hide, or to control the cleaning device to move to a new position to hide, etc.

[0044] According to a third aspect, a lidar device is provided. The device includes at least one processor and a memory. The at least one processor is coupled to the memory and configured to read and execute instructions in the memory. The device is configured to perform the method of the previous aspect.

[0045] According to a fourth aspect, there is provided a computer readable medium storing program code which, when executed on a computer, enables the computer to carry out a method according to the previous aspect.

[0046] According to a fifth aspect, there is provided a chip. The chip includes at least one processor and a memory. The at least one processor is coupled to the memory and configured to read and execute instructions in the memory. An apparatus is configured to perform the method of the previous aspect.

[0047] According to a sixth aspect, an intelligent vehicle is provided. The vehicle includes at least one processor and a memory. The at least one processor is coupled to the memory and configured to read and execute instructions in the memory. The processor in the vehicle is configured to perform the method of the previous aspect.

[0048] According to a seventh aspect, there is provided an intelligent vehicle, the vehicle including a device or apparatus according to any of the previous aspects. [Brief description of the drawings]

[0049] [Figure 1] 1 is a schematic functional diagram of a vehicle according to an embodiment of the present application; [Diagram 2] 2 is a schematic diagram 200 of a lidar architecture and a lidar cleaning device according to one embodiment of the present application. [Diagram 3] 1 is a schematic diagram of a cleaning device 300 according to an embodiment of the present application. [Figure 4] FIG. 2 is another schematic diagram of a cleaning apparatus 300 according to an embodiment of the present application. [Diagram 5] FIG. 5 is a schematic diagram of a lidar cleaning method 500 according to an embodiment of the present application. [Figure 6] FIG. 6 is a schematic diagram of a lidar cleaning method 600 according to an embodiment of the present application. [Figure 7] FIG. 7 is a schematic diagram of a LIDAR device 700 according to an embodiment of the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0050] The technical solutions of this application are described below with reference to the accompanying drawings.

[0051] For ease of understanding, an exemplary scenario to which the embodiments of this application are applicable is described below with reference to FIG. 1, using an intelligent driving scenario as an example.

[0052] 1 is a schematic functional diagram of a vehicle 100 according to an embodiment of this application. The vehicle 100 may be configured to be in a fully or partially autonomous driving mode. For example, the vehicle 100 can obtain surrounding environment information of the vehicle 100 by using a detection system 120, obtain an autonomous driving policy based on an analysis of the surrounding environment information, and perform fully autonomous driving, or can present the analysis result to a user and perform partially autonomous driving.

[0053] Vehicle 100 may include various subsystems, such as infotainment system 110, sensing system 120, decision control system 130, drive system 140, and computing platform 150. Optionally, vehicle 100 may include more or fewer subsystems, and each subsystem may include multiple components. Furthermore, each subsystem and component of vehicle 100 may be connected to each other by wires or wirelessly.

[0054] In some embodiments, infotainment system 110 may include a communication system 111 , an entertainment system 112 , and a navigation system 113 .

[0055] The communication system 111 may include a wireless communication system that may communicate with one or more devices in a wireless mode directly or through a communication network. For example, the wireless communication system 146 may communicate over a 3G cellular network, such as CDMA, EVD0, or GSM / GPRS, or over a 4G cellular network, such as LTE. Alternatively, the wireless communication system may communicate over a 5G cellular network communication. The wireless communication system may communicate with a wireless local area network (WLAN) using Wi-Fi. In some embodiments, the wireless communication system 146 may communicate with devices directly using an infrared link, Bluetooth, or ZigBee. For other wireless protocols, various vehicle communication systems, such as wireless communication systems, may include one or more dedicated short range communications (DSRC) devices that may include public and / or private data communication between the vehicle and another vehicle and / or roadside stations.

[0056] The entertainment system 112 may include a central control screen, a microphone, and audio. Based on the entertainment system, the user can listen to broadcasts and play music in the vehicle. Or, a mobile phone is connected to the vehicle and the projection of the mobile phone is performed on the central control screen. The central control screen may be a touch screen and the user can perform operations by touching the screen. In some cases, the microphone may be used to obtain the user's voice signal and some control performed by the user on the vehicle 100 is performed based on the analysis of the user's voice signal, for example adjusting the temperature in the vehicle. In some other cases, the sound may be used to play music to the user.

[0057] The navigation system 113 may include a map service provided by a map supplier to provide route navigation for the vehicle 100. The navigation system 113 may be used in conjunction with the vehicle's global positioning system 121 and inertial measurement unit 122. The map service provided by the map supplier may be a two-dimensional map or a high-precision map.

[0058] The detection system 120 may include a number of sensors configured to sense and detect the surrounding environment information of the vehicle 100. For example, the detection system 120 may include a global positioning system (which may be a GPS system, a BeiDou system, or another positioning system) 121, an inertial measurement unit (IMU) 122, a lidar 123, a millimeter wave radar 124, an ultrasonic radar 125, and a camera device 126. The detection system 120 may further include sensors of the internal systems of the vehicle 100 being monitored (e.g., an interior air quality monitor, a fuel gauge, and an oil temperature gauge). Sensor data from one or more of these sensors may be used to detect objects and corresponding characteristics of the objects (position, shape, orientation, speed, etc.). Such detection and recognition is an important function of the safe operation of the vehicle 100.

[0059] The global positioning system 121 may be used to estimate the geographic position of the vehicle 100 .

[0060] The inertial measurement unit 122 is configured to sense changes in position and orientation of the vehicle 100 based on inertial acceleration. In some embodiments, the inertial measurement unit 122 may be a combination of an accelerometer and a gyroscope.

[0061] LIDAR 123 may use lasers to sense objects in the environment in which vehicle 100 is located. In some embodiments, LIDAR 123 may include one or more laser sources, a laser scanner, one or more detectors, and other system components.

[0062] The mmWave radar 124 may use radio signals to detect objects in the environment surrounding the vehicle 100. In some embodiments, in addition to detecting objects, the radar 126 may be further configured to detect the speed and / or direction of movement of the objects.

[0063] The ultrasonic radar 125 may detect objects around the vehicle 100 using ultrasonic signals.

[0064] The camera device 126 may be configured to capture image information of the environment surrounding the vehicle 100. The camera device 126 may include a monocular camera, a binocular camera, a structured light camera, a panoramic camera, etc. The image information acquired by the camera device 126 may include still images or may include video stream information.

[0065] The decision control system 130 includes a computing system 131 that performs analysis and decisions based on the information obtained by the sensing system 120. Additionally, the decision control system 130 includes a vehicle controller 132 that controls the power system of the vehicle 100, a steering system 133, a throttle 134, and a braking system 135 configured to control the vehicle 100.

[0066] The computing system 131 may operate to process and analyze various information acquired by the sensing system 120 to identify targets, objects, and / or features in the environment surrounding the vehicle 100. The targets may include pedestrians or animals, and the objects and / or features may include traffic lights, road boundaries, or obstacles. The computing system 131 may use techniques such as object recognition algorithms, structure from motion (SFM) algorithms, and video tracking. In some embodiments, the computing system 131 may be configured to map the environment, track objects, estimate object speeds, and the like. The computing system 131 may analyze the acquired information and derive a control policy for the vehicle.

[0067] The vehicle controller 132 may be configured to regulate and control the vehicle's power battery and engine 141 to improve the dynamic performance of the vehicle 100 .

[0068] The steering system 133 may be manipulated to adjust the direction of travel of the vehicle 100. For example, in one embodiment, the steering system may be a steering wheel system.

[0069] The throttle 134 is configured to control the operating speed of the engine 141 to further control the speed of the vehicle 100 .

[0070] Braking system 135 is configured to controllably slow down vehicle 100. Braking system 135 can slow down wheels 144 by using frictional forces. In some embodiments, braking system 135 can convert kinetic energy of wheels 144 into electrical current. Alternatively, braking system 135 can use another form to reduce the rotational speed of wheels 144 to control the speed of vehicle 100.

[0071] The drive system 140 may include components that provide power for the vehicle 100 to move. In one embodiment, the drive system 140 may include an engine 141, an energy source 142, a transmission system 143, and wheels 144. The engine 141 may be an internal combustion engine, a motor, an air compression engine, or a combination of another type of engine, such as a hybrid engine including a gasoline engine and a motor, or a hybrid engine including an internal combustion engine and an air compression engine. The engine 141 converts the energy source 142 into mechanical energy.

[0072] Examples of energy source 142 include gasoline, diesel, other oil-based fuels, propane, other compressed gas-based fuels, anhydrous alcohol, solar panels, batteries, and other power sources. Energy source 142 may also provide energy to other systems of vehicle 100.

[0073] The transmission device 143 may transmit mechanical power from the engine 141 to the wheels 144. The transmission device 143 may include a gearbox, a differential, and a drive shaft. In one embodiment, the transmission device 143 may further include other components, such as a clutch. The drive shaft may include one or more shafts that may be coupled to one or more wheels 121.

[0074] Some or all of the functions of vehicle 100 are controlled by computing platform 150. Computing platform 150 may include at least one processor 151. Processor 151 may execute instructions 153 stored in a non-transitory computer-readable medium, such as memory 152. In some embodiments, computing platform 150 may alternatively be multiple computing devices providing distributed control of individual components or subsystems of vehicle 100.

[0075] The processor 151 may be any conventional processor, such as a commercially available CPU. Alternatively, the processor 151 may further include a graphic processing unit (GPU), a field programmable gate array (FPGA), a system on chip (SOC), an application specific integrated circuit (ASIC), or a combination thereof. Although FIG. 1 functionally illustrates the processor, memory, and other components of the computer 110 in the same block, one skilled in the art should understand that the processor, computer, or memory may actually include multiple processors, computers, or memories that may or may not be stored in the same physical housing. For example, the memory may be a hard disk drive or another storage medium located in a housing different from that of the computer 110. Thus, reference to a processor or computer is understood to include reference to a set of processors or computers or memories that may or may not operate in parallel. Unlike using a single processor to perform the steps described herein, some components, such as the steering components and the deceleration components, may include respective processors. The processor performs only calculations related to the component's specific functionality.

[0076] In various aspects described herein, the processor may be located remotely from the vehicle and communicate wirelessly with the vehicle. In other aspects, some processes described herein are executed on a processor located inside the vehicle and other processes are executed by a remote processor, which includes performing the steps necessary for a single operation.

[0077] In some embodiments, memory 152 may include instructions 153 (e.g., program logic) that may be executed by processor 151 to perform various functions of vehicle 100. Memory 152 may also include additional instructions, including instructions used to transmit data to, receive data from, interact with, and / or control one or more of infotainment system 110, sensing system 120, decision control system 130, and drive system 140.

[0078] In addition to instructions 153, memory 152 may further store data and other information, such as road maps, route information, vehicle position, direction, speed, and other such vehicle data. Such information may be used by vehicle 100 and computer system 150 during operation of vehicle 100 in autonomous, semi-autonomous, and / or manual modes.

[0079] Computing platform 150 may control functions of vehicle 100 based on inputs received from various subsystems (e.g., drive system 140, sensing system 120, and decision control system 130). For example, computing platform 150 may utilize inputs from decision control system 130 to control steering system 133 to avoid obstacles detected by sensing system 120. In some embodiments, computing platform 150 may operate to provide control over many aspects of vehicle 100 and its subsystems.

[0080] Optionally, one or more of the aforementioned components may be located separately from or associated with vehicle 100. For example, memory 152 may exist partially or completely separate from vehicle 100. The aforementioned components may be communicatively coupled to each other via wires and / or wirelessly.

[0081] Optionally, the above components are only examples. In practical application, the components in the above modules can be added or deleted based on practical requirements. FIG. 1 should not be construed as a limitation to this embodiment of this application.

[0082] An autonomous vehicle traveling on a road, such as vehicle 100, can identify objects in the vehicle's environment to determine to adjust its current speed. The objects may be another vehicle, a traffic control device, or another type of object. In some examples, the autonomous vehicle can consider each identified object independently and determine an adjusted speed of the autonomous vehicle based on characteristics of each identified object, such as the current speed of the object, the acceleration of the object, or the distance between the object and the autonomous vehicle.

[0083] Optionally, the vehicle 100 or a sensing and computing device associated with the vehicle 100 (e.g., computing system 131 or computing platform 150) can predict the behavior of the identified object based on the recognized object features and the surrounding environment conditions (e.g., traffic, rain, ice on the road, etc.). Optionally, all identified objects depend on each other's behavior, so that all identified objects can be considered together to predict the behavior of a single identified object. The vehicle 100 can adjust the speed of the vehicle 100 based on the predicted behavior of the identified object. In other words, the autonomous vehicle can determine a particular stable state (e.g., accelerate, decelerate, or stop) to which the vehicle needs to be adjusted based on the predicted behavior of the object. In this process, the speed of the vehicle 100, for example, the horizontal position of the vehicle 100 on the road on which the vehicle travels, the curvature of the road, or another factor for determining the proximity between stationary and dynamic objects can also be taken into account.

[0084] In addition to providing instructions to adjust the speed of the autonomous vehicle, the computing device may provide instructions to change the steering angles of vehicle 100 so that the autonomous vehicle follows a given trajectory and / or maintains a safe lateral and longitudinal distance from objects next to the autonomous vehicle (e.g., cars in adjacent lanes on the road).

[0085] The vehicle 100 may be a car, truck, motorcycle, bus, boat, airplane, helicopter, lawn mower, recreational vehicle, playground vehicle, construction device, trolley, golf cart, train, etc., which is not specifically limited in this embodiment of the application.

[0086] In order to facilitate understanding of the embodiments of this application, the following describes terms used in the embodiments of this application.

[0087] (1) CAN bus: The CAN bus is a type of field bus. Unlike the common point-to-point bus structure, the controller area network (CAN) allows electronic control units (ECUs) to be attached to the same main line via branch lines. The time division and arbitration modes ensure that each node can be directly controlled by the CPU as the main node, and implement a structure with multiple main nodes, i.e., a structure that does not distinguish between main nodes and secondary nodes.

[0088] (2) CAN: Controller area network (CAN) is a feature-rich vehicle bus standard designed to enable communication between microcontrollers and devices without the need for a host.

[0089] (3) LiDAR: LiDAR, also known as light detection and ranging (LDR), is a sensing technology that uses a light source and a receiver to remotely detect and range objects. In the vehicle domain, the function of LiDAR is to detect and model obstacles around the vehicle.

[0090] (4) MCU: Micro-control unit (MCU) is also called processing unit, control unit, or single chip microcomputer (SCM). With the emergence and development of large scale integrated circuits, MCU integrates a computer's CPU, RAM, ROM, timer, and multiple I / O interfaces into a chip to form a chip-level computer for different application scenarios.

[0091] FIG. 2 is a schematic diagram 200 of a lidar architecture and a lidar cleaning device according to one embodiment of the present application.

[0092] 2, a schematic diagram of the lidar architecture and the lidar cleaning apparatus may include a lidar body apparatus 210 and a cleaning apparatus 220. The lidar body apparatus 210 may be connected to the cleaning apparatus 220 via a CAN bus. The lidar body apparatus 210 may include a detection unit 211, an MCU 212, and a CAN transceiver 213. The cleaning apparatus 220 may include a water pump 221, a water pump control module 222, a nozzle 223, a transmission mechanism 224, a motor 225, and a motor drive module 226.

[0093] The detection unit 211 may be disposed in the lidar body device 210 in the lidar device and connected to the MCU 212 and the CAN transceiver 213 via a signal cable. Alternatively, the detection unit 211 may be located outside the lidar body device 210 and connected to the MCU 212 via a signal cable.

[0094] In the cleaning device 220, the water pump 221 and the nozzle 223 may be connected via a cleaning line, the water pump 221 and the water pump control module 222 may be connected via a signal cable, the nozzle 223, the transmission mechanism 224 and the motor 225 may be connected using a mechanical connection, and the motor 225 and the motor drive module 226 may be connected via a signal cable.

[0095] Further, the structure of the lidar and the diagram of the lidar washing apparatus may be externally connected to a water tank 230 and a cockpit controller 240. The water tank 230 may be connected to a water pump 221 in the washing apparatus 220 via a washing fluid pipeline. The cockpit controller 240 may be connected to a CAN transceiver 213 of the lidar body 210 via a CAN bus.

[0096] The rider body device 210 can communicate with the motor drive module 226, the water pump controller 222, and the body cockpit controller 240 through the interface of the CAN transceiver 213. As the computing center of the entire device, the MCU 212 in the rider body is responsible for processing the sensing data, sending execution commands to the motor drive module 226 and the water pump 221, and sending alarm signals to the cockpit controller 240.

[0097] It should be understood that the CAN bus in Figure 2 may be a special signal line used to transmit CAN signals, the signal line may be a signal line used to transmit other signals than CAN signals, and the mechanical connection may be a connection made mechanically using, for example, gears and bearings.

[0098] It should be further understood that in the embodiments of this application, unless otherwise specified and limited, terms such as "connected" and "connection" should be understood in a broad sense. For example, these terms may be fixed connection, detachable connection, or integral connection, these terms may be mechanical connection, electrical connection, or intercommunication, or these terms may be direct connection, indirect connection through an intermediate medium, or internal connection of two elements, or interactive relationship between two elements. For those skilled in the art, the specific meaning of the aforementioned terms in the present invention may be understood based on the specific situation.

[0099] In the actual application process of the lidar device, the detection unit 211 can obtain the position of the obstruction on the lidar window, and the MCU 212 determines the cleaning target area according to the position of the obstruction, and uses the CAN transceiver 213 to control the motor drive module 226 and the water pump control module 222. The motor drive module 226 controls and operates the motor 225, and the motor 225 uses the transmission mechanism 224 to drive the nozzle 223 to move to the position of the obstruction. The water pump control module 222 controls the water pump 221 to operate, and the water pump 221 drives water or detergent from the water tank 230 to the nozzle 223, and the nozzle 223 starts to spray the water or detergent to clean the obstruction.

[0100] In this embodiment of the present application, the cleaning device is directly controlled by the lidar, and the cleaning device and the lidar are electrically connected, there is no need to build hardware cables for the cleaning device and the third party controller during operation, there is no need for software adaptation, the software adjustment duration time can be shortened, and the efficiency of the cleaning system can be improved.

[0101] In this embodiment of the application, various suitable solutions may be used for the detection unit 221 to obtain the position information of the obstruction and the MCU 212 to determine the cleaning target area.

[0102] In a possible implementation form, position information of an obstructing object on the lidar window can be acquired in a manner in which the detection unit 211 acquires obstruction information of the obstructing object on the lidar window.

[0103] The lidar can rapidly and accurately acquire three-dimensional images of different scenarios in a three-dimensional imaging manner. Furthermore, the detection unit 211 of the lidar can identify the position of an obstruction on the lidar window on the acquired three-dimensional image to determine whether the lidar window needs to be cleaned. Therefore, this embodiment of the application is mainly for cleaning a specific area of ​​the lidar window. Another type of lidar may not be applicable to this embodiment of the application because the position of the obstruction on the lidar window may not be identified.

[0104] Optionally, the position information of the obstruction on the lidar window may include an obstruction region of the obstruction on the lidar window.

[0105] It should be understood that the determined cleaning target area is not limited in this embodiment of the application and the cleaning target area may alternatively be any shape, for example, a sector, a rectangle, or a circle. The extent of the cleaning target area may be greater than, equal to, or less than the extent of the occlusion area.

[0106] For example, if the horizontal coordinate range of the occlusion area on the lidar window is [x1, x2], the determined cleaning target area range may be [x1, x2]. In this case, the determined cleaning target area is equal to the occlusion area of ​​the occlusion object, and the occlusion object can be accurately cleaned in a targeted manner. Alternatively, the determined cleaning target area may be [x1-a1, x2+a2], where a1 and a2 may be pre-set parameters, and the values ​​of a1 and a2 are greater than 0. In this case, the determined cleaning target area is greater than the occlusion area of ​​the occlusion object.

[0107] As another example, if the occlusion area on the lidar window is a sector of radius R, the determined range of the cleaning target area may be a sector of radius R. In this case, the determined cleaning target area is equal to the occlusion area of ​​the occlusion, and the occlusion may be precisely cleaned in a targeted manner. Alternatively, the determined range of the cleaning target area may be a sector with a radius of R+r, where r may be a pre-set parameter, and the value of r is greater than 0. In this case, the determined cleaning target area is greater than the occlusion area of ​​the occlusion.

[0108] It should be understood that if the area to be cleaned is represented by a coordinate range, the nozzle of the corresponding cleaning device may be a sliding cleaning nozzle, or if the area to be cleaned is represented by a sector, the nozzle of the corresponding cleaning device may be a rotating cleaning nozzle.

[0109] Optionally, the position information of the obstruction on the lidar window may include a coordinate range of the obstruction on the lidar window. In this case, the MCU 212 may determine the coordinate range of the cleaning target area based on the coordinate range of the obstruction on the lidar window.

[0110] Optionally, the coordinate range of the area to be cleaned is equal to or greater than the coordinate range of the obstruction on the lidar window.

[0111] It should be understood that in this embodiment of the application, the coordinate range of the occlusion on the lidar window may include a horizontal coordinate range of the occlusion, may include a vertical coordinate range of the occlusion, or may include a horizontal and vertical coordinate range of the occlusion. The determined coordinate range of the area to be cleaned may include a horizontal coordinate range of the area to be cleaned, or may include a vertical coordinate range of the area to be cleaned, or may include a horizontal and vertical coordinate range of the area to be cleaned.

[0112] In this embodiment of the application, the detection unit 211 of the lidar can detect the coordinate range of the obstruction on the lidar window, and then the MCU 212 of the lidar determines the coordinate range of the cleaning target area according to the coordinate range of the obstruction on the lidar window, and controls the cleaning device to clean the cleaning target area within the coordinate range of the cleaning target area. Therefore, cleaning of a specific area on the lidar window can be performed in a more sophisticated manner, and the cleaning efficiency of the lidar window can be improved.

[0113] In this embodiment of the application, the MCU 212 can control the cleaning device to clean the lidar window based on the area to be cleaned using a variety of suitable cleaning solutions.

[0114] In a possible implementation, the MCU 212 can determine motor parameters based on the coordinate range of the obstruction on the lidar window. Based on the motor parameters, the MCU 212 can further control the motor to rotate and drive the nozzle 223 to clean the target area of ​​the lidar window.

[0115] Specifically, the motor parameter may refer to a parameter that needs to be set on the nozzle motor when the cleaning device performs cleaning. For example, the motor parameter may be a motor rotation angle, and the motor rotation angle may correspond to a horizontal coordinate range of an obstruction on a particular range of windows. In this manner, the MCU 212 may control the nozzle 223 of the cleaning device to perform cleaning in a targeted manner on the lidar window based on the motor rotation angle.

[0116] Table 1 shows an example of the correspondence between the horizontal coordinate range of an object obstructing a window and the motor rotation angle. [Table 1]

[0117] According to the embodiment of Table 1, when the horizontal coordinate range of the obstruction on the window is [X1, X2], the corresponding motor rotation angle range of the nozzle is [θ1, θ2]. After the motor rotation angle range of the nozzle is determined, the MCU 212 can control the motor 225 to rotate to the corresponding angle based on the motor rotation angle range, and the motor 225 can control the nozzle 223 to perform cleaning of a specific area, so as to avoid the waste of resources caused by large-scale cleaning.

[0118] Specifically, in the process of the motor 225 controlling the nozzle 223 to perform cleaning, the motor 225 may control the nozzle 223 to scan a different range. For example, if the horizontal coordinate range of the obstruction on the window is [X1, X2], the motor 225 may control the nozzle 223 to scan the range of [X1, X2]. In this case, the scanning range of the nozzle 223 is equal to the horizontal coordinate range of the obstruction on the lidar window, and the obstruction can be accurately cleaned.

[0119] Also, when the horizontal coordinate range of the obstruction on the window is [X1, X2], the motor 225 may control the nozzle 223 to scan the range of [0, X2], or may control the nozzle 223 to scan the range of [X1-b1, X2], where b1 is a positive number and is preset. Also, the motor 225 may control the nozzle to scan in the range of [X1, X2+b2], where b2 is a positive number and may be preset. In this case, the scanning range of the nozzle 223 is larger than the horizontal coordinate range of the obstruction on the lidar window, and the obstruction can be washed more effectively.

[0120] In one example, if the horizontal coordinate ranges of the obstruction on the lidar window are [X1,X2]=[0,20], [X3,X4]=[20,40], and [X5,X6]=[40,60], the corresponding motor rotation angles of the nozzle are [θ1,θ2]=[2π,6π], [θ3,θ4]=[6π,10π], and [θ5,θ6]=[10π,14π], respectively. The horizontal coordinates of the obstruction on the lidar window are in millimeters (mm), and the motor rotation angles of the nozzle are in rad.

[0121] It should be understood that in this embodiment of the application, the rotation angle of the motor can be determined using the table lookup method described above, or using the formula calculation method.

[0122] In a possible implementation, the motor parameter may be a motor rotation speed, which may correspond to a horizontal coordinate range of an obstruction on the window within a certain range. In this way, the MCU 212 can control the nozzle 223 of the cleaning device to clean the lidar window based on the motor rotation speed.

[0123] Table 2 shows an example of the correspondence between the horizontal coordinate range of an obstruction on a window and the motor rotation speed. [Table 2]

[0124] According to the embodiment of Table 2, when the horizontal coordinate range of the obstruction on the window is [X1, X2], the corresponding rotation speed range of the nozzle motor is ε1. Therefore, MCU 212 can control the rotation speed of motor 225 based on the position of the obstruction on the lidar window to control the scanning speed of nozzle 223, so as to improve the cleaning efficiency of the lidar window.

[0125] In one example, when the horizontal coordinate ranges of the obstruction on the lidar window are [X1,X2]=[0,20], [X3,X4]=[20,40], and [X5,X6]=[40,60], the corresponding motor rotation angles of the nozzle are ε1=15, ε2=11, and ε1=8, respectively. The unit of the horizontal coordinate of the obstruction on the lidar window is millimeter (mm), and the unit of the motor rotation speed of the nozzle is r / s.

[0126] In this embodiment, when the horizontal coordinate range of the obstruction is located at the center of the lidar window, the motor rotation speed can be set to a small value, so that the nozzle 223 can better clean the center of the lidar window to ensure the cleaning efficiency of the core region.

[0127] In this embodiment of the application, MCU 212 can determine motor parameters based on the coordinate range of the obstruction on the lidar window, and control motor 225 based on the motor parameters to drive nozzle 223 to clean the lidar window. The cleaning can be performed in a targeted manner to improve the cleaning efficiency of the lidar window.

[0128] In a possible implementation, if the number of times the cleaning device has consecutively performed cleaning is less than a first threshold, the MCU 212 controls the cleaning device to perform cleaning, and if the number of times the cleaning device has consecutively performed cleaning is greater than the first threshold, the MCU 212 sends an alarm signal to the cockpit controller 240 to request manual intervention.

[0129] It should be understood that in this embodiment of the application, the first threshold value may be a preset number of lidar washes before the wash starts, or may be the number of times the obstruction needs to be washed in the actual washing process. Note that the number of consecutive washes may refer to the number of times the cleaning device performs consecutive washes under the control of the MCU 212, or may refer to the number of times the whole process from obtaining the obstruction position information to controlling the cleaning device to perform the wash is performed consecutively.

[0130] In this embodiment of the application, different specific area cleaning policies can be used by comparing the number of consecutive cleaning runs with a first threshold. If the number of consecutive cleaning runs is high, it indicates that the general cleaning method of the cleaning device may not be able to effectively clean the obstruction. In this case, manual intervention is required. In this way, the operating stability of the cleaning system can be improved, and the cleaning efficiency of the rider is improved.

[0131] In a possible implementation, if the duration during which the cleaning device continuously performs cleaning is shorter than the second threshold, the MCU 212 can control the cleaning device to clean the cleaning target area of ​​the lidar window, and if the duration during which the cleaning device continuously performs cleaning is longer than the second threshold, the MCU 212 can control the nozzle 223 to move to an end of the guide rail that is located outside the visible range of the lidar window.

[0132] In this embodiment of the application, the working state of the cleaning device can be determined by comparing the duration for which cleaning is performed with a second threshold value. If the duration for which the cleaning device continuously performs cleaning is short, the cleaning device is controlled to perform cleaning of a specific area. When the duration of cleaning of the cleaning device reaches the duration required to clean the obstruction, the nozzle is controlled to move to the end of the guide rail so that the nozzle is located outside the visible range of the lidar window. In this way, in one aspect, the duration of cleaning performed by the cleaning device can be controlled, thereby saving cleaning resources. In another aspect, the nozzle can be prevented from being directly exposed to the environment after performing cleaning, improving the performance of the nozzle.

[0133] 3 is a schematic diagram of a washing device 300 according to an embodiment of the present application. The device may be applied to the vehicle 100 of FIG. 1 or the lidar and lidar washing system 200 of FIG. 2.

[0134] As shown in FIG. 3, the cleaning device 300 may include a water inlet pipe 301, a water pump 302, a water outlet pipe 303, a customized nozzle 304, a customized screw rod nut 305, a screw rod 306, a guide rod 307, a cover 308, a guide rail 309, a motor 310, and a rider 311. The cleaning device 300 may be integrated with the rider body, that is, the control modules of the water pump 302 and the motor 310 may be connected to the rider body via a CAN bus. In this way, the cleaning device 300 may be directly controlled by the rider. There is no need to build hardware cables for the cleaning device and a third-party controller during operation, and there is no need for software adaptation, which can shorten the software adjustment duration and improve the efficiency of the cleaning system.

[0135] In the cleaning device 300, a water inlet pipe 301 is connected to a water pump 302, one end of a water outlet pipe 303 is connected to the water pump 302, and the other end is connected to a customized nozzle 304. The customized nozzle 304 is disposed on a customized screw rod nut 305 and configured to clean the rider 311. The customized nozzle 304 can use different types of cleaning liquids. For example, the customized nozzle 304 may repeatedly scan within the range of the obstruction and spray water or detergent to clean it. The cleaning manner of the customized nozzle 304 is not limited in this application.

[0136] The customized screw rod nut 305 is disposed on the screw rod 306 and the guide rod 307, and can move on the screw rod 306 and the guide rod 307. The guide rail 309 is located on the cover 308. The customized nozzle 304 can move along the guide rail 309, and the motor 310 is configured to drive the customized nozzle 304 and the customized screw rod nut 305 to wash the rider window. When the cleaning device 300 performs cleaning, the motor 310 controls the customized screw rod nut 305 to perform a linear motion, and the customized screw rod nut 305 drives the customized nozzle 304 to move along the guide rail to the position of the obstruction and clean the obstruction.

[0137] It should be understood that the orientation or positional relationship indicated by "upper", "lower", etc. in the embodiments of this application is based on the orientation or positional relationship shown in the attached drawings, and is intended merely to facilitate and simplify the description of the present invention, and does not indicate or imply that the specified devices or elements must have a particular orientation or have a particular structure and operation. Therefore, this cannot be construed as a limitation on the present invention.

[0138] In this embodiment of the application, by using a structure having a motor, a screw rod, and a guide rail, the customized nozzle can perform a scanning motion along the lidar window, resulting in a more compact structure of the cleaning system and higher space utilization.

[0139] Figure 4 is another schematic diagram of a cleaning device 300 according to this embodiment of the present application. The schematic diagram is a front view of the cleaning device of Figure 3, with Figure 4(a) being a schematic diagram of the device in a stationary state and Figure 4(b) being a schematic diagram of the device in a cleaning state.

[0140] 4A, when the cleaning device is in a stationary state, the customized nozzle 304 is located at the end of the guide rail. Since the end of the guide rail is located outside the visible range of the rider window, the customized nozzle 304 may be hidden from the rider window.

[0141] As shown in (b) of FIG. 4, when the cleaning device is in a state of performing cleaning, the motor 310 controls the customized screw rod nut 305 to perform linear movement, and the customized screw rod nut 305 drives the customized nozzle 304 to move along the screw rod 306 to the position of the obstruction and clean the obstruction. After the cleaning is completed, the motor 310 controls the customized nozzle 304 to move again to the end of the guide rail. Since the end of the guide rail is located outside the visible range of the rider window, the customized nozzle 304 can become hidden again with respect to the rider window.

[0142] It should be understood that the hiding state of the nozzle shown in Figure 4 is only an example for illustration purposes and is not limiting in this application. The hiding aspect may be controlling the customized nozzle to return to an initial position for hiding, controlling the customized nozzle to move to a new position for hiding, etc.

[0143] In this embodiment of the application, when the lidar window does not need to be cleaned, the nozzle can be completely hidden. After the lidar window is cleaned, the nozzle can be controlled to be hidden again. In this way, in this embodiment of the application, the nozzle can be effectively protected, and the overall space utilization of the cleaning system is improved.

[0144] In practice, conventional lidar cleaning devices can only be used to clean lidar windows over a wide area through a fixed program. In such cleaning mode, in one aspect, the obstructions are not easily cleaned in a targeted manner. In another aspect, when a fixed program cleaning mode is started, a fixed duration and a fixed amount of cleaning agent are consumed, which is inefficient and causes a waste of resources. The embodiments of this application provide a specific area cleaning method so that the obstructions on the lidar window can be cleaned in a targeted manner, improving cleaning efficiency.

[0145] 5 is a schematic diagram of a method 500 for cleaning a specific area of ​​a lidar according to one embodiment of the present application. The method for cleaning a specific area of ​​a lidar can be applied to the lidar and lidar cleaning system 200 of FIG. 2, and can also be applied to the cleaning device of FIG. 3 or FIG. 4. The method 500 can include the following steps.

[0146] S501: Obtain position information of obstructions on the lidar window.

[0147] Optionally, the position information of the obstruction on the lidar window may include an obstruction region of the obstruction on the lidar window.

[0148] Optionally, the position information of the obstruction on the lidar window may include a coordinate range of the obstruction on the lidar window.

[0149] It should be understood that in this embodiment of the application, the position information of the obstruction on the lidar window may include the obstruction area of ​​the obstruction, the coordinate range of the obstruction on the lidar window, the size of the obstruction area of ​​the obstruction, etc.

[0150] S502: Based on position information of an obstruction on the lidar window, a cleaning target area of ​​the lidar window is determined.

[0151] Optionally, this step may include determining the area to be cleaned based on an obscured area of ​​the obstruction object on the lidar window.

[0152] Optionally, this step may include determining a coordinate range of the area to be cleaned based on a coordinate range of an obstruction on the lidar window.

[0153] It should be understood that the determined cleaning target area is not limited in this embodiment of the application and the cleaning target area may alternatively be any shape, for example, a sector, a rectangle, or a circle. The size of the cleaning target area may be larger, equal, or smaller than the size of the occlusion area.

[0154] S503: The cleaning device is controlled to clean the cleaning target area of ​​the lidar window.

[0155] Based on the aforementioned technical solutions, the embodiments of this application provide an efficient lidar cleaning method, in which the cleaning device can be controlled to perform cleaning of specific areas for the lidar in a targeted manner based on the position of the obstruction on the lidar window, thereby improving the cleaning efficiency of the lidar.

[0156] In this embodiment of the application, the cleaning device is controlled based on the area to be cleaned to clean the lidar window and can use a variety of suitable cleaning fluids.

[0157] In a possible implementation, step S503 further includes determining motor parameters based on a coordinate range of the obstruction on the lidar window, and controlling the motor to rotate based on the motor parameters to drive the cleaning device and clean the cleaning target area of ​​the lidar window.

[0158] In this embodiment of the application, the motor parameters may be determined based on the horizontal coordinate range of the obstruction on the lidar window, and in order to improve the cleaning efficiency of the cleaning device, the cleaning device is controlled to perform cleaning in a targeted manner based on the motor parameters.

[0159] In a possible implementation, in step S503, if the number of times the cleaning device has consecutively performed cleaning is less than a first threshold, the cleaning device is controlled to perform cleaning, or if the number of times the cleaning device has consecutively performed cleaning is greater than the first threshold, an alarm signal is sent, and the alarm signal is used to request manual intervention.

[0160] In this embodiment of the application, different specific area cleaning policies can be used by comparing the number of consecutive cleaning runs with a first threshold. If the number of consecutive cleaning runs is high, it indicates that the general cleaning method of the cleaning device may not be able to effectively clean the obstruction. In this case, manual intervention is required. In this way, the operation stability of the cleaning system can be improved, and the cleaning efficiency of the rider is improved.

[0161] In a possible implementation, in step S503, if the duration during which the cleaning device continuously performs cleaning is shorter than a second threshold, the cleaning device is controlled to clean the cleaning target area of ​​the lidar window, or if the duration during which the cleaning device continuously performs cleaning is longer than the second threshold, the cleaning device is controlled to be located outside the visibility range of the lidar.

[0162] It should be understood that in this embodiment of the application, the manner of controlling the cleaning device to hide outside the visible range of the lidar window is not limited. The method may be to control the cleaning device to return to an initial position to hide, or to control the cleaning device to move to a new position to hide, etc.

[0163] In this embodiment of the application, the working state of the cleaning device can be determined by comparing the duration during which the cleaning device continuously performs cleaning with a second threshold value. If the duration during which the cleaning device continuously performs cleaning is short, the cleaning device is controlled to perform cleaning of a specific area. If the duration during which the cleaning device continuously performs cleaning reaches the duration required to clean the obstruction, the nozzle is controlled to be hidden relative to the lidar window. In this way, in one aspect, the duration of cleaning performed by the cleaning device can be controlled, thereby saving cleaning resources. In another aspect, the cleaning device can be prevented from being directly exposed to the environment after performing cleaning, improving the performance of the cleaning device.

[0164] This embodiment of the present application will now be described in detail with reference to the process shown in FIG.

[0165] 6 is a schematic diagram of a method 600 for cleaning a specific area of ​​a lidar according to an embodiment of the present application. The method can be applied to the lidar and lidar cleaning system 200 of FIG. 2, and also to the cleaning device of FIG. 3 or FIG. 4. The method 600 may include the following steps.

[0166] S601: Start the rider.

[0167] S602: Determine whether rider washing is required. If rider washing is required, execute step S603, or if rider washing is not required, the washing device is not started for washing.

[0168] Optionally, determining whether a lidar wash is required comprises determining whether a lidar wash is required based on the returned point cloud, in particular in this manner the presence or absence of an occlusion can be identified on the three-dimensional image returned from the point cloud.

[0169] It should be understood that in this application, the method of using the returned point cloud to determine whether lidar cleaning is required is merely an example for purposes of illustration, and the manner of determination is not a limitation of this application.

[0170] S603: Determine whether the number of consecutive washes is equal to or less than n times. If the number of consecutive washes is equal to or less than n times, execute step S604; if the number of consecutive washes is not equal to or less than n times, send an alarm signal to the cockpit controller to request manual intervention.

[0171] It should be understood that n may be an integer equal to or greater than 0, and the specific value of n may be preset based on actual cleaning requirements.

[0172] In this way, in this embodiment of the application, the number of times cleaning is performed by the cleaning device can be controlled, and different cleaning policies can be used based on actual situations, thereby improving the stability of the cleaning system.

[0173] S604: Determine the location of an occlusion on the window.

[0174] Optionally, determining the position of the occlusion on the window comprises determining a horizontal coordinate range [X1, X2] of the occlusion on the window.

[0175] Optionally, this step further comprises determining a ratio ε of occlusion to window and a size of the occlusion region.

[0176] It should be understood that in this embodiment of the application, the position of the obstruction on the window may be the horizontal coordinate range of the obstruction on the lidar window, the vertical coordinate range of the obstruction on the lidar window, etc.

[0177] S605: Determine the corresponding motor parameters of the nozzle at the location of the obstruction.

[0178] Optionally, the motor parameters include a motor rotation angle range [θ1, θ2] for the nozzle within a range of [X1, X2].

[0179] It should be understood that the motor parameter may be a motor rotation angle, a motor rotation speed, and the like.

[0180] S606: Send a command to the motor so that the motor moves to the position of the obstruction.

[0181] Optionally, the instructions include a command for the motor to rotate through an angle θ1.

[0182] It should be understood that the commands sent to the motor are not limited to this embodiment of the application, and the commands are applicable to this embodiment of the application as long as the motor is capable of moving to the location of the obstruction according to the commands.

[0183] S607: Send a command to the water pump, the command instructing the water pump to start injecting water.

[0184] S608: The motor and nozzle are controlled to perform a uniform speed scan within the range of the obstruction.

[0185] Optionally, this step includes the motor performing a uniform velocity scan in a rotation angle range [θ1, θ2] and correspondingly, the nozzle performing a uniform velocity scan in a range [X1, X2].

[0186] It should be understood that when a motor scans at a constant speed in a rotational angle range [θ1, θ2], it may mean that the motor moves back and forth in the rotational angle range [θ1, θ2], and when a nozzle scans at a constant speed in a range [X1, X2], it may mean that the nozzle moves back and forth in the range [X1, X2].

[0187] S609: The water pump starts injecting water, and after the preset injection duration ends, it stops injecting water and the nozzle returns to a position outside the visible range of the lidar window and becomes hidden.

[0188] Optionally, assume that the injection duration is preset to T and the water pump stops injecting water after εT.

[0189] It should be understood that the setting parameter ε in this specification can refer to the ratio of the occlusion to the window, and the value of the parameter ε can be determined based on the ratio of the size of the occlusion area of ​​the occlusion to the size of the lidar window.

[0190] It should further be appreciated that the reason for multiplying the preset injection duration T by a proportionality factor is to cooperate with the nozzle to perform a specific area wash for the lidar window obscuration.

[0191] Optionally, execution continues with step S602 after the nozzle returns to a position outside the visible range of the lidar window and becomes hidden.

[0192] Based on the above technical solution, in this embodiment of the application, the cleaning target area can be determined according to the position of the obstruction on the lidar window, and the cleaning device is controlled to perform cleaning of the specific area in a targeted manner, thereby improving the cleaning efficiency of the lidar window and saving cleaning resources. Furthermore, when the cleaning device is not in use, the nozzle is controlled to be located outside the visible range of the lidar window, thereby avoiding the nozzle from being directly exposed to the environment when the nozzle is not in use, and prolonging the life of the cleaning device.

[0193] 7 is a schematic diagram of a lidar device 700 according to an embodiment of the present application. The device may be applied to the vehicle 100 of FIG 1 and the lidar architecture and lidar cleaning device diagram of FIG 2.

[0194] The lidar device includes a memory 710, a processor 720, and a communication interface 730. The memory 710, the processor 720, and the communication interface 730 are connected via an internal connection path. The memory 710 is configured to store instructions. The processor 720 is configured to execute the instructions stored in the memory 720 to control the input / output interface 730 to receive / transmit at least some parameters of the second channel model. Optionally, the memory 710 may be coupled to the processor 720 via an interface or may be integrated with the processor 720.

[0195] It should be noted that the communication interface 730 facilitates communication between the communication device 700 and other devices or communication networks by using a transceiver device, such as, but not limited to, a transceiver. The communication interface 730 may further include an input / output interface.

[0196] In the implementation process, the steps of the aforementioned method may be implemented using hardware integrated logic circuits in the processor 720, or instructions in the form of software. The methods disclosed with reference to the embodiments of this application may be directly implemented by a hardware processor, or may be implemented by a combination of hardware and software modules in the processor. The software modules may be located in a mature storage medium in the art, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, or a register. The storage medium is located in the memory 710, and the processor 720 reads the information in the memory 710 and completes the steps of the aforementioned method in combination with the hardware of the processor. To avoid repetition, the details will not be described again in this specification.

[0197] An embodiment of this application further provides a computer readable medium, which stores a program code, which, when executed on a computer, enables the computer to perform any one of the above-mentioned methods of FIG.

[0198] An embodiment of the present application further provides a chip including at least one processor and a memory, wherein the at least one processor is coupled to the memory and configured to read and execute instructions in the memory to perform any one of the aforementioned methods of FIG.

[0199] An embodiment of the present application further provides an intelligent vehicle including at least one processor and a memory, wherein the at least one processor is coupled to the memory and configured to read and execute instructions in the memory to perform any one of the aforementioned methods of FIG.

[0200] An embodiment of the present application further provides an intelligent vehicle including any one of the aforementioned lidar devices or apparatus of FIG. 2, FIG. 3, or FIG.

[0201] It should be understood that the processor in the embodiments of this application may be a central processing unit (CPU), or may be another general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, etc. The general-purpose processor may be a microprocessor, or the processor may be any conventional processor, etc.

[0202] It should be further understood that in the embodiments of this application, the memory may include read-only memory and random access memory to provide instructions and data to the processor. A portion of the processor may further include non-volatile random access memory. For example, the processor may further store device type information.

[0203] It should be understood that the term "and / or" in this specification describes only the associative relationship between related objects and indicates that three relationships may exist. For example, A and / or B can represent three cases: only A is present, both A and B are present, or only B is present. In addition, the character " / " in this specification generally indicates an "or" relationship between related objects.

[0204] It should be further understood that the sequence numbers of the above processes in various embodiments of this application do not mean the execution order. The execution order of the processes should be determined based on the functions and internal logic of the processes. The sequence numbers of the above processes should not be construed as any limitation on the implementation process of the embodiments of this application.

[0205] As used herein, terms such as "component," "module," and "system" refer to computer-related entities, hardware, firmware, a combination of hardware and software, software, or software being executed. For example, a component may be, but is not limited to, a process running on a processor, a processor, an object, an executable file, a thread of execution, a program, and / or a computer. As illustrated using the figures, both a computing device and an application executing on a computing device may be a component. One or more components may reside within a process and / or thread of execution, and a component may be located on one computer and / or distributed between two or more computers. In addition, these components may be executed by various computer-readable media that store various data structures. For example, a component may communicate using local and / or remote processes based on signals having one or more data packets (e.g., data of a local system, a distributed system, and / or two components interacting with another component over a network, e.g., the Internet interacting with another system using signals).

[0206] As those skilled in the art can understand, in combination with the examples described in the embodiments disclosed herein, the units and algorithm steps can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether a function is implemented by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but the implementation should not be considered to go beyond the scope of this application.

[0207] For convenience and simplicity of description, it can be clearly understood by those skilled in the art that the detailed operation processes of the above-mentioned systems, devices, and units may refer to the corresponding processes in the above-mentioned method embodiments, and details will not be described again here.

[0208] In some embodiments provided in this application, it should be understood that the disclosed system, device, and method may be implemented in other manners. For example, the device embodiment described is merely an example. For example, the division into units is merely a logical division of functions, and the actual implementation may have other manners for division. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not implemented. Furthermore, the shown or described mutual couplings or direct couplings or communication connections may be implemented using some interfaces. Indirect couplings or communication connections between devices or units may be implemented in electronic, mechanical, or other forms.

[0209] The units described as separate components may or may not be physically separated. The components shown as units may or may not be physical units, and may be located in one location or distributed across multiple network units. Some or all of the units may be selected based on the actual requirements for achieving the objectives of the solutions of the embodiments.

[0210] Furthermore, the functional units in the embodiments of this application may be integrated into one processing unit, or each of the units may exist physically separately, or two or more units may be integrated into one unit.

[0211] When a function is implemented in the form of a software functional unit and sold or used as an independent product, the function may be stored in a computer-readable storage medium. Based on such understanding, the technical solution of this application may be essentially implemented in the form of a software product, or a part of the technical solution may be implemented in the form of a software product. The computer software product includes some instructions stored in a storage medium and instructing a computer device (which may be a personal computer, a server, a network device, etc.) to execute all or part of the steps of the method described in the embodiments of this application. The aforementioned storage medium includes any medium that can store program code, such as a USB flash drive, a removable hard disk drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, an optical disk, etc.

[0212] The above description is merely a specific embodiment of this application, and is not intended to limit the scope of protection of this application. Any modifications or replacements that are easily conceived by those skilled in the art within the technical scope disclosed in this application shall fall within the scope of protection of this application. Therefore, the scope of protection of this application shall be subject to the scope of protection of the claims. [Explanation of symbols]

[0213] 100 vehicles 110 Infotainment systems, computers 111 Communication Systems 112 Entertainment System 113 Navigation System 120 Detection System 121 Global Positioning System, Wheel 122 Inertial Measurement Unit 123 Rider 124 Millimeter Wave Radar 125 Ultrasonic Radar 126 Radar and camera equipment 130 Decision Control Systems 131 Computing Systems 132 Vehicle Controller 133 Steering System 134 Throttle 135 Braking System 140 Drive System 141 Engine 142 Energy Sources 143 Transmission equipment, transmission systems 144 Wheels 146 Wireless Communication Systems 150 Computer Systems, Computing Platforms 151 processor 152 Memory 153 Command 200 Cleaning System 210 Rider body, rider body device 211 Detection unit 213 CAN transceiver 220 Cleaning Equipment 221 Water pump, detection unit 222 Water Pump Controller, Water Pump Control Module 223 Nozzle 224 Transmission Mechanism 225 Motor 226 Motor Drive Module 230 Water Tank 240 Body Cockpit Controller 300 Cleaning equipment, cleaning devices 301 Water inlet pipe 302 Water Pump 303 Water Outlet Pipe 304 Nozzle 305 screw rod nut 306 Screw Rod 307 Guide Rod 308 Cover 309 Guide Rail 310 Motor 311 Rider 500 Rider Cleaning Method 600 Rider Cleaning Method 700 Lidar equipment, communication devices 710 Memory 720 Processor 720 Memory 730 Communication Interface, Input / Output Interface

Claims

1. A lidar device comprising a cleaning device and a control unit, The control unit determines a cleaning target area of ​​the lidar window based on position information of an obstruction on the lidar window, and controls the cleaning device to clean the cleaning target area of ​​the lidar window. Lidar device.

2. The position information of the obstruction on the lidar window includes a coordinate range of the obstruction on the lidar window, The control unit determines a coordinate range of the cleaning target area based on the coordinate range of the obstruction on the lidar window.

13. The lidar device of claim 1.

3. The lidar device of claim 2 , wherein the coordinate range of the cleaning target area is greater than or equal to the coordinate range of the obstruction on the lidar window.

4. The lidar device of claim 1 , further comprising a detection unit, the detection unit being configured to obtain the position information of the obstruction on the lidar window.

5. The cleaning device includes a nozzle, a screw rod, a motor, and a guide rail. the motor is rotatably disposed on the screw rod for driving the nozzle to move along a defined track of the guide rail; A lidar device as described in any one of claims 1 to 4.

6. The control unit determines motor parameters based on the coordinate range of the obstruction on the lidar window; The control unit controls the motor to rotate based on the motor parameters, and drives the nozzle to clean the cleaning target area of ​​the lidar window.

6. The lidar device of claim 5.

7. The lidar device of claim 6 , wherein the motor parameter comprises a motor rotation angle or a motor rotation speed.

8. 8. A lidar device as claimed in claim 1, wherein the control unit controls the cleaning device to perform cleaning if the number of times the cleaning device has performed consecutive cleanings is less than a first threshold value.

9. 8. A lidar device as described in any one of claims 1 to 7, wherein the device further comprises a transceiver unit, the transceiver unit being configured to transmit an alarm signal to a cockpit controller if the number of times the cleaning device has performed consecutive cleanings is greater than a first threshold, the alarm signal being used to request manual intervention.

10. 9. The lidar device of claim 1, wherein the control unit controls the cleaning device to clean the cleaning target area of ​​the lidar window when the duration for which the cleaning device continuously performs cleaning is shorter than a second threshold.

11. 9. The lidar device of claim 1, wherein when the duration during which the cleaning device continuously performs cleaning is longer than a second threshold, the control unit controls the nozzle to move to an end of the guide rail, the end of the guide rail being located outside the visible range of the lidar window.

12. The lidar device further comprises a lidar body, the lidar body comprises a controller area network interface, and the cleaning apparatus further comprises a water pump control module and a motor drive module; The controller area network interface is connected to the water pump control module and / or the motor drive module via a controller area network bus.

12. A lidar device as described in any one of claims 1 to 11.

13. acquiring position information of an obstruction on a lidar window; determining a cleaning target area of ​​the lidar window based on the position information of the obstruction on the lidar window; controlling a cleaning device to clean the cleaning target area of ​​the lidar window; A rider cleaning method including:

14. The position information of the obstruction on the lidar window includes a coordinate range of the obstruction on the lidar window, The step of determining a cleaning target area based on the position information of the obstruction on the lidar window includes a step of determining a coordinate range of the cleaning target area based on the coordinate range of the obstruction on the lidar window. The method of claim 13.

15. The method of claim 14 , wherein the coordinate range of the cleaning target area is greater than or equal to the coordinate range of the obstruction on the lidar window.

16. 16. The method according to any one of claims 13 to 15, determining motor parameters based on the coordinate range of the occlusion on the lidar window; controlling a motor to rotate based on the motor parameters to drive the cleaning device to clean the cleaning target area of ​​the lidar window; The method further comprises:

17. The method of claim 16 , wherein the motor parameter comprises a motor rotation angle or a motor rotation speed.

18. The step of controlling a cleaning device to clean the cleaning target area of ​​the lidar window comprises: controlling the cleaning device to perform cleaning if the number of times the cleaning device has performed consecutive cleanings is less than a first threshold; 18. The method of any one of claims 13 to 17, comprising:

19. The method comprises: sending an alarm signal if the number of consecutive cleaning runs performed by the cleaning device is greater than a first threshold, the alarm signal being used to request manual intervention; 18. The method of any one of claims 13 to 17, further comprising:

20. The step of controlling a cleaning device to clean the cleaning target area of ​​the lidar window comprises: controlling the cleaning device to clean the cleaning target area of ​​the lidar window when the duration for which the cleaning device continuously performs cleaning is less than a second threshold; 20. The method of any one of claims 13 to 19, comprising:

21. The method comprises: controlling the cleaning device to be positioned outside the visible range of the lidar window when a duration during which the cleaning device continuously performs cleaning is longer than a second threshold value; 20. The method of any one of claims 13 to 19, further comprising:

22. 22. An intelligent vehicle comprising at least one processor and a memory, the at least one processor coupled to the memory and configured to read and execute instructions in the memory to perform the method of any one of claims 13 to 21.

23. 13. An intelligent vehicle comprising a lidar device according to any one of claims 1 to 12.

Citation Information

Patent Citations

  • Radar shielding object detection method and device

    CN113376581A

  • Wiper control device

    JP1992151350A

  • Vehicle washing system

    JP2019104365A

  • Systems, apparatus, and methods to remove vehicle sensor debris

    US20200108801A1

  • Vehicle cleaner system and vehicle provided with vehicle cleaner system

    WO2018230255A1