Bayonet device and snapshot method

Abstract

The embodiment of the invention provides a bayonet device and a snapshot method, relates to the technical field of image acquisition, and solves the problems that the number of devices in a bayonet system is large, the construction cost is high, and construction and maintenance are tedious. According to the specific scheme, a sensing module is used for obtaining point cloud data of a plurality of lanes, and a control module is used for sending a snapshot position signal to a light supplement lane deflection module based on the point cloud data. The light supplementing lane deflection module is used for adjusting the position of the light supplementing module based on the snapshot position signal, so that the light supplementing area of the light supplementing module covers the target object, the light supplementing module is used for emitting the light supplementing area, and the bayonet camera is used for snapshot of the target object. The embodiment of the invention is used for the process of capturing the target object.

Description

Technical Field

[0001] This application relates to the field of image acquisition technology, and in particular to a checkpoint device and a snapshot method. Background Technology

[0002] Traffic checkpoint cameras (also known as checkpoint cameras) are an important tool in modern urban traffic management. They use high-tech video recording technology and intelligent recognition systems to control, identify, and manage vehicles. These cameras are widely used in road traffic management, violation management, and traffic flow statistics, providing strong support and assurance for urban traffic management.

[0003] Traffic checkpoint cameras, using high-definition cameras and advanced image recognition technology, can capture real-time vehicle information on the road, such as license plate numbers, vehicle models, colors, and speeds. Through comparison and analysis with a database, the system can automatically identify and classify vehicles, and provide data support to traffic management departments by recording vehicle communication information and traffic violations.

[0004] Typically, checkpoint systems require multiple devices such as cameras, supplementary lights, and speed radar to perform various functions including shooting, supplementary lighting, and speed measurement. When there are multiple lanes, the various devices in the checkpoint system form a congested "sparrow array," which not only affects the aesthetics of the city but also leads to high construction costs and complicated construction and maintenance. Summary of the Invention

[0005] This application provides a checkpoint device and a capture method, which improves the problems of a large number of devices, high construction costs, and cumbersome construction and maintenance in checkpoint systems.

[0006] To achieve the above objectives, the embodiments of this application adopt the following technical solutions.

[0007] In a first aspect, embodiments of this application provide a checkpoint device, comprising: a sensing module, a control module, a checkpoint camera, a supplementary lighting module, and a supplementary lighting lane deflection module. The sensing module acquires point cloud data of multiple lanes, and the control module sends a capture position signal to the supplementary lighting lane deflection module based on the point cloud data. The supplementary lighting lane deflection module adjusts the position of the supplementary lighting module based on the capture position signal, so that the supplementary lighting area of ​​the supplementary lighting module covers the target object. The supplementary lighting module emits the supplementary lighting area, and the checkpoint camera captures the target object.

[0008] Therefore, compared to each lane being equipped with a separate speed-measuring radar and supplementary lighting, the checkpoint device provided in this application integrates a sensing module, a checkpoint camera, and a supplementary lighting module, achieving multi-device unification. Furthermore, the checkpoint device also includes a supplementary lighting lane deflection module. The control module can control this module to provide supplementary lighting to target objects in any of the multiple lanes. In other words, the checkpoint device provided in this application allows one device to manage multiple lanes, reducing the number of devices in the checkpoint system and improving the problems of high construction costs and cumbersome construction and maintenance. Additionally, the control module can control the supplementary lighting area of ​​the supplementary lighting module based on the point cloud data acquired by the sensing module, enabling precise supplementary lighting.

[0009] In one possible design, the capture position signal includes the position signal of the vehicle window. The supplementary lighting lane deflection module is specifically used to adjust the position of the supplementary lighting module based on the vehicle window position signal, so that the supplementary lighting area of ​​the module covers the target vehicle window. Therefore, the checkpoint device can control the supplementary lighting module to accurately illuminate the target vehicle window through the supplementary lighting lane deflection module, improving the efficiency of supplementary lighting, reducing energy waste, and lowering light pollution.

[0010] In one possible design, the control module is specifically used to parse point cloud data to obtain the speed and position information of a target object in any one of the multiple lanes, and then send a capture position signal to the supplementary lighting lane deflection module based on the speed and position information. The control module is also used to send a capture time signal to the supplementary lighting module and a capture trigger signal to the checkpoint camera based on the speed and position information. The capture time signal and the capture trigger signal are used to achieve timing synchronization between the supplementary lighting module and the checkpoint camera. Thus, the control module can obtain the speed and position information of the target object to achieve timing synchronization between the supplementary lighting module and the checkpoint camera, thereby executing the capture process.

[0011] In one possible design, the mount camera is also used to determine the capture data for the current frame based on capture data from historical frames, including gain and exposure time. Thus, the mount device can obtain a clearer image by adjusting the capture data of the mount camera in real time.

[0012] In one possible design, the supplementary lighting lane deflection module is a microelectromechanical system (MEMS) micromirror or a fast-control reflector.

[0013] In one possible design, the supplementary lighting module is at least one of the following: an infrared laser light source, a white laser light source, or a white light emitting diode light source.

[0014] In one possible design, when the supplementary lighting module includes an infrared laser source and a white laser source, the optical paths of the infrared laser source and the white laser source are the same.

[0015] In one possible design, the optical paths of the infrared laser source, the white laser source, and the lane deflection module are the same.

[0016] In one possible design, the sensing module is at least one of the following: an infrared detector, a lidar, or a millimeter-wave radar.

[0017] Secondly, embodiments of this application provide a capture method applied to a checkpoint device. The checkpoint device includes a sensing module, a control module, a checkpoint camera, a supplementary lighting module, and a supplementary lighting lane deflection module. The capture method includes: acquiring point cloud data of multiple lanes through the sensing module; sending a capture position signal to the supplementary lighting lane deflection module based on the point cloud data through the control module; adjusting the position of the supplementary lighting module based on the capture position signal through the supplementary lighting lane deflection module, so that the supplementary lighting area of ​​the supplementary lighting module covers the target object; emitting the supplementary lighting area through the supplementary lighting module, and capturing the target object through the checkpoint camera.

[0018] In one possible design, the capture position signal includes the position signal of the vehicle window. The position of the supplementary lighting module is adjusted based on the capture position signal by the supplementary lighting lane deflection module so that the supplementary lighting area of ​​the supplementary lighting module covers the target object. This includes: adjusting the position of the supplementary lighting module based on the position signal of the vehicle window by the supplementary lighting lane deflection module so that the supplementary lighting area of ​​the supplementary lighting module covers the vehicle window of the target object.

[0019] In one possible design, the control module sends a capture position signal to the supplementary lighting lane deflection module based on point cloud data. This includes: parsing the point cloud data to obtain the speed and position information of the target object in any lane from multiple lanes, and sending the capture position signal to the supplementary lighting lane deflection module based on the speed and position information. The method also includes: sending a capture time signal to the supplementary lighting module and a capture trigger signal to the checkpoint camera based on the speed and position information. The capture time signal and the capture trigger signal are used to achieve timing synchronization between the supplementary lighting module and the checkpoint camera. In another possible design, the method further includes: determining the capture data of the current frame based on capture data from historical frames using the checkpoint camera. The capture data includes gain and exposure time.

[0020] In one possible design, the lane deflection module is a MEMS micromirror or a fast-controllable reflector.

[0021] In one possible design, the supplementary lighting module is at least one of the following: an infrared laser light source, a white laser light source, or a white LED light source.

[0022] In one possible design, when the supplementary lighting module includes an infrared laser source and a white laser source, the optical paths of the infrared laser source and the white laser source are the same.

[0023] In one possible design, the optical paths of the infrared laser source, the white laser source, and the lane deflection module are the same.

[0024] In one possible design, the sensing module is at least one of the following: an infrared detector, a lidar, or a millimeter-wave radar.

[0025] For the benefits of the second aspect, please refer to the explanation of the first aspect.

[0026] Thirdly, embodiments of this application provide a computer-readable storage medium including computer instructions that, when executed on an electronic device, cause the electronic device to perform the snapshot method in any of the possible implementations of the second aspect described above.

[0027] Fourthly, embodiments of this application provide a computer program product that, when run on a computer or processor, causes the computer or processor to execute the snapshot method in any of the possible implementations of the second aspect described above.

[0028] It is understood that any of the aforementioned checkpoint devices, computer-readable storage media, or computer program products can be applied to the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to in the beneficial effects of the corresponding methods, and will not be repeated here.

[0029] These or other aspects of this application will become more readily apparent in the following description. Attached Figure Description

[0030] Figure 1 A scene diagram of a checkpoint system provided in an embodiment of this application;

[0031] Figure 2 A structural diagram of a bayonet device provided in an embodiment of this application;

[0032] Figure 3 A schematic diagram of the optical path of a bayonet device provided in an embodiment of this application;

[0033] Figure 4 A structural diagram of another bayonet device provided in an embodiment of this application;

[0034] Figure 5 A structural diagram of another bayonet device provided in the embodiments of this application;

[0035] Figure 6 A flowchart illustrating a snapshot method provided in this application embodiment;

[0036] Figure 7 A flowchart of another snapshot method provided in this application embodiment. Detailed Implementation

[0037] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; "and / or" in this text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0038] Furthermore, the term "coupling" is used to refer to electrical connections, including direct connections via wires or terminals or indirect connections via other devices. Therefore, "coupling" should be considered a broad type of electronic communication connection.

[0039] It should be noted that, in this application, the terms "exemplary" or "for example" are used to indicate that something is being described as an example, illustration, or illustration. Any embodiment or design described as "exemplary" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or design solutions. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0040] The checkpoint system is short for road traffic security checkpoint monitoring system. It is a road traffic on-site monitoring system that relies on specific locations on the road, such as toll stations, traffic or checkpoints, to photograph, record and process all motor vehicles passing through the checkpoint.

[0041] Currently, in multi-lane checkpoint systems, a single camera typically covers the entire field of view of multiple lanes. Additionally, each lane requires an independent supplemental lighting system to illuminate targets in bright sunlight reflected off car windows during the day or in low-light conditions at night. Each lane also has its own radar to acquire speed information for detecting speeding and other traffic violations. Figure 1 As shown, Figure 1 The diagram shows a camera, lane 1, and lane 2. Lane 1 is equipped with xenon headlights 1 and radar 1, while lane 2 is equipped with xenon headlights 2 and radar 2. Additionally, the checkpoint system includes a capture line, which can be positioned at a certain distance from the checkpoint system; in one possible example, this distance could be 25 meters.

[0042] Specifically, when a vehicle in lane 1 reaches the detection line, the xenon headlights 1 illuminate the vehicle, the camera captures an image, and the radar 1 acquires the vehicle's speed information. Thus, the checkpoint system can obtain the vehicle's image and speed information to perform corresponding violation judgment and analysis.

[0043] However, the various devices in the checkpoint system of this scheme easily form a congested "sparrow formation," which not only affects the aesthetics of the city but also leads to high construction costs and cumbersome construction and maintenance. Furthermore, the lack of integration between radar and supplementary lighting results in information waste and an inability to intelligently supplement lighting for the vehicle's area of ​​interest. Typically, the area of ​​interest for a vehicle is at the window, and a clear image of the window area can reveal the driver's behavior inside the vehicle. In addition, xenon headlights have a large supplementary lighting range, with much of the supplementary lighting energy being used in ineffective areas, resulting in energy waste, severe light pollution, low efficiency, and affecting the safety of other cyclists and drivers.

[0044] Therefore, this application provides a checkpoint device that integrates a sensing module, a checkpoint camera, and a supplementary lighting module, achieving multi-device unification. Additionally, the checkpoint device includes a supplementary lighting lane deflection module. The control module, by controlling this module, enables the supplementary lighting module to illuminate target objects in any of the multiple lanes, allowing one checkpoint device to manage multiple lanes. This reduces the number of devices in the checkpoint system and alleviates the problems of high construction costs and cumbersome maintenance. Furthermore, the control module can control the supplementary lighting area of ​​the supplementary lighting module based on point cloud data acquired by the sensing module, achieving precise supplementary lighting.

[0045] Besides the checkpoint scenarios mentioned above, the checkpoint device provided in this application embodiment can also be applied to electronic traffic enforcement (ECE) scenarios and pedestrian-card (PCC) scenarios. In the ECE scenario, "electronic traffic enforcement" refers to a system that uses modern electronic information technology to detect and record traffic violations. Compared to checkpoint systems, ECE focuses more on detecting specific violations, such as speeding, running red lights, and illegal lane changes. ECE uses intelligent image analysis technology to capture the dynamic behavior of vehicles, and combined with backend data analysis, helps improve urban traffic order and reduce traffic accident rates. The PCC scenario refers to a pedestrian flow statistics and control system, which uses technologies such as facial recognition and body feature recognition to accurately calculate changes in the number of people in a certain area, which is of great significance for crowd control and public safety.

[0046] The bayonet device provided in the embodiments of this application will be further described below with reference to the accompanying drawings.

[0047] This application provides a bayonet device, such as... Figure 2 As shown, the checkpoint device includes a sensing module, a control module, a checkpoint camera, a supplementary lighting module, and a supplementary lighting lane deflection module.

[0048] The perception module is used to acquire point cloud data for multiple lanes.

[0049] For example, the perception module may include a field of view, which is equipped with capture lines. The capture lines may be set at a certain distance from the checkpoint device, for example, at a distance of 25m. When a target object enters the field of view (before the target object reaches the capture line), the perception module acquires point cloud data of multiple lanes.

[0050] For example, point cloud data is a collection of a large number of points in three-dimensional space. Each point typically includes three coordinate values ​​(e.g., X, Y, and Z), which represent the length, width, and height of the object, describing the geometry of the object's surface. In this case, the point cloud data acquired by the perception module includes scene data for multiple lanes and data for the target object.

[0051] For example, assuming the power supply frequency of the checkpoint device is 2 Hz, where N is typically 20 or 25, the operating frequency of the sensing module can be N Hz, meaning it scans the entire scene once every 1 / N ms to obtain point cloud data for multiple lanes. The sensing module can complete point cloud generation and processing within two cycles. Specifically, in the first cycle, the sensing module collects point cloud data, and in the second cycle, it processes the point cloud data. The processing of the point cloud data by the sensing module can include noise reduction and filtering to remove noise points and retain only useful information. In one possible example, filtering methods could include thresholding, neighborhood averaging, and morphological operations.

[0052] Optionally, the sensing module may be at least one of the following: an infrared detector, a lidar, or a millimeter-wave radar.

[0053] For example, an infrared detector can sense the presence and location of an object by detecting changes in thermal radiation in the surrounding environment. Infrared detectors operate based on the principle of infrared radiation, which is part of the electromagnetic spectrum and lies between visible light and microwaves. An infrared detector mainly consists of an infrared sensing element and a signal amplification circuit. The infrared sensing element is typically a thermistor, pyroelectric material, or semiconductor device. It senses infrared radiation emitted by external heat sources and converts changes in this radiation into an electrical signal. The signal amplification circuit then amplifies this electrical signal for further processing.

[0054] For example, a lidar (Light Detection and Ranging) system is a device that uses laser pulses to measure distance. Its basic principle is to emit a laser pulse towards a target object and receive the reflected signal to calculate the target object's distance, speed, and direction. A lidar system typically includes a laser emitter, an optical system, a photodetector, and a data processing unit. The laser emitter emits high-intensity laser pulses, which are very short, typically only a few nanoseconds, enabling lidar to measure very long distances accurately. The optical system focuses the laser pulse and directs it onto the target object, and focuses the reflected light onto the photodetector. The photodetector receives the laser pulse reflected from the target object and converts it into an electronic signal. The data processing unit analyzes the received electronic signal, decodes it, and calculates the target object's three-dimensional coordinates.

[0055] For example, millimeter-wave radar is a device that detects and identifies targets by transmitting and receiving millimeter-level electromagnetic waves. Its basic principle is to transmit electromagnetic waves in the millimeter-level frequency band (generally referring to radio waves with frequencies between 30 GHz and 300 GHz and wavelengths of approximately 1 mm to 10 mm) via an antenna. When these millimeter-level electromagnetic waves encounter a target, they are reflected back. The radar receiver captures these reflected waves and calculates information such as the target's distance, angular position, velocity, and shape characteristics by comparing the time difference and amplitude changes between the transmitted and received electromagnetic waves.

[0056] The control module is used to send the capture position signal to the supplementary lighting lane deflection module based on point cloud data.

[0057] For example, the control module can be a central processing unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.

[0058] Optionally, the control module is specifically used to parse point cloud data, obtain the speed and position information of the target object in any one of the multiple lanes, and send the capture position signal to the supplementary lighting lane deflection module based on the speed and position information.

[0059] For example, the control module can process point cloud data based on acceleration operators and point cloud algorithms to obtain the speed and position information of the target object. The speed information can be used to predict the time when the target object arrives at the capture line, and the position information can be used to predict the position of the target object when it arrives at the capture line; this position can also be understood as the lane where the target object is located. Specifically, acceleration operators can improve computational efficiency and reduce computation time and resource consumption, such as quantization and low-precision calculations, distributed computing, or approximate calculations. Point cloud algorithms can include: first, denoising and filtering the point cloud data to remove outliers and noise interference, improving data instruction quality; second, feature extraction from the point cloud data to identify key features such as edges, corners, and points for subsequent analysis and processing; third, point cloud registration, i.e., aligning multiple point cloud datasets to solve the data fusion problem of multi-view or mobile platforms; and finally, segmenting and classifying the point cloud data, i.e., dividing the point cloud into different parts according to specific criteria and labeling their categories (e.g., vehicles, ground, and trees).

[0060] Optionally, the control module is also used to send a capture time signal to the supplementary light module and a capture trigger signal to the camera mount based on speed and position information. The capture time signal and the capture trigger signal are used to achieve timing synchronization between the supplementary light module and the camera mount.

[0061] For example, the control module can also determine whether to trigger the checkpoint camera to execute the capture process based on the position of the preset capture line. Specifically, continuing with the example of a 2NHz power supply frequency for the checkpoint device, the checkpoint camera can also operate in a 2N frames per second (FPS) mode, meaning the checkpoint camera periodically captures images of multiple lanes. The periodically captured images are only for recording; when a target object reaches the capture line, the checkpoint device captures the image, which is then used to analyze whether the target object has committed a violation. The control module can determine the time and position of the target object's arrival at the capture line based on its speed and position information. If the target object has not yet reached the capture line, the control module does not trigger the checkpoint camera to execute the capture process; if the target object is near the capture line, the control module triggers the checkpoint camera to execute the capture process.

[0062] For example, since the camera periodically captures images and the sensing module periodically scans the entire scene, the control module should also control the timing synchronization of the camera, sensing module, and supplementary lighting module to execute the capture process.

[0063] For example, the control module should send signals to the lane deflection module, the lighting module, and the camera at least two frames in advance to ensure that the lighting module is in the appropriate lighting position and the camera is ready to execute the capture process before the target object reaches the capture line.

[0064] Therefore, compared to configuring one radar per lane, the checkpoint device provided in this application, through the cooperation of the sensing module and the control module, can obtain the speed and location information of the target object, while also reducing the number of radars and lowering construction costs.

[0065] The supplementary lighting lane deflection module is used to adjust the position of the supplementary lighting module based on the capture position signal so that the supplementary lighting area of ​​the supplementary lighting module covers the target object.

[0066] For example, the capture position signal may include two-dimensional state information of the supplementary lighting module, namely its lateral and longitudinal positions. The supplementary lighting lane deflection module can adjust the position of the supplementary lighting module in both the lateral and longitudinal directions so that the supplementary lighting area of ​​the module covers the target object.

[0067] Therefore, compared to configuring one supplementary light for each lane, the checkpoint device provided in this application can achieve precise supplementary lighting by modulating the position of the supplementary lighting module through the supplementary lighting lane deflection module, thereby reducing the number of supplementary lights and lowering construction costs.

[0068] Optionally, the lane deflection module for supplemental lighting can be a microelectromechanical system (MEMS) micromirror or a fast steering mirror (FSM).

[0069] For example, a MEMS micromirror is a small, movable mirror integrated onto a microelectromechanical system chip. The MEMS micromirror can quickly change the position of the illumination module, making the illumination area of ​​the module coincide with the desired illumination area. A fast-control mirror, also known as a quick-reflecting mirror, is a device that uses a reflective surface to precisely control a light beam between a light source and a receiver. It can achieve rapid, minute-angle deflection of the light beam using piezoelectric ceramics or voice coil electrodes.

[0070] In other words, the control module can send voltage signals to the MEMS micromirrors and the fast-control mirrors. The MEMS micromirrors and the fast-control mirrors can adjust the position of the supplementary lighting module based on the voltage signals, so as to enable the supplementary lighting module to accurately supplement the target object, reduce the waste of light energy, increase the utilization rate of light energy, and reduce light pollution.

[0071] The supplementary lighting module is used to emit supplementary lighting to the designated area.

[0072] For example, a supplemental lighting module can be a lighting device that enhances the light in a specific environment. The supplemental lighting module can employ infrared supplemental lighting and white light supplemental lighting. For instance, in completely dark or very low-light scenes, the supplemental lighting module can provide auxiliary lighting using infrared light, which is invisible to the human eye, ensuring that the driver's normal vision is not affected while still capturing the necessary details such as license plates, driver's face, and seat belts. As another example, in scenes requiring high brightness and uniform illumination, the supplemental lighting module can use white light for auxiliary lighting to improve the overall brightness of the image, making colors more vivid and details clearer.

[0073] For example, to ensure the checkpoint device can capture a suitable image, the supplementary lighting lane deflection module adjusts the supplementary lighting module to a suitable position at least one frame before the checkpoint camera performs the capture operation. This ensures that the supplementary lighting area emitted by the supplementary lighting module covers the target object when the checkpoint camera performs the capture operation. After the supplementary lighting module is adjusted to the suitable position, it remains stationary, waiting for the control module to trigger the strobe supplementary lighting. Specifically, the supplementary lighting module can emit the supplementary lighting area based on the capture time signal.

[0074] Optionally, the supplementary lighting module can be at least one of the following: an infrared laser light source, a white laser light source, or a white light emitting diode (LED) light source.

[0075] For example, an infrared laser source is a special type of laser source that can generate a beam of light in the infrared band, outside the visible light range. Specifically, an infrared laser source can include semiconductor laser diodes and solid-state lasers, which use high-energy electrons to excite atoms or molecules in a substance, causing them to transition to higher energy levels and subsequently release energy to form a laser beam. Infrared lasers have relatively long wavelengths, typically in the near-infrared to far-infrared range, and can be in continuous wave or pulsed form.

[0076] For example, a white light laser source is a laser system capable of emitting light of all colors within the visible spectrum. Specifically, a white light laser source passes a laser beam through a dispersive element (such as a prism or grating) to separate and disperse light of different wavelengths, and then converges the dispersed colors back along the same path to form composite white light.

[0077] For example, a white LED light source is a device that directly converts electrical energy into visible light. Specifically, the working principle of a white LED light source is based on the photoelectric effect of semiconductor materials. When current passes through an LED composed of P-type and N-type semiconductors, electrons and holes recombine at the PN junction, releasing photons and forming a light emission phenomenon.

[0078] For example, the supplementary lighting module may include only an infrared laser light source, only a white laser light source, or only a white LED light source. The supplementary lighting module may also include both an infrared laser light source and a white laser light source, or both an infrared laser light source and a white LED light source.

[0079] Optionally, when the supplementary lighting module includes an infrared laser source and a white laser source, the optical paths of the laser emitted by the infrared laser source and the white laser source are the same.

[0080] For example, when the supplementary lighting module includes both an infrared laser source and a white light laser source, the supplementary lighting module may also include a beam combiner, wherein the lasers emitted by the infrared laser source and the white light laser source are both converged to the beam combiner. In one possible example, the laser emitted by the infrared laser source can be converged to the beam combiner along a first direction, and the laser emitted by the white light laser source can be converged to the beam combiner along a second direction, wherein the first direction and the second direction can be perpendicular to each other.

[0081] Optionally, when the supplementary lighting module includes both an infrared laser source and a white laser source, the optical paths of the infrared laser source and the white laser source can also be different. In other words, the infrared laser source and the white laser source can have separate optical path designs.

[0082] For example, when the supplementary lighting module includes both an infrared laser source and a white LED source, the laser beam emitted by the infrared laser source and the LED beam emitted by the white LED source can both be converged to the beam combiner.

[0083] Optionally, the optical paths of the infrared laser source, the white laser source, and the supplementary lighting lane deflection module are the same.

[0084] For example, the optical paths of the infrared laser source and the white light laser source can also reuse the optical path of the supplementary lighting lane deflection module. For instance... Figure 3 As shown, taking the lane deflection module as an example, the lasers emitted by the infrared laser source and the white laser source converge into the beam combiner, and then the beam is emitted outward through the fast-control mirror. This simplifies the design of the checkpoint device.

[0085] Optionally, the optical paths of the infrared laser source and the white light laser source can also be different from those of the supplementary lighting lane deflection module.

[0086] Optionally, the capture position signal includes the position signal of the vehicle window. The supplementary lighting lane deflection module is specifically used to adjust the position of the supplementary lighting module based on the position signal of the vehicle window, so that the supplementary lighting area of ​​the supplementary lighting module covers the vehicle window of the target object.

[0087] For example, the control module can obtain the window's position information based on the target object's speed and position information. Therefore, the supplementary lighting lane deflection module can adjust the position of the supplementary lighting module to ensure that its illumination area accurately covers the target object's window. Typically, the target object's region of interest is the window; in other words, the precise coverage of the region of interest by the supplementary lighting module improves illumination efficiency, reduces energy waste, and lowers light pollution.

[0088] Among them, the checkpoint camera is used to capture images of the target object.

[0089] For example, the capture trigger signal is the moment when the control module predicts, based on speed and position information, that the target object will arrive near the capture line. When the target object approaches the capture line, the supplementary lighting module emits supplementary lighting, and the checkpoint camera captures the target object. Specifically, the checkpoint camera can capture the target object based on the capture trigger signal. The captured image can be transmitted to a terminal device for image processing to determine whether the driver in the target object has committed a traffic violation.

[0090] Optionally, the mount camera is also used to determine the capture data for the current frame based on capture data from historical frames, including gain and exposure time.

[0091] For example, before the camera captures a target object, it can adjust its parameters based on historical frame capture data. For instance, it can adjust the gain of the current frame, i.e., adjust the auto exposure (AE) parameters. It can also adjust the exposure time of the current frame to increase or decrease the overall image brightness. Furthermore, it can adjust the aperture of the current frame to control the amount of light entering the lens. Thus, by adjusting the camera's capture data in real time, the mount device can obtain a clearer image.

[0092] In one possible implementation, such as Figure 4As shown, the perception module is a LiDAR, the lane deflection supplementary lighting module is a fast-control reflector, and the supplementary lighting module is an infrared laser source. The checkpoint camera also includes sensors that convert light signals into electrical signals. These sensors are coupled to the control module via a high-speed bus, while the control module is coupled to the LiDAR, fast-control reflector, and infrared laser source via a low-speed bus. The high-speed bus can be used to transmit image signals captured by the checkpoint camera; in one possible example, the high-speed bus could be a Mobile Industry Processor Interface (MIPI) or a Peripheral Component Interconnect Express (PCIE). The low-speed bus can be used to transmit capture position signals, capture time signals, and capture trigger signals; in one possible example, the low-speed bus could be RS485 or an Interintegrated Circuit (I2C) interface. In addition, the control module is coupled to the LiDAR, fast-control reflector, and infrared laser source via a power bus, which supplies power to these components. The control module is also coupled to the terminal device via the low-speed bus to transmit captured images to the terminal device.

[0093] In another possible implementation, such as Figure 5 As shown, the sensing module is a millimeter-wave radar, the lane deflection supplementary lighting module is a MEMS micromirror, and the supplementary lighting module is a white light laser source. The checkpoint camera also includes sensors, which can be coupled to the control module via a high-speed bus. The control module is also coupled to the millimeter-wave radar, MEMS micromirror, and white light laser source via a low-speed bus. In addition, the control module is coupled to the millimeter-wave radar, MEMS micromirror, and white light laser source via a power bus, and also to the terminal device via a low-speed bus.

[0094] Understandable, except Figure 4 and Figure 5 The checkpoint device shown can also be a combination of other components, such as a LiDAR sensing module, a fast control feedback mirror for lane deflection, and a white LED light source for illumination. This application does not limit this specific embodiment.

[0095] Therefore, compared to each lane being equipped with a separate speed-measuring radar and supplementary lighting, the checkpoint device provided in this application integrates a sensing module, a checkpoint camera, and a supplementary lighting module, achieving multi-device unification. Furthermore, the checkpoint device also includes a supplementary lighting lane deflection module. The control module can control this module to provide supplementary lighting to target objects in any of the multiple lanes. In other words, the checkpoint device provided in this application allows one device to manage multiple lanes, reducing the number of devices in the checkpoint system and improving the problems of high construction costs and cumbersome construction and maintenance. Additionally, the control module can control the supplementary lighting area of ​​the supplementary lighting module based on the speed and location information obtained by the sensing module, enabling precise supplementary lighting.

[0096] Applied to the aforementioned checkpoint device, the image capture method provided in this application embodiment will be further described below with reference to the accompanying drawings.

[0097] This application provides a snapshot method, such as... Figure 6 As shown, the method includes the following steps.

[0098] S601, the checkpoint device acquires point cloud data of multiple lanes through the sensing module.

[0099] S602, the checkpoint device sends the capture position signal to the supplementary lighting lane deflection module based on point cloud data through the control module.

[0100] S603, the checkpoint device adjusts the position of the supplementary light module based on the capture position signal through the supplementary light lane deflection module, so that the supplementary light area of ​​the supplementary light module covers the target object.

[0101] S604, the bayonet device emits supplementary light to the supplementary light area through the supplementary light module.

[0102] S605, the bayonet device captures images of the target object using a bayonet camera.

[0103] Optionally, the capture position signal includes the position signal of the vehicle window. S603 may include: the checkpoint device adjusting the position of the supplementary lighting module based on the position signal of the vehicle window using the supplementary lighting lane deflection module, so that the supplementary lighting area of ​​the supplementary lighting module covers the vehicle window of the target object. For example, the checkpoint device can control the supplementary lighting module to accurately illuminate the vehicle window of the target object through the supplementary lighting lane deflection module, improving the efficiency of supplementary lighting, reducing energy waste, and reducing light pollution.

[0104] Optionally, S602 may include: the checkpoint device sending a capture position signal to the supplementary lighting lane deflection module based on point cloud data through the control module, including: parsing the point cloud data through the control module to obtain the speed information and position information of the target object in any lane among multiple lanes, and sending the capture position signal to the supplementary lighting lane deflection module based on the speed information and position information.

[0105] Optionally, the method further includes: the bayonet device sending a capture time signal to the supplementary lighting module and a capture trigger signal to the bayonet camera based on speed information and position information through the control module, wherein the capture time signal and the capture trigger signal are used to achieve timing synchronization between the supplementary lighting module and the bayonet camera.

[0106] For example, the control module can obtain the speed and position information of the target object to achieve timing synchronization between the supplementary lighting module and the camera mount, so as to execute the capture process.

[0107] For example, the process of a checkpoint device can include three parts: perception, prediction, and capture. Specifically, perception involves acquiring point cloud data of multiple lanes through a perception module, and then parsing the point cloud data through a control module to obtain position and speed information. Prediction involves the control module predicting the capture position signal, capture time signal, and capture trigger signal based on the position and speed information. Capture involves emitting supplementary light to the illuminated area through a supplementary lighting module, and capturing images through the checkpoint camera.

[0108] Optionally, the method further includes: the bayonet device determining the capture data of the current frame based on the capture data of the bayonet camera based on the capture data of historical frames, the capture data including gain and exposure time.

[0109] For example, the bayonet device can obtain a clearer image by adjusting the capture data of the bayonet camera in real time, such as adjusting the gain, exposure time, and aperture.

[0110] Another flowchart of the snapshot method provided in this application is as follows: Figure 7 As shown, Figure 7The diagram illustrates the actions of the perception layer, decision layer, and execution layer. Specifically, the perception layer first acquires point cloud data, which is then processed by the decision layer to obtain precise distance and precise speed measurements. Precise distance measurement includes vehicle pose and window position, while precise speed measurement includes vehicle tracking and vehicle speed. Finally, the execution layer performs image processing and supplementary lighting triggering, with the supplementary lighting triggering the supplementary lighting module in the perception layer. Additionally, the perception layer acquires capture data, which is processed by the decision layer, and the execution layer performs capture control to obtain new capture data. Thus, the distance to the target object can be obtained based on precise distance measurement, the speed of the target object can be obtained based on precise speed measurement, and an image of the target object can be obtained based on image processing. The terminal device can then determine whether the target object has engaged in any traffic violations based on the target object's distance, speed, and image.

[0111] This application also provides an electronic device, including one or more processors and one or more memories. The one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, including computer instructions. When the one or more processors execute the computer instructions, the electronic device performs the aforementioned method steps to implement the image capture method in the above embodiments.

[0112] Embodiments of this application also provide a computer storage medium storing computer instructions. When the computer instructions are executed on an electronic device, the electronic device performs the aforementioned method steps to implement the snapshot method in the above embodiments.

[0113] The embodiments of this application also provide a computer program product that, when run on a computer, causes the computer to perform the aforementioned related steps to implement the snapshot method executed by the electronic device in the above embodiments.

[0114] In addition, embodiments of this application also provide an apparatus, which may specifically be a chip, component or module. The apparatus may include a connected processor and a memory; wherein, the memory is used to store computer execution instructions, and when the apparatus is running, the processor may execute the computer execution instructions stored in the memory to cause the chip to execute the snapshot method executed by the electronic device in the above method embodiments.

[0115] In this embodiment, the electronic device, computer storage medium, computer program product or chip are all used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding method provided above, and will not be repeated here.

[0116] Through the above description of the embodiments, those skilled in the art will understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0117] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0118] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0119] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0120] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, essentially or in other words, the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0121] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A bayonet device, characterized in that, include: Sensing module, control module, checkpoint camera, supplementary lighting module, and supplementary lighting lane deflection module; The perception module is used to acquire point cloud data for multiple lanes; The control module is used to send a capture position signal to the supplementary lighting lane deflection module based on the point cloud data; The supplementary lighting lane deflection module is used to adjust the position of the supplementary lighting module based on the capture position signal, so that the supplementary lighting area of ​​the supplementary lighting module covers the target object; The supplementary lighting module is used to emit supplementary lighting to the designated area; The camera is used to capture images of the target object.

2. The bayonet device according to claim 1, characterized in that, The capture location signal includes the position signal of the vehicle window; The supplementary lighting lane deflection module is specifically used to adjust the position of the supplementary lighting module based on the position signal of the vehicle window, so that the supplementary lighting area of ​​the supplementary lighting module covers the vehicle window of the target object.

3. The bayonet device according to claim 1 or 2, characterized in that, The control module is specifically used to parse the point cloud data to obtain the speed information and position information of the target object in any one of the multiple lanes, and send the capture position signal to the supplementary lighting lane deflection module based on the speed information and the position information. The control module is further configured to send a capture time signal to the supplementary lighting module and a capture trigger signal to the camera based on the speed information and the position information. The capture time signal and the capture trigger signal are used to achieve time synchronization between the supplementary lighting module and the camera.

4. The bayonet device according to any one of claims 1-3, characterized in that, The camera mount is also used to determine the capture data of the current frame based on the capture data of historical frames, the capture data including gain and exposure time.

5. The bayonet device according to any one of claims 1-4, characterized in that, The supplementary lighting lane deflection module is a microelectromechanical system (MEMS) micromirror or a fast-control reflector.

6. The bayonet device according to any one of claims 1-5, characterized in that, The supplementary lighting module is at least one of the following: an infrared laser light source, a white laser light source, or a white light emitting diode light source.

7. The bayonet device according to claim 6, characterized in that, When the supplementary lighting module includes the infrared laser source and the white light laser source, the optical paths of the infrared laser source and the white light laser source are the same.

8. The bayonet device according to claim 7, characterized in that, The infrared laser source, the white laser source, and the lane deflection module have the same optical path.

9. The bayonet device according to any one of claims 1-8, characterized in that, The sensing module is at least one of the following: an infrared detector, a lidar, or a millimeter-wave radar.

10. A method for capturing images, characterized in that, The method is applied to a checkpoint device, which includes a sensing module, a control module, a checkpoint camera, a supplementary lighting module, and a supplementary lighting lane deflection module. The method includes: Point cloud data of multiple lanes are acquired through the perception module; The control module sends a capture position signal to the supplementary lighting lane deflection module based on the point cloud data. The fill light lane deflection module adjusts the position of the fill light module based on the capture position signal so that the fill light area of ​​the fill light module covers the target object; The supplementary lighting module emits supplementary lighting in the designated area. The target object is captured by the camera.

11. The method according to claim 10, characterized in that, The capture position signal includes the position signal of the vehicle window. The step of adjusting the position of the supplementary lighting module based on the capture position signal, so that the supplementary lighting area of ​​the supplementary lighting module covers the target object, includes: The fill light lane deflection module adjusts the position of the fill light module based on the position signal of the vehicle window, so that the fill light area of ​​the fill light module covers the vehicle window of the target object.

12. The method according to claim 10 or 11, characterized in that, The step of sending the capture position signal to the supplementary lighting lane deflection module based on the point cloud data by the control module includes: The control module parses the point cloud data to obtain the speed and position information of the target object in any of the multiple lanes, and sends the capture position signal to the supplementary lighting lane deflection module based on the speed and position information. The method further includes: The control module sends a capture time signal to the fill light module and a capture trigger signal to the camera based on the speed information and the position information. The capture time signal and the capture trigger signal are used to achieve time synchronization between the fill light module and the camera.

13. The method according to any one of claims 10-12, characterized in that, The method further includes: The capture data for the current frame is determined by the camera based on the capture data of historical frames, and the capture data includes gain and exposure time.

14. The method according to any one of claims 10-13, characterized in that, The supplementary lighting lane deflection module is a MEMS micromirror or a fast-control reflector.

15. The method according to any one of claims 10-14, characterized in that, The supplementary lighting module is at least one of the following: an infrared laser light source, a white laser light source, or a white LED light source.

16. The method according to claim 15, characterized in that, When the supplementary lighting module includes the infrared laser source and the white light laser source, the optical paths of the infrared laser source and the white light laser source are the same.

17. The method according to claim 16, characterized in that, The infrared laser source, the white laser source, and the lane deflection module have the same optical path.

18. The method according to any one of claims 10-17, characterized in that, The sensing module is at least one of the following: an infrared detector, a lidar, or a millimeter-wave radar.

19. A computer-readable storage medium, characterized in that, Includes computer instructions that, when executed on an electronic device, cause the electronic device to perform the method described in any one of claims 10-18.

Images