Laser-vision linkage night intrusion detection system
By introducing dynamic parameter adjustment and linkage model in the laser-visual linkage night intrusion detection system, the problem of unstable detection effect in the existing technology is solved, and higher detection accuracy and adaptability are achieved, ensuring that the system is in different environments and Effective operation under conditions.
Patent Information
- Application Number
- CN202411497273.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-25
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2044-10-25
AI Technical Summary
The existing laser-visual linkage night intrusion detection system cannot automatically adjust the working parameters according to changes in the environment and target objects, resulting in unstable detection effect, lack of an effective linkage mechanism, and cannot fully exert the synergy between laser and vision sensors.
A system including laser sensors, vision sensors, data processing modules and control modules was designed. Through the light intensity, target object speed and distance detection units, the working parameters of laser and vision sensors are dynamically adjusted, and a dynamic linkage model is established to achieve different Adaptation of the environment and the state of the target object.
It improves the accuracy and adaptability of night intrusion detection, realizes high-precision detection and identification of target objects, and ensures the stability and reliability of the system under various complex situations.
Smart Images

Figure CN119024353A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of intrusion detection, and in particular to a laser-vision linked nighttime intrusion detection system. Background Art
[0002] In today's society, security protection is of vital importance. As one of the key means of security protection, the main function of the intrusion detection system is to monitor specific areas in real time and promptly detect any unauthorized entry or abnormal activities. Whether it is a family residence, commercial place or industrial facility, a reliable intrusion detection system is needed to ensure the safety of personnel and property. The intrusion detection system can quickly issue an alarm when a potential security threat appears so that appropriate measures can be taken to prevent and respond. The night environment poses a huge challenge to intrusion detection. Under low light conditions, traditional detection methods often find it difficult to accurately identify target objects and judge their behavior. The laser-vision linkage intrusion detection method provides a new idea and method for solving the problem of night detection.
[0003] Laser sensors have high-precision distance measurement capabilities and can accurately determine the location of target objects at night. Even in the dark, the laser beam can be reliably reflected back to provide accurate distance information between the target object and the sensor. Visual sensors can collect image information of the target area and provide rich image features, which helps to more accurately identify and classify target objects. Linking laser and visual sensors can give full play to the advantages of both. At night, when the ambient light intensity is low, laser sensors can provide stable distance information, while visual sensors can obtain clearer images by enhancing sensitivity and other methods. This linkage method not only improves the accuracy of night intrusion detection, but also enhances the adaptability and reliability of the system.
[0004] At present, the traditional laser-vision linkage night intrusion detection system still has certain defects when in use. The existing laser-vision linkage night intrusion detection system simply combines laser and visual sensors, and usually cannot automatically adjust the working parameters according to the changes in the environment and target objects. Under different light intensity, target object moving speed and distance, it cannot flexibly adapt to actual needs, resulting in unstable detection effect, lack of effective linkage mechanism, and cannot give full play to the synergy of laser and visual sensors, and cannot achieve the best detection effect. Therefore, it is necessary to propose a laser-vision linkage night intrusion detection system to solve the problems in the existing technology. Summary of the invention
[0005] The purpose of the present invention is to make up for the shortcomings of the prior art and to provide a laser-vision linkage night intrusion detection system, which can automatically adjust the working parameters of the laser and vision sensors according to factors such as the ambient light intensity, the moving speed and distance of the target object to achieve the best detection effect, and by establishing a dynamic linkage model, dynamically adjust the coordination mode between the two to adapt to different intrusion scenarios.
[0006] In order to solve the above technical problems, the present invention provides the following technical solutions: a laser-vision linkage nighttime intrusion detection system, which includes a laser sensor, a vision sensor, a data processing module and a control module. The laser sensor is used to emit a laser beam and receive the reflected laser signal to measure the distance and position information of the target object. The vision sensor is used to collect image information of the target area. The data processing module processes and analyzes the data collected by the laser and vision sensors, and establishes a dynamic linkage model together with the control module. The control module automatically adjusts the working parameters of the laser and vision sensors according to the environmental light intensity, the moving speed and distance factors of the target object, and dynamically adjusts the coordination between the two. The control module includes a light intensity detection unit, a target object speed detection unit, a target object distance detection unit and a parameter adjustment unit, wherein the light intensity detection unit is used to detect the light intensity of the environment, the target object speed detection unit is used to detect the moving speed of the target object, and the target object distance detection unit is used to detect the distance between the target object and the sensor. The parameter adjustment unit realizes precise adjustment of sensor parameters to adapt to different environments and target object states by working in coordination with the light intensity detection unit, the target object speed detection unit and the target object distance detection unit; The light intensity detection unit in the control module detects the ambient light intensity as follows: , Less than normal light intensity threshold When , a signal is sent to the parameter adjustment unit, and the parameter adjustment unit adjusts the parameter according to the formula Increase the power of the laser sensor, where is the laser power adjustment coefficient, and according to the formula Enhance the light sensitivity of the visual sensor, including is the sensitivity adjustment coefficient of the visual sensor, and the target object speed detection unit detects the target object speed as , Greater than speed threshold When the parameter adjustment unit is based on the formula Increase the sampling frequency of the sensor, where is the sampling frequency adjustment coefficient, and the target object distance detection unit detects the target object distance as , when in different distance intervals, , the parameter adjustment unit is based on the formula Adjust the laser power according to the formula Adjust the visual sensor sensitivity, where and is the adjustment coefficient corresponding to the distance interval.
[0007] Furthermore, the laser sensor is composed of a laser emitting unit, a receiving unit and a signal processing unit, which can emit a laser beam of a specific wavelength and frequency, receive and process the reflected laser signal, and calculate the distance and position information between the target object and the sensor. The laser sensor measures the round-trip time of the laser. , according to the formula Determine the distance of the target object from the sensor, where The speed of light.
[0008] Furthermore, the visual sensor is composed of a lens, an image sensor and an image processing unit, which can collect light in the target area, convert the light signal into an electrical signal to generate image data, and process and analyze it to extract the characteristic information of the target object. The visual sensor assists in judging the light intensity by analyzing the brightness and contrast characteristics of the image.
[0009] Furthermore, the data processing module extracts high-precision distance information of laser data and image features of visual data in real time, and fuses and analyzes these data. The data processing module extracts texture features by calculating the grayscale co-occurrence matrix of the image, and defines the grayscale of the image as , the image size is , the relative position offset of two pixels is , then the gray-level co-occurrence matrix Indicates that the gray value in the image is The pixel point and its distance The gray value at position The probability of pixels appearing at the same time is calculated, and the texture characteristics of the image are described by calculating various statistics of the gray-level co-occurrence matrix.
[0010] Furthermore, the light intensity detection unit uses the parameters of the image sensor to assist in determining the light intensity. The system analyzes the captured image and statistics the distribution of brightness values of pixels in the image. If the image is darker as a whole, it means that the light intensity is low, and if the image is brighter, it means that the light intensity is high.
[0011] Furthermore, the target object speed detection unit detects the moving speed of the target object using the Doppler effect and a motion detection algorithm; Using the Doppler effect to detect speed, the laser frequency emitted by the laser sensor is defined as , the irradiation speed is When the laser is reflected back from the target object, the received laser frequency The Doppler effect formula Calculated by measuring and The speed of the target object is calculated by ,in is the speed of light; Use motion detection algorithm to determine the position coordinates of the target object in continuous image frames and The time interval for image acquisition is , then the moving speed of the target object on the image plane is expressed by the formula Calculated.
[0012] Furthermore, the target object distance detection unit uses a laser sensor to measure the distance between the target object and the sensor by measuring the laser round trip time. , and combined with the image analysis technology of the visual sensor, the distance is estimated through stereo vision and monocular vision; Stereo vision calculates the distance between the target object and the sensor through the principle of triangulation ,in is the baseline distance between the two vision sensors, is the focal length of the visual sensor, is the disparity of the target object in the two images; Monocular vision estimates the distance based on the size of the target object in the image, the known actual size of the target object, and the focal length of the visual sensor. ,in is the actual size of the target object, is the height of the target object in the image, is the focal length of the visual sensor.
[0013] Furthermore, the parameter adjustment unit comprehensively considers the light intensity, target object speed and distance factors, and adjusts the parameters of the laser and the visual sensor as a whole, and finally the laser power is adjusted to , the visual sensor sensitivity is adjusted to , the sampling frequency is adjusted to .
[0014] Furthermore, the data processing module and the control module jointly establish a dynamic linkage model as follows: First, the parameter adjustment unit in the control module adjusts the working parameters of the laser and visual sensor according to the environmental data, establishes the basic framework of the linkage model, enhances the laser power and the sensitivity of the visual sensor in a weak light environment, increases the sensor sampling frequency when the target object moves quickly, and adjusts the coordination between the two according to the distance of the target object; Then, the data processing module fuses the high-precision distance information of the laser data and the image features of the visual data, optimizes the linkage model through a multimodal data fusion algorithm, and uses machine learning and artificial intelligence technology to learn and analyze historical data to continuously improve the performance of the linkage model; As the system runs, the environment and target objects are continuously monitored in real time, and the linkage model is dynamically adjusted and improved based on new data.
[0015] Furthermore, the multimodal data fusion algorithm adopts a weighted average method and defines the target object position estimate provided by the laser data as , the target object position estimated by the visual data is , the fused position is estimated to be ,in and is the weight coefficient, which is adjusted according to the reliability and accuracy of laser and visual data. The machine learning algorithm is used for behavior pattern recognition. The support vector machine SVM algorithm is used to define the training sample set as ,in is the eigenvector, is the category label, and the goal of SVM is to find a hyperplane , so that the classification interval is maximized, by solving the optimization problem: ,in is a slack variable, and satisfies , get the best and , to achieve the classification and recognition of target object behavior.
[0016] Compared with the existing technology, the laser-vision linkage night intrusion detection system has the following beneficial effects: The present invention utilizes the coordination between various units in the control module to achieve the effect of automatically adjusting sensor parameters according to the environment and the state of the target object, enhances the power of the laser and the sensitivity of the visual sensor in a weak light environment, increases the sampling frequency of the sensor when the target object moves quickly, and adjusts the coordination mode of the laser and the visual sensor according to the distance of the target object, thereby improving the accuracy and adaptability of detection. Through the fusion analysis of the laser and visual data by the data processing module and the establishment of a dynamic linkage model with the control module, the high-precision distance information of the laser data and the rich image features of the visual data are utilized to achieve high-precision detection and recognition of the target object.
[0017] Other advantages, objectives and features of the present invention will be set forth in part in the following description and, in part, will be apparent to those skilled in the art based on an examination of the following or may be taught from the practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0019] Figure 1 It is a flow chart of a laser-vision linkage nighttime intrusion detection system; Figure 2 This is a schematic diagram of the structure of a laser-vision linkage nighttime intrusion detection system. DETAILED DESCRIPTION
[0020] The technical solutions in the embodiments of the present invention are described clearly and completely below. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0021] Embodiment 1 In order to strengthen security protection at night, a large factory installed the laser-vision linkage night intrusion detection system of the present invention.
[0022] Laser sensors and vision sensors are deployed at key locations around the factory, such as around walls and entrances to important equipment areas. The installation angle of the laser sensor has been carefully adjusted to ensure that it can cover the widest possible range while ensuring measurement accuracy. The vision sensor is installed in a position where it can clearly capture the image of the target area, and has a certain overlap with the coverage area of the laser sensor to facilitate better linkage detection.
[0023] The laser sensor and visual sensor are connected to the data processing module and the control module through a high-speed data transmission line. After the system is started, a comprehensive self-test and initialization are performed. First, each sensor tests its own performance to ensure that the laser emission and reception are normal and the image acquisition of the visual sensor is clear. Then, the data processing module and the control module load the preset parameters and algorithms to prepare for subsequent detection work.
[0024] The light intensity detection unit continuously monitors the light intensity around the factory through the photosensitive sensor. , the normal light intensity threshold is ,like For example, when the light intensity is low at night, the system starts the light compensation mechanism. The photosensor converts the received light signal into an electrical signal and determines the light intensity value according to a preset conversion formula.
[0025] The target object speed detection unit and the target object distance detection unit start working, using the Doppler effect and motion detection algorithm to detect the moving speed and distance of the possible target object. Assuming a moving target is detected, the target object speed is calculated through the frequency change of the laser reflection signal and the displacement of the target object in the image. and distance from the factory .
[0026] For the Doppler effect speed detection, the laser frequency emitted by the laser sensor is assumed to be When the laser is reflected back from the target object, the received laser frequency The Doppler effect formula can be used (in is the speed of light) calculated by measuring and The speed of the target object can be calculated by .
[0027] For motion detection algorithms, determine the position coordinates of the target object in consecutive image frames. and The time interval for image acquisition is , then the moving speed of the target object on the image plane can be expressed by the formula The target object distance detection unit uses a laser sensor to measure the distance and records the time difference between laser emission and reception. , according to the speed of light , the distance between the target object and the sensor ,At the same time, the image analysis technology of the ,vision sensor can also be combined to estimate the distance through ,stereo vision or the size and position relationship of the target ,object in the image.
[0028] Stereo vision calculates the distance between the target object and the sensor through the principle of triangulation ,in is the baseline distance between the two vision sensors, is the focal length of the visual sensor, is the disparity of the target object in the two images.
[0029] Monocular vision estimates the distance based on the size of the target object in the image, the known actual size of the target object, and the focal length of the visual sensor. ,in is the actual size of the target object, is the height of the target object in the image, is the focal length of the visual sensor.
[0030] The laser sensor emits a laser beam and based on the laser round trip time , using the formula (in The speed of light is used to calculate the distance between the target object and the sensor and determine the approximate position of the target object. At the same time, the signal processing unit of the laser sensor analyzes the received laser signal and extracts some characteristic information of the target object, such as reflection intensity, etc. This information can assist in determining the material and other characteristics of the target object.
[0031] The visual sensor collects image information of the target area, analyzes the brightness, contrast and other features of the image to assist in judging the light intensity, and uses image processing algorithms to extract image features. For example, the grayscale co-occurrence matrix of the image is calculated to extract texture features. Suppose the grayscale level of the image is , the image size is , the relative position offset of two pixels is , then the gray-level co-occurrence matrix Indicates that the gray value in the image is The pixel point and its distance The gray value at position The probability of simultaneous appearance of pixels is calculated, and the texture features of the image are described by calculating various statistics of the gray-level co-occurrence matrix to determine the type of the target object. Image recognition technology can also be used to identify whether the target object is a person, a vehicle, or other objects.
[0032] The control module adjusts the sensor parameters according to the environmental data. If the light intensity meets the , the laser power enhancement coefficient is based on the formula Calculate and enhance the power of the laser sensor; the sensitivity enhancement factor of the visual sensor is , enhance the sensitivity of visual sensors, where and To adjust the coefficient, it can be set according to the actual environment and needs of the factory.
[0033] When the target object speed Greater than speed threshold When the sampling frequency increases by , increase the sampling frequency of the sensor, The speed adjustment coefficient ensures that when the target object moves quickly, the system can capture its motion state in a timely and accurate manner.
[0034] According to the distance of the target object Adjust the coordination between the two. In a specific range, such as , the laser power is adjusted to , the visual sensor sensitivity is adjusted to , and The distance adjustment coefficient dynamically adjusts the parameters of the laser and visual sensors as the distance of the target object changes to achieve the best detection effect.
[0035] The data processing module combines the high-precision distance information of the laser data with the image features of the visual data, and adopts the weighted average method. The target object position estimate provided by the laser data is , the target object position estimated by the visual data is , the fused position is estimated to be ,in , adjust the weight coefficients according to the reliability and accuracy of the laser and visual data. For example, if the laser data has high accuracy but may be disturbed in some cases, while the visual data is relatively stable but slightly less accurate, then the values of α and β can be adjusted according to the actual situation to obtain a more accurate position estimate.
[0036] The machine learning algorithm is used for behavior pattern recognition, and the support vector machine (SVM) algorithm is adopted. The training sample set is ,in is the eigenvector, is the category label, and the goal of SVM is to find a hyperplane , so that the classification interval is maximized, by solving the optimization problem: ,in is a slack variable, and satisfies , we can get the best and , thereby judging whether the behavior of the target object is abnormal intrusion behavior. For example, by learning from historical data, a normal behavior pattern library is established. When a new target object appears, its features are compared with the patterns in the library. If the difference is large, it is judged as abnormal intrusion behavior.
[0037] The system continuously monitors the factory's surrounding environment and target objects in real time. If the ambient light intensity, target object speed or distance changes, the control module will immediately adjust the sensor parameters and notify the data processing module. The data processing module will dynamically adjust the linkage model based on the new data.
[0038] For example, when the target object suddenly accelerates, the system recalculates the sampling frequency increase factor ,in It is the new speed of the target object, and then adjusts the sensor sampling frequency according to the new coefficient. If the behavior of the target object is judged to be abnormal intrusion behavior, the system will immediately issue an alarm and notify the factory security personnel to take corresponding measures. The alarm can be issued through sound and light alarm devices, mobile phone text messages, monitoring center display screens and other methods to ensure that security personnel can receive and respond in time.
[0039] In summary: The laser-vision linkage detection system can detect any potential intrusion behavior in a timely and accurate manner, whether it is a person climbing a wall or a vehicle entering illegally, it can be detected and an alarm can be issued in the first time. The sensor parameters are automatically adjusted according to factors such as ambient light intensity, target object speed and distance to ensure that the system can maintain good performance in various complex situations. Whether in a low-light environment or facing fast-moving target objects, efficient detection can be achieved. The use of machine learning algorithms for behavioral pattern recognition can accurately distinguish between normal activities and abnormal intrusion behaviors, avoiding unnecessary alarms and missed reports. The system's real-time monitoring and alarm functions enable security personnel to respond quickly, reduce patrol workload, improve the efficiency of security management, ensure that the factory can maintain a safe and stable environment at night, and avoid production interruptions and property losses caused by intrusion incidents.
[0040] Embodiment 2 In an important highway tunnel, in order to ensure driving safety and prevent illegal intrusion, the laser-vision linkage nighttime intrusion detection system of the present invention is installed.
[0041] Laser sensors and visual sensors are installed at the entrance, exit and at certain intervals inside the tunnel. The laser sensor is installed high on the tunnel wall to ensure that the entire tunnel cross-section can be covered and will not be disturbed by passing vehicles. The visual sensor is installed in a suitable position so that the vehicles and other target objects in the tunnel can be clearly captured.
[0042] After the system is started, it performs self-check and initialization. Each sensor checks its own working status. The data processing module and control module load preset parameters and algorithms to prepare for subsequent monitoring work.
[0043] The light intensity detection unit continuously monitors the light intensity in the tunnel. Since the light in the tunnel is usually provided by the lighting system, the light intensity is relatively stable. However, in some cases, such as lighting system failure or special weather conditions, the light intensity may change. Suppose the current light intensity in the tunnel is , the normal light intensity threshold is ,like , the system automatically adjusts the sensor's parameters to adapt to low-light conditions.
[0044] The target object speed detection unit and the target object distance detection unit start working, using the Doppler effect and motion detection algorithm to detect the moving speed and distance of the vehicle in the tunnel. For the Doppler effect detection speed, the laser frequency emitted by the laser sensor is set to , when the irradiation speed is When the laser beam is reflected back from the vehicle, the received laser frequency The Doppler effect formula can be used (in is the speed of light) and is obtained by measuring and The difference between .
[0045] The target object distance detection unit uses a laser sensor to measure the distance and record the time difference between laser emission and reception. , according to the speed of light , the distance between the vehicle and the sensor ,At the same time, the image analysis technology of the ,vision sensor can also be combined to estimate the distance ,through the size and position relationship of the vehicle in the ,image.
[0046] The laser sensor emits a laser beam and based on the laser round trip time , using the formula (in The laser sensor can also detect information such as the height and width of the vehicle, providing more data for subsequent analysis.
[0047] The visual sensor collects image information in the tunnel, analyzes the image's brightness, contrast and other features to assist in determining the light intensity, and uses image processing algorithms to extract image features. For example, image recognition technology can be used to identify information such as the type, color and license plate number of a vehicle. The vehicle's driving trajectory and behavior can also be analyzed to determine whether there are any abnormal conditions, such as speeding or illegal lane changes.
[0048] The control module adjusts the sensor parameters according to the environmental data. If the light intensity meets the , the laser power enhancement coefficient is based on the formula Calculate and enhance the power of the laser sensor; the sensitivity enhancement factor of the visual sensor is , enhance the sensitivity of visual sensors, where and To adjust the coefficient, it can be set according to the actual lighting conditions in the tunnel.
[0049] When the vehicle speed Greater than speed threshold When the sampling frequency increases by , increase the sampling frequency of the sensor, The speed adjustment coefficient ensures that the system can accurately capture the vehicle's motion status in a timely manner when the vehicle is traveling at high speed. According to the vehicle distance Adjust the coordination between the two. If the vehicle is far away, use the laser sensor for detection first to obtain the accurate position information of the vehicle. When the vehicle is close, combine the image information of the visual sensor to improve the recognition accuracy of the vehicle.
[0050] The data processing module combines the high-precision distance information of the laser data with the image features of the visual data, and adopts the weighted average method. The vehicle position estimate provided by the laser data is assumed to be , the vehicle position estimate provided by the visual data is , the fused position is estimated to be ,in , the weight coefficients are adjusted according to the reliability and accuracy of the laser and visual data. For example, if the laser data is more accurate when measuring at long distances but may be interfered with at close distances, while the visual data can provide more detailed information at close distances, then the values of α and β can be adjusted according to the distance of the vehicle to obtain a more accurate position estimate.
[0051] The machine learning algorithm is used for behavior pattern recognition, and the support vector machine (SVM) algorithm is adopted. The training sample set is in is the eigenvector, It is a category label. By learning from historical data, a normal vehicle driving pattern library is established. When a new vehicle appears, its characteristics are compared with the patterns in the library. If the difference is large, it is judged as abnormal behavior, such as speeding, illegal lane change, etc.
[0052] The system continuously monitors the environment and vehicles in the tunnel in real time. If the ambient light intensity, vehicle speed or distance changes, the control module will immediately adjust the sensor parameters and notify the data processing module. The data processing module will dynamically adjust the linkage model based on the new data.
[0053] For example, when a vehicle is detected speeding, the system immediately issues an alarm to notify the tunnel management department to take appropriate measures. The alarm can be issued through the sound and light alarm device in the tunnel, the monitoring center display screen, etc. At the same time, the information of the violating vehicle can be transmitted to the traffic management department for subsequent processing.
[0054] In summary: By real-time monitoring of vehicles and the environment in the tunnel, potential safety hazards can be discovered in a timely manner, such as speeding, illegal lane changes, and lighting system failures, providing drivers with a safer driving environment. The sensor parameters are automatically adjusted according to factors such as light intensity, vehicle speed and distance in the tunnel to ensure that the system can maintain good performance in various complex situations. Whether in low light conditions or facing high-speed vehicles, efficient monitoring can be achieved. The system's real-time monitoring and alarm functions enable tunnel management departments to respond quickly and deal with various abnormal situations in a timely manner, reducing the probability of accidents, improving the tunnel's traffic efficiency, and ensuring that highway tunnels can maintain a safe and stable operation state at night, avoiding traffic interruptions and property losses caused by safety accidents.
[0055] It will be apparent to those skilled in the art that the invention is not limited to the details of the exemplary embodiments described above and that the invention can be implemented in other specific forms without departing from the spirit or essential features of the invention. Therefore, the embodiments should be considered in all respects as exemplary and non-limiting, and the scope of the invention is defined by the appended claims rather than the foregoing description, and it is intended that all variations falling within the meaning and scope of the same elements of the claims be included in the invention. Any reference numeral in a claim should not be considered as limiting the claim to which it relates.
Claims
1. A laser-vision linkage nighttime intrusion detection system, characterized in that: The system includes a laser sensor, a visual sensor, a data processing module and a control module. The laser sensor is used to emit a laser beam and receive the reflected laser signal to measure the distance and position information of the target object. The visual sensor is used to collect image information of the target area. The data processing module processes and analyzes the data collected by the laser and visual sensors, and establishes a dynamic linkage model with the control module. The control module automatically adjusts the working parameters of the laser and visual sensors according to the light intensity of the environment, the moving speed and distance of the target object, and dynamically adjusts the coordination between the two. The control module includes a light intensity detection unit, a target object speed detection unit, a target object distance detection unit and a parameter adjustment unit, wherein the light intensity detection unit is used to detect the light intensity of the environment, the target object speed detection unit is used to detect the moving speed of the target object, and the target object distance detection unit is used to detect the distance between the target object and the sensor. The parameter adjustment unit realizes precise adjustment of sensor parameters to adapt to different environments and target object states by working in coordination with the light intensity detection unit, the target object speed detection unit and the target object distance detection unit; The light intensity detection unit in the control module detects the ambient light intensity as follows: , Less than normal light intensity threshold When , a signal is sent to the parameter adjustment unit, and the parameter adjustment unit adjusts the parameter according to the formula Increase the power of the laser sensor, where is the laser power adjustment coefficient, and according to the formula Enhance the light sensitivity of the visual sensor, including is the sensitivity adjustment coefficient of the visual sensor, and the target object speed detection unit detects the target object speed as , Greater than speed threshold When the parameter adjustment unit is based on the formula Increase the sampling frequency of the sensor, where is the sampling frequency adjustment coefficient, and the target object distance detection unit detects the target object distance as , when in different distance intervals, , the parameter adjustment unit is based on the formula Adjust the laser power according to the formula Adjust the visual sensor sensitivity, where and is the adjustment coefficient corresponding to the distance interval.
2. A laser-vision-linked nighttime intrusion detection system according to claim 1, characterized in that: The laser sensor consists of a laser emitting unit, a receiving unit and a signal processing unit. It can emit a laser beam of a specific wavelength and frequency, receive and process the reflected laser signal, and calculate the distance and position information between the target object and the sensor. The laser sensor measures the round-trip time of the laser. , according to the formula Determine the distance of the target object from the sensor, where The speed of light.
3. The laser-vision linkage nighttime intrusion detection system according to claim 1 is characterized in that: The visual sensor is composed of a lens, an image sensor and an image processing unit. It can collect light in the target area, convert light signals into electrical signals to generate image data, and process and analyze them to extract feature information of the target object. The visual sensor assists in judging light intensity by analyzing the brightness and contrast characteristics of the image.
4. The laser-vision linkage nighttime intrusion detection system according to claim 1 is characterized in that: The data processing module extracts high-precision distance information of laser data and image features of visual data in real time, and fuses and analyzes these data. The data processing module extracts texture features by calculating the grayscale co-occurrence matrix of the image, and defines the grayscale of the image as , the image size is , the relative position offset of two pixels is , then the gray-level co-occurrence matrix Indicates that the gray value in the image is The pixel point and its distance The gray value at position The probability of pixels appearing at the same time is calculated, and the texture characteristics of the image are described by calculating various statistics of the gray-level co-occurrence matrix.
5. The laser-vision-linked nighttime intrusion detection system according to claim 1 is characterized in that: The light intensity detection unit uses the parameters of the image sensor to assist in determining the light intensity. The system analyzes the collected image and counts the distribution of the brightness values of the pixels in the image. If the image is darker as a whole, it means that the light intensity is low, and if the image is brighter, it means that the light intensity is high.
6. The laser-vision linkage nighttime intrusion detection system according to claim 1, characterized in that: The target object speed detection unit detects the moving speed of the target object using the Doppler effect and a motion detection algorithm; Using the Doppler effect to detect speed, the laser frequency emitted by the laser sensor is defined as , the irradiation speed is When the laser is reflected back from the target object, the received laser frequency The Doppler effect formula Calculated by measuring and The difference between ,in is the speed of light; Use motion detection algorithm to determine the position coordinates of the target object in continuous image frames and The time interval for image acquisition is , then the moving speed of the target object on the image plane is expressed by the formula Calculated.
7. The laser-vision-linked nighttime intrusion detection system according to claim 1 is characterized in that: The target object distance detection unit uses a laser sensor to measure the distance between the target object and the sensor by measuring the laser round trip time. , and combined with the image analysis technology of the visual sensor, the distance is estimated through stereo vision and monocular vision; Stereo vision calculates the distance between the target object and the sensor through the principle of triangulation ,in is the baseline distance between the two vision sensors, is the focal length of the visual sensor, is the disparity of the target object in the two images; Monocular vision estimates the distance based on the size of the target object in the image, the known actual size of the target object, and the focal length of the visual sensor. ,in is the actual size of the target object, is the height of the target object in the image, is the focal length of the visual sensor.
8. The laser-vision linkage nighttime intrusion detection system according to claim 1 is characterized in that: The parameter adjustment unit comprehensively considers the light intensity, target object speed and distance factors, and adjusts the parameters of the laser and visual sensor as a whole. The final laser power is adjusted to , the visual sensor sensitivity is adjusted to , the sampling frequency is adjusted to .
9. The laser-vision linkage nighttime intrusion detection system according to claim 1, characterized in that: The process of establishing a dynamic linkage model jointly established by the data processing module and the control module is as follows: First, the parameter adjustment unit in the control module adjusts the working parameters of the laser and visual sensor according to the environmental data, establishes the basic framework of the linkage model, enhances the laser power and the sensitivity of the visual sensor in a weak light environment, increases the sensor sampling frequency when the target object moves quickly, and adjusts the coordination between the two according to the distance of the target object; Then, the data processing module fuses the high-precision distance information of the laser data and the image features of the visual data, optimizes the linkage model through a multimodal data fusion algorithm, and uses machine learning and artificial intelligence technology to learn and analyze historical data to continuously improve the performance of the linkage model; As the system runs, the environment and target objects are continuously monitored in real time, and the linkage model is dynamically adjusted and improved based on new data.
10. The laser-vision linkage nighttime intrusion detection system according to claim 9, characterized in that: The multimodal data fusion algorithm adopts a weighted average method and defines the target object position estimate provided by the laser data as , the target object position estimated by the visual data is , the fused position is estimated to be ,in and is the weight coefficient, which is adjusted according to the reliability and accuracy of laser and visual data. The machine learning algorithm is used for behavior pattern recognition. The support vector machine SVM algorithm is used to define the training sample set as ,in is the eigenvector, is the category label, and the goal of SVM is to find a hyperplane , so that the classification interval is maximized, by solving the optimization problem: ,in is a slack variable, and satisfies , get the best and , to achieve the classification and recognition of target object behavior.
Citation Information
Patent Citations
Laser-vision linked night invasion detection device
CN101976489A
Three-dimensional data acquisition imaging system for detecting target in front of vehicle
CN112883846A
Distance detection system based on laser distance sensing technology
CN116184427A
Automatic shooting control device and control method based on multiple sensors and deep reinforcement learning
CN116996771A
Multi-sensor fusion intelligent robot following method based on laser radar
CN118191865A
