A camera analysis method with vibration detection function

By integrating vibration detection function in the camera and combining image and audio acquisition and analysis technology to identify the traffic status of high-load vehicles, the problem of road management and maintenance lag is solved, precise monitoring and maintenance suggestions are achieved, and road use is extended life.

CN114785933BActive Publication Date: 2024-11-01JIANGSU UTIS NEW TECH
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202210514384.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-05-12
Publication Date
2024-11-01
Estimated Expiration
2042-05-12

AI Technical Summary

Technical Problem

The prior art has lag in road management and maintenance, resulting in short road usage cycles and serious damage, especially road damage caused by high-load vehicles cannot be effectively monitored and prevented.

Method used

Design a camera with vibration detection function, combining image acquisition, vibration detection and audio acquisition and analysis technologies, and identify and count the traffic status of high-load vehicles through CCD/CMOS sensors, DSP video processing chips and main control modules, and use large-scale Combining data and artificial intelligence systems provide road maintenance advice.

Benefits of technology

Long-term monitoring and accurate data collection of roads have been achieved, key parameters for road maintenance have been provided, road maintenance has been extended, and road service life has been provided, providing more favorable conditions for economic and social development.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114785933B_ABST
    Figure CN114785933B_ABST
Patent Text Reader

Abstract

The present invention provides a camera with a vibration detection function and an analysis method thereof, comprising a lens, a CCD / CMOS sensor, a DSP video processing chip, a main control module, a power module, an audio acquisition and encoding module, a vibration detection module, a power module, and a peripheral interface and output module. Through the accurate acquisition of images, audio, and vibration conditions by each module, a two-layer screening scheme is set, initially through image judgment, and then through vibration monitoring and audio monitoring, accurate data of full load of large vehicles is effectively obtained, and heavy-loaded vehicles are counted, which is used as a key parameter for road damage and whether maintenance is needed, and long-term monitoring is performed. In combination with other factors in the study of the whole life cycle of the road, under the auxiliary decision-making of big data and related artificial intelligence analysis systems, reliable suggestions can be provided for road maintenance and maintenance technology, thereby extending the service life of the road and providing more favorable conditions for the development of the economy and society.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of traffic infrastructure, and in particular to a camera with a vibration detection function and an analysis method thereof. Background Art

[0002] Economic development and the well-being of the people are inseparable from the development of road construction. At present, the rapid development of China's economy is inseparable from the construction of roads. However, compared with the construction of roads, the research on road management, road maintenance, and road life cycle is relatively lagging behind, which to a certain extent causes serious damage to roads in daily operations, inadequate maintenance, short service life and other adverse consequences, and also leads to adverse social effects.

[0003] In road traffic operations, factors that affect the life cycle of roads generally include the geological conditions of the area where the roads are located, climatic conditions, materials used in road construction, construction technology, and the level of maintenance in the later period. Another key factor is the load of passing vehicles. If a road is under the long-term passage of high-load vehicles, the damage to the road will be great. If combined with the combined influence of maintenance cycles, maintenance levels and other conditions, its service life will be greatly reduced. In order to monitor the traffic status of various types of vehicles on the road for a long time, we invented a camera with vibration detection function and its analysis method, which can provide traffic data of various vehicles for the analysis of the entire life cycle of the road, especially the traffic status of high-load vehicles. Summary of the invention

[0004] The purpose of the present invention is to solve the shortcomings of the prior art and to propose a camera with vibration detection function and an analysis method thereof.

[0005] To achieve the above object, the present invention adopts the following technical solutions:

[0006] A camera with a vibration detection function comprises a camera body with a supporting rod, a lens, a CCD / CMOS sensor, a DSP video processing chip, a main control module, a power module, an audio acquisition and encoding module, a vibration detection module, a power module, and a peripheral interface and output module;

[0007] The lens is arranged at the front end of the camera body, and the audio acquisition and encoding module and the vibration detection module are integrated into the camera body;

[0008] The lens is arranged outside the CCD / CMOS sensor, and the CCD / CMOS sensor is electrically connected to the DSP video processing chip;

[0009] The DSP video processing chip, audio acquisition and encoding module, vibration detection module, peripheral interface and output module are electrically connected to the main control module;

[0010] The power supply module supplies power to various components of the camera.

[0011] Through image acquisition and analysis, vibration detection and analysis, and audio acquisition and analysis, we can determine whether there are heavy-loaded vehicles on the current road, and count the heavy-loaded vehicles. This is used as a key parameter for road damage and whether maintenance is needed. Long-term monitoring is combined with other factors in the study of the road's entire life cycle. With the assistance of big data and related artificial intelligence analysis systems, reliable suggestions can be provided for road maintenance and maintenance processes, thereby extending the service life of roads and providing more favorable conditions for economic and social development.

[0012] Furthermore, the CCD / CMOS sensor collects image information after the lens imaging, and converts the graphic information into an image digital signal. The CCD / CMOS sensor sends the digital signal to the DSP video processing chip. The DSP video processing chip processes the received image digital signal, including digital signal amplification, correction and functional processing, to obtain a second image digital signal. The DSP video processing chip sends the second image digital signal to the main control module, and the image information is collected and analyzed through the CCD / CMOS sensor and the DSP video processing chip.

[0013] Furthermore, the audio acquisition and encoding module acquires omnidirectional audio around the camera body and performs audio encoding to obtain an audio digital signal. The audio acquisition and encoding module sends the audio digital signal to the main control module, and the audio digital signal is acquired by the audio acquisition and encoding module.

[0014] Furthermore, the vibration detection module collects the resonance of the camera body caused by the vibration generated by the installation on the ground, and generates a vibration digital signal. The vibration detection module sends the vibration digital signal to the main control module, and the resonance is collected by the vibration detection module.

[0015] Furthermore, the main control module receives the second image digital signal, audio digital signal, and vibration digital signal and processes and analyzes them. The main control module processes the second image digital signal, identifies whether there is large vehicle full load information in the second image digital signal, counts and stores it as road monitoring data, and finally obtains the road monitoring data through analysis by the main control module, which is used as a parameter indicator for road maintenance.

[0016] Furthermore, the peripheral interface and output module establish a communication connection with the third-party data platform, and the main control module sends the second image digital signal, audio digital signal, vibration digital signal and road monitoring data to the third-party data platform through the peripheral interface and output module, and combines the third-party data platform and other factors in the road life cycle study to comprehensively determine whether the road should be maintained and the maintenance plan.

[0017] A camera analysis method with a vibration detection function comprises the following steps:

[0018] S1: Preset large vehicle phenomenon information, vehicle full load phenomenon information, audio digital signal level information, and vibration digital signal level information in the main control module of the camera with vibration detection function installed on the current road section, wherein the audio digital signal level information also includes the audio digital signal critical level, and the vibration digital signal level information also includes the vibration digital signal critical level; preset the large vehicle full load level;

[0019] S2: The main control module identifies whether there is large vehicle phenomenon information and fully loaded vehicle phenomenon information in the second image digital signal. If there is neither large vehicle phenomenon information nor fully loaded vehicle phenomenon information, further analysis and processing is stopped; otherwise, the process goes to the next step.

[0020] S3: The main control module identifies and compares the audio digital signal with the audio digital signal level information, and grades the audio digital signal to obtain the actual level of the audio digital signal, and compares whether the actual level of the audio digital signal exceeds the critical level of the audio digital signal;

[0021] S4: The main control module identifies and compares the vibration digital signal with the vibration digital signal level information, and grades the vibration digital signal to obtain the actual level of the vibration digital signal, and compares whether the actual level of the vibration digital signal exceeds the critical level of the vibration digital signal;

[0022] S5: If the actual level of the audio digital signal does not exceed the critical level of the audio digital signal, and the actual level of the vibration digital signal does not exceed the critical level of the vibration digital signal, then stop further analysis and processing; otherwise, go to the next step;

[0023] S6: Confirm the existence of large vehicle full load information, compare the large vehicle full load level, and confirm the actual large vehicle full load level. For vehicles with confirmed large vehicle full load information, statistics are collected based on the actual large vehicle full load level and stored as road monitoring data. The statistics include the number of passes and the time of pass parameters. The road monitoring data is sent to a third-party data platform through the peripheral interface and output module.

[0024] This method screens out a variety of confusing data sources and sets up a two-layer screening scheme. It initially uses image judgment, and then vibration monitoring and audio monitoring to effectively obtain accurate data on the full load of large vehicles. Through multiple information screening and filtering, the collected information is analyzed and rated to obtain accurate road monitoring data, and statistics are performed over a long period of time to provide a reliable data source for road maintenance and maintenance technology.

[0025] Furthermore, the third-party data platform uses road monitoring data as a basic data source, combined with the current road section's weather conditions, temperature, humidity, and precipitation, to evaluate the road fatigue and damage level of the current road section in a certain period, and analyzes to obtain the current road section maintenance plan. The current road section maintenance plan includes whether maintenance is needed, the type of maintenance, the maintenance level, and the maintenance process. By combining other factors in the road life cycle study, reliable suggestions are provided for road maintenance and maintenance processes, thereby extending the service life of the road.

[0026] Compared with the prior art, the beneficial effects of the present invention are as follows: (1) by image acquisition and analysis, vibration detection and analysis, and audio acquisition and analysis, it is possible to determine whether there are heavy-loaded vehicles on the current road, and to count the heavy-loaded vehicles, which is used as a key parameter for road damage and whether maintenance is required, and long-term monitoring is carried out. In combination with other factors in the study of the entire life cycle of the road, with the assistance of big data and related artificial intelligence analysis systems, reliable suggestions can be provided for road maintenance and maintenance processes, thereby extending the service life of the road and providing more favorable conditions for the development of the economy and society; (2) the present method screens out a variety of confusing data sources, sets up a two-layer screening scheme, initially through image judgment, and then through vibration monitoring and audio monitoring, effectively obtains accurate data on the full load of large vehicles, and through multiple information screening and filtering, analyzes and rates the collected information, obtains accurate road monitoring data, and performs long-term statistics, providing a reliable data source for road maintenance and maintenance processes. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 This is a schematic diagram of module connection in Example 1 of the present invention. DETAILED DESCRIPTION

[0028] In order to provide a further understanding of the purpose, structure, features, and functions of the present invention, the following detailed description is given in conjunction with the embodiments.

[0029] Embodiment 1, a camera with a vibration detection function, comprising a camera body with a support rod, including a lens, a CCD / CMOS sensor, a DSP video processing chip, a main control module, a power module, an audio acquisition and encoding module, a vibration detection module, a power module, and a peripheral interface and output module;

[0030] The lens is set at the front end of the camera body, and the audio acquisition and encoding module and the vibration detection module are integrated into the camera body;

[0031] The lens is arranged outside the CCD / CMOS sensor, and the CCD / CMOS sensor is electrically connected to the DSP video processing chip;

[0032] The DSP video processing chip, the audio acquisition and encoding module, the vibration detection module, the peripheral interface and the output module are electrically connected to the main control module;

[0033] The power module provides power to all components of the camera.

[0034] Specifically: Lens: The lens is the main component of the camera's optical imaging, responsible for collecting the illuminated object and reflecting it onto the sensor through the pinhole imaging principle.

[0035] CCD / CMOS sensor: Its function is to convert the image formed by the lens into a digital signal.

[0036] DSP video processing chip: responsible for amplifying, correcting and processing special functions of the digital signal converted by the image sensor; such as auto focus, wide dynamic, digital slow shutter, color and black and white conversion, area shielding, digital noise reduction, white balance and other functions.

[0037] Audio acquisition and encoding module: The omnidirectional audio around the camera is collected through the sound pickup device integrated on the camera, and then the audio is encoded for later processing by the main control module. In the application scenario of the present invention, it mainly collects the sound generated by the vehicle passing the road where the camera is located, and can especially identify the engine roar of the vehicle when it passes (mainly for heavy-load vehicles).

[0038] Vibration detection module: The vibration detection module integrated in the camera can detect the vibration caused by the camera and the road surface when a vehicle passes by, or the resonance caused by the engine sound and the ground and poles.

[0039] After long-term learning, the audio acquisition and encoding module can identify whether the engine sound is the roar of a large vehicle when fully loaded, and the vibration detection module can identify the resonance between the engine sound and the ground or camera pole when fully loaded, and the road vibration caused by the passing of the vehicle.

[0040] Peripheral interface module and output module: the interface between the camera and external devices, namely data input and output, audio and video output, alarm linkage I / O and power input, input or output interface of other special functions, etc.

[0041] The output types of the peripheral interface modules and output modules include but are not limited to: network, audio, data, etc.

[0042] Power module: responsible for the power supply of all modules of the camera

[0043] Through image acquisition and analysis, vibration detection and analysis, and audio acquisition and analysis, it is possible to determine whether there are heavy-loaded vehicles on the current road, and to collect statistics on heavy-loaded vehicles, which are used as key parameters for road damage and whether maintenance is needed, and are monitored over a long period of time.

[0044] When this embodiment is implemented, the CCD / CMOS sensor collects image information after the lens imaging, and converts the graphic information into an image digital signal. The CCD / CMOS sensor sends the digital signal to the DSP video processing chip. The DSP video processing chip processes the received image digital signal, including digital signal amplification, correction and function processing, to obtain a second image digital signal. The DSP video processing chip sends the second image digital signal to the main control module, and the image information is collected and analyzed through the CCD / CMOS sensor and the DSP video processing chip.

[0045] When this embodiment is implemented, the audio acquisition and encoding module acquires omnidirectional audio around the camera body and performs audio encoding to obtain an audio digital signal. The audio acquisition and encoding module sends the audio digital signal to the main control module, and the audio digital signal is acquired by the audio acquisition and encoding module.

[0046] When this embodiment is implemented, the vibration detection module collects the resonance of the camera body caused by the vibration generated by the installation on the ground and generates a vibration digital signal. The vibration detection module sends the vibration digital signal to the main control module, and the vibration detection module collects the resonance.

[0047] When this embodiment is implemented, the main control module receives the second image digital signal, the audio digital signal, and the vibration digital signal and processes and analyzes them. The main control module processes the second image digital signal, identifies whether there is large vehicle full load information in the second image digital signal, counts and stores it as road monitoring data, and finally obtains the road monitoring data through analysis by the main control module, which is used as a parameter indicator for road maintenance.

[0048] During the implementation of this embodiment, the peripheral interface and the output module establish a communication connection with the third-party data platform, and the main control module sends the second image digital signal, the audio digital signal, the vibration digital signal and the road monitoring data to the third-party data platform through the peripheral interface and the output module. In combination with the third-party data platform and other factors in the road life cycle study, a comprehensive judgment is made as to whether the road should be maintained and the maintenance plan.

[0049] The third-party data platform generally refers to the road management department platform.

[0050] Embodiment 2, a camera analysis method with a vibration detection function, comprises the following steps:

[0051] S1: Preset large vehicle phenomenon information, vehicle full load phenomenon information, audio digital signal level information, and vibration digital signal level information in the main control module of the camera with vibration detection function installed on the current road section, the audio digital signal level information also includes the audio digital signal critical level, and the vibration digital signal level information also includes the vibration digital signal critical level; preset the large vehicle full load level;

[0052] S2: The main control module identifies whether there is large vehicle phenomenon information and vehicle fully loaded phenomenon information in the second image digital signal. If there is neither large vehicle phenomenon information nor vehicle fully loaded phenomenon information, further analysis and processing is stopped; otherwise, the process goes to the next step.

[0053] The end of step S2 is the first data source screening;

[0054] S3: The main control module identifies and compares the audio digital signal with the audio digital signal level information, and grades the audio digital signal to obtain the actual level of the audio digital signal, and compares whether the actual level of the audio digital signal exceeds the critical level of the audio digital signal;

[0055] S4: The main control module identifies and compares the vibration digital signal with the vibration digital signal level information, and grades the vibration digital signal to obtain the actual level of the vibration digital signal, and compares whether the actual level of the vibration digital signal exceeds the critical level of the vibration digital signal;

[0056] S5: If the actual level of the audio digital signal does not exceed the critical level of the audio digital signal, and the actual level of the vibration digital signal does not exceed the critical level of the vibration digital signal, then stop further analysis and processing; otherwise, go to the next step;

[0057] The end of step S5 is the second data source screening;

[0058] S6: Confirm the existence of large vehicle full load information, compare the large vehicle full load level, and confirm the actual large vehicle full load level. For vehicles with confirmed large vehicle full load information, statistics are collected based on the actual large vehicle full load level and stored as road monitoring data. The statistics include the number of passes and the time of pass parameters. The road monitoring data is sent to a third-party data platform through the peripheral interface and output module.

[0059] This method screens out a variety of confusing data sources and sets up a two-layer screening scheme. It initially uses image judgment, and then vibration monitoring and audio monitoring to effectively obtain accurate data on the full load of large vehicles. Through multiple information screening and filtering, the collected information is analyzed and rated to obtain accurate road monitoring data, and statistics are performed over a long period of time to provide a reliable data source for road maintenance and maintenance technology.

[0060] When this embodiment is implemented, the third-party data platform uses road monitoring data as the basic data source, combined with the current road section's weather conditions, temperature, humidity, and precipitation, to evaluate the road fatigue and damage level of the current road section in a certain period, and analyzes to obtain the current road section maintenance plan. The current road section maintenance plan includes whether maintenance is needed, the type of maintenance, the maintenance level, and the maintenance process. By combining other factors in the road life cycle study, reliable suggestions are provided for road maintenance and maintenance processes, thereby extending the service life of the road.

[0061] The present invention has been described by the above-mentioned relevant embodiments, however, the above-mentioned embodiments are only examples for implementing the present invention. It must be pointed out that the disclosed embodiments do not limit the scope of the present invention. On the contrary, changes and modifications made without departing from the spirit and scope of the present invention are all within the scope of patent protection of the present invention.

Claims

1. A camera analysis method with vibration detection function, Features: The camera with vibration detection function comprises a camera body with a supporting rod, a lens CCD / CMOS sensor, a DSP video processing chip, a main control module, a power module, an audio acquisition and encoding module, a vibration detection module, a power module and a peripheral interface and output module. The lens is arranged at the front end of the camera body, the audio acquisition and encoding module and the vibration detection module are integrated in the camera body, the lens is arranged outside the CCD / CMOS sensor, the CCD / CMOS sensor is electrically connected to the DSP video processing chip, the DSP video processing chip, the audio acquisition and encoding module, the vibration detection module, the peripheral interface and output module are electrically connected to the main control module, the power module supplies power to various components of the camera, and the CCD / CMOS sensor acquires the lens into The CCD / CMOS sensor receives the image information after imaging, and converts the image information into an image digital signal. The CCD / CMOS sensor sends the digital signal to the DSP video processing chip. The DSP video processing chip processes the received image digital signal, including digital signal amplification, correction and function processing, to obtain a second image digital signal. The DSP video processing chip sends the second image digital signal to the main control module. The audio acquisition and encoding module acquires the omnidirectional audio around the camera body and performs audio encoding to obtain an audio digital signal. The audio acquisition and encoding module sends the audio digital signal to the main control module. The vibration detection module acquires the resonance generated by the vibration of the camera body due to the installation on the ground, and generates a vibration digital signal. The vibration detection module sends the vibration digital signal to the main control module. The analysis method comprises the following steps: S1: Preset large vehicle phenomenon information, vehicle full load phenomenon information, audio digital signal level information, and vibration digital signal level information in the main control module of the camera with vibration detection function installed on the current road section, wherein the audio digital signal level information also includes the audio digital signal critical level, and the vibration digital signal level information also includes the vibration digital signal critical level; preset the large vehicle full load level; S2: The main control module identifies whether there is large vehicle phenomenon information and fully loaded vehicle phenomenon information in the second image digital signal. If there is neither large vehicle phenomenon information nor fully loaded vehicle phenomenon information, further analysis and processing is stopped; otherwise, the process goes to the next step. S3: The main control module identifies and compares the audio digital signal with the audio digital signal level information, and grades the audio digital signal to obtain the actual level of the audio digital signal, and compares whether the actual level of the audio digital signal exceeds the critical level of the audio digital signal; S4: The main control module identifies and compares the vibration digital signal with the vibration digital signal level information, and grades the vibration digital signal to obtain the actual level of the vibration digital signal, and compares whether the actual level of the vibration digital signal exceeds the critical level of the vibration digital signal; S5: If the actual level of the audio digital signal does not exceed the critical level of the audio digital signal, and the actual level of the vibration digital signal does not exceed the critical level of the vibration digital signal, then stop further analysis and processing; Otherwise, go to the next step; S6: Confirm the existence of large vehicle full load information, compare the large vehicle full load level, and confirm the actual large vehicle full load level. For vehicles with confirmed large vehicle full load information, statistics are collected based on the actual large vehicle full load level and stored as road monitoring data. The statistics include the number of passes and the time of pass parameters. The road monitoring data is sent to a third-party data platform through the peripheral interface and output module.

2. A camera analysis method with vibration detection function as claimed in claim 1, Features: The peripheral interface and output module establish a communication connection with the third-party data platform, and the main control module sends the second image digital signal, audio digital signal, vibration digital signal and road monitoring data to the third-party data platform through the peripheral interface and output module.

3. A camera analysis method with vibration detection function as claimed in claim 1, Features: The third-party data platform uses road monitoring data as the basic data source, combined with the current road section's weather conditions, temperature, humidity, and precipitation, to evaluate the road fatigue and damage level of the current road section in a certain period, and analyze to obtain the current road section maintenance plan. The current road section maintenance plan includes whether maintenance is needed, the type of maintenance, the maintenance level, and the maintenance process.

Citation Information

Patent Citations

  • Visual big data analysis system for road maintenance

    CN108335002A

  • A large vehicle analysis system based on deep learning

    CN109919069A

  • Lane intelligent control box

    CN110096932A

  • Holographic traffic signal lamp system

    CN113724512A

  • System, multi-utility device and method to monitor vehicles for road saftey

    IN201921002360A