Monitoring device and electronic equipment

Abstract

The utility model discloses a monitoring device and electronic equipment, the monitoring device comprises a first data acquisition module, an image acquisition module, a processor and a signal transmission module, the processor is connected with the data acquisition module, the image acquisition module and the signal transmission module, and the first data acquisition module acquires position data of the monitoring device; the plurality of image acquisition modules acquire image data of an external environment of the monitoring device; the processor is used for analyzing the position data and judging whether the position data is abnormal or not; and splicing the image data to obtain a panoramic image of the external environment of the monitoring device, and the signal transmission module is used for transmitting the panoramic image corresponding to the abnormal position data to the cloud server under the condition that the position data is abnormal. The monitoring device not only realizes multi-functional monitoring, but also improves the informatization management level.

Description

TECHNICAL FIELD

[0001] The utility model relates to a circuit technical field, concretely relates to a monitoring device and electronic equipment. BACKGROUND

[0002] With the acceleration of global infrastructure construction, especially in the continuous expansion and perfection of key facilities such as bridges, tunnels, dams and highways, these infrastructures bear huge social and economic responsibilities, and their safety and stability are directly related to people's life and property safety.

[0003] Traditional GNSS monitoring equipment can provide accurate position information and deformation trend analysis, but its functions are mainly concentrated in the data acquisition layer, and the functions are relatively single, which cannot fully meet the needs of efficient and safe management of modern infrastructure. SUMMARY

[0004] The embodiment of the application discloses a kind of monitoring device and electronic equipment, not only can data be collected, but also the panoramic image around monitoring device can be acquired, in the case of the data collected is abnormal, evaluate in combination with panoramic image, not only realize multiple function monitoring, also improve the information management level.

[0005] The first aspect of the embodiment of the application discloses a kind of monitoring device, including first data acquisition module, image acquisition module, processor and signal transmission module, the processor is connected with the first data acquisition module, multiple image acquisition modules and signal transmission module respectively, wherein:

[0006] The first data acquisition module is used to acquire the position data of the monitoring device;

[0007] Multiple image acquisition modules are used to acquire image data of the external environment of the monitoring device;

[0008] The processor is used to analyze the position data, and judge whether the position data is abnormal;And, for the image data is spliced, obtains the panoramic image of the external environment of the monitoring device;

[0009] The signal transmission module is used to transmit the panoramic image corresponding to the position data exception to cloud server in the case of the position data exception.

[0010] As an optional implementation, in the first aspect of the embodiment, the position data comprises accurate position information, the first data acquisition module comprises a GNSS positioning board card and a LoRa wireless terminal, the GNSS positioning board card is connected with the processor through a USB interface and a UART interface of the processor, and the LoRa wireless terminal is connected with the processor through a UART interface of the processor, wherein:

[0011] The GNSS positioning board card is configured to acquire initial position information of the monitoring device, and calibrate the initial position information according to calibration data of the LoRa wireless terminal to obtain the accurate position information.

[0012] The LoRa wireless terminal is configured to send the initial position information to a reference station, and receive the calibration data sent by the reference station.

[0013] As an optional implementation, in the first aspect of the embodiment, the position data further comprises angle information of the monitoring device, and the first data acquisition module further comprises a six-axis sensor, which is connected with the processor through an SPI interface of the processor.

[0014] The six-axis sensor is configured to obtain the angle information.

[0015] As an optional implementation, in the first aspect of the embodiment, the monitoring device further comprises a second data acquisition module, which is connected with a UART interface of the processor through the at least two communication standards, and is configured to acquire state data of an external environment of the monitoring device, the state data comprising crack data and temperature data.

[0016] The processor is further configured to analyze the state data and determine whether the state data is abnormal.

[0017] The signal transmission module is further configured to transmit a panoramic image corresponding to the abnormal state data to a cloud server in a case where the state data is abnormal.

[0018] As an optional implementation, in the first aspect of the embodiment, the image acquisition module comprises a visual sensor, and a plurality of visual sensors are connected with the processor through an MIPI interface of the processor.

[0019] As an optional implementation, in the first aspect of the embodiment, the image acquisition module further comprises an infrared light supplementing device, which is connected with the visual sensor.

[0020] The infrared light supplementing device is configured to supplement light for the external environment of the monitoring device by the infrared light source of the light supplementing device when the visual sensors acquire the image data in a dark environment, and the dark environment is an environment with an illumination less than a set threshold.

[0021] As an optional implementation, in the first aspect of the embodiment, the monitoring device further comprises at least one MIPI switch, and the image acquisition modules are connected to the MIPI interface of the processor through the MIPI switch.

[0022] The MIPI switch is configured to switch the transmission state between the image acquisition modules and the processor, and the transmission state comprises an open state or a closed state.

[0023] As an optional implementation, in the first aspect of the embodiment, the monitoring device further comprises a first memory connected to the processor through the SDIO interface of the processor.

[0024] The first memory is configured to store the image data, the position data and / or the state data, and to encrypt the image data, the position data and / or the state data to back up the image data, the position data and / or the state data.

[0025] As an optional implementation, in the first aspect of the embodiment, the monitoring device further comprises a second memory connected to the processor through the SDIO interface of the processor.

[0026] The second memory is configured to store the panoramic image, the position data and / or the state data, and to acquire the panoramic image when the position data and / or the state data are abnormal.

[0027] The second aspect of the embodiment discloses an electronic device comprising the monitoring device.

[0028] Compared with the related art, the embodiments of the present application have at least the following beneficial effects:

[0029] The monitoring device disclosed by the embodiment of the application comprises a first data acquisition module, an image acquisition module, a processor and a signal transmission module, the processor is connected with the data acquisition module, the image acquisition module and the signal transmission module respectively, wherein: the first data acquisition module is used for acquiring position data of the monitoring device; the plurality of image acquisition modules are used for acquiring image data of the external environment of the monitoring device; the processor is used for analyzing the position data and judging whether the position data is abnormal; and is used for splicing the image data to obtain a panoramic image of the external environment of the monitoring device; and the signal transmission module is used for transmitting the panoramic image corresponding to the abnormal position data to a cloud server in the case of abnormal position data. The monitoring device can not only acquire position data, but also acquire panoramic images around the monitoring device, and evaluate in the case of abnormal collected data combined with the panoramic images, so that multiple function monitoring is realized, and the information management level is improved. BRIEF DESCRIPTION OF DRAWINGS

[0030] In order to more clearly illustrate the technical solutions in the embodiments of the application, the drawings needed to be used in the embodiments will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the application, and other drawings can be obtained by those skilled in the art without creative labor on the basis of these drawings.

[0031] Figure 1 A structural schematic diagram of a monitoring device provided by the embodiment of the application is shown in the figure.

[0032] Figure 2 A structural schematic diagram of another monitoring device provided by the embodiment of the application is shown in the figure.

[0033] Figure 3 A structural schematic diagram of another monitoring device provided by the embodiment of the application is shown in the figure.

[0034] Figure 4 A structural schematic diagram of another monitoring device provided by the embodiment of the application is shown in the figure.

[0035] Figure 5 A structural schematic diagram of another monitoring device provided by the embodiment of the application is shown in the figure.

[0036] Figure 6 A structural schematic diagram of an electronic device provided by the embodiment of the application is shown in the figure. DETAILED DESCRIPTION

[0037] With reference to the accompanying drawings, the technical solutions in the embodiments of the present application will be clearly and completely described below. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of the present application.

[0038] It should be noted that the terms "first", "second", and "third" in the embodiments of the present application are used to distinguish similar or different objects and do not represent a specific order of the objects. Understandably, "first", "second", and "third" can be interchanged in a specific order or sequence as appropriate, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0039] It should be noted that the terms "include" and "have" and any variations thereof in the embodiments of the present application and the accompanying drawings are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device including a series of steps or units is not limited to the listed steps or units, but can optionally include steps or units not listed or can optionally include other steps or units inherent to the process, method, product, or device.

[0040] With the acceleration of global infrastructure construction, especially the continuous expansion and improvement of key facilities such as bridges, tunnels, dams, and highways, these infrastructures bear huge social and economic responsibilities, and their safety and stability are directly related to the safety of people's lives and property.

[0041] Traditional GNSS monitoring equipment can provide accurate position information and deformation trend analysis, but its functions are mainly concentrated in the data collection layer, and it is difficult to comprehensively and real-time monitor the dynamic changes of the surrounding environment, thereby limiting the accuracy of facility health condition assessment, and failing to fully meet the needs of efficient and safe management of modern infrastructure.

[0042] The embodiments of the present application disclose a monitoring device and electronic equipment, which can not only collect data, but also obtain panoramic images around the monitoring device. In the case of abnormal collected data, the panoramic images are combined for evaluation, realizing multiple function monitoring, reducing the workload of personnel investigation, improving work efficiency, and improving the informatization management level ， The following will be described in detail:

[0043] The monitoring device disclosed in the embodiments of the present application can be applied to various fields, which are not specifically limited herein, such as infrastructure monitoring field, intelligent city construction field, natural disaster monitoring and early warning field, transportation and logistics field, and energy field, which are not specifically limited herein.

[0044] In the field of infrastructure monitoring, the monitoring device can be applicable to bridges, tunnels, dams, roads, etc., without specific limitation. In the field of smart city construction, the monitoring device can be applicable to traffic lights, power facilities, underground pipe networks, etc., without specific limitation. In the field of natural disaster monitoring and early warning, the monitoring device can be applicable to earthquakes, floods, landslides, etc., without specific limitation. In the field of transportation and logistics, the monitoring device can be applicable to vehicle transportation, logistics warehouses, etc., without specific limitation. In the field of energy, the monitoring device can be applicable to real-time monitoring of key energy facilities such as power facilities and oil and gas pipelines, without specific limitation.

[0045] Based on the above monitoring device, the embodiment of the present application discloses a structural schematic diagram of a monitoring device, please refer to Figure 1 The monitoring device 10 includes a first data acquisition module 11, a plurality of image acquisition modules 12, a processor 13, and a signal transmission module 14, the processor 13 is connected with the first data acquisition module 11, a plurality of image acquisition modules 12 and the signal transmission module 14 respectively, wherein:

[0046] The first data acquisition module 11 is used for acquiring position data of the monitoring device 10;

[0047] A plurality of image acquisition modules 12 are used for acquiring image data of the external environment of the monitoring device 10;

[0048] The processor 13 is used for analyzing the position data and judging whether the position data is abnormal, and is used for splicing the image data to obtain a panoramic image of the external environment of the monitoring device 10;

[0049] The signal transmission module 14 is used for transmitting the panoramic image corresponding to the abnormal position data to the cloud server in the case of abnormal position data.

[0050] Optionally, the processor 13 can be NVIDIA Jetson Nano, Qualcomm Snapdragon600 series, MediaTek MT8167, Allwinner V3s, HiSilicon Kirin 659, Ambarella CV22, RV1126K, etc., without specific limitation.

[0051] Preferably, the processor 13 is an RV1126K, which is a high-performance, low-power system-on-chip developed by Ruiyi Micro, integrating multi-core CPU, image processing unit, AI accelerator, video codec hardware and other functions, suitable for various embedded systems with high requirements for image processing, video stream processing and AI inference. It has the advantages of low power consumption, high efficiency, flexible expansion, etc.

[0052] Firstly, the RV1126K adopts ARM Cortex-A7 core. Cortex-A7 is a low-power, high-performance processor 13 suitable for applications that need to process simple to moderately complex tasks. Its multi-core design improves the concurrent processing capability of the system and can meet certain computing needs. Secondly, the RV1126K has an AI accelerator built-in, supporting deep learning and artificial intelligence inference, especially suitable for image recognition, target detection, behavior analysis and other AI applications. In addition, the RV1126K also supports hardware video encoding and decoding, which can decode and encode high-definition video streams in real time. Thirdly, the RV1126K is equipped with a Mali-400 MP2 graphics processing unit, supporting graphics rendering and multimedia applications. It can accelerate the rendering of images and videos, and is suitable for applications that require certain graphical interfaces or video display. Finally, the RV1126K provides a variety of connection interfaces such as USB, Ethernet, MIPI, I2C, SPI, etc., supporting a variety of peripherals and network communication and processing. And it supports multiple MIPI-CSI interfaces, can connect multiple cameras, and has powerful image processing capabilities, can process images from multiple cameras and perform fusion, stitching, analysis, etc.

[0053] In the embodiment, please refer to Figure 2 , Figure 2 Another monitoring device provided by the embodiment of the application is shown in the schematic diagram. The signal transmission module 14 can include a 10 / 100M Ethernet 24 connected to the processor 13 through an RMII1 interface, a WIFI+Bluetooth module 25 connected to the processor 13 through an SDIO interface, and a 4G communication module 26 connected to the processor through a USB interface.

[0054] Alternatively, the Ethernet connected to the processor through the RMII interface can also be 1000BASE-T, 10GBASE-T and 100BASE-TX, etc., which is not specifically limited here.

[0055] Alternatively, the module connected to the processor 13 through the SDIO interface can be a WiFi+NFC module, a WiFi+Zigbee module, and a WiFi+NB-IoT module, etc., which is not specifically limited here.

[0056] Optionally, the module connected with the processor through the USB interface can also be a 5G communication module, an LTE Cat-1 module, etc., which is not specifically limited here.

[0057] The signal transmission module 14 can be connected to the cloud and select an appropriate way to transmit data to the cloud according to the on-site situation. For example, in the case of poor or no 4G network signal on site, data transmission can be performed through a 10 / 100M Ethernet or WIFI+Bluetooth module; or in the case of poor or no 4G network signal and inconvenience to pull the network cable, the WIFI+Bluetooth module can be selected for data transmission.

[0058] Exemplarily, the first data module of the monitoring device 10 acquires position data in real time and sends the position data to the processor 13, and the processor 13 analyzes the position data. In this process, the plurality of image acquisition modules 12 of the monitoring device 10 acquire image data of the external environment, the processor 13 acquires the image data of the external environment, and the image data is spliced to generate a panoramic image. In the case where the processor 13 detects that the position data is abnormal, the panoramic image corresponding to the position data is transmitted to the cloud server for the staff to view the panoramic image and evaluate whether personnel need to be arranged to the site for investigation. Not only does it reduce the workload of personnel investigation, but also improves the informatization management level.

[0059] In some embodiments, the monitoring device 10 further comprises a warning device for sending warning information to the cloud in the case where the position data is detected to be abnormal, so as to remind the staff to view the panoramic image and evaluate whether personnel need to be arranged to the site for investigation. Not only does it reduce the workload of personnel investigation, but also improves the informatization management level.

[0060] In some embodiments, the position information includes precise position information. Optionally, the precise position information can be longitude, latitude, height information, etc., which is not specifically limited here. Based on the precise position information, the first data acquisition module 11 can include a GNSS positioning board card and a LoRa wireless terminal. Please further refer to Figure 2 , including a GNSS positioning board card 21 and the LoRa wireless terminal 22, the GNSS positioning board card 21 is connected with the processor 13 through the USB interface and the UART interface of the processor, and the LoRa wireless terminal is connected with the processor 13 through the UART interface of the processor 13, wherein:

[0061] The GNSS positioning board card 21 is used to acquire initial position information of the monitoring device 10, and calibrate the initial position information according to the calibration data of the LoRa wireless terminal 22 to obtain the precise position information;

[0062] LoRa wireless terminal 22, for sending the initial position information to the reference station, and for receiving the calibration data sent by the reference station.

[0063] The GNSS positioning board card 21 and the LoRa wireless terminal 22 are described in detail as follows:

[0064] The Global Navigation Satellite System (GNSS) positioning board card 21 is a hardware device used to obtain device location information through satellite positioning technology. It integrates GNSS receivers, antennas, and other auxiliary components, and can communicate with multiple global navigation satellite systems to accurately determine the geographical position of the device.

[0065] The core working principle of the GNSS positioning board card is to communicate with multiple satellite systems, receive signals transmitted from these satellites, and calculate the longitude, latitude, and altitude of the device through triangulation or other positioning algorithms. The specific steps are as follows:

[0066] Receive satellite signals: The GNSS board card communicates with multiple satellites through the built-in GNSS receiver. Among them, the global navigation satellite system can be GPS (USA), GLONASS (Russia), Galileo (Europe), Beidou (China), QZSS (Japan), and IRNSS (India), etc., without specific limitation here.

[0067] Positioning algorithm calculation: After receiving the satellite signals, the GNSS receiver estimates the distance between the device and multiple satellites by calculating the time of the signal from the satellite to the receiver, and then obtains the accurate device position through triangulation.

[0068] The GNSS positioning board card has the advantages of high precision, real-time, multi-system support, and support for multi-band technology. Among them, high precision means that the GNSS positioning board card can provide high-precision longitude, latitude, and altitude position information through GNSS satellite positioning. Depending on the application scenario, the accuracy ranges from a few meters to centimeters. Real-time means that the GNSS positioning board card can also obtain real-time positioning data and constantly update it. Multi-system support means that the GNSS positioning board card supports multiple GNSS systems, providing more stable and reliable positioning services in different environments. Support for multi-band technology means that it can receive signals of multiple frequencies at the same time, further improving positioning accuracy and stability.

[0069] In some embodiments, in order to improve positioning accuracy, the GNSS positioning board card calibrates the initial position information according to the calibration data of the LoRa wireless terminal 22 to obtain the accurate position information;

[0070] The LoRa wireless terminal 22 is configured to send the initial position information to a reference station and receive the calibration data sent by the reference station, so that the GNSS can obtain accurate position information according to the calibration data.

[0071] The LoRa wireless terminal is a low-power wide-area network communication device based on LoRa technology, which is used to realize long-distance wireless data transmission. LoRa technology is promoted by Semtech Company, which is particularly suitable for low-power, high-delay tolerant, long-distance transmission of Internet of Things applications.

[0072] The LoRa wireless terminal is usually composed of a LoRa wireless module, a sensor, a microcontroller, a shell and packaging, and other components, which is used to connect to the LoRa network and realize wireless transmission of data.

[0073] The LoRa wireless module is the core component of the LoRa wireless terminal, responsible for wireless communication. Optionally, the LoRa module can be SX1276, SX1278, SX1262, etc. of Semtech. The sensor is mainly used for data collection. The microcontroller is mainly responsible for controlling the data collection of the sensor, data processing, wireless communication and other functions. The shell and packaging are designed to cope with harsh working environments, with waterproof, dustproof, shockproof and other designs to ensure stable operation of the equipment in different environments.

[0074] In addition, the LoRa wireless terminal has the characteristics of low power consumption, long distance transmission, strong anti-interference ability and high capacity network support, etc. The low power consumption means that the LoRa wireless terminal uses low power consumption technology and can run for a long time, which is suitable for battery-powered applications. And through the optimized data transmission mode, it can realize data transmission for a long time without frequent battery replacement. Long distance transmission means that compared with other wireless communication technologies, the communication distance of LoRa can reach more than 10 kilometers, far beyond the traditional short-range wireless technologies such as Wi-Fi or Bluetooth. Strong anti-interference ability means that LoRa wireless terminal adopts spread spectrum technology, which enables it to work stably in noisy and interfered environments. High-capacity network support means that LoRa network is based on star topology and supports a large number of terminal devices to connect at the same time.

[0075] For example, please further refer to Figure 2The GNSS board card 21 in the first data module of the monitoring device 10 obtains the initial position information of the monitoring device 10 in real time through satellite positioning technology, and sends the initial position information to the nearby base station through the LoRa wireless terminal 22. The nearby base station sends the calibration data to the LoRa wireless terminal, and the GNSS positioning board card 21 calibrates the initial position information according to the calibration data to obtain accurate position information. The processor 13 analyzes the position data containing the accurate position information. In this process, the plurality of image acquisition modules 12 of the monitoring device 10 acquire image data of the external environment. The processor 13 acquires the image data of the external environment and splices the image data to generate a panoramic image. In the case where the processor 13 detects that the position data is abnormal, a warning is issued and the panoramic image corresponding to the position data is transmitted to the cloud server, so that the staff can view the panoramic image when receiving the warning and evaluate whether personnel need to be arranged to the site for investigation. Not only the workload of personnel investigation is reduced, but also the information management level is improved.

[0076] In some embodiments, the position data further includes angle information of the monitoring device 10. Optionally, the angle information can be motion state or direction information, etc. Based on the angle information, the first data acquisition module 11 further includes a six-axis sensor, please further refer to Figure 2 The six-axis sensor 23 is connected with the processor 13 through the SPI interface of the processor, and is mainly used for acquiring angle information of the monitoring device.

[0077] The six-axis sensor 23 is mainly composed of an accelerometer and a gyroscope. The accelerometer measures acceleration by the movement of internal particles and springs or other sensing elements. When an object accelerates in a certain direction, the spring in the sensor will stretch or compress, causing the displacement of the particles. According to the size of the displacement, the acceleration of the object along the axis can be calculated. The gyroscope works based on the principle of angular momentum conservation. It measures the rotational angular velocity of the object around each axis through internal rotating elements or micro mechanical structures. When the object rotates, the internal rotating elements of the gyroscope will change accordingly, and these changes can be output through the electrical signal of the sensor, and then the angular velocity of the object can be calculated.

[0078] The accelerometer can detect the linear motion of the object and the gravity acting on it. Under normal circumstances, the accelerometer can measure the acceleration of three axes, for example, X axis, Y axis and Z axis. By knowing the static and dynamic acceleration of the object, the position change, speed and other information of the object can be calculated.

[0079] The gyroscope provides angular velocity data with units of "degrees per second" (° / s) or "radians per second" (rad / s), which can help measure the rotational angular velocity of the object around the X axis, Y axis and Z axis.

[0080] The six-axis sensor can not only obtain the angle information of the monitoring device 10, but also can be used together with other positioning sensors through data fusion algorithm by combining the data of the accelerometer and the gyroscope to assist in realizing the navigation and positioning functions of the device and realizing more accurate pose calculation.

[0081] Exemplarily, further referring to Figure 2 The GNSS board card in the first data module of the monitoring device 10 obtains the initial position information of the monitoring device 10 in real time through satellite positioning technology, and sends the initial position information to the nearby base station through the LoRa wireless terminal 22. The nearby base station sends the calibration data to the LoRa wireless terminal 22, and the GNSS positioning board card 21 calibrates the initial position information according to the calibration data to obtain accurate position information. In addition, the monitoring device 10 also obtains the angle information of the monitoring device 10 through the six-axis sensor, and the processor 13 analyzes the position data containing the accurate position information and the angle information. In this process, the plurality of image acquisition modules 12 of the monitoring device 10 obtain the image data of the external environment, the processor 13 obtains the image data of the external environment, and splices the image data to generate a panoramic image. In the case where the processor 13 detects that the position data is abnormal, a warning is issued and the panoramic image corresponding to the position data is transmitted to the cloud server, so that the staff can view the panoramic image when receiving the warning and evaluate whether personnel need to be arranged to the site for investigation. Not only the workload of personnel investigation is reduced, but also the informatization management level is improved.

[0082] In some embodiments, in order to improve the accuracy of abnormal monitoring, the monitoring device 10 further comprises a second data acquisition module for acquiring state data of the external environment of the monitoring device 10 for abnormal judgment together with the position data of the first data acquisition module 11. Please refer to Figure 3 , Figure 3 Another schematic structural diagram of a monitoring device provided by the embodiment of the application comprises a second data acquisition module 31 connected with the UART interface of the processor 13 through at least two communication standards such as RS558 and RS232, for acquiring state data of the external environment of the monitoring device 10, and the state data comprises crack data and temperature data. Based on the state data, the processor 13 is further used for analyzing the state data and judging whether the state data is abnormal. The signal transmission module 14 is further used for transmitting the panoramic image corresponding to the state data abnormality to the cloud server in the case where the state data is abnormal.

[0083] Optionally, the communication standard can also be RS-232C and RS-232C and other serial communication standards, which are not limited here.

[0084] In the case where the acquired state data is crack data, the second data acquisition module 31 may include strain sensors, ultrasonic sensors, magnetic particle inspection sensors, and fiber optic sensors, etc., without specific limitations, to be applicable to crack detection of different materials and structures.

[0085] When the acquired status data is temperature data, the second data acquisition module 31 may include thermocouples, RTDs, thermistors, infrared temperature sensors, and fiber optic temperature sensors, etc., without specific limitations, to monitor the ambient temperature around the monitoring device 10.

[0086] By acquiring and monitoring crack and temperature data, we can not only improve safety and extend equipment lifespan, but also effectively reduce maintenance costs, optimize resource utilization, and increase production efficiency. The resulting real-time decision support and data analysis capabilities will greatly enhance the accuracy and scientific rigor of engineering management, while also helping to comply with regulations and industry standards, ensuring the long-term reliable operation of equipment and structures.

[0087] Optionally, the second data acquisition module 31 can acquire not only crack data and temperature data, but also humidity data, atmospheric pressure data, wind speed and direction data, light intensity data, noise data, air quality data, ground vibration data, radiation data, and precipitation data, etc., without specific limitations. This data helps to comprehensively assess the impact of the external environment on equipment, structures, or systems.

[0088] When the acquired status data is humidity data, the second data acquisition module 31 may include a capacitive humidity sensor or a resistive humidity sensor, etc., without specific limitations, and can measure the relative humidity of the environment in real time.

[0089] When the acquired state data is atmospheric pressure data, the second data acquisition module 31 may include a piezoelectric pressure sensor or a pressure transmitter, etc., without specific limitations, for real-time measurement of atmospheric pressure to help monitor changes in the external environment.

[0090] When the acquired status data is wind speed and wind direction data, the second data acquisition module 31 may include a hot-wire anemometer, a rotor anemometer, etc., without specific limitations, for measuring wind speed and wind direction in the environment.

[0091] When the acquired state data is light intensity data, the second data acquisition module 31 may include photoelectric sensors, photoresistors, etc., without specific limitations, for measuring the light intensity in the environment.

[0092] In the case of acquired state data being noise data, the second data acquisition module 31 can include a sound level meter, a microphone array, etc., which are not specifically limited herein, for monitoring the intensity of environmental noise to help assess environmental quality.

[0093] In the case of acquired state data being air quality data, the second data acquisition module 31 can include a carbon dioxide sensor, an ozone sensor, a VOC sensor, etc., which are not specifically limited herein, for monitoring the concentration of harmful substances in the air.

[0094] In the case of acquired state data being ground vibration data, the second data acquisition module 31 can include a speedometer, a seismograph, or a displacement sensor, etc., which are not specifically limited herein, for being able to detect the vibration of the ground or equipment in real time.

[0095] In the case of acquired state data being radiation data, the second data acquisition module 31 can include a gamma-ray detector, an X-ray sensor, etc., which are not specifically limited herein, for being able to detect the radiation level in the environment in real time.

[0096] In the case of acquired state data being precipitation data, the second data acquisition module 31 can include a rain sensor or a pluviometer, etc., which are not specifically limited herein, for being able to record the amount of precipitation in real time, and for being used in hydrological monitoring, environmental assessment, etc.

[0097] Exemplarily, further reference can be made to Figure 3The GNSS board card in the first data module of the monitoring device 10 obtains the initial position information of the monitoring device 10 in real time through satellite positioning technology, and sends the initial position information to the nearby base station through the LoRa wireless terminal 22. The nearby base station sends the calibration data to the LoRa wireless terminal 22. The GNSS positioning board card 21 calibrates the initial position information according to the calibration data to obtain accurate position information. In addition, the monitoring device 10 also obtains the angle information of the monitoring device 10 through the six-axis sensor in the first data acquisition module 11. The monitoring device 10 also obtains the state data of the external environment through the second data acquisition module 31. The monitoring processor 13 analyzes the position data including the accurate position information and the angle information and the state data including at least the crack data and the temperature data. In this process, the image acquisition module 12 of the monitoring device 10 obtains the image data of the external environment. The processor 13 obtains the image data of the external environment and splices the image data to generate a panoramic image. When the processor 13 detects that the position data is abnormal, a warning is issued and the panoramic image corresponding to the position data is transmitted to the cloud server for the staff to view the panoramic image when receiving the warning to evaluate whether personnel need to be arranged to the scene for investigation. Not only does it reduce the workload of personnel investigation, but also improves the informatization management level.

[0098] In some embodiments, the image acquisition module includes a plurality of visual sensors, please further refer to Figure 4 The plurality of visual sensors 41 are connected with the processor 13 through the MIPI interface of the processor 13.

[0099] Optionally, in different use scenarios, the visual sensors included in the image acquisition module are different, which can be selected according to actual conditions, for example: the visual sensor can be an RGB camera, a black and white camera, a depth camera, an infrared camera, a spectrum sensor and a thermal imaging sensor, etc., which is not specifically limited here.

[0100] The RGB camera is a common color camera that captures images in the visible light range and outputs RGB image data. The black and white camera only captures black and white images and is usually used in low-light environments or applications that do not require color information. Depth cameras, such as structured light and stereo vision cameras, can capture image data and obtain depth information for each pixel, which is used for three-dimensional reconstruction or object distance perception. The infrared camera can capture infrared radiation images and is suitable for monitoring in low-light or night environments. The spectrum sensor can capture light in different wavelength ranges (such as infrared, ultraviolet, visible light, etc.) and obtain the reflection characteristics of different substances.

[0101] In some embodiments, the image acquisition module further includes an infrared light supplement device 42, please further refer toFigure 4 each of the infrared light supplementing devices 42 is connected with the visual sensor 41, wherein:

[0102] The infrared light supplementing device 42 is configured to supplement light for the external environment of the monitoring device 10 by the infrared light source of the light supplementing device in the case that the visual sensor 41 acquires the image data in a dark environment, and the dark environment is an environment with an illuminance less than a set threshold.

[0103] The infrared light supplementing device 42 is a device for providing additional light source in low light or completely dark environment. Its basic principle is based on the invisible characteristics of infrared, that is, the wavelength of infrared is longer, and the human eye cannot directly perceive it, but many cameras or sensors can perceive light of these wavelengths. In order to enable the camera to still obtain clear images at night, the infrared light supplementing device illuminates the target area by emitting infrared light, and captures the reflected infrared light by using an infrared camera, so as to obtain clear image information. Using the infrared light supplementing device on the camera not only can obtain clear images in low light environment, but also will not disturb people or animals in the environment because the infrared light is invisible to people and animals.

[0104] The infrared light supplementing device is usually composed of infrared light emitting diode lamp beads, optical lens, driving circuit and mounting bracket. Among them, the infrared light emitting diode lamp bead is the core component of the infrared light supplementing device. These light emitting diode lamp beads can emit light with specific wavelength of infrared light, and the common wavelength range is 850nm to 940nm. And different wavelengths will affect the irradiation distance and effect of the light supplementing device. Shorter wavelength usually has better penetration and longer irradiation range, while longer wavelength performs lower in light visibility, is more concealed, but the irradiation range is relatively shorter.

[0105] In addition, the advantages of the infrared light supplementing device not only lie in concealment and night working ability, but also lie in energy saving, durability and easy maintenance. Compared with traditional lighting equipment, the infrared LED lamp has lower power consumption, can work for a long time, and has strong anti-interference and waterproof functions, and is suitable for various harsh environments.

[0106] Exemplarily, please further refer to Figure 5The GNSS board card in the first data module of the monitoring device 10 obtains the initial position information of the monitoring device 10 in real time through satellite positioning technology, and sends the initial position information to the nearby base station through the LoRa wireless terminal 22. The nearby base station sends calibration data to the LoRa wireless terminal 22, and the GNSS positioning board card 21 calibrates the initial position information according to the calibration data to obtain accurate position information. In addition, the monitoring device 10 also obtains the angle information of the monitoring device 10 through the six-axis sensor in the first data acquisition module 11. In addition, the monitoring device 10 also obtains the state data of the external environment through the second data acquisition module 31. The monitoring processor 13 analyzes the position data including the accurate position information and the angle information, and the state data including at least the crack data and the temperature data. In this process, the multiple visual sensors and the infrared light supplementing device 42 of the monitoring device 10 obtain the image data of the external environment in the daytime or at night. The processor 13 obtains the image data of the external environment and splices the image data to generate a panoramic image. In the case where the processor 13 detects that the position data is abnormal, a warning is issued and the panoramic image corresponding to the position data is transmitted to the cloud server, so that the staff can view the panoramic image when receiving the warning, and evaluate whether personnel need to be arranged to the scene for investigation. Not only the workload of personnel investigation is reduced, but also the informatization management level is improved.

[0107] In some embodiments, the monitoring device 10 further comprises at least one MIPI switch, and the multiple image acquisition modules are connected with the MIPI interface of the processor 13 through the MIPI switch. Please refer to Figure 5 , Figure 5 Another schematic structural diagram of a monitoring device provided by the embodiment of the application comprises a MIPI switch 51. The MIPI switch 51 is used to switch the transmission state between the multiple image acquisition modules and the processor 13. The transmission state includes an open state or a closed state. When the transmission state is the open state, the processor 13 obtains the image data from at least one image acquisition module.

[0108] The MIPI switch 51 is an electronic switch that plays an important role in mobile devices and other electronic systems, especially in applications related to high-speed signal transmission. MIPI (Mobile Industry Processor Interface) is a set of standards developed by the MIPI Alliance for communication between various hardware modules in mobile devices. MIPI interface is usually used to connect modules such as mobile phones, tablets, televisions, camera modules, displays, sensors, etc., and the MIPI switch plays a key role in signal selection and switching in these systems.

[0109] The working principle of the MIPI switch is to switch the signal from one path to another path through the change of the switch structure, ensuring that the signal is transmitted to the correct module at the correct time. In practical applications, the MIPI switch is usually used to connect different hardware modules, such as connecting the processor 13 with the display screen, camera module, sensor, etc. Taking the monitoring device of the present application as an example, the MIPI switch can switch signals between different camera modules and the processor 13, ensuring that when using the front camera, the signal is transmitted through the front camera; and when using the rear camera, the signal is switched to the rear camera module.

[0110] The MIPI switch has the advantages of high frequency response capability, low power consumption, and being suitable for various types of signal transmission methods. Among them, since the MIPI switch has high frequency response capability, it can support high-speed data transmission protocols such as MIPI DSI (Display Serial Interface), MIPI CSI (Camera Serial Interface), etc. This enables the MIPI switch to handle data streams of several gigabits per second with very low signal attenuation and delay, ensuring the transmission quality of images, videos and data. In addition, the MIPI switch is often designed using low-power CMOS technology to reduce power consumption and have a smaller size, meeting the needs of miniaturized devices. The MIPI switch is also suitable for various types of signal transmission methods, such as single-ended signal transmission and differential signal transmission. Preferably, the MIPI switch of the present application uses differential signal transmission, because differential signal transmission has better anti-interference performance and higher signal transmission quality, which can ensure the integrity and stability of data.

[0111] For example, please further refer to Figure 5The GNSS board card in the first data module of the monitoring device 10 obtains the initial position information of the monitoring device 10 in real time through satellite positioning technology, and sends the initial position information to the nearby base station through the LoRa wireless terminal 22. The nearby base station sends the calibration data to the LoRa wireless terminal 22. The GNSS positioning board card 21 calibrates the initial position information according to the calibration data to obtain accurate position information. In addition, the monitoring device 10 also obtains the angle information of the monitoring device 10 through the six-axis sensor in the first data acquisition module 11. In addition, the monitoring device 10 also obtains the state data of the external environment through the second data acquisition module 31. The monitoring processor 13 analyzes the position data including the accurate position information and the angle information and the state data including at least the crack data and the temperature data. In this process, the multiple visual sensors and the infrared supplementary lighting device 42 of the monitoring device 10 obtain the image data of the external environment in the daytime or at night. The image data is transmitted to the processor 13 through the MIPI switch 51 when the processor 13 obtains the image data of the external environment. The processor 13 splices the obtained image data to generate a panoramic image. When the processor 13 detects that the position data is abnormal, a warning is issued and the panoramic image corresponding to the position data is transmitted to the cloud server, so that the staff can view the panoramic image when receiving the warning, and evaluate whether personnel need to be arranged to the scene for investigation. Not only the workload of personnel investigation is reduced, but also the information management level is improved.

[0112] In some embodiments, the monitoring device 10 further comprises a first memory, please further refer to Figure 5 The first memory 52 is connected with the processor 13 through the SDIO interface of the processor 13, and is mainly used for storing the image data, the position data and / or the state data, and for encrypting the image data, the position data and / or the state data to backup the image data, the position data and / or the state data.

[0113] Optionally, the first memory can be a TF card, a MSD card, a SD card, a UFS, and a SDHC card, etc., which is not limited here.

[0114] Preferably, the first memory of the present application is a TF card. The TF card is a small and detachable memory card, which not only has a large storage capacity, but also becomes a standard accessory of various electronic products due to its small size and high read-write performance.

[0115] The storage capacity, speed level and performance of the TF card can be greatly different, and can be selected according to actual needs. Among them, the capacity of the TF card ranges from as low as a few GB to as high as 512 GB or more, suitable for devices and purposes with different needs. For example, 8 GB, 16 GB, 32 GB, 64 GB, 128 GB, etc.

[0116] The speed of the TF card can be Class 2, 4, 6, 10 or UHS-I, UHS-II, etc., which is not specifically limited here. Among them, Class 2, 4, 6, 10, etc. represent the minimum write speed of the TF card. For example, the minimum write speed of the Class 10 card is 10 MB / s. UHS is the abbreviation of ultra-high speed, which is divided into UHS-I and UHS-II. Among them, the maximum speed of UHS-I is 104 MB / s, and the maximum speed of UHS-II is 312 MB / s.

[0117] The application performance level of the TF card can be A1 or A2, which is not specifically limited here. These levels refer to the performance of the TF card when running applications. For example, the A1 standard indicates that the TF card can support at least 1500 read and 500 write operations, and the random read speed per second is 10 MB.

[0118] In the embodiments of the present application, the TF card is used as the first memory. Since the TF card has the advantages of small size, convenience, large capacity expansion, high read-write performance, wide compatibility, and reliable durability, etc., it not only saves the monitoring space, but also has a high storage rate. And because of its strong applicability, the monitoring device 10 can work stably in different environments.

[0119] In some embodiments, the monitoring device 10 further comprises a second memory, please further refer to Figure 5 , comprising a second memory 53 connected with the processor 13 through the SDIO interface of the processor 13, mainly used for storing panoramic images, the position data and / or the state data, so as to determine the processor 13 to obtain the panoramic image in the case of abnormal position data and / or the state data.

[0120] Optionally, the memory can be an embedded multi-media card (eMMC) storage, an embedded flash (EF), a universal flash storage (UFS) storage, etc., which is not specifically limited here.

[0121] Preferably, the second memory 53 of the present application is an eMMC memory with a memory capacity of 32 GB. The eMMC memory is a storage card based on NAND flash technology, and is usually soldered to the mainboard of a device, and is suitable for devices that require embedded storage.

[0122] The core of the embedded multimedia card is a storage system composed of NAND flash memory and a built-in controller. The NAND flash memory is the storage medium of the eMMC, which stores data through electric charge and is a non-volatile storage technology that can retain data in the event of power failure. The controller is an integrated controller inside the eMMC, responsible for managing read and write requests of the storage medium. The controller handles various complex tasks behind the scenes, such as bad block management, data erasure, and write amplification effects. Due to its high performance, low power consumption, small size, and high integration, the eMMC is widely used in various devices.

[0123] It can be understood that the monitoring device 10 can also include a double data rate memory 54 (RAM DDR) connected to the MMDC interface of the processor. Please refer to Figure 5 The RAM DDR can provide fast data storage and access capabilities, temporarily store real-time monitoring data, algorithm calculation results, and system status information to support high-speed data processing and real-time response. Its high bandwidth characteristics enable the monitoring system to maintain high efficiency when processing large amounts of data, ensuring that the monitoring device 10 can quickly perform complex calculations and provide timely data access when needed.

[0124] Optionally, the memory connected to the MMDC interface of the processor can also be a synchronous dynamic random access memory (SDRAM), a low-power double data rate memory (LPDDR), and a static random access memory (SRAM), etc., which is not specifically limited here.

[0125] Based on the above monitoring device 10, Figure 6 is a structural schematic diagram of an electronic device disclosed in an embodiment of the present application. As Figure 6 shown, the electronic device 60 can include any one of the monitoring devices 10 disclosed in the embodiments of the present application.

[0126] It should be understood that the term "one embodiment" or "an embodiment" as used herein means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the application. The appearances of the phrase "in one embodiment" or "in an embodiment" in various places in the specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. It will be appreciated by those skilled in the art that the embodiments described herein that can be implemented by software programs and / or firmware instructions can generally be located on any platform being equipped with a processing unit.

[0127] In various embodiments of the present application, it should be understood that the magnitude of the serial number of the above processes does not mean the inevitable sequence of execution, and the execution sequence of the processes should be determined according to its function and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0128] The units described above as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e. they can be located in one place, or they can be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiments of the present application.

[0129] In addition, each functional unit in each embodiment of the present application can be integrated in one processor, or each unit can exist physically, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of software functional unit.

[0130] The term "and / or" herein is only a description of the association relationship of the associated objects, which means that there can be three relationships, for example, object A and / or object B, which can represent the three cases of existence of object A alone, existence of object A and object B, and existence of object B alone.

[0131] It should be noted that in this paper, the term "include", "contain" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed, or includes elements inherent to such process, method, article or device. Without more limitations, the element defined by the sentence "including a…" does not exclude the presence of other identical elements in the process, method, article or device including the element.

[0132] The methods disclosed in the several method embodiments provided by the present application can be combined arbitrarily without conflict to obtain new method embodiments.

[0133] The features disclosed in several product embodiments provided by the present application can be arbitrarily combined without conflict, to obtain new product embodiments.

[0134] The features disclosed in several method or device embodiments provided by the present application can be arbitrarily combined without conflict, to obtain new method embodiments or device embodiments.

[0135] The monitoring device disclosed in the embodiments of the present application is described in detail above, and the principles and implementation manners of the present application are described by applying specific examples. The above embodiment descriptions are only used to help understand the method of the present application and its core idea. Meanwhile, for those skilled in the art, the specific implementation manners and application ranges will be changed according to the idea of the present application. In summary, the content of the specification should not be understood as a limitation of the present application.

Claims

1. A monitoring device, characterized in that The application relates to a monitoring device, which comprises a first data acquisition module, a plurality of image acquisition modules, a processor and a signal transmission module, wherein the processor is connected with the first data acquisition module, the plurality of image acquisition modules and the signal transmission module respectively. The first data acquisition module is used for acquiring position data of the monitoring device. The plurality of image acquisition modules are used for acquiring image data of an external environment of the monitoring device. The processor is used for analyzing the position data and judging whether the position data is abnormal, and is used for splicing the image data to obtain a panoramic image of the external environment of the monitoring device. The signal transmission module is used for transmitting the panoramic image corresponding to the abnormal position data to a cloud server in the case that the position data is abnormal.

2. The monitoring device of claim 1, wherein, The position data comprises accurate position information, the first data acquisition module comprises a GNSS positioning board card and a LoRa wireless terminal, the GNSS positioning board card is connected with the processor through a USB interface and a UART interface of the processor, and the LoRa wireless terminal is connected with the processor through a UART interface of the processor. The GNSS positioning board card is used for acquiring initial position information of the monitoring device, and is used for calibrating the initial position information according to calibration data of the LoRa wireless terminal to obtain the accurate position information. The LoRa wireless terminal is used for sending the initial position information to a reference station, and is used for receiving the calibration data sent by the reference station.

3. The monitoring device of claim 2, wherein, The position data further comprises angle information of the monitoring device, and the first data acquisition module further comprises a six-axis sensor, which is connected with the processor through an SPI interface of the processor. The six-axis sensor is used for obtaining the angle information.

4. The monitoring device of claim 1, wherein, The monitoring device further comprises a second data acquisition module, which is connected with a UART interface of the processor through at least two communication standards and is used for acquiring state data of an external environment of the monitoring device, wherein the state data comprises crack data and temperature data. The processor is further used for analyzing the state data and judging whether the state data is abnormal. The signal transmission module is further used for transmitting the panoramic image corresponding to the abnormal state data to the cloud server in the case that the state data is abnormal.

5. The monitoring device of claim 1, wherein, The image acquisition module comprises a visual sensor, and a plurality of visual sensors are connected with the processor through an MIPI interface of the processor.

6. The monitoring device of claim 5, wherein, The image acquisition module further comprises an infrared light supplementing device, which is connected with the visual sensor. The infrared light supplementing device is used for supplementing light for the external environment of the monitoring device through an infrared light source of the light supplementing device in the case that the plurality of visual sensors acquire the image data in a dark environment, and the dark environment is an environment with an illuminance less than a set threshold.

7. The monitoring device of claim 6, wherein, The monitoring device further comprises at least one MIPI switch, and a plurality of the image acquisition modules are connected with the MIPI interface of the processor through the MIPI switch, The MIPI switch is configured to switch transmission states between the plurality of the image acquisition modules and the processor, and the transmission states include an open state or a closed state. When the transmission state is the open state, the processor acquires the image data from at least one of the image acquisition modules.

8. The monitoring device of claim 4, wherein, The monitoring device further comprises a first memory, and the first memory is connected with the processor through the SDIO interface of the processor, The first memory is configured to store the image data, the position data and / or the state data, and to perform encryption processing on the image data, the position data and / or the state data to back up the image data, the position data and / or the state data.

9. The monitoring device of claim 8, wherein, The monitoring device further comprises a second memory, and the second memory is connected with the processor through the SDIO interface of the processor, The second memory is configured to store the panoramic image, the position data and / or the state data, so as to acquire the panoramic image when the position data and / or the state data are abnormal.

10. An electronic device, comprising: The monitoring device comprises any one of the monitoring devices according to claims 1-9.

Images