Vehicle image recognition system and method based on camera
By designing a camera image recognition system in an intelligent driving system, monitoring and managing the working status of the camera in real time, the problem of difficulty in camera fault diagnosis is solved, the camera is safe and reliable operation is achieved, and the safety of the vehicle is improved.
Patent Information
- Application Number
- CN202410897579.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-05
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2044-07-05
AI Technical Summary
In the existing intelligent driving system, it is difficult to diagnose and troubleshoot camera faults, affecting the safe driving of the vehicle.
A camera-based vehicle image recognition system is designed, including equipment management control subsystem, communication subsystem, early warning subsystem, operation log management subsystem and vehicle management subsystem. By monitoring the working status of the camera in real time, fault diagnosis and Exclude auxiliary functions and ensure the safe and reliable operation of the camera through real-time power monitoring, humidity, temperature and smoke detection, fault inspection modules, etc.
Real-time power management of the camera and rapid fault diagnosis are realized, ensuring the safe operation of the camera, avoiding vehicle stoppage caused by insufficient energy or failure, and improving vehicle safety and reliability.
Smart Images

Figure CN119052407A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of autonomous driving, and in particular to a camera-based vehicle image recognition system and method. Background Art
[0002] The prerequisite for intelligent driving is that the vehicle we choose meets the dynamic requirements of driving, the sensors on the vehicle can obtain relevant visual and auditory signals and information, and control the corresponding follow-up system through cognitive computing, including obtaining image information outside the vehicle through cameras, measuring obstacle distance information through distance sensors, etc.
[0003] Intelligent driving has become a development trend. To this end, we have proposed a solution that can fully call and control the camera, obtain effective image information, and cooperate with warning and emergency response functions to achieve safe driving of the vehicle. Summary of the invention
[0004] The purpose of the present invention is to provide a vehicle image recognition system and method based on a camera, which can monitor some structural components of the camera in real time and monitor their working status. When a fault occurs, it can assist staff in diagnosing and troubleshooting the fault to solve the problems raised in the above background technology.
[0005] To achieve the above-mentioned purpose, the present invention provides the following technical solutions: a camera-based vehicle image recognition system and method, comprising a device management and control subsystem, a communication subsystem, an early warning subsystem, an operation log management subsystem and a vehicle management subsystem;
[0006] It also includes: a task management subsystem, which includes a task publishing module, a task acquisition module and a task completion determination module, the task publishing module is connected to a warning module, and one end of the warning module is connected to the task completion determination module;
[0007] The equipment management and control subsystem is connected to the task management subsystem, and the equipment management and control subsystem includes a main controller, a signal receiving module, a single camera scheduling module, a single camera operation module, and a PLC control module; one end of the main controller is connected to the task acquisition module, and the signal receiving module, the single camera scheduling module, the single camera operation module, and the PLC control module are respectively connected to the main controller;
[0008] A single camera operation module includes multiple single camera online monitoring modules, multiple Beidou positioning and navigation modules, multiple backup camera operation modules and multiple real-time power monitoring modules. The output end of the real-time power monitoring module is electrically connected to the charging and discharging module. The main controller is connected to the early warning subsystem. The main controller is connected to the operation log management subsystem. The operation log management subsystem includes an operation log generation module, an operation log storage module and an operation log viewing module. The main controller is connected to the communication subsystem. The communication subsystem includes multiple wireless communication modules and wired communication modules. One end of the main controller is connected to an abnormal feedback module. The abnormal feedback module is respectively connected to the mobile terminal and the monitoring background through the wireless communication module and the wired communication module. The main controller is connected to the vehicle management subsystem. The vehicle management subsystem includes a vehicle monitoring module and a vehicle update module.
[0009] Preferably, the early warning subsystem includes a plurality of humidity detection modules, a plurality of temperature detection modules, a plurality of smoke monitoring modules, a plurality of fault detection modules and a plurality of alarm modules;
[0010] The warning module is provided with a red light and a green light. When the camera is in operation, the red light is on, and when the camera is idle, the green light is on.
[0011] The humidity detection module includes a plurality of humidity detection sensors, the temperature detection module includes a plurality of temperature detection sensors, and the smoke monitoring module includes a plurality of smoke detectors; the humidity detection module, the temperature detection module and the smoke monitoring module are respectively connected to the main controller.
[0012] Preferably, the fault detection module includes a vehicle brake detection module installed on the upper part of the camera, a detection distance sensor installed on one side of the camera, a correction module for detecting drive wheel slippage, and a vibration detection module, and the guide wheel detection module, the detection distance sensor, the correction module, and the vibration detection module are respectively connected to the main controller;
[0013] The vehicle brake detection module includes several distance sensors 2 and wireless communication module 2. The distance sensor is installed on one side of the upper guide wheel to detect the wear condition of the upper guide wheel housing. The distance sensor 2 is connected to the wireless communication module 2 and connected to the main controller through the wireless communication module 2. The correction module includes a distance sensor 3 and a reference board matched with the distance sensor 3. The distance sensor 3 is installed on one side of the camera, and the reference board is installed on one side of the lane.
[0014] The vibration detection module includes a plurality of vibration sensors mounted on the surface of the camera.
[0015] Preferably, the signal sent from the task acquisition module is sent to the main controller, and the signal reception is determined by the signal receiving module and a single camera scheduling module is executed.
[0016] Preferably, a single camera online monitoring module and a Beidou positioning and navigation module are also installed on the backup camera operation module. The Beidou positioning and navigation module sends the camera's location and time information to the main controller through the wireless communication module installed on the camera. The main controller processes the information and transmits it to the PLC control module so that the PLC control module can control the operation of the camera.
[0017] Preferably, during the execution of the single camera operation module and / or the backup camera operation module, the single camera scheduling module monitors the changes in power in real time through the real-time power monitoring module and selectively allocates power to any one of the single camera operation module and the backup camera operation module.
[0018] Preferably, the charging and discharging module is used to enable the charging brush head to output power to charge the camera after receiving a signal from the main controller indicating that the camera has reached a predetermined position and has stopped moving.
[0019] Preferably, the vehicle update module is used to update the camera data after the camera operation is completed.
[0020] Compared with the prior art, the present invention has the following beneficial effects:
[0021] 1. In the present invention, the single camera scheduling module can selectively allocate the camera execution task to any one of the single camera operation module and the standby camera operation module according to the real-time power monitoring module connected to the single camera operation module and the standby camera operation module to monitor the power changes in real time, and the remaining idle cameras are connected to the external power supply through the charging and discharging module to perform charging operations, thereby ensuring that the camera is in a fully charged operating state, and the camera can be reasonably arranged for charging and use, and the camera will not be unusable due to energy problems;
[0022] 2. The present invention also sets up an early warning subsystem. The humidity detection module, temperature detection module and smoke monitoring module will send the humidity, temperature and smoke signals collected inside the camera to the micro control unit for threshold judgment. Once the threshold setting is exceeded, the control signal will continue to be sent to the alarm module. In this way, the humidity, temperature and smoke abnormal signals inside the camera can be received instantly, thereby ensuring the internal safety of the camera.
[0023] 3. The present invention is provided with a fault inspection module to check the degree of wear of the nylon shell of the upper guide wheel of the camera, and determine whether the shaking and vibration of the camera during operation are caused by the wear of the upper guide wheel. At the same time, through the setting of the distance sensor 3 and the reference board in the correction module, if the distance information of the distance sensor 3 does not change immediately after the motor is driven to rotate, it means that the camera motor is slipping or the camera is stuck, which can assist the staff in determining the cause of the fault. In addition, the distance sensor is used to assist in detecting the change information of the distance of the address plate to determine the cause of the horizontal front address recognizer fault. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] Figure 1 It is the overall connection block diagram of the system of the present invention;
[0025] Figure 2 It is a module connection block diagram of the present invention;
[0026] Figure 3 It is a connection diagram of the fault detection module of the present invention;
[0027] In the figure: 1. Task management subsystem; 11. Task release module; 12. Task acquisition module; 13. Task completion determination module; 2. Equipment management and control subsystem; 21. Main controller; 22. Signal receiving module; 23. Single camera scheduling module; 24. Single camera operation module; 25. PLC control module; 241. Single camera online monitoring module; 242. Beidou positioning and navigation module; 243. Backup camera operation module; 244. Real-time power monitoring module; 210. Charging and discharging module; 3. Communication subsystem; 31. Wireless communication module; 32. Wired communication module; 4. Early warning subsystem; 41 , humidity detection module; 42, temperature detection module; 43, smoke monitoring module; 44, fault inspection module; 441, vehicle brake detection module; 442, detection distance sensor; 443, correction module; 444, vibration detection module; 4411, distance sensor 2; 4412, wireless communication module 2; 5, operation log management subsystem; 51, operation log generation module; 52, operation log storage module; 53, operation log viewing module; 6, vehicle management subsystem; 61, vehicle monitoring module; 62, vehicle update module; 7, warning module; 8, abnormal feedback module; 9, mobile terminal; 10, monitoring background. DETAILED DESCRIPTION
[0029] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0030] In the description of the present invention, it should be noted that the terms "upper", "lower", "inner", "outer", "top / bottom" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific position, be constructed and operated in a specific position, and therefore cannot be understood as limiting the present invention. In addition, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance.
[0031] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "provided with", "mounted / connected", "connected", etc. should be understood in a broad sense. For example, "connected" can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.
[0032] See also Figure 1-3 , the present invention provides a technical solution: a camera-based vehicle image recognition system and method, comprising: a task management subsystem 1, an equipment management and control subsystem 2, a communication subsystem 3, an early warning subsystem 4, an operation log management subsystem 5 and a vehicle management subsystem 6;
[0033] The task management subsystem 1 includes a task issuing module 11, a task acquiring module 12 and a task completion determining module 13. The task issuing module 11 is connected to an alarm module 7, and one end of the alarm module 7 is connected to the task completion determining module 13;
[0034] The device management and control subsystem 2 is connected to the task management subsystem 1, and the device management and control subsystem 2 includes a main controller 21, a signal receiving module 22, a single camera scheduling module 23, a single camera operation module 24, and a PLC control module 25; one end of the main controller 21 is connected to the task acquisition module 12, and the signal receiving module 22, the single camera scheduling module 23, the single camera operation module 24 and the PLC control module 25 are respectively connected to the main controller 21;
[0035] A single camera operation module 24 includes multiple single camera online monitoring modules 241, multiple Beidou positioning and navigation modules 242, multiple backup camera operation modules 243 and multiple real-time power monitoring modules 244. The output end of the real-time power monitoring module 244 is electrically connected to the charging and discharging module 210. The main controller 21 is connected to the early warning subsystem 4. The main controller 21 is connected to the operation log management subsystem 5. The operation log management subsystem 5 includes an operation log generation module 51, an operation log storage module 52 and an operation log viewing module 53. The main controller 21 is connected to the communication subsystem 3. The communication subsystem 3 includes multiple wireless communication modules 31 and wired communication modules 32. One end of the main controller 21 is connected to an abnormal feedback module 8. The abnormal feedback module 8 is respectively connected to the mobile terminal 9 and the monitoring background 10 through the wireless communication module 31 and the wired communication module 32. The main controller 21 is connected to the vehicle management subsystem 6. The vehicle management subsystem 6 includes a vehicle monitoring module 61 and a vehicle update module 62.
[0036] The early warning subsystem 4 includes a plurality of humidity detection modules 41, a plurality of temperature detection modules 42, a plurality of smoke monitoring modules 43, a plurality of fault detection modules 44 and a plurality of alarm modules;
[0037] The warning module 7 is provided with a red light and a green light. When the camera is in operation, the red light is on, and when the camera is idle, the green light is on. The humidity detection module 41 includes multiple humidity detection sensors, the temperature detection module 42 includes multiple temperature detection sensors, and the smoke monitoring module 43 includes multiple smoke detectors. The humidity detection module 41, the temperature detection module 42 and the smoke monitoring module 43 are respectively connected to the main controller 21.
[0038] The fault inspection module 44 includes a vehicle brake detection module 441 installed on the upper part of the camera, a detection distance sensor 442 installed on one side of the camera, a correction module 443 for detecting drive wheel slippage, and a vibration detection module 444. The guide wheel detection module, the detection distance sensor 442, the correction module 443 and the vibration detection module 444 are respectively connected to the main controller 21; the vehicle brake detection module 441 includes a plurality of distance sensors 4411 and a wireless communication module 4412. The distance sensor is installed on one side of the upper guide wheel for detecting the wear condition of the upper guide wheel housing. The distance sensor 4411 is connected to the wireless communication module 4412, and is connected to the main controller through the wireless communication module 4412; the correction module 443 includes a distance sensor 3 and a reference board matched with the distance sensor 3. The distance sensor 3 is installed on one side of the camera, and the reference board is installed on one side of the lane; the vibration detection module 444 includes a plurality of vibration sensors installed on the surface of the camera.
[0039] The signal sent by the task acquisition module 12 is sent to the main controller 21, and the signal reception module 22 determines the signal reception and executes the single camera scheduling module 23.
[0040] A single camera online monitoring module 241 and a Beidou positioning and navigation module 242 are also installed on the backup camera operation module 243. The Beidou positioning and navigation module 242 sends the camera's location and time information to the main controller 21 through the wireless communication module 31 installed on the camera. The main controller 21 processes and transmits the information to the PLC control module 25 so that the PLC control module 25 can control the operation of the camera.
[0041] During the execution of the single camera operation module 24 and / or the backup camera operation module 243, the single camera scheduling module 23 monitors the changes in power in real time through the real-time power monitoring module 244 and selectively allocates power to any one of the single camera operation module 24 and the backup camera operation module 243.
[0042] The charging and discharging module 210 is used to enable the charging brush head to output power to charge the camera after receiving a signal from the main controller 21 indicating that the camera has reached a predetermined position and has stopped moving.
[0043] The vehicle updating module 62 is used to update the camera data after the camera operation is completed.
[0044] Working principle: When the present invention is used, the task issuing module 11 and the task acquiring module 12 in the task management subsystem 1 send the camera working signal to the main controller 21, and then the signal receiving module 22 determines the signal reception and sends it to the single camera scheduling module 23. At this time, the single camera scheduling module 23 can selectively allocate the camera task to any one of the single camera operation module 24 and the backup camera operation module 243 according to the real-time power monitoring module 244 connected to the single camera operation module 24 and the backup camera operation module 243 to monitor the power changes in real time, and the remaining idle cameras are charged. The discharge module 210 performs charging operations to ensure that the camera is in a fully charged operating state. In addition, during the shooting process, the design of the early warning subsystem 4 and the vehicle monitoring module 61 can collect the air environment signals and live scenes inside the camera in real time. Once there is an abnormal change in the physical environment, it can be discovered and processed in time to effectively reduce the loss. There is also a design of the operation log management subsystem 5. The operation log generation module 51 can generate a log report in real time and store it through the operation log storage module 52, so that the management personnel can later view the real-time scheduling through the operation log viewing module 53 on the mobile terminal 9 or the monitoring background 10.
[0045] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.
[0046] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.
Claims
1. A vehicle image recognition system based on a camera, comprising a device management and control subsystem (2), a communication subsystem (3), an early warning subsystem (4), an operation log management subsystem (5) and a vehicle management subsystem (6), It is characterized in that Also includes: A task management subsystem (1), the task management subsystem (1) comprising a task issuing module (11), a task acquiring module (12) and a task completion determining module (13), the task issuing module (11) being connected to an alarm module (7), one end of the alarm module (7) being connected to the task completion determining module (13); The device management and control subsystem (2) is connected to the task management subsystem (1), and the device management and control subsystem (2) comprises a main controller (21), a signal receiving module (22), a single camera scheduling module (23), a single camera operation module (24), and a PLC control module (25); one end of the main controller (21) is connected to the task acquisition module (12), and the signal receiving module (22), the single camera scheduling module (23), the single camera operation module (24), and the PLC control module (25) are respectively connected to the main controller (21); The single camera operation module (24) comprises a plurality of single camera online monitoring modules (241), a plurality of Beidou positioning and navigation modules (242), a plurality of standby camera operation modules (243) and a plurality of real-time power monitoring modules (244); the output end of the real-time power monitoring module (244) is electrically connected to a charging and discharging module (210); the main controller (21) is connected to the early warning subsystem (4); the main controller (21) is connected to an operation log management subsystem (5); the operation log management subsystem (5) comprises an operation log generation module (51), an operation log storage module (52) and an operation log storage module (53); A log viewing module (53), the main controller (21) is connected to a communication subsystem (3), the communication subsystem (3) includes a plurality of wireless communication modules (31) and a wired communication module (32), one end of the main controller (21) is connected to an abnormality feedback module (8), the abnormality feedback module (8) is respectively connected to a mobile terminal (9) and a monitoring background (10) via the wireless communication module (31) and the wired communication module (32), the main controller (21) is connected to a vehicle management subsystem (6), the vehicle management subsystem (6) includes a vehicle monitoring module (61) and a vehicle update module (62); The early warning subsystem (4) comprises a plurality of humidity detection modules (41), a plurality of temperature detection modules (42), a plurality of smoke monitoring modules (43), a plurality of fault detection modules (44) and a plurality of alarm modules.
2. A vehicle image recognition system and method based on a camera according to claim 1, Features: The warning module (7) is provided with a red light and a green light. When the camera is in operation, the red light is on, and when the camera is idle, the green light is on. The humidity detection module (41) includes a plurality of humidity detection sensors, the temperature detection module (42) includes a plurality of temperature detection sensors, and the smoke monitoring module (43) includes a plurality of smoke detectors; the humidity detection module (41), the temperature detection module (42) and the smoke monitoring module (43) are respectively connected to a main controller (21).
3. A vehicle image recognition system based on a camera according to claim 1, Features: The fault detection module (44) comprises a vehicle brake detection module (441) installed on the upper part of the camera, a detection distance sensor (442) installed on one side of the camera, a correction module (443) for detecting drive wheel slippage, and a vibration detection module (444), wherein the guide wheel detection module, the detection distance sensor (442), the correction module (443), and the vibration detection module (444) are respectively connected to the main controller (21); The vehicle brake detection module (441) includes a plurality of distance sensors (4411) and a wireless communication module (4412), wherein the distance sensor is arranged on one side of the upper guide wheel for detecting the wear condition of the upper guide wheel housing, and the distance sensor (4411) is connected to the wireless communication module (4412) and connected to the main controller through the wireless communication module (4412); The correction module (443) comprises a distance sensor 3 and a reference board matched with the distance sensor 3, wherein the distance sensor 3 is arranged on one side of the camera, and the reference board is arranged on one side of the lane; The vibration detection module (444) comprises a plurality of vibration sensors arranged on the surface of the camera.
4. A vehicle image recognition system based on a camera according to claim 1, Features: The signal sent by the task acquisition module (12) is sent to the main controller (21), and the signal reception is confirmed by the signal receiving module (22) and a single camera scheduling module (23) is executed.
5. A vehicle image recognition system based on a camera according to claim 1, Features: The standby camera operation module (243) is also provided with a single camera online monitoring module (241) and a Beidou positioning and navigation module (242). The Beidou positioning and navigation module (242) sends the camera's position and time information to the main controller (21) via a wireless communication module (31) installed on the camera. The main controller (21) processes the information and transmits it to the PLC control module (25), so that the PLC control module (25) controls the operation of the camera.
6. A vehicle image recognition system based on a camera according to claim 1, Features: The single camera scheduling module (23) selectively allocates power to any one of the single camera operation module (24) and the backup camera operation module (243) by monitoring the change of power in real time through the real-time power monitoring module (244) during the execution of the single camera operation module (24) and / or the backup camera operation module (243).
7. The camera-based vehicle image recognition system according to claim 1, Features: The charging and discharging module (210) is used to enable the charging brush head to output power to charge the camera after receiving a signal from the main controller (21) indicating that the camera has reached a predetermined position and has stopped moving.
8. The camera-based vehicle image recognition system according to claim 1, Features: The vehicle updating module (62) is used to update the camera data after the camera operation is completed.
9. The vehicle image recognition method based on a camera according to claim 5, It is characterized in that Using a camera-based vehicle image recognition system, the specific steps are as follows: Step 1: sending a camera operation signal to a main controller (21) through a task issuing module (11) and a task acquiring module 12 in a task management subsystem (1); Step 2: Then, the signal receiving module (22) determines that the signal is received and sends it to the single camera scheduling module (23). At this time, the single camera scheduling module (23) can selectively allocate the camera execution task to any one of the single camera operation module (24) and the standby camera operation module (243) according to the real-time power monitoring module (244) connected to the single camera operation module (24) and the standby camera operation module (243) to monitor the change of power in real time, while the remaining idle cameras are charged through the charging and discharging module (210), thereby ensuring that the cameras are in a fully charged operation state; Step 3: During the video recording process, the design of the early warning subsystem (4) is combined with the vehicle monitoring module (61), so that any abnormal changes can be discovered and handled immediately.
Citation Information
Patent Citations
Multi-motion-object video monitoring system and tracking monitoring method thereof
CN105844634A
Low-power-consumption camera, monitoring management control system and control method thereof
CN111050114A
Vehicle management system with alarming and remote monitoring functions
CN113205616A
Electric quantity monitoring method and device of wearable equipment, equipment and storage medium
CN115103430A
Monocase real time panorama seamless no distortion video camera
CN201118859Y
