A vehicle-mounted audio and video security monitoring method

Abstract

The present invention discloses a vehicle-mounted audio and video safety monitoring method, which relates to the technical field of audio and video safety monitoring, and comprises the following steps: substituting the collected video frame average contrast value and video frame average brightness value into a video quality evaluation monitoring unit to calculate a video quality evaluation value; substituting the video quality evaluation value into an audio and video comprehensive evaluation monitoring unit to calculate a comprehensive evaluation score value. The present invention has the ability to evaluate and monitor the collected audio and video in real time, and can focus on monitoring the quality of the audio and video, so as to adjust the parameters of the camera and microphone according to the actual situation to achieve the purpose of optimization, ensure that the situation in the vehicle can be effectively monitored in real time, and can also take into account a variety of influencing factors so that the audio and video can be completely and effectively monitored, ensuring the normal and effective output of the audio and video, and has excellent intelligence and practical effects.

Description

Technical Field

[0001] The present invention relates to the technical field of audio and video safety monitoring, and in particular to a vehicle-mounted audio and video safety monitoring method. Background Art

[0002] The management of transportation is an important issue. For example, the monitoring of taxi companies and the management and monitoring of buses require security monitoring of the situation inside the car. The existing security monitoring method is to install cameras and microphones in the car to collect audio and video of the moving vehicle, and upload the audio and video to the control center for security monitoring of the audio and video. The purpose of improving security is to monitor the audio and video.

[0003] However, most of the existing audio and video monitoring methods currently collect and upload audio and video directly, and lack a form of security monitoring of the audio and video itself. In actual use, due to the uncertainty of the camera, transmission network and equipment, the collected audio and video may fluctuate and become blurred, resulting in the inability to guarantee the purpose of real-time security monitoring, resulting in poor practicality. Summary of the invention

[0004] The purpose of the present invention is to provide a vehicle-mounted audio and video security monitoring method, which solves the problems raised in the above-mentioned background technology.

[0005] To achieve the above object, the present invention provides the following technical solution: a vehicle-mounted audio and video security monitoring method, comprising the following steps:

[0006] Audio and video acquisition: Install cameras in the driving area and passenger area of ​​the vehicle to be monitored, and configure the camera's resolution, brightness and contrast parameters. Then transmit the audio and video collected by the camera to the monitoring host through electrical communication technology;

[0007] Preprocessing: preprocess the audio and video data transmitted to the monitoring host, including data decoding and format conversion;

[0008] Security monitoring: specifically including:

[0009] First, the collected video frame average contrast value and video frame average brightness value are substituted into the video quality assessment monitoring unit to calculate the video quality assessment value;

[0010] Next, the video quality assessment value is substituted into the audio and video comprehensive assessment monitoring unit to calculate the comprehensive assessment score value;

[0011] Afterwards, the video quality evaluation value and the comprehensive evaluation score are substituted into the security monitoring effectiveness index unit to calculate the monitoring effectiveness index;

[0012] And, the monitoring performance index is further calculated to calculate a new Va value, and the Va value replaces the original Va value in the video quality assessment monitoring unit to adjust the weight of the average brightness value of the video frame, so as to affect the calculation values ​​of the video quality assessment monitoring unit and the audio and video comprehensive assessment monitoring unit, so as to iterate the vehicle audio and video safety monitoring method;

[0013] Result output: The calculation results of the safety monitoring steps are output in the form of numerical values ​​and provided to management personnel for observation so that management personnel can make timely scheduling and control;

[0014] Optimization and adjustment: Based on monitoring results and passenger feedback, the monitoring system methods are continuously optimized and adjusted to improve monitoring effects and service quality;

[0015] Subsequent processing: Store the monitoring data and regularly back up and clean up expired data, then regularly maintain and upgrade the vehicle-mounted audio and video monitoring system and check the working status of the hardware equipment.

[0016] Optionally, a security monitoring module, a video acquisition module, a video transmission module, a processing module and a storage processing module are used;

[0017] The safety monitoring module is used to monitor the driving area and passenger area of ​​the monitored vehicle in real time during driving, and transmit the monitored audio and video data through the video acquisition module through the video transmission module. The video transmission module uses wireless transmission based on electrical communication technology to transmit the audio and video data to the monitoring body in the processing module. The processing module preferentially decodes and formats the audio and video data, and calculates the video quality evaluation value, comprehensive evaluation score value and monitoring efficiency index of the audio and video data to achieve real-time safety monitoring of the target vehicle, and can provide feedback on the monitoring situation so that the management personnel can make timely adjustments and optimizations according to the monitoring audio and video situation, and can further calculate the monitoring efficiency index and re-substitute it into the video quality evaluation value calculation process to continuously optimize the overall algorithm unit system, and store the calculated video quality evaluation value, comprehensive evaluation score value and monitoring efficiency index through the storage processing module;

[0018] The processing module includes: a video quality evaluation monitoring unit, an audio and video comprehensive evaluation monitoring unit and a security monitoring efficiency index unit.

[0019] Optionally, the video quality assessment monitoring unit is as follows:

[0020] ;

[0021] ;

[0022] in: is the video quality assessment value;

[0023] is the important value of the average brightness of the video frame;

[0024] is an adjustable brightness value weight parameter;

[0025] is the average brightness value of the video frame;

[0026] is the average contrast value of the video frame;

[0027] is the definition value of the video frame;

[0028] and are the weight values ​​of contrast and clarity respectively;

[0029] Setting: Normal brightness range [100, 200], normal contrast range [15, 30], normal resolution The range is [20, 50];

[0030] when When , the camera exposure time is increased. When , reduce the exposure time;

[0031] when or When changing the contrast value in the camera, In Inside;

[0032] when or When adjusting the camera focus, In Inside.

[0033] Optionally, the audio and video comprehensive evaluation monitoring unit is as follows:

[0034] ;

[0035] ;

[0036] in: is the comprehensive evaluation score;

[0037] is the audio quality evaluation value;

[0038] is the noise level value;

[0039] is the audio clarity value;

[0040] A1 and A2 are the weight coefficients of noise and clarity in the audio quality evaluation value respectively;

[0041] is the noise level value. Since the noise level is as low as possible, express;

[0042] To obtain the maximum value of the function, after comparing the video quality evaluation value and the audio quality evaluation value in the audio and video comprehensive evaluation monitoring unit, the higher one of the two is selected as the comprehensive evaluation score value.

[0043] Optionally, the safety monitoring effectiveness index unit is as follows:

[0044] ;

[0045] in: It is the monitoring effectiveness index;

[0046] and They are the video quality assessment value and the comprehensive assessment score respectively;

[0047] and They are and The weight index is used to balance and The weight of .

[0048] Optionally, the safety monitoring effectiveness index unit is further as follows:

[0049] first, ;

[0050] Next, use the calculated The value is substituted into the video quality assessment monitoring unit to participate in the calculation , to the initial The value is optimized, and the operation values ​​of the video quality evaluation monitoring unit, the audio and video comprehensive evaluation monitoring unit and the security monitoring efficiency index unit are iterated and optimized, and an iterative convergence condition is set;

[0051] The convergence conditions are:

[0052] Condition 1: stop when the number of iterations reaches eight;

[0053] Condition two, , referring to After iterations With After iterations Difference;

[0054] Note: When any of the above two conditions is met, the iteration terminates and reaches the convergence condition. In a stable state;

[0055] in: is the adjustable brightness value weight parameter after adjustment, which is used to substitute into the video quality assessment monitoring algorithm ;

[0056] is the adjustable brightness value weight parameter before adjustment, and at the initial ;

[0057] is in this formula The adjustment factor of

[0058] yes Threshold used to determine whether weights need to be adjusted.

[0059] Optionally, the processing module includes: a monitoring center unit and a display unit, wherein the monitoring center unit is used to remotely command and dispatch the target vehicle and perform two-way interactive audio and video command of the vehicle, and the display unit is used to display the vehicle's monitoring screen in real time on a display screen.

[0060] Optionally, the security monitoring module includes a high-definition camera and an audio acquisition device, wherein the high-definition camera is used to capture real-time images of the vehicle during driving, and the audio acquisition device is used to monitor and collect audio information inside the vehicle.

[0061] Compared with the prior art, the present invention has the following beneficial effects:

[0062] 1. The present invention can monitor the quality of video data in real time through a video quality assessment monitoring unit, and automatically adjust the parameters of devices such as cameras and microphones, thereby achieving the purpose of optimizing video quality, achieving the purpose of efficiently monitoring video quality, and ensuring the integrity of video data. Through real-time monitoring and optimization, it can ensure that the monitoring effect of audio and video is always maintained in the best state.

[0063] 2. The present invention uses an audio and video comprehensive evaluation and monitoring unit, which not only involves video quality but also incorporates multiple factors in audio quality for comprehensive evaluation and monitoring. The audio and video are split into audio and video, which is convenient for more accurate and corresponding analysis of specific audio and video problems. Comprehensive evaluation and monitoring can more accurately reflect the performance of the monitoring system and help managers quickly locate potential problems.

[0064] 3. The present invention calculates a monitoring efficiency index based on the video quality evaluation value and the comprehensive evaluation score through a security monitoring efficiency index unit. The monitoring efficiency index not only achieves the purpose of monitoring and evaluating audio and video in an all-round way, but also intuitively gives a numerical representation for users to observe conveniently. At the same time, the monitoring efficiency index can be further calculated and substituted into the calculation process of the video quality evaluation monitoring unit, thereby enabling the various algorithm units of the present invention to be continuously optimized and iterated, making the monitoring of audio and video more accurate and effective, and ensuring real-time monitoring of audio and video. The three algorithm units in the present invention have excellent correlation and loop optimization characteristics in the calculation process and effect, so that they can automatically optimize and improve according to actual changes, which is intelligent and practical. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] Figure 1 A method flow chart of a vehicle-mounted audio and video security monitoring method;

[0066] Figure 2 The figure is a schematic diagram of the overall structure of the vehicle-mounted audio and video security monitoring method. DETAILED DESCRIPTION

[0067] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0068] Regarding the vehicle-mounted audio and video safety monitoring method, it is different from the existing vehicle-mounted audio and video monitoring method. The existing vehicle-mounted audio and video monitoring method may have the problem of insufficient video quality assessment. The existing monitoring methods often lack real-time evaluation and optimization of video quality. Due to the differences in actual cameras and transmission networks, the audio and video acquisition may fluctuate, resulting in poor monitoring effects. In addition, the existing monitoring methods mostly focus on the evaluation and detection of video quality, but in actual use, there are also comprehensive evaluations of multiple factors such as audio quality, equipment status, and network conditions. A single audio and video evaluation monitoring method cannot fully reflect the performance of the monitoring system. The vehicle-mounted audio and video safety monitoring method can not only perform a split integrated evaluation of audio and video, but also integrate audio and video for comprehensive analysis to perform real-time monitoring and timely discover audio and video defects, and can also focus on multiple factors for comprehensive monitoring and evaluation, thereby improving intelligence and accuracy.

[0069] For example, see Figure 1 to Figure 2 This embodiment provides a vehicle-mounted audio and video security monitoring method, comprising the following steps:

[0070] Audio and video acquisition: Install cameras in the driving area and passenger area of ​​the vehicle to be monitored, and configure the camera's resolution, brightness and contrast parameters. Then transmit the audio and video collected by the camera to the monitoring host through electrical communication technology;

[0071] Preprocessing: preprocess the audio and video data transmitted to the monitoring host, including data decoding and format conversion;

[0072] Security monitoring: specifically including:

[0073] First, the collected video frame average contrast value and video frame average brightness value are substituted into the video quality assessment monitoring unit to calculate the video quality assessment value;

[0074] Next, the video quality assessment value is substituted into the audio and video comprehensive assessment monitoring unit to calculate the comprehensive assessment score value;

[0075] Afterwards, the video quality evaluation value and the comprehensive evaluation score are substituted into the security monitoring effectiveness index unit to calculate the monitoring effectiveness index;

[0076] And, the monitoring performance index is further calculated to calculate a new Va value, and the Va value replaces the original Va value in the video quality assessment monitoring unit to adjust the weight of the average brightness value of the video frame, so as to affect the calculation values ​​of the video quality assessment monitoring unit and the audio and video comprehensive assessment monitoring unit, so as to iterate the vehicle audio and video safety monitoring method;

[0077] Result output: The calculation results of the safety monitoring steps are output in the form of numerical values ​​and made available to management personnel for observation so that they can make timely dispatch and control;

[0078] Optimization and adjustment: Based on monitoring results and passenger feedback, the monitoring system methods are continuously optimized and adjusted to improve monitoring effects and service quality;

[0079] Subsequent processing: Store the monitoring data and regularly back up and clean up expired data, then regularly maintain and upgrade the vehicle-mounted audio and video monitoring system and check the working status of the hardware equipment.

[0080] The vehicle-mounted audio and video security monitoring method adopts a security monitoring module, a video acquisition module, a video transmission module, a processing module and a storage processing module;

[0081] The safety monitoring module is used to monitor the driving area and passenger area of ​​the monitored vehicle in real time during driving, and transmit the monitored audio and video data through the video acquisition module through the video transmission module. The video transmission module uses wireless transmission based on electrical communication technology to transmit the audio and video data to the monitoring body in the processing module. The processing module preferentially decodes and formats the audio and video data, and calculates the video quality evaluation value, comprehensive evaluation score value and monitoring efficiency index of the audio and video data to achieve real-time safety monitoring of the target vehicle, and can provide feedback on the monitoring situation so that the management personnel can make timely adjustments and optimizations according to the monitoring audio and video situation, and can further calculate the monitoring efficiency index and re-substitute it into the video quality evaluation value calculation process to continuously optimize the overall algorithm unit system, and store the calculated video quality evaluation value, comprehensive evaluation score value and monitoring efficiency index through the storage processing module;

[0082] The processing module includes: a video quality assessment monitoring unit, an audio and video comprehensive assessment monitoring unit and a security monitoring efficiency index unit.

[0083] In this embodiment, the vehicle-mounted audio and video security monitoring method not only improves the accuracy and comprehensiveness of video quality evaluation through the cooperation of the three algorithm units in the processing module, but also realizes the dynamic optimization of weights, making the vehicle-mounted audio and video monitoring more intelligent and flexible, and can realize comprehensive real-time intelligent monitoring of the vehicle's audio and video conditions. At the same time, the efficiency and accuracy of monitoring can be improved by cooperating with electronic communication technology and image processing technology. The video quality evaluation monitoring unit can combine the audio and video brightness and contrast for comprehensive calculations. The calculated video quality evaluation value can be used by the administrator to promptly discover the quality problems of the vehicle-mounted audio and video, which has an excellent monitoring effect and ensures the accuracy and effectiveness of the audio and video. The audio and video comprehensive evaluation monitoring unit not only combines the video quality evaluation value but also substitutes the comprehensive audio quality value for calculation, making the calculation of the comprehensive evaluation score value more accurate. It is comprehensive and effective, which helps the administrator to adjust the audio and video collection in time according to the actual situation, and can timely discover the audio and video collection status to avoid the situation that the audio and video collection is not in place. Finally, the security monitoring efficiency index unit can combine the first two algorithm units to calculate the monitoring efficiency index, so that the audio and video data can be more fully evaluated, and the value can be further calculated and re-substituted into the video quality evaluation value for calculation. Through this cyclic iteration form, the three algorithm units of the present invention have a strong correlation, so that the calculation value of the algorithm unit itself is constantly improved and optimized, which has the effect of dynamic optimization and change. After the three algorithms are combined together, the vehicle-mounted audio and video safety monitoring method can realize real-time evaluation and optimization of video quality, comprehensive comprehensive evaluation, and intelligent adjustment and optimization.

[0084] See also Figure 1 and Figure 2 ,The video quality assessment monitoring unit is as follows:

[0085] ;

[0086] ;

[0087] in: is the video quality assessment value;

[0088] is the important value of the average brightness of the video frame;

[0089] is an adjustable brightness value weight parameter;

[0090] is the average brightness value of the video frame;

[0091] is the average contrast value of the video frame;

[0092] is the definition value of the video frame;

[0093] and are the weight values ​​of contrast and clarity respectively;

[0094] Setting: Normal brightness range [100, 200], normal contrast range [15, 30], normal resolution The range is [20, 50];

[0095] when When , the camera exposure time is increased. When , reduce the exposure time;

[0096] when or When changing the contrast value in the camera, In Inside;

[0097] when or When adjusting the camera focus, In Inside.

[0098] In this embodiment, the video frame quality evaluation value can be specifically linked to the automatic adjustment of camera parameters, the video quality evaluation can be decomposed into clarity, brightness and contrast, and a set threshold is given to automatically modify the corresponding camera parameters. For different video quality evaluation indicators, a mapping relationship between camera parameters such as focal length, aperture, exposure time, etc. is established, and after adjusting the camera parameters, the video quality evaluation value is immediately re-performed to verify the adjustment effect. If the adjustment effect is not good, the parameters can be adjusted again according to the new evaluation results until the video quality reaches a satisfactory level. Through multiple optimization adjustments, the accuracy and effectiveness of the video quality evaluation monitoring unit can be gradually improved, and the above is based on , and Combined with To comprehensively judge which camera parameters need to be adjusted, as well as the direction and magnitude of adjustment, and adjust the weights according to the actual situation and To achieve the purpose of adjusting camera parameters;

[0099] Existing video quality assessment monitoring often only focuses on the clarity or frame rate of video quality, lacking a comprehensive assessment of video quality. This single video quality assessment method is difficult to accurately reflect the actual performance of vehicle-mounted audio and video. This method combines the two key factors of brightness and contrast and introduces Dynamic adjustments can more accurately assess the quality of vehicle audio and video, thereby improving the accuracy and flexibility of audio and video monitoring assessment;

[0100] In the vehicle-mounted audio and video security monitoring system, the video quality directly affects the effectiveness and reliability of monitoring, and higher-quality audio and video can provide clearer and more accurate images and audio information, which helps to discover and solve problems in a timely manner. Therefore, the evaluation of audio and video quality in this method is an important step to ensure the normal operation of the vehicle-mounted audio and video security monitoring system;

[0101] Brightness is one of the key factors of video quality. Ensuring brightness can ensure the clarity and visibility of video images. In vehicle-mounted audio and video monitoring, if the brightness is too low, the image may be blurred and difficult to recognize; if the brightness is too high, overexposure may occur, which also affects the clarity of the image. Therefore, by evaluating the brightness, it can be determined whether the video meets the basic clarity requirements. Contrast is also a key factor in video quality. High contrast can make different elements in the audio and video image more distinct, which is conducive to identification and distinction. Therefore, this algorithm unit can combine contrast and brightness for comprehensive evaluation to avoid incomplete and incomplete monitoring of vehicle-mounted audio and video. When there is a problem with the audio and video quality, the overall system method can detect and alarm in time to prompt the administrator to check and repair, which can avoid monitoring failure or false alarm caused by video quality problems. According to the results of the audio and video quality evaluation, the system can automatically adjust the monitoring strategy, such as increasing the number of cameras and adjusting the camera angle.

[0102] See also Figure 1 and Figure 2 , the audio and video comprehensive evaluation monitoring unit is as follows:

[0103] ;

[0104] ;

[0105] in: is the comprehensive evaluation score;

[0106] is the audio quality evaluation value;

[0107] is the noise level value;

[0108] is the audio clarity value;

[0109] A1 and A2 are the weight coefficients of noise and clarity in the audio quality evaluation value respectively;

[0110] is the noise level value. Since the noise level is as low as possible, express;

[0111] To obtain the maximum value of the function, after comparing the video quality evaluation value and the audio quality evaluation value in the audio and video comprehensive evaluation monitoring unit, the higher one of the two is selected as the comprehensive evaluation score value.

[0112] In this embodiment, by calculating the video evaluation score and the audio evaluation score separately and taking them as two independent parts of the comprehensive evaluation score, the audio and video quality is evaluated separately, so that the management personnel can more easily locate whether the problem lies in the video or the audio, and an abnormality detection mechanism can be added in the process of calculating the score of each evaluation indicator. and When the score is lower than the preset threshold, the abnormal information of the indicator can be recorded and reported, that is, the location of specific devices such as image sensors in the video and microphones in the audio can be located, so as to help managers quickly locate them;

[0113] Existing vehicle audio and video security monitoring methods may only consider the video quality, while ignoring the factors that may affect the monitoring effect. As a result, this incomplete audio and video monitoring evaluation method is difficult to accurately reflect the overall performance of the vehicle audio and video. In this formula, the audio and video can be monitored and evaluated in a comprehensive, split and comprehensive manner, and the operation based on the video quality evaluation monitoring unit provides data support for the audio and video comprehensive evaluation monitoring unit in terms of video quality, making the comprehensive evaluation result more accurate.

[0114] In this formula, based on the detection and evaluation of the quality of audio and video monitoring data, a comprehensive audio quality value is calculated. The calculation of the comprehensive audio quality value includes the splitting calculation of audio and video, and can fully consider the influence of audio and video noise during vehicle driving, so as to achieve a more comprehensive evaluation of vehicle-mounted audio and video, and provide more powerful support for subsequent monitoring and management;

[0115] In this formula, the calculation results of the video quality assessment monitoring unit and the numerical values ​​involved in its calculation are used to ensure the important position of video quality in this formula, and video quality plays an important basic role in the evaluation of the overall audio and video security monitoring data.

[0116] See also Figure 1 and Figure 2 , the audio and video comprehensive evaluation monitoring unit is as follows:

[0117] ;

[0118] in: It is the monitoring effectiveness index;

[0119] and They are the video quality assessment value and the comprehensive assessment score respectively;

[0120] and They are and The weight index is used to balance and The weight of .

[0121] In this embodiment, this method is an integration of the video quality assessment monitoring unit and the audio and video comprehensive assessment monitoring unit, so that this method can fully reflect the data information of various audio and video during the driving process of the target vehicle, and ensure the correctness and integrity of the audio and video output. To monitor the performance index, the performance index can refer to the following forms:

[0122] First, it can represent the monitoring quality index, which measures the comprehensive quality of audio and video monitoring in terms of real-time, clarity, and stability, thus providing a quantitative monitoring quality assessment method;

[0123] Secondly, in the process of audio and video security monitoring, the overall system method needs a certain degree of adaptive adjustment ability to cope with the impact of environmental changes or monitoring equipment problems. It is an important indicator of the system's adaptive adjustment capability, and can guide the system to perform operations such as weight adjustment and parameter optimization;

[0124] And, when When the value is low, it means that the monitoring system is at risk of failure and performance degradation. At this time, the system can send out an early warning signal to prompt the management personnel to conduct troubleshooting and maintenance.

[0125] See also Figure 1 and Figure 2 , the audio and video comprehensive evaluation monitoring unit is further as follows:

[0126] first, ;

[0127] Next, use the calculated The value is substituted into the video quality assessment monitoring unit to participate in the calculation , to the initial The value is optimized, and the operation values ​​of the video quality evaluation monitoring unit, the audio and video comprehensive evaluation monitoring unit and the security monitoring efficiency index unit are iterated and optimized, and an iterative convergence condition is set;

[0128] The convergence conditions are:

[0129] Condition 1: stop when the number of iterations reaches eight;

[0130] Condition two, , referring to After iterations With After iterations Difference;

[0131] Note: When any of the above two conditions is met, the iteration terminates and reaches the convergence condition. The stability is higher and the volatility is lower;

[0132] in: is the adjustable brightness value weight parameter after adjustment, which is used to substitute into the video quality assessment monitoring algorithm ;

[0133] is the adjustable brightness value weight parameter before adjustment, and at the initial ;

[0134] is in this formula The adjustment factor of

[0135] yes Threshold used to determine whether weights need to be adjusted.

[0136] In this embodiment, the audio and video comprehensive evaluation monitoring unit achieves the effect of convergence termination when any one of the conditions is met through this iterative form. After multiple iterations, it remains relatively stable and no longer changes significantly, which means that the algorithm has converged to a stable state. The unstable changes may be caused by the overfitting of the model to the training data. This indicates that the model has found a solution with good generalization ability, thus reducing the risk of overfitting;

[0137] This audio and video comprehensive evaluation monitoring unit can not only calculate the monitoring efficiency index, but also calculate the monitoring efficiency index. Then, the calculation value of the video quality assessment monitoring unit is continuously affected by iterative optimization, so as to achieve the purpose of continuous circulation and optimization. Most of the existing vehicle-mounted audio and video security monitoring methods do not have the form of dynamic adjustment of the overall monitoring system method, and thus require management personnel to perform manual operations based on experience and data changes, but this operation lacks flexibility and intelligence, and the operation is more troublesome and difficult to meet the changes in actual monitoring needs. In this formula, the adjustable brightness value weight parameter after calculation adjustment realizes dynamic optimization of the weight. This method can easily adapt to different monitoring needs and environmental changes. Compared with the existing technology, this dynamic optimization method is more intelligent and flexible;

[0138] In the vehicle-mounted audio and video security monitoring system method, the monitoring environment and requirements may change over time. For example, higher brightness may be required at night, while higher contrast may be required during the day. Therefore, in this method, a mechanism of dynamically adjusting weights is used to adapt to these changes. Through this form of dynamic optimization, the system of the present invention can automatically adapt to changes in the monitoring environment and requirements, improve the flexibility and adaptability of monitoring, and the overall system can optimize the relative importance of video quality and comprehensive evaluation, thereby improving the accuracy and reliability of monitoring. The automated optimization and iterative form of optimization reduce dependence on human operation, thereby reducing the frequency and cost of human intervention, and improving the automation level and efficiency of the system.

[0139] In the specific implementation process, the three algorithm units in the method are used to form a system system of the vehicle-mounted audio and video security monitoring method, which not only improves the accuracy and comprehensiveness of the video quality evaluation but also realizes the dynamic optimization of the weight. The video quality evaluation monitoring unit combines the audio and video brightness and contrast for comprehensive calculations. The calculated video quality evaluation value can be used by the administrator to promptly discover the quality problems of the vehicle-mounted audio and video, which has an excellent monitoring effect and ensures the accuracy and effectiveness of the audio and video. The audio and video comprehensive evaluation monitoring unit calculates the comprehensive evaluation score value based on the video quality evaluation value, and can also substitute a variety of influencing factors for correlation, so that the calculation of the comprehensive evaluation score value is more comprehensive and effective, which helps the administrator to adjust the audio and video acquisition in time according to the actual situation. Finally, the security monitoring efficiency index unit can calculate the monitoring efficiency index by combining the first two algorithm units, so that the audio and video data can be more fully evaluated, and the value can be further calculated and re-substituted into the video quality evaluation value for calculation. Through this cyclic iteration form, the three algorithm units of the present invention have a strong correlation, so that the calculation value of the algorithm unit itself is continuously improved and optimized, which has the effect of dynamic optimization and change.

[0140] Embodiment 2, based on the above embodiment;

[0141] See also Figure 1and Figure 2 The processing module includes: a monitoring center unit and a display unit. The monitoring center unit is used to remotely command and dispatch the target vehicle and perform two-way interactive audio and video command on the vehicle. The display unit is used to display the vehicle's monitoring screen in real time on the display screen.

[0142] In this embodiment, the monitoring center is used to collect the acquired audio and video information data and can observe the status of the audio and video in real time, and can promptly perform scheduling and vehicle control according to the actual situation with excellent timeliness, and the display unit can display various information of the target vehicle, which is convenient for users to observe and monitor.

[0143] See also Figure 1 and Figure 2 :The safety monitoring module includes a high-definition camera and an audio acquisition device. The high-definition camera is used to capture real-time images of the vehicle while it is driving, and the audio acquisition device is used to monitor and collect audio information inside the vehicle.

[0144] In this embodiment, the security monitoring module is used to perform two-way monitoring and feedback of the video and audio of the target vehicle, the high-definition camera is used to take real-time photos of the situation inside and outside the vehicle and upload the data, and the audio acquisition device is used to collect and upload the audio information in the vehicle. Through the two-way acquisition and monitoring of audio and video, comprehensive, real-time and intelligent monitoring of the situation inside and outside the vehicle can be achieved.

[0145] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A vehicle-mounted audio and video security monitoring method, characterized in that: The following steps are involved: Audio and video acquisition: Install cameras in the driving area and passenger area of ​​the vehicle to be monitored, and configure the camera's resolution, brightness and contrast parameters. Then transmit the audio and video collected by the camera to the monitoring host through electrical communication technology; Preprocessing: Preprocess the audio and video data transmitted to the monitoring host, including data decoding and format conversion; Security monitoring: specifically including: Firstly, the collected video frame average contrast value and video frame average brightness value are input into the video quality assessment monitoring unit to obtain the video quality assessment value; Next, the video quality assessment value is input into the audio and video comprehensive assessment monitoring unit to obtain a comprehensive assessment score value; Afterwards, the video quality evaluation value and the comprehensive evaluation score value are inputted into the safety monitoring effectiveness index unit together to obtain the monitoring effectiveness index and the new adjustable brightness value weight parameter value. The new adjustable brightness value weight parameter value replaces the original adjustable brightness value weight parameter value in the video quality evaluation monitoring unit to adjust the weight degree of the average brightness value of the video frame, so as to affect the calculation values ​​of the video quality evaluation monitoring unit and the audio and video comprehensive evaluation monitoring unit, so as to iterate the vehicle-mounted audio and video safety monitoring process; Result output: outputting the calculation results of the safety monitoring steps in the form of numerical values ​​for observation by management personnel; Optimization and adjustment: Continuously optimize and adjust the monitoring system methods based on monitoring results and passenger feedback; Subsequent processing: store the monitoring data and regularly back up and clean up expired data, then regularly maintain and upgrade the vehicle audio and video monitoring system, and check the working status of the hardware equipment; The security monitoring method is implemented by using a security monitoring module, a video acquisition module, a video transmission module, a processing module and a storage processing module; The safety monitoring module is used to monitor the driving area and passenger area of ​​the monitored vehicle in real time during driving, and transmit the monitored audio and video data through the video acquisition module through the video transmission module. The video transmission module transmits the audio and video data to the monitoring body in the processing module in the form of wireless transmission based on electrical communication technology. The processing module preferentially decodes and formats the audio and video data, and calculates the video quality evaluation value, comprehensive evaluation score value and monitoring efficiency index of the audio and video data, so as to achieve real-time safety monitoring of the target vehicle, and can provide feedback on the monitoring situation, so that the management personnel can make timely adjustments and optimizations according to the monitoring audio and video situation, and can further calculate the monitoring efficiency index and re-substitute it into the process of video quality evaluation value calculation to continuously optimize the overall algorithm unit system, and store the calculated video quality evaluation value, comprehensive evaluation score value and monitoring efficiency index through the storage processing module; The processing module includes: a video quality assessment monitoring unit, an audio and video comprehensive assessment monitoring unit and a security monitoring effectiveness index unit; The video quality assessment monitoring unit is as follows: ； ； in: is the video quality assessment value; is the important value of the average brightness of the video frame; is an adjustable brightness value weight parameter; is the average brightness value of the video frame; is the average contrast value of the video frame; is the definition value of the video frame; and are the weight values ​​of contrast and clarity respectively; Setting: Normal brightness range [100, 200], normal contrast range [15, 30], normal resolution The range is [20, 50]; when When , the camera exposure time is increased. When , reduce the exposure time; when or When changing the contrast value set in the camera, In Inside; when or When adjusting the camera focus, In Inside.

2. The vehicle-mounted audio and video security monitoring method according to claim 1 is characterized in that: The audio and video comprehensive evaluation monitoring unit is as follows: ； ； in: is the comprehensive evaluation score; is the audio quality evaluation value; is the noise level value; is the audio clarity value; A1 and A2 are the weight coefficients of noise and clarity in the audio quality evaluation value respectively; is the noise level value. Since the noise level is as low as possible, express; To obtain the maximum value of the function, after comparing the video quality evaluation value and the audio quality evaluation value in the audio and video comprehensive evaluation monitoring unit, the higher one of the two is selected as the comprehensive evaluation score value.

3. The vehicle-mounted audio and video security monitoring method according to claim 2 is characterized in that: The safety monitoring effectiveness index unit is as follows: ； in: To monitor the effectiveness index; and They are the video quality assessment value and the comprehensive assessment score respectively; and They are and The weight index is used to balance and The weight of first, ; Next, use The value is input to the video quality assessment monitoring unit to participate in the calculation , to the initial The value is optimized, and the operation values ​​of the video quality evaluation monitoring unit, the audio and video comprehensive evaluation monitoring unit and the security monitoring efficiency index unit are iterated and optimized, and an iterative convergence condition is set; The convergence conditions are: Condition 1: Stop when the number of iterations reaches eight; Condition two, , referring to After iterations With After iterations Difference; Note: When any of the above two conditions is met, the iteration terminates and reaches the convergence condition. In a stable state; in: is the adjustable brightness value weight parameter after adjustment, which is used to substitute into the video quality assessment monitoring algorithm ; is the adjustable brightness value weight parameter before adjustment, and at the initial ; is in this formula The adjustment factor of yes Threshold used to determine whether weights need to be adjusted.

4. The vehicle-mounted audio and video security monitoring method according to claim 1 is characterized in that: The processing module also includes a monitoring center unit and a display unit. The monitoring center unit is used to remotely command and dispatch the target vehicle and perform two-way interactive audio and video command on the vehicle. The display unit is used to display the monitoring screen of the vehicle in real time on the display screen.

5. The vehicle-mounted audio and video security monitoring method according to claim 1 is characterized in that: The safety monitoring module includes a high-definition camera and an audio acquisition device. The high-definition camera is used to capture real-time images of the vehicle during driving, and the audio acquisition device is used to monitor and collect audio information inside the vehicle.

Images