A public security multimedia security monitoring system and method

By acquiring and verifying user information during the patrol process, and using facial image and voice recognition technology, combined with historical records for secondary verification, the problems of information delay and error handling in existing technologies are solved, thereby improving the real-time performance and accuracy of information in the security system.

CN117152808BActive Publication Date: 2026-01-30JIANGSU JINGKEFU INFORMATION TECHNOLOGY CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202310995833.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-08-09
Publication Date
2026-01-30
Estimated Expiration
2043-08-09

AI Technical Summary

Technical Problem

Existing personal devices can only record in real time during patrols, but cannot obtain and verify user information in a timely manner, resulting in information delays and erroneous processing.

Method used

By acquiring basic information about the target object, including facial images and voice content, the information recognition unit is used to generate user identification information, which is then verified in conjunction with the voice content to generate a verification result. An anomaly analysis unit is used to analyze verification error signals, and a second verification is performed in conjunction with historical records to ensure the accuracy of the information.

Benefits of technology

It improved the real-time availability of information, reduced information delays and error handling, and enhanced the reliability of the security system and the security awareness of operators.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117152808B_ABST
    Figure CN117152808B_ABST
Patent Text Reader

Abstract

This invention discloses a public security multimedia security monitoring system and method, including an information acquisition unit, an information identification unit, an information verification unit, an anomaly analysis unit, and an information output unit. This invention relates to the field of security monitoring technology and solves the technical problem of the inability to verify acquired information in a timely manner, thus reducing the real-time control of information. This invention identifies and verifies the acquired user information, compares the information in the database with real-time information to determine the correctness of the user information, and re-verifies users with erroneous information. It uses ID numbers and image information to monitor users' real-time information, thereby preventing users from falsifying information and improving the security of the work. Then, it directly generates warning signals for abnormal users and displays them to operators in a timely manner, enhancing the operators' security awareness.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of security monitoring technology, specifically to a public security multimedia security monitoring system and method. Background Technology

[0002] Currently, digital video surveillance technology is becoming increasingly prevalent in the construction of security monitoring systems across the country, with digital processing permeating all aspects of the system, including transmission, control, and storage. The digital "network video server + monitoring platform" approach offers unparalleled advantages in terms of networking flexibility and scalability for intelligent applications.

[0003] According to patent application number CN201910400388.7, the patent includes a monitoring and processing center, a first monitoring system, a second monitoring system, and an anti-monitoring system. The monitoring and processing center transmits signals to a wireless communication module, which in turn transmits the signals to a main control module. The main control module simultaneously transmits the signals to a positioning module, a timer, an anti-monitoring system, and a public security-specific receiving module. The main control module then transmits the signals to a positioning and tracking module and a secondary encryption module. The positioning and tracking module transmits the signals through a primary encryption module to a secondary encryption module, which then transmits the signals back to the main control module for encryption. The positioning and tracking module transmits the signals through the main control module and the wireless communication module to the monitoring and processing center for anti-tracking. The public security-specific receiving module transmits the signals to an alarm system.

[0004] For personnel conducting field patrols, the cameras and microphones they carry record their every move during the patrol. However, some existing handheld devices, due to their limited functionality, can only record in real time. In special circumstances, they cannot promptly obtain information from users being questioned, nor can they understand the situation of the users being questioned, which can lead to information delays and incorrect handling. Summary of the Invention

[0005] In view of the shortcomings of the existing technology, the present invention provides a public security multimedia security monitoring system and method, which solves the problem that the acquired information cannot be verified in a timely manner, thereby reducing the real-time control of information.

[0006] To achieve the above objectives, the present invention provides the following technical solution: a public security multimedia security monitoring system, comprising:

[0007] The information acquisition unit is used to acquire basic information of the target object, wherein the target object includes: the user being questioned, and the basic information of the user being questioned includes: facial image and voice content, and transmits the basic information of the target object to the information recognition unit;

[0008] The information identification unit is used to acquire the basic information of the target object being transmitted, identify the basic information of the user being queried to generate user identification information, and transmit the user identification information to the information verification unit.

[0009] The information verification unit is used to acquire the transmitted user identification information and the user's voice content, and to verify the user identification information in combination with the user's voice content, and generate the corresponding verification result. The verification result includes a verification correct signal and a verification incorrect signal. The verification correct signal is transmitted to the information output unit and the verification incorrect signal is transmitted to the anomaly analysis unit.

[0010] The anomaly analysis unit is used to acquire and analyze the transmitted verification error signal, and at the same time acquire the historical records stored in the data storage unit. The historical records include: name, ID number and image. It should be noted that the historical records represent information of fugitive suspects. The unit combines the historical records to analyze the verification error signal and generate analysis information, which includes: anomaly signal and warning signal. The generated analysis information is then transmitted to the information output unit.

[0011] The anomaly analysis unit is used to analyze the generated anomaly signals and perform secondary verification of the ID number information of the user to be analyzed.

[0012] As a further aspect of the present invention, the specific method by which the information recognition unit generates user identification information is as follows:

[0013] S1: First, use the monitoring device to obtain the facial image of the user asking the question, and obtain multiple sets of facial images. At the same time, filter the multiple sets of facial images and select one set of images as the standard facial image. It should be noted here that the standard facial image is the facial image of the user asking the question when the angle between the head and shoulders is a right angle.

[0014] S2: Next, the standard face image is recognized, and a standard face model is generated by 3D modeling. Then, the feature points of the standard face model are marked and denoted as i. It should be noted that the feature points represent the center of the eyebrows, the two cheekbones, and the chin. The feature point i is matched with the information stored in the database to generate user identification information. It should be noted that the information stored in the database protects the user's name, photo, age, ID number, etc.

[0015] As a further aspect of the present invention, the specific method by which the information verification unit generates the verification result is as follows:

[0016] P1: Acquire the user's voice and convert it into Chinese characters. Simultaneously, extract feature data from the converted content. It should be noted that feature data refers to the information data included in the user's identification information. By extracting this type of data and marking it as feature data, and when recognizing a name through voice, it is necessary to ask the user to break down the name and provide a word-by-word explanation. This avoids recognition errors caused by polyphonic characters, which would affect the overall recognition. Then, the feature data is sorted according to the order in the user's identification information to generate feature data sorting information. It should be noted that the order in the user's identification information refers to the sorting according to the display order of name, gender, age, ID number, etc.

[0017] P2: Next, the feature data sorting information is matched with the user identification information. The specific matching method is as follows: when the feature data sorting information and the user identification information are different, the system displays an error and generates a verification error signal. When the feature data sorting information and the user identification information are the same, the system displays a correct result and generates a verification correct result signal. It should be noted here that when there is a difference between the content in the feature data and the user identification information, it means that the two are different. If the content in the feature data and the user identification information are the same, it means that the two information match.

[0018] As a further aspect of the present invention, the specific method by which the anomaly analysis unit generates analysis information is as follows:

[0019] M1: Obtain the ID card number information from the historical records and match it with the feature data sorting information in the verification error signal. If the ID card number information is the same, a matching signal is generated and a warning signal is generated at the same time. If the ID card number information is different, a mismatch signal is generated and the user is marked as a user to be analyzed.

[0020] M2: Next, the user to be analyzed is analyzed, and the facial profile information of the user to be analyzed is obtained. At the same time, the image information in the historical records is obtained and matched. If the facial profile information matches the image information, a warning signal is generated. Otherwise, if the facial profile information does not match the image information, an abnormal signal is generated.

[0021] As a further aspect of the present invention: the specific method by which the anomaly analysis unit performs secondary verification of the anomaly signal is as follows: the user to be analyzed writes down his ID number and performs video recognition on the written result. It should be noted that: by recognizing the written text, the result is then matched with the user's identification information, and a corresponding matching result is generated. The matching result includes: a correct signal and an incorrect signal. The matching result is then transmitted to the information output unit.

[0022] As a further aspect of the present invention: the data storage unit is used to store historical records and transmit the historical records to the anomaly analysis unit; the information output unit is used to acquire the transmitted analysis information and matching results and display them to the operator through a display device.

[0023] A monitoring method for a public security multimedia security monitoring system, the method comprising the following steps:

[0024] Step 1: The acquisition end obtains the basic information of the target object, and identifies the basic information of the target object based on the real-time information obtained by the monitoring device to generate user identification information, and transmits the user identification information to the processing end.

[0025] Step 2: The processing end obtains the user identification information and combines it with the target object's basic information to verify the user identification information and generate a verification result. Then, it analyzes the verification error signals in the verification result.

[0026] Step 3: Obtain the verification error signal and analyze it in combination with historical records to generate analysis information, which includes abnormal signals and warning signals. The analysis information cannot be transmitted to the output terminal.

[0027] Step 4: The output end receives the transmitted analysis information and displays it to the operator via a display device.

[0028] Beneficial effects

[0029] This invention provides a public security multimedia security monitoring system and method. Compared with the prior art, it has the following advantages:

[0030] This invention identifies and verifies the acquired user information, compares the information in the database with real-time information to determine the correctness of the user information, and re-verifies users with erroneous information. It also uses ID numbers and image information to monitor users' real-time information, thereby preventing users from falsifying information and improving security. Furthermore, it directly generates warning signals for abnormal users and displays them to operators in a timely manner, enhancing their security awareness. Attached Figure Description

[0031] Figure 1 This is a system block diagram of the present invention.

[0032] Figure 2 This is a flowchart of the method of the present invention. Detailed Implementation

[0033] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0034] Example 1, please refer to Figure 1 This application provides a public security multimedia security monitoring system, including:

[0035] The information acquisition unit is used to acquire basic information of the target object, wherein the target object includes: the user being questioned, and the basic information of the user being questioned includes: facial image and voice content, and transmits the basic information of the target object to the information recognition unit.

[0036] The information identification unit is used to acquire the basic information of the target object being transmitted, identify the basic information of the user being queried to generate user identification information, and transmit the user identification information to the information verification unit. The specific method for generating user identification information is as follows:

[0037] S1: First, use the monitoring device to obtain the facial image of the user asking the question, and obtain multiple sets of facial images. At the same time, filter the multiple sets of facial images and select one set of images as the standard facial image. It should be noted here that the standard facial image is the facial image of the user asking the question when the angle between the head and shoulders is a right angle.

[0038] S2: Next, the standard face image is recognized, and a standard face model is generated by 3D modeling. Then, the feature points of the standard face model are marked and denoted as i. It should be noted that the feature points represent the center of the eyebrows, the two cheekbones, and the chin. The feature point i is matched with the information stored in the database to generate user identification information. It should be noted that the information stored in the database protects the user's name, photo, age, ID number, etc.

[0039] The information verification unit is used to acquire the transmitted user identification information and the user's voice content, and to verify the user identification information in conjunction with the user's voice content, generating a corresponding verification result. The verification result includes a verification correct signal and a verification incorrect signal. The verification correct signal is transmitted to the information output unit, and the verification incorrect signal is transmitted to the anomaly analysis unit. The specific method for generating the verification result is as follows:

[0040] P1: Acquire the user's voice and convert it into Chinese characters. Simultaneously, extract feature data from the converted content. It should be noted that feature data refers to the information data included in the user's identification information. By extracting this type of data and marking it as feature data, and when recognizing a name through voice, it is necessary to ask the user to break down the name and provide a word-by-word explanation. This avoids recognition errors caused by polyphonic characters, which would affect the overall recognition. Then, the feature data is sorted according to the order in the user's identification information to generate feature data sorting information. It should be noted that the order in the user's identification information refers to the sorting according to the display order of name, gender, age, ID number, etc.

[0041] P2: Next, the feature data sorting information is matched with the user identification information. The specific matching method is as follows: when the feature data sorting information and the user identification information are different, the system displays an error and generates a verification error signal. When the feature data sorting information and the user identification information are the same, the system displays a correct result and generates a verification correct result signal. It should be noted here that when there is a difference between the content in the feature data and the user identification information, it means that the two are different. If the content in the feature data and the user identification information are the same, it means that the two information match.

[0042] The anomaly analysis unit is used to acquire and analyze transmitted verification error signals, and simultaneously acquire historical records stored in the data storage unit. These historical records include names, ID numbers, and images. It should be noted that the historical records represent information about fugitive suspects. The unit combines these historical records to analyze the verification error signals and generate analysis information, which includes anomaly signals and warning signals. This generated analysis information is then transmitted to the information output unit. The specific method for generating the analysis information is as follows:

[0043] M1: Obtain the ID card number information from the historical records and match it with the feature data sorting information in the verification error signal. If the ID card number information is the same, a matching signal is generated and a warning signal is generated at the same time. If the ID card number information is different, a mismatch signal is generated and the user is marked as a user to be analyzed.

[0044] M2: Next, the user to be analyzed is analyzed, and the facial profile information of the user to be analyzed is obtained. At the same time, the image information in the historical records is obtained and matched. If the facial profile information matches the image information, a warning signal is generated. Otherwise, if the facial profile information does not match the image information, an abnormal signal is generated.

[0045] Based on the analysis of the actual application scenario, the first step is to verify the ID number information of the user who requested the information. However, ID numbers can be forged. Therefore, in cases where the ID numbers are different, further image comparison processing is required to determine whether there is any information forgery through secondary confirmation, thereby ensuring the accuracy of the results.

[0046] The information output unit is used to acquire the transmitted analysis information and display it to the operator through a display device.

[0047] Example 2, as an example of the present invention, differs from Example 1 in that the anomaly analysis unit analyzes the generated anomaly signal.

[0048] The anomaly analysis unit is used to analyze the generated abnormal signals. It performs secondary verification on the ID card number information of the user to be analyzed. The specific method of secondary verification is as follows: the user to be analyzed writes down the ID card number and performs video recognition on the written result. It should be noted that: by recognizing the written text, the recognition result is then matched with the user's identification information to generate the corresponding matching result. The matching result includes: correct signal and incorrect signal. At the same time, the matching result is transmitted to the information output unit.

[0049] The information output unit is used to acquire the transmitted matching results and display them to the operator through a display device.

[0050] Example 3, as Example 3 of the present invention, focuses on combining the implementation processes of Example 1 and Example 2.

[0051] Example 4, please refer to Figure 2 This application provides a monitoring method for a public security multimedia security monitoring system, which specifically includes the following steps:

[0052] Step 1: The acquisition end obtains the basic information of the target object, and identifies the basic information of the target object based on the real-time information obtained by the monitoring device to generate user identification information, and transmits the user identification information to the processing end.

[0053] Step 2: The processing end obtains the user identification information and combines it with the target object's basic information to verify the user identification information and generate a verification result. Then, it analyzes the verification error signals in the verification result.

[0054] Step 3: Obtain the verification error signal and analyze it in combination with historical records to generate analysis information, which includes abnormal signals and warning signals. The analysis information cannot be transmitted to the output terminal.

[0055] Step 4: The output end receives the transmitted analysis information and displays it to the operator via a display device.

[0056] Some of the data in the above formulas are numerical calculations with dimensions removed, and the contents not described in detail in this specification are all prior art known to those skilled in the art.

[0057] The above embodiments are only used to illustrate the technical methods of the present invention and are not intended to limit it. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical methods of the present invention without departing from the spirit and scope of the technical methods of the present invention.

Claims

1. A public security multimedia security monitoring system, characterized in that, The application relates to an information processing method and device. The information acquisition unit is used for acquiring target object basic information, wherein the target object comprises an inquiring user, the inquiring user basic information comprises a face image and voice content, and the target object basic information is transmitted to the information identification unit; the information identification unit is used for acquiring the transmitted target object basic information, identifying the inquiring user basic information to generate user identification information, and transmitting the user identification information to the information verification unit; the information verification unit is used for acquiring the transmitted user identification information and inquiring user voice content, verifying the user identification information in combination with the inquiring user voice content to generate corresponding verification results, wherein the verification results comprise a verification correct signal and a verification error signal, the verification correct signal is transmitted to the information output unit, and the verification error signal is transmitted to the abnormality analysis unit; and the specific processing mode is as follows: P1: the inquiring user voice is acquired and converted into Chinese characters, feature data of the converted content is extracted, the feature data is sorted according to the sequence of the user identification information to generate feature data sorting information; P2: the feature data sorting information is matched with the user identification information, and the specific matching mode is that when the feature data sorting information is different from the user identification information, the system displays an error and generates a verification error signal, and when the feature data sorting information is the same as the user identification information, the system displays a correct and generates a verification correct signal; the abnormality analysis unit is used for acquiring the transmitted verification error signal and analyzing the same, acquiring historical records stored in the data storage unit, wherein the historical records comprise a name, an ID number and an image, analyzing the verification error signal in combination with the historical records to generate analysis information, wherein the analysis information comprises an abnormality signal and a warning signal, and the generated analysis information is transmitted to the information output unit; and the specific processing mode is as follows: M1: the ID number information in the historical records is acquired and matched with the feature data sorting information in the verification error signal, if the ID number information is the same, a matching signal is generated, a warning signal is generated, if the ID number information is different, a non-matching signal is generated, and the user is marked as an analyzed user; M2: the analyzed user is analyzed, face portrait information of the analyzed user is acquired, image information in the historical records is acquired, and the two are matched, if the face portrait information matches the image information, a warning signal is generated, and if the face portrait information does not match the image information, an abnormality signal is generated; the abnormality analysis unit is used for analyzing the generated abnormality signal, and the specific processing mode is that the user ID number information is verified again. The information identification unit generates user identification information in the following specific mode: ​ ​ ​ ​ ​ ​ ​ ​ 2. The public security multimedia security monitoring system according to claim 1, characterized in that, ​ S1: First, the monitoring device obtains the face image of the inquiring user and obtains multiple sets of face images, and filters the multiple sets of face images and selects one set of images as a standard face image; S2: Then, the standard face image is recognized, a standard face model is generated by three-dimensional modeling, the feature points of the standard face model are marked and recorded as i, and the feature points i are matched with the information stored in the database to generate user identification information.

3. The public security multimedia security monitoring system according to claim 1, characterized in that, The data storage unit is configured to store the historical records and transmit the historical records to the anomaly analysis unit.

4. The public security multimedia security monitoring system according to claim 1, characterized in that, The information output unit is configured to obtain the transmitted analysis information and matching result and display them to the operator through the display device.

5. The monitoring method of the public security multimedia security monitoring system according to any one of claims 1-3, characterized in that, The method comprises the following steps: Step one: the terminal obtains the target object basic information, identifies the target object basic information according to the real-time information obtained by the monitoring device to generate user identification information, and transmits the user identification information to the processing terminal; Step two: the processing terminal obtains the user identification information, verifies the user identification information in combination with the target object basic information to generate a verification result, and then analyzes the verification error signal in the verification result; Step three: the verification error signal is obtained and analyzed in combination with the historical records to generate analysis information, wherein the analysis information includes an abnormal signal and a warning signal, and the analysis information cannot be transmitted to the output terminal; Step four: the output terminal obtains the transmitted analysis information and displays it to the operator through the display device.

Citation Information

Patent Citations

  • Security monitoring system for public security system

    CN110223478A

  • Intelligent safety monitoring system and method based on multilevel filtering face recognition

    CN102201061A

  • Non-inductive identity verification device and method for large-scale activity security

    CN115630350A