Driver organism and license information integrated acquisition method, system and equipment
Through RFID tags and face recognition technology, the automated collection and comparison of driver biological and license information in customs ports is achieved, and the problem of low efficiency in vehicle and personnel information collection in the existing technology is solved, and customs clearance efficiency and safety are improved.
Patent Information
- Application Number
- CN202411555661.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-04
- Publication Date
- 2024-12-03
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The collection and verification efficiency of vehicle and personnel information in the customs port is low, resulting in a long customs clearance process and insufficient intelligence, which makes it impossible to effectively deal with the huge traffic flow and the coordination and optimization of multiple departments.
Using RFID tags and facial recognition technology, we can obtain vehicle information through wireless signals, calculate driver position, and move face recognition equipment to compare identity. Combined with multi-angle image acquisition and feature analysis, we can generate facial feature models to realize driver biological and Automatic collection and comparison of license information.
It significantly reduces manual inspection time, improves customs clearance efficiency and safety, prevents identity impersonation, ensures the legitimacy of drivers and vehicles, and achieves fast and accurate identity verification and security management.
Smart Images

Figure CN119068535A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of data analysis and processing, and in particular to a method, system and device for integrating the collection of driver's biometric and license information. Background Art
[0002] Intelligent equipment is often installed at ports to check the information of vehicles and personnel. Despite the assistance of intelligent equipment, there are still problems in daily operations: during peak hours, the number of channels may still be insufficient to cope with the huge traffic flow, leading to congestion. In addition, although data sharing and joint inspection have been achieved, the coordination and operation standards between different departments still need to be further optimized to ensure the efficient execution of all processes. In view of the current situation, ports may continue to expand channel capacity and increase the proportion of intelligent facilities, such as automated inspection equipment and mobile inspection equipment, as well as further improve the information sharing mechanism and emergency response mechanism among multiple departments to ensure that the port can operate efficiently under any circumstances. As ports are constantly expanding and improving, some old facilities need to be replaced to meet the growing customs clearance needs.
[0003] Prior art 1, application number: CN 202311207637.3 discloses a computing platform for the intelligent identification gate release system at customs ports, including a device body, a multimodal data fusion module, an import and export trend analysis module, and an intelligent collaboration module; although by introducing multiple modules, different types of data can be comprehensively analyzed, and the system meets the customs Golden Gate Phase II docking standards, seamlessly docks and exchanges data with the customs system, providing more comprehensive and accurate identification and release decisions; through machine learning and statistical analysis technology, future import and export trends can be predicted, and corresponding decision rules and measures can be taken in advance to improve security management and response capabilities; through the import and export trend analysis module and the intelligent collaboration module, risks can be assessed and corresponding decision rules and measures can be formulated based on the results of the prediction model and historical data analysis, to optimize resource allocation and security measures, improve efficiency and reduce risks. However, its functions are relatively complex, and there is a lack of simultaneous collection and verification of vehicle and personnel information, which affects the efficiency of customs clearance to a certain extent.
[0004] Prior art 2, application number: CN 202310419559.7 discloses a structured management method, device, computer equipment group and storage medium for customs business data. It is the first time to propose the use of edge computing ideas to process customs business data. Through terminal data collection and preprocessing, it can realize the de-redundant entry of batch customs data to be inspected, and automatically determine the risk control type, return the risk screening results, and upload refined valid information to the fusion result database. At the same time, through hot deployment, synchronous maintenance services are maintained, thereby reducing the network bandwidth uploaded by each terminal data source, reducing the processing pressure of the customs data center server, and improving the management efficiency and accuracy of the customs business data system. The risks of high-risk goods and illegal goods are blocked in a timely and accurate manner. Although the inspection manpower cost at the customs port site is reduced, the efficient integration of customs business data is realized. However, the vehicles and personnel passing through the customs are not involved, resulting in a low degree of intelligence in the solution, which is not suitable for the integrated processing of driver information at the port.
[0005] Prior art three, application number: CN 202011417155.7 discloses a port big data processing method and system, which normalizes the port big data that needs to be processed when entering the port, and uses the port big data messages obtained by the system from the bottom layer and its corresponding special distribution processing flow attributes, port flow chain attributes, commodity type attributes, and processing queue attributes to perform differential priority processing on conventional big data sequences and special big data sequences. Although a good big data classification and placement effect has been achieved, and a field isolation management effect different from the prior art has been achieved by setting the separation of field filling, the informationization and modularization characteristics of the port big data processing system have been strengthened. However, it involves a large scope, and does not specifically propose the collection of driver information, resulting in a lack of effective technical means for the integrated processing of driver information.
[0006] At present, the existing technologies 1, 2 and 3 have the problem that the vehicle inspection time is long, resulting in the need to further improve the customs clearance efficiency of ports. Therefore, the present invention provides a method, system and device for collecting driver's biometric and license information in an integrated manner. Summary of the invention
[0007] In order to solve the above technical problems, the present invention provides a method for integrating driver's biometric and license information collection, comprising the following steps: When a vehicle equipped with an RFID tag enters the preset distance of the port inspection channel, it actively sends a wireless signal containing the vehicle's driving license information; the height of the vehicle's cab is obtained from the vehicle's driving license information, and the driver's position is calculated based on the height; Move the face recognition device to the front of the vehicle cab, match it with the position, obtain face information, obtain the identity information of the current driver through face information comparison, associate the vehicle license information with the identity information, and obtain an information set; The information set is compared with the pre-stored vehicle license information and identity information. If the comparison result reaches the similarity threshold, the inspection is qualified; if the comparison result does not reach the similarity threshold, the content that does not reach the similarity threshold is reported.
[0008] Optionally, the process of calculating the position of the driver based on the altitude comprises the following steps: Get the perception distance that triggers the vehicle license information program. The perception distance is calculated by the initialization time of the face recognition device and the current vehicle speed. Set a unified world coordinate system, where the ordinate represents the height of the vehicle and its cab in space, and the abscissa and depth coordinates are used to determine the specific position of the vehicle. Filter the data fields from the vehicle license information to obtain the preliminary height of the cab; set a standard height of the driver relative to the bottom of the cab according to the preliminary height of the cab and the coordinates of the driver sitting on the driver's seat; Get the 3D coordinates of the driver in the world coordinate system.
[0009] Optionally, the process of obtaining the height of the cab relative to the ground comprises the following steps: The name, structure and attribute of the preset data field identification are used to generate attribute indexes for the items of vehicle license information to match the vehicle height, thereby obtaining the preliminary height of the cab; When the real-time vehicle license information is obtained, the names of the various items of the vehicle license information are obtained according to the attribute index, and the items of the approved passenger capacity and outer dimensions are searched to obtain the approved passenger capacity and outer dimensions under the items; The number of seats behind the cab is determined based on the approved passenger capacity, and the number of seats is transmitted to the facial recognition device to provide a reference for obtaining the coordinates of the driver sitting in the driver's seat. The overall height of the vehicle is obtained through the outer dimensions, and the vehicle height is used as the preliminary height of the cab.
[0010] Optionally, the process of obtaining the information set includes the following steps: After receiving the vehicle's driving license information, the facial recognition device automatically adjusts its height and direction based on the obtained cab height; combined with the built-in level, the lens of the facial recognition device is flush with the driver's eyes; the facial recognition device analyzes the sensitive layout of the vehicle, predicts obstructions, and adjusts the lens position; After the lens is adjusted, under the control of the image acquisition program, the lens is started to synchronously acquire high-resolution images; the driver's facial image is captured in a multi-directional panoramic manner, including recording snapshots from different angles, from the front to the side, and then to a 45-degree tilt angle, to form a set of facial feature points; the target features are extracted and a facial feature model is generated, including facial contours, eye contact, and smiles at the corners of the mouth, etc. Combine image features to form a profile describing the driver's facial features; associate the facial feature model with the vehicle license information to create a comprehensive information set; and quickly compare it with pre-stored driver identity information to calculate the matching similarity score.
[0011] The optional process of adjusting the lens position includes the following steps: Combined with the time-of-flight sensor, the face recognition device collects three-dimensional data of the cab and generates a dense point cloud map of the interior environment in real time; Based on the point cloud image, pixel-level segmentation is performed to identify obstacles that may block the driver's face, including mirrors, roof lights, seat backs, and other fixed objects in the car; After predicting potential obstructions, the height and angle of the lens are adjusted in real time through the built-in electric adjuster of the face recognition device; after each adjustment, the depth information is obtained again to confirm whether the new position of the lens meets expectations. If not, continue to adjust.
[0012] Optionally, homogeneous coordinates and transformation matrices are used to represent the adjustment of the lens position: Homogeneous transformation matrix It consists of a rotation matrix and a displacement vector: Rotation matrix: Rotation matrix around the x-axis : Rotation matrix around the y axis : Rotation matrix around the z-axis : Displacement vector: The final homogeneous transformation matrix: New position of the lens It is expressed as: By constantly adjusting and , realize real-time and precise adjustment of the lens and construct the optimization objective function: The optimization objective function is used to minimize the distance between the adjusted lens position and the driver's eye coordinates, thereby achieving high-precision lens position adjustment; represents the three-dimensional coordinates of the driver's eyes, Indicates the current three-dimensional coordinates of the lens. Indicates the offset of the lens adjustment, Indicates the rotation angle of the lens adjustment. Indicates the amount of movement of the lens in each direction. Indicates the rotation angle of the lens on each axis. The homogeneous transformation matrix representing the lens is obtained through mathematical model and optimization method.
[0013] Optionally, the process of forming a facial feature point set includes the following steps: The camera direction is quickly adjusted according to the preset viewing angle. Multiple cameras work in parallel to obtain images of the driver's face at different angles at the same time. The accelerometer and gyroscope are used to record the dynamic changes of each angle in real time, and the camera position is tracked and corrected to be level with the driver's eyes. By using the natural marks of the corners of the eyes, nose and mouth in the image, combined with the active point cloud, a facial feature point set is generated in real time, and the important feature points in the image are automatically calibrated; the driver's facial expression changes are monitored in real time through micro sensors; Get the basic facial contour layer, analyze the detailed skin texture, light and shadow changes, and dynamic expression layer, synthesize images from different perspectives, generate a comprehensive view, and combine the analysis results and the comprehensive view to form a multi-dimensional facial feature model.
[0014] Optionally, the process of forming a multi-dimensional facial feature model comprises the following steps: The initial layer of the convolutional neural network is used to extract static features such as facial edges and textures. The network layer analyzes the texture and light and shadow changes of the facial skin, and performs different convolution operations on each area such as the eyes and mouth to capture expression changes and dynamic features. The subsequent layers use long short-term memory networks to process time series data and capture dynamic changes in expressions. Perform Fourier transform on the captured facial expression changes to extract frequency domain features; extract frequency features by analyzing the amplitude spectrum and phase spectrum in the frequency domain features to reflect the frequency information of expression changes; map facial expression features, vertically fuse the time domain information with the features generated in the frequency domain to construct a dynamic feature representation; The facial feature points are extracted from multi-view images to generate point cloud data, the feature points are aligned, and all the aligned feature points are integrated to generate a three-dimensional facial model.
[0015] The present invention provides a driver's biometric and license information integrated collection system, comprising: The position calculation module is responsible for actively sending a wireless signal when a vehicle equipped with an RFID tag enters the preset distance of the port inspection channel. The wireless signal contains the vehicle's driving license information; the height of the vehicle's cab is obtained from the vehicle's driving license information, and the driver's position is calculated based on the height; The information association module is responsible for moving the face recognition device to the front of the vehicle cab, matching the position, obtaining face information, obtaining the identity information of the current driver through face information comparison, and associating the vehicle license information with the identity information to obtain an information set; The result verification module is responsible for comparing the information set with the pre-stored vehicle license information and identity information. If the comparison result reaches the similarity threshold, the verification is qualified; if the comparison result does not reach the similarity threshold, the content that does not reach the similarity threshold will be reported.
[0016] An electronic device provided by the present invention includes a processor and a memory coupled to the processor, wherein the memory stores program instructions that can be executed by the processor; when the processor executes the program instructions stored in the memory, the integrated collection method of driver biometric and license information is implemented.
[0017] The automatic recognition technology of the present invention reduces the time of manual inspection and confirmation, making the customs clearance process at ports more efficient; the driver's position can be calculated by the height of the cab, which can improve the success rate of subsequent face recognition and avoid recognition failures caused by position mismatch. Automated face recognition and identity confirmation can effectively prevent identity fraud and ensure the legitimacy of personnel; through the dynamic adjustment of the equipment, identity verification can be completed quickly and effectively, reducing recognition errors caused by uncomfortable posture or light. Through a strict information comparison mechanism, the access of unauthorized drivers and illegal vehicles can be effectively excluded, improving the security of customs clearance; reporting on situations that do not reach the threshold can not only provide real-time feedback on inspection information, but also provide on-site personnel with an operational decision-making basis to take corresponding measures in a timely manner.
[0018] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description and the accompanying drawings.
[0019] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings: Figure 1 This is a flow chart of the integrated collection method of driver's biometric and license information in Example 1 of the present invention; Figure 2 A process diagram of calculating the position of the driver according to the height in Embodiment 2 of the present invention; Figure 3 A diagram showing a process of obtaining the height of the cab relative to the ground in Embodiment 3 of the present invention; Figure 4 This is a process diagram for obtaining an information set in Embodiment 4 of the present invention; Figure 5 A process diagram of adjusting the lens position in Embodiment 5 of the present invention; Figure 6 This is a process diagram of forming a facial feature point set in Embodiment 6 of the present invention; Figure 7 A process diagram of forming a multi-dimensional facial feature model in Embodiment 7 of the present invention; Figure 8 A process diagram of calculating a matching similarity score in Embodiment 8 of the present invention; Fig. 9 This is a process diagram for implementing multi-dimensional interaction of data in Embodiment 9 of the present invention; Fig.10 is a process diagram of comparing information sets in Embodiment 10 of the present invention; Fig.11 This is a block diagram of a system for collecting driver's biometric and license information in an integrated manner in Example 11 of the present invention; Fig.12 The figure is a schematic structural diagram of an embodiment of an electronic device of the present invention. DETAILED DESCRIPTION
[0021] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.
[0022] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the embodiments of the present application. The singular forms of "a", "said" and "the" used in the embodiments of the present application are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used in this article refers to and includes any or all possible combinations of one or more associated listed items.
[0023] When the following description relates to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. On the contrary, they are only examples of devices and methods consistent with some aspects of the present application. In the description of the present application, it should be understood that the terms "first", "second", "third", etc. are only used to distinguish similar objects, and do not have to be used to describe a specific order or sequence, nor can they be understood as indicating or implying relative importance. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood according to the specific circumstances.
[0024] Example 1: Figure 1 As shown, an embodiment of the present invention provides a method for integrating driver biometric and license information collection, comprising the following steps: S100: When a vehicle equipped with an RFID tag enters a preset distance of a port inspection channel, it actively sends a wireless signal, which contains the vehicle's driving license information; the height of the vehicle's cab is obtained from the vehicle's driving license information, and the driver's position is calculated based on the height; S200: moving the face recognition device to the front of the vehicle cab, matching the position, obtaining face information, obtaining the identity information of the current driver through face information comparison, associating the vehicle license information with the identity information, and obtaining an information set; S300: Compare the information set with the pre-stored vehicle license information and identity information. If the comparison result reaches the similarity threshold, the inspection is qualified; if the comparison result does not reach the similarity threshold, the content that does not reach the similarity threshold is broadcasted.
[0025] The working principle and beneficial effects of the above technical solution are as follows: first, in this embodiment, when a vehicle equipped with an RFID tag enters a preset distance of the port inspection channel, a wireless signal is actively sent, and the wireless signal contains the vehicle driving license information; the height of the vehicle cab is obtained from the vehicle driving license information, and the driver's position is calculated according to the height; secondly, the face recognition device is moved to the front of the vehicle cab, matched with the position, and the face information is obtained, and the identity information of the current driver is obtained by comparing the face information, and the vehicle driving license information is associated with the identity information to obtain an information set; finally, the information set is compared with the pre-stored vehicle driving license information and identity information. If the comparison result reaches the similarity threshold, the inspection is qualified; if the comparison result does not reach the similarity threshold, the content that does not reach the similarity threshold is broadcast. In the above scheme, step S100 of RFID tag automatic identification and driver position calculation, when the vehicle enters the preset distance of the port inspection channel, the vehicle carrying the RFID tag will automatically send a wireless signal containing the driving license information to the reading system, without the need for manual intervention, which significantly improves the efficiency of information collection; the reading system can quickly receive and parse the information of the vehicle driving license, and then extract the height data of the vehicle cab; through the calculated cab height, the approximate position of the driver can be calculated to prepare for face recognition. Significance: Through automatic identification technology, the time for manual inspection and confirmation is reduced, making the port clearance process more efficient; the driver's position can be calculated through the cab height, which can improve the success rate of subsequent face recognition and avoid recognition failures caused by position mismatch. Step S200 positioning and identity verification of the face recognition device, the face recognition device flexibly moves to the front of the cab according to the calculated driver's position to ensure the best viewing angle and distance for face recognition; through face recognition technology, the system can quickly obtain and confirm the identity information of the current driver. Significance: Automated face recognition and identity confirmation can effectively prevent identity fraud and ensure the legitimacy of personnel; through the dynamic adjustment of the equipment, identity verification can be completed quickly and effectively, reducing recognition errors caused by posture or light discomfort. Step S300: Compare and screen the information set, compare the obtained driving license information with the driver's identity information, and cross-verify with the pre-stored information; adopt the similarity threshold standard, if the comparison result reaches the threshold, it is considered to be qualified; if the threshold is not reached, a prompt will be broadcast. Significance: Through a strict information comparison mechanism, the access of unauthorized drivers and illegal vehicles can be effectively excluded, and the security of customs clearance can be improved; the report of situations that do not reach the threshold can not only provide real-time feedback on inspection information, but also provide on-site personnel with an actionable decision-making basis to take corresponding measures in a timely manner.
[0026] In summary, this embodiment improves the efficiency and security of port inspection in multiple dimensions, integrates the collection of biometrics and license information into an automated process, and reduces the need for manual intervention; through the rapid and accurate collection and real-time comparison of information, it significantly shortens the time required for vehicle clearance; it effectively prevents identity theft and vehicle counterfeiting, and improves the overall security management level of the port; the fast and seamless inspection process improves the driver's clearance experience and increases convenience.
[0027] Example 2: Figure 2 As shown, based on Example 1, the process of calculating the position of the driver according to the height provided in the embodiment of the present invention includes the following steps: S101: Obtaining the perception distance for triggering the vehicle license information program, where the perception distance is calculated by the initialization time of the face recognition device and the current vehicle speed; setting a unified world coordinate system, where the ordinate represents the height of the vehicle and its cab in space, and the abscissa and depth coordinates are used to determine the specific position of the vehicle; S102: Filter data fields from the vehicle license information to obtain the initial height of the cab; according to the initial height of the cab and the coordinates of the driver sitting on the driver's seat, set a standard height of the driver relative to the bottom of the cab, such as the height from the top of the driver's head to the bottom of the seat, recorded as Therefore, the actual height of the driver It is expressed as: In the formula, Indicates the height of the driver's seat relative to the bottom of the cab; Set the driver's position in the vehicle coordinate system: X coordinate (longitudinal position): In the vehicle coordinate system, the driver's position is set to the middle or specific point of the vehicle cab (for example, the driver's longitudinal position is half of this coordinate or a certain offset); Y coordinate (height): Use the height calculated above ; Z coordinate (lateral position): If precision is required, determine the offset value of the driver's seat to the left or right side relative to the vehicle; S103: Obtain the three-dimensional coordinates of the driver in the world coordinate system, expression: In the formula, represents the position of the vehicle in the world coordinate system, It is the lateral offset of the driver inside the vehicle relative to the center of the vehicle, which is set according to the design parameters of the vehicle cab and the driver's sitting posture; Indicates the height of the cab relative to the ground. Indicates the height from the bottom of the driver's seat to the top of the driver's head; represents the depth position of the vehicle in the world coordinate system, Indicates the longitudinal offset of the driver inside the vehicle relative to the center of the vehicle. The offset represents the actual position of the driver sitting forward or backward (for example, the distance adjusted forward or backward).
[0028] The working principle and beneficial effects of the above technical solution are as follows: the present embodiment first obtains the perception distance that triggers the vehicle license information program, and the perception distance is calculated by the initialization time of the face recognition device and the current vehicle speed; sets a unified world coordinate system, in which the ordinate represents the height of the vehicle and its cab in space, and the abscissa and depth coordinates are used to determine the specific position of the vehicle; secondly, the data field is filtered from the vehicle license information to obtain the initial height of the cab; according to the initial height of the cab and the coordinates of the driver sitting on the driver's seat, a certain standard height of the driver relative to the bottom of the cab is set; and the three-dimensional coordinates of the driver in the world coordinate system are obtained. Step S101 of the above solution calculates the relationship between the initialization time of the face recognition device and the current vehicle speed to obtain a dynamic perception distance, which can be effectively used for vehicle environment perception; the ordinate (height) is combined with the abscissa and depth coordinates to form a standardized coordinate system, so that various position data can be compared and integrated relatively. Significance: Provides a basis for height and spatial position calculation, ensuring that the three-dimensional coordinates of the vehicle and its cab are relatively consistent and accurate; the calculation of the perceived distance is crucial for functions such as face recognition and driver identification, and provides basic data for the intelligent driving system. Step S102 extracts the height of the cab relative to the ground and other necessary data from the vehicle license information to enhance the validity and accuracy of the data; calculates the driver's height by setting the standard height of the driver sitting in the driver's seat; accurately obtains the specific height of the driver; and accurately locates the driver's position in the vehicle coordinate system by determining the driver's X, Y, and Z coordinates. Significance: Customize the driver's position according to the driver's height and sitting posture to improve the human-computer interaction experience and safety; ensure that the driver's position calculation in the vehicle is more accurate, which is helpful for the vehicle's automatic driving, driver monitoring and other applications. Step S103 calculates the driver's accurate position in the world coordinate system; combines the vehicle position and the driver's offset relative to the vehicle to form a complete three-dimensional position description. Significance: It helps integrate the status data of vehicles and drivers, and provides real data support for subsequent traffic management, intelligent driving and safety protection measures; accurate three-dimensional position data is crucial for safety devices such as autonomous driving systems and collision warning systems, improving safety and convenience during driving.
[0029] In summary, the driver position calculation process of this embodiment shows how to combine multiple data sources (vehicle information, sensor data, etc.) to form a comprehensive three-dimensional positioning solution. It not only enhances the intelligence and automation level of the vehicle, achieves better driving safety and driver comfort, and promotes the development of the smart car field. It is also of great significance for further driver analysis, behavior prediction and optimization system design.
[0030] Example 3: Figure 3 As shown, based on Example 1, the process of obtaining the height of the cab relative to the ground provided in the embodiment of the present invention includes the following steps: S1021: Preset the name, structure and attribute of the data field identification, generate attribute indexes for the items of the vehicle license information, and use them to match the vehicle height, thereby obtaining the preliminary height of the cab; S1022: when the real-time vehicle license information is obtained, the name of each item of the vehicle license information is obtained according to the attribute index, and the item of the approved passenger capacity and outer dimensions is searched to obtain the approved passenger capacity and outer dimensions under the item; S1023: Determine the number of seats behind the cab based on the approved passenger capacity, transmit the number of seats to the face recognition device to provide a reference for obtaining the coordinates of the driver sitting on the driver's seat, obtain the overall height of the vehicle through the outer dimensions, and use the vehicle height as the preliminary height of the cab.
[0031] The working principle and beneficial effects of the above technical solution are as follows: the present embodiment first presets the name, structure and attribute of the data field identification, generates an attribute index for the items of the vehicle license information, and uses it to match the vehicle height, thereby obtaining the preliminary height of the cab; secondly, when the real-time vehicle license information is obtained, the name of each item of the vehicle license information is obtained according to the attribute index, and the items of the approved passenger capacity and outer dimensions are found to obtain the approved passenger capacity and outer dimensions under the items; finally, the number of seats behind the cab is determined according to the approved passenger capacity, and the number of seats is transmitted to the face recognition device to provide a reference for obtaining the coordinates of the driver sitting on the driver's seat, and the overall height of the vehicle is obtained through the outer dimensions, and the vehicle height is used as the preliminary height of the cab. S1021 of the above solution presets the name, structure and attribute of the data field identification; by presetting the name, structure and attribute of the data field, a standardized understanding and efficient access to the vehicle license information is formed; the generated attribute index enables the system to quickly match and retrieve information related to the cab height. Significance achieved: The standardized information framework improves the efficiency of information processing and ensures that the subsequent steps can accurately and quickly extract key information; the structured method facilitates the subsequent system maintenance and function expansion, and helps to achieve a higher level of automation and intelligence. Step S1022 obtains real-time vehicle license information and searches for the approved passenger capacity and external dimensions; by obtaining the vehicle license information in real time, the key data such as the approved passenger capacity and external dimensions are accurately extracted according to the attribute index; the accuracy and effectiveness of information extraction are guaranteed. Significance achieved: Using officially certified data (i.e., the approved passenger capacity and external dimensions) provides a reliable basis for subsequent height calculations; it helps to ensure that the final cab height is authentic and repeatable, and enhances the credibility of the entire system. Step S1023 determines the number of seats behind the cab according to the approved passenger capacity, and uses the approved passenger capacity to deduce the number of seats behind the cab, thereby providing the necessary coordinate reference for the face recognition device; combined with the external dimension information, the overall height of the vehicle is calculated, and this height is used as the preliminary height of the cab. Significance achieved: Through prediction and calculation, it can effectively support the positioning and recognition operations of face recognition equipment in actual work; ensure that the system can adapt to the changes of the driver in a dynamic environment, laying the foundation for accurate identification of the driver.
[0032] This embodiment achieves the efficiency and accuracy of information extraction: how to quickly and accurately identify and extract data related to the cab height from a large amount of vehicle license information, and ensure that the data used can be effectively matched and calculated; data standardization and structuring: that is, how to improve the automation and intelligence level of vehicle license data processing through standardized data field definitions, and solve the problem of inconsistent data structures of different vehicle information sources; understanding of spatial relationships: how to deduce the configuration of the cab's internal space based on the approved number of passengers, so as to accurately calculate the height, which involves a comprehensive analysis of the driver's actual position in the cab and related physical characteristics; system integration and real-time performance: ensure that the entire system can quickly feed back to the face recognition device while processing vehicle license information in real time, making driver identification and vehicle coordination more efficient. It improves the scientificity and automation of the vehicle inspection process and promotes the development of intelligent transportation systems.
[0033] Example 4: Figure 4 As shown, based on Example 1, the process of obtaining an information set provided by the embodiment of the present invention includes the following steps: S201: After receiving the vehicle driving license information, the face recognition device automatically adjusts its height and direction based on the obtained cab height; combined with the built-in level, the lens of the face recognition device is flush with the driver's eyes; the face recognition device analyzes the sensitive layout of the vehicle interior, predicts obstructions, and adjusts the lens position; S202: After the lens adjustment is completed, under the control of the image acquisition program, the lens is started to synchronously acquire high-resolution images; the driver's facial image is captured in a multi-directional panoramic manner, including recording snapshots from different perspectives, from the front to the side, and then to a 45-degree tilt angle, to form a facial feature point set; target features are extracted and a facial feature model is generated, including facial contours, eye contact, and smiles at the corners of the mouth, etc.; S203: Combining the image features to form a profile describing the driver's facial features; associating the facial feature model with the vehicle license information to create a comprehensive information set; and calculating a matching similarity score by quickly comparing with pre-stored driver identity information.
[0034] The working principle and beneficial effects of the above technical solution are as follows: first, in this embodiment, after receiving the vehicle driving license information, the face recognition device automatically adjusts its height and direction based on the obtained cab height; combined with the built-in level, the lens of the face recognition device is flush with the driver's eyes; the face recognition device analyzes the sensitive layout of the vehicle, predicts the obstruction, and adjusts the lens position; secondly, after the lens adjustment is completed, under the control of the image acquisition program, the lens is started to synchronously perform high-resolution image acquisition; the driver's facial image is captured in a multi-directional panoramic manner, including recording snapshots of different perspectives, from the front to the side, and then to a 45-degree tilt angle, to form a facial feature point set; finally, after capturing the facial image, the image analysis program is started to extract the target features and generate a facial feature model, including facial contours, eye contact and smiles at the corners of the mouth, etc., combined with image features, to form a profile describing the driver's facial features; the facial feature model is associated with the vehicle driving license information to create a comprehensive information set; by quickly comparing with the pre-stored driver identity information, the matching similarity score is calculated. In the above scheme, step S201 height and direction adjustment, by obtaining the cab height information, the device can automatically adjust to the appropriate height so that the lens is flush with the driver's eyes. Automation makes the device more adaptable and can be applied to different models and drivers; sensitive analysis of the in-car layout effectively reduces potential recognition interference, ensures that the lens can always be aimed at the driver's face, and helps to improve the success rate of subsequent image capture. Significance achieved: By ensuring the accuracy of the lens position, it is crucial to clearly capture the driver's facial features, providing a high-quality image input basis; reducing the driver's interference in the device setting process, making the entire recognition process smoother and more natural, and enhancing user acceptance. Step S202 multi-directional image acquisition, the synchronous start of the lens ensures multi-angle image acquisition, making it possible to obtain the driver's facial image from different angles and dynamic states, thereby capturing facial features more comprehensively; recording snapshots of different perspectives according to the natural state can better describe the driver's true appearance in different situations and improve the validity of the data. Significance achieved: Through multi-angle image collection, the driver's features can be more accurately identified, especially the differences caused by changes in facial expressions, so that the system can make more accurate judgments in complex situations; multi-angle acquisition reduces the risk of misjudgment due to the lack of a single perspective, and improves the reliability and accuracy of identity recognition. Step S203 facial feature extraction and information integration, after starting the image analysis program, can quickly extract the key features of the face, including contours, eyes and expressions, and generate a detailed facial feature model. This fast and accurate analysis can significantly shorten the recognition time; by associating the facial feature model with the vehicle license information, a comprehensive information set is created, which not only provides a basis for identity confirmation, but also enhances the multi-dimensional integration capability of data.Significance achieved: Rapidly generate detailed facial feature files and compare them with the identity information in the database, which can achieve high matching accuracy and reduce the chance of identification errors; through effective identity verification, it helps to improve the safety and compliance of vehicle use and ensure that only legal drivers can operate the vehicle.
[0035] This embodiment improves the accuracy of the facial recognition system in capturing the driver's facial features in a dynamic environment, and reduces the recognition errors caused by posture, angle and obstructions; optimizes the identity authentication process, realizes the rapid collection, analysis and comparison of facial images, improves the response speed of the overall system, and reduces the user's waiting time; through automatic adjustment and multi-view capture, reduces the intervention of the driver, makes the identity recognition process more natural and seamlessly integrated into the driving experience; ensures the comprehensiveness and effectiveness of user identity authentication, strengthens the driver's identity security and the compliance of vehicle operation; establishes an efficient facial feature and vehicle information association mechanism to realize the intelligent integration and subsequent management of related data. By centrally solving the above technical problems, the application performance of facial recognition technology in intelligent transportation systems is effectively improved, and the intelligent process of customs inspection and vehicle management is promoted.
[0036] In summary, this embodiment forms an efficient, accurate and user-friendly identity recognition process through systematic automatic adjustment, comprehensive data collection and precise feature analysis, further enhancing the efficiency of personnel safety and vehicle management; and laying a solid foundation for the development and application of intelligent transportation systems.
[0037] Example 5: Figure 5 As shown, based on Example 4, the process of adjusting the lens position provided in the embodiment of the present invention includes the following steps: S2011: Combined with the time-of-flight sensor, the face recognition device collects three-dimensional data of the cab and generates a dense point cloud map of the interior environment in real time; S2012: Based on the point cloud image, pixel-level segmentation is performed to identify obstacles that may block the driver's face, including mirrors, roof lights, seat backs, and other fixed objects in the car; S2013: After predicting a potential obstruction, the height and angle of the lens are adjusted in real time through the electric regulator built into the face recognition device; after each adjustment, the depth information is obtained again to confirm whether the new position of the lens meets the expectation, and if not, continue to adjust; Among them, homogeneous coordinates and transformation matrices are used to represent the adjustment of the lens position: Homogeneous transformation matrix It consists of a rotation matrix and a displacement vector: Rotation matrix: Rotation matrix around the x-axis : Rotation matrix around the y axis : Rotation matrix around the z-axis : Displacement vector: The final homogeneous transformation matrix: New position of the lens It is expressed as: By constantly adjusting and , to achieve real-time and precise adjustment of the lens. In order to optimize the adjustment accuracy, the following optimization objective function is constructed: The optimization objective function is used to minimize the distance between the adjusted lens position and the driver's eye coordinates, thereby achieving high-precision lens position adjustment; represents the three-dimensional coordinates of the driver's eyes, Indicates the current three-dimensional coordinates of the lens. Indicates the offset of the lens adjustment, Indicates the rotation angle of the lens adjustment. Indicates the amount of movement of the lens in each direction. Indicates the rotation angle of the lens on each axis. The homogeneous transformation matrix representing the lens can achieve higher-precision lens position adjustment through mathematical models and optimization methods, providing support for performance improvement of face recognition equipment.
[0038] The working principle and beneficial effects of the above technical solution are as follows: First, in this embodiment, the face recognition device collects three-dimensional data of the cab in combination with the time-of-flight sensor, and generates a dense point cloud map of the in-car environment in real time; secondly, based on the point cloud map, pixel-level segmentation is performed to identify obstacles that may block the driver's face, including mirrors, roof lights, seat backs and other fixed objects in the car; finally, after predicting potential obstructions, the height and angle of the lens are adjusted in real time through the built-in electric regulator of the face recognition device; after each adjustment, the depth information is obtained again to confirm whether the new position of the lens meets the expectations, and if it does not meet the expectations, continue to adjust. In step S2011 of the above scheme, the three-dimensional data acquisition, combined with the time-of-flight (ToF) sensor, the face recognition device can measure the distance from each pixel to the sensor with precise time, and generate a dense point cloud map to reflect the three-dimensional structure of the in-car environment in real time. Significance: Through high-precision three-dimensional data, the equipment can clearly obtain the layout of the cab, including various protrusions and depressions, to form a comprehensive understanding of the interior space of the car; it solves the limitation of traditional two-dimensional images that it is difficult to accurately evaluate spatial structure and depth information in complex in-car environments, and improves the reliability of environmental perception. Step S2012 Pixel-level segmentation and occlusion recognition, based on point cloud data, accurate pixel-level segmentation is performed to achieve accurate identification of potential occlusions; occlusions include rearview mirrors, roof lights, seat backs, etc., and their impact on the line of sight can be quantified. Significance: By identifying occlusions, the system can predict in advance which objects may affect the capture of facial features and provide key data support; it ensures that the system can dynamically optimize the recognition process in a complex in-car environment. It solves the problem of insufficient sensitivity of traditional recognition technology to obstacles, can effectively handle and predict occlusions in actual scenes, and improves overall recognition accuracy. Step S2013: Dynamic adjustment of lens position. The face recognition device uses a built-in electric regulator to automatically adjust the height and angle of the lens after obtaining information about potential obstructions to ensure optimal alignment with the driver's eyes. After each adjustment, the depth information is obtained again to confirm the validity of the new position. Significance: By dynamically adjusting the lens position, the best shooting angle can be maintained to capture the driver's facial features, minimizing the recognition error caused by obstructions; ensuring that the lens is always parallel to the driver's line of sight, improving the accuracy of recognition; solving the problem of poor recognition results due to changes in the layout of the vehicle in statically installed equipment, and significantly improving the system's ability to adapt to the environment.
[0039] In summary, this embodiment solves the problem of facial feature capture effectiveness caused by the complexity of the in-vehicle layout during face recognition. It effectively reduces the error rate of identity authentication and improves the safety and reliability of the intelligent driving system; the ability of dynamic adaptation makes face recognition technology have greater application potential in intelligent transportation and vehicle-mounted applications.
[0040] Example 6: Figure 6 As shown, based on Example 4, the process of forming a facial feature point set provided by the embodiment of the present invention includes the following steps: S2021: Rapidly adjust the lens direction according to the preset viewing angle, with multiple lenses working in parallel to obtain images of the driver's face at different angles at the same time; use the accelerometer and gyroscope to record the dynamic changes of each angle in real time, track and correct the lens position to be level with the driver's eyes; S2022: Utilize natural markers such as the corners of the eyes, nose and mouth in the image, and combine with the active point cloud to generate a facial feature point set in real time, automatically calibrate important feature points in the image; monitor the driver's facial expression changes in real time through micro sensors; S2023: Obtain the basic facial contour layer, analyze the detailed skin texture, light and shadow changes, and dynamic expression layer, synthesize images from different perspectives, generate a comprehensive view, and combine the analysis results and the comprehensive view to form a multi-dimensional facial feature model.
[0041] The working principle and beneficial effects of the above technical solution are as follows: First, the embodiment quickly adjusts the lens direction according to the preset viewing angle, and multiple lenses work in parallel to obtain images of the driver's face at different angles at the same time; the accelerometer and gyroscope are used to record the dynamic changes of each angle in real time, track and correct the lens position, and make it level with the driver's eyes; secondly, the natural marks of the corners of the eyes, nose wings and mouth corners in the image are used to generate a set of facial feature points in real time in combination with the active point cloud, and the important feature points in the image are automatically calibrated; the driver's expression changes are monitored in real time through micro sensors; finally, the basic facial contour layer is obtained, the detailed skin texture, light and shadow changes and dynamic expression layer are analyzed, and the images of each perspective are synthesized to generate a comprehensive view, and the analysis results and the comprehensive view are combined to form a multi-dimensional facial feature model. Step S2021 of the above solution is lens adjustment and dynamic recording, and multiple lenses are quickly adjusted according to preset parameters to ensure that the driver's facial image is captured at different angles at the same time; the dynamic changes of the lens are recorded in real time by the accelerometer and gyroscope to ensure that the lens is always level with the driver's eyes, so as to achieve accurate angle tracking and position correction. Significance: Establishing a standard shooting angle can effectively reduce errors and ensure efficient capture of multi-view images; real-time monitoring and adjustment ensure the stability and consistency of the lens, and enhance the accuracy of facial feature capture; solve the problem of inaccurate facial analysis caused by the misalignment of the lens position with the driver's eyes in a dynamic vehicle environment, and ensure the reliability of the data. Step S2022 Feature point calibration and expression monitoring, using natural markers such as the corners of the eyes, wings of the nose, and corners of the mouth, and using active point cloud technology to generate a set of facial feature points in real time, thereby automatically marking important feature points; micro sensors monitor changes in the driver's facial expressions in real time and provide instant expression data. Significance: Automated feature point recognition significantly improves the efficiency and accuracy of facial feature capture and reduces the need for manual intervention; real-time monitoring of expression changes can enhance the system's adaptive ability in different situations, and can adjust the recognition strategy according to the driver's emotional state; solves the problem of inaccurate feature point recognition caused by lighting and angles during facial feature calibration, and can reflect the driver's emotions in real time to provide support for subsequent analysis. Step S2023: Comprehensive view generation and feature model construction: Through the image synthesis technology of each perspective, a comprehensive view of the driver is generated, which improves the comprehensiveness of facial feature extraction; combined with the basic facial contour, skin texture, light and shadow changes, and dynamic expression layer, a multi-dimensional facial feature model is formed, which further improves the model's sophistication and description ability. Significance: The generation of the comprehensive view provides a panoramic facial data; the multi-dimensional model can more comprehensively reflect the characteristics of the driver, which helps to improve the accuracy in subsequent data processing and feature matching.The problem of missing features or inconsistent data caused by different perspectives and changes in lens position in feature capture is solved. Through synthesis and analysis, the most comprehensive and stable facial feature description is guaranteed.
[0042] In summary, the process of forming a facial feature point set through the above three steps in this embodiment not only improves the accuracy and effectiveness of data collection, provides strong data support, and solves the technical problem of real-time capture and analysis of facial features in a dynamic environment.
[0043] Example 7: Figure 7 As shown, based on Example 6, the process of forming a multi-dimensional facial feature model provided by the embodiment of the present invention includes the following steps: S20231: The initial layer of the convolutional neural network is used to extract static features such as facial edges and textures. The network layer analyzes the texture and light and shadow changes of the facial skin, and performs different convolution operations on each area such as the eyes and mouth to capture expression changes and dynamic features. The subsequent layers use long short-term memory networks to process time series data and capture dynamic changes in expressions. S20232: Perform Fourier transform on the captured facial expression changes to extract frequency domain features; extract frequency features by analyzing the amplitude spectrum and phase spectrum in the frequency domain features to reflect the frequency information of expression changes; map the facial expression features, vertically fuse the time domain information with the features generated in the frequency domain, and construct a dynamic feature representation; S20233: Extract facial feature points from multi-view images to generate point cloud data, align the feature points, and integrate all aligned feature points to generate a three-dimensional facial model.
[0044] The working principle and beneficial effects of the above technical solution are as follows: This embodiment first uses the initial layer of the convolutional neural network to extract static features such as facial edges and textures, the network layer analyzes the texture and light and shadow changes of the facial skin, and performs different convolution operations on each area such as the eyes and mouth to capture expression changes and dynamic features; the subsequent layer uses a long short-term memory network to process time series data to capture the dynamic changes of expressions; secondly, the captured facial expression changes are Fourier transformed to extract frequency domain features; by analyzing the amplitude spectrum and phase spectrum in the frequency domain features, frequency features are extracted to reflect the frequency information of expression changes; facial expression features are mapped, and the time domain information and the features generated by the frequency domain are vertically integrated to construct a dynamic feature representation; finally, facial feature points are extracted from multi-view images to generate point cloud data, the feature points are aligned, and all aligned feature points are integrated to generate a three-dimensional facial model. The initial layer of step S20231 of the above scheme extracts static features and captures dynamic features, and uses the initial layer of the convolutional neural network to extract the edges, textures and other static features of the face; through a series of convolution calculations, it can capture the basic structure and key areas of the face (such as eyes, mouth, etc.); the subsequent layers of the network can analyze the texture and light and shadow changes of the facial skin; through different convolution operations, it focuses on different areas such as eyes and mouth to capture dynamic expression changes; using long short-term memory networks to process time series data, it can recognize and learn the time-varying patterns of facial expressions and capture the dynamic changes of expressions. The significance achieved: Through the extraction of static features, the basic form of the face at a certain moment is understood, and the capture of dynamic features enables the system to evaluate the evolution of expressions over time, enhancing the system's responsiveness; it makes it possible to integrate static and dynamic information, achieving a more comprehensive understanding of facial expressions. Step S20232: Extract frequency domain features and fuse time domain and frequency domain features, perform Fourier transform on facial expression changes, convert time domain signals into frequency domain signals, and extract frequency domain features from them; frequency domain features (such as amplitude spectrum and phase spectrum) can reflect the frequency information of expressions, including the intensity and phase of periodic changes; through the longitudinal fusion of time domain and frequency domain features, dynamic feature representation can be formed; not only can the temporal development of expressions be captured, but also the frequency patterns behind them can be identified. Significance achieved: Combining time domain and frequency domain features enables the model to have a deeper understanding of facial expression changes, especially those frequent changes that may not be simple linear changes; strengthens the robustness and adaptability of the model, lays the foundation for subsequent analysis and application, and improves the accuracy of overall expression recognition. Step S20233: Generate a three-dimensional facial model, extract facial feature points from multi-view images and generate point cloud data, so that facial features at different angles can be aligned consistently in three-dimensional space; use active point cloud technology to integrate all aligned feature points to generate an accurate three-dimensional facial model.Significance achieved: The 3D model not only provides static snapshots of facial expressions, but also captures subtle dynamic changes and lighting effects, enhancing the applicability of the model in real-world scenarios.
[0045] This embodiment solves the problem of how to integrate time series and frequency information to form dynamic feature representation to accurately reflect changes in facial expressions; how to use multi-view image data to generate high-precision three-dimensional facial models for use in various application scenarios; and how to improve the accuracy and real-time response capabilities of facial expression recognition through efficient deep learning models. It not only helps to obtain more refined emotion analysis information, but also provides a technical foundation for the development of various future intelligent systems (such as human-computer interaction, driver monitoring, mental health monitoring, etc.).
[0046] Example 8: Figure 8 As shown, based on Example 4, the process of calculating the matching similarity score provided in this embodiment of the present invention includes the following steps: S2031: Arranging and classifying the features extracted from the three-dimensional surface features to form a data file including the driver's facial features and the vehicle license information; S2032: Associating the facial feature model with the vehicle license information one-to-one to form a comprehensive information set, adding contextual data related to the driver's behavior to achieve multi-dimensional data interaction; S2033: The facial features are converted into low-dimensional vector representations through an embedding layer, and the similarity scores between the facial features to be identified and the pre-stored facial features are calculated using cosine similarity.
[0047] The working principle and beneficial effects of the above technical solution are as follows: the present embodiment first organizes and classifies the features extracted from the three-dimensional face features to form a data file containing the driver's facial features and vehicle license information; secondly, the facial feature model is associated with the vehicle license information one-to-one to form a comprehensive information set, and context data related to the driver's behavior is added to realize multi-dimensional interaction of data; finally, the facial features are converted into low-dimensional vector representations through the embedding layer, and the similarity score between the facial features to be identified and the pre-stored facial features is calculated using cosine similarity. Step S2031 of the above solution is feature organization and classification, which organizes the three-dimensional facial features, including the extracted facial key points, contours, texture information, etc., to form a standardized data file; at the same time, the key information in the vehicle license (such as vehicle number, registration information, etc.) is organized and integrated with the facial features to ensure the systematicness and retrievability of the data; the facial features and vehicle information are stored in a standardized manner using a structured database management system to facilitate subsequent rapid query and comparison. Significance achieved: Through the standardized information structure, information retrieval and association are made more efficient; the initial integration of driver identity information and vehicle information is achieved, providing a basic data layer for more complex data analysis and calculation. Step S2032: The association of information sets and the addition of context data, the facial feature model is associated with the vehicle license information one-to-one to form a comprehensive information set; the data is expanded in combination with the driver's behavioral characteristics (such as emotional state, fatigue level, driving habits, etc.); the logical consistency of information is ensured by setting data association rules; context data is added to the comprehensive information set to form a multi-dimensional interaction, so that the information can not only be seen in visual features, but also can extract information such as the driver's behavioral psychological state and real-time reaction. Significance achieved: Through such a multi-dimensional information set, not only the ability to identify the driver is possessed, but also the specific state of the driver can be understood in the process of in-depth analysis; dynamic monitoring of driving behavior is achieved, which can provide data support for customs inspection, risk warning, etc., and improve the safety and accuracy of intelligent driving. Step S2033: Similarity score calculation: high-dimensional facial features are converted into low-dimensional vector representations through an embedding layer, and the efficiency of feature extraction is improved by using a deep learning model (such as an autoencoder or a convolutional neural network); the embedding method not only improves the speed of calculation, but also retains the clarity and recognizability of facial features; the similarity score is calculated using cosine similarity; the similarity between the facial features to be identified and the stored features can be quantitatively measured, and the score range is between -1 and 1, and the closer the value is to 1, the higher the similarity. Significance achieved: facial feature measurement becomes more accurate and efficient, especially in the application of high-dimensional data processing, which improves the response speed of the system; the calculation result of the similarity score provides a basis for subsequent identity authentication and decision-making, which helps to achieve real-time judgment and response and enhance driving safety.
[0048] The key technical problem solved by this embodiment is how to use complex facial features and vehicle information to achieve fast and accurate driver identification and behavior analysis; effectively organize and classify data from different sources (facial features and vehicle information) to support fast comparison and query; provide richer background information for identification by associating different data types (facial features and contextual information) to enhance the accuracy of judgment; and ensure the real-time and accuracy of the system during the identification process through efficient similarity calculation methods, ensuring that high performance can still be maintained under certain environmental changes. Through the overall process, it is possible to provide effective technical support for applications such as intelligent driving and vehicle safety monitoring on the basis of high precision, significantly improving driving safety and intelligence.
[0049] Example 9: Fig. 9 As shown, based on Example 8, the process of implementing multi-dimensional interaction of data provided by the embodiment of the present invention includes the following steps: S20321: By comparing the features of the front view and the side view, the similarity of each angle is evaluated; the extracted three-dimensional facial features are converted into abstract feature vectors; at the same time, the vehicle driving license information is encoded, and the unique identifier of the vehicle identification code is used as a connection, so that the facial features of each driver and their vehicle information are matched into a pair; S20322: Construct an information set including a low-dimensional vector representation of the driver's facial features, vehicle license information, and behavioral context data; monitor the driver's behavior and physiological state in real time through embedded sensors, identify changes in the driver's facial expressions, and generate a personalized driving behavior model for the driver in combination with historical driving data; S20323: After the information collection is completed, different types of data are integrated through a weighted fusion strategy; each type of information (facial features, vehicle information, and contextual data) is evaluated for impact by giving a given weight.
[0050] The working principle and beneficial effects of the above technical solution are as follows: this embodiment first evaluates the similarity of each angle by comparing the features of the front view and the side view; converts the extracted three-dimensional facial features into abstract feature vectors; at the same time, the vehicle driving license information is encoded, and the vehicle identification code unique identifier is used as a connection, so that each driver's facial features and its vehicle information are matched as a pair; secondly, an information set is constructed, including a low-dimensional vector representation of the driver's facial features, the vehicle driving license information and the behavioral context data; the driver's behavior and physiological state are monitored in real time by embedded sensors, the driver's expression changes are identified, and the driver's personalized driving behavior model is generated in combination with historical driving data; finally, after the information set is completed, different types of data are integrated through a weighted fusion strategy; each type of information (facial features, vehicle information and context data) is evaluated for impact by giving a given weight. The feature extraction and encoding of step S20321 of the above scheme can comprehensively evaluate the facial similarity of the driver by comparing the features of the front view and the side view; use computer vision technology (such as convolutional neural network based on deep learning) to extract key points, curves, textures and other important features of the face, so as to obtain richer feature data; convert the extracted three-dimensional facial features into abstract feature vectors to ensure that these vectors can effectively distinguish different individuals in high-dimensional space, which helps to simplify the subsequent similarity calculation and reduce the computational burden; at the same time, encode the vehicle driving license information and use the vehicle identification number (VIN) as a connecting bridge; it can ensure that the driver's facial features and his vehicle information establish an accurate relationship and achieve one-to-one matching. The significance achieved: Through comprehensive feature extraction and effective encoding, a solid foundation is laid for subsequent data integration; the efficient association of driver identity information and vehicle information is ensured, and the accuracy of identity recognition is optimized; the completion enables the system to accurately identify the driver in different situations (front and side), improving the overall recognition robustness and flexibility. Step S20322: Information set construction, constructing a low-dimensional vector representation of the driver's facial features, vehicle license information, and behavioral context data; integrating multiple information into a unified format by designing a structured data set (such as JSON or graph database); using embedded sensors to monitor the driver's behavior and physiological state (such as heart rate, skin temperature, etc.), and using machine vision technology to identify the driver's emotional state and expression changes in real time; being able to collect historical data to form a personalized behavior model for the driver. Significance achieved: Integrating multi-dimensional information, improving the comprehensiveness and availability of data, enabling the system to understand the driver's status and its relationship with the vehicle in a larger range; combining real-time monitoring with historical data, allowing the driver's behavior pattern to be dynamically updated, providing the system with intelligent analysis capabilities; by understanding the driver's emotions and behaviors, more sophisticated risk assessments and decisions can be made.Step S20323: weighted data fusion. After the information collection is completed, the weighted fusion strategy is applied to integrate different types of data (facial features, vehicle information, contextual data). By defining the weight of the correlation, the impact of important information on the overall output is more prominent. According to the real-time situation and the driver's status, the weight of each type of information can be dynamically adjusted, so that the system can more accurately capture the key influencing factors. The significance achieved: It ensures the effective collaboration between multi-dimensional data, helps to improve the decision-making ability of the intelligent system, and reduces the error rate of identity recognition. Through weighted fusion, the identity recognition scheme can be optimized according to the specific situation, so that the algorithm can show its advantages in different situations, thereby improving the user experience and safety.
[0051] The key technical problem solved by this embodiment is how to deeply interact with multiple information sources (such as facial features, vehicle information, and behavioral context data) to achieve real-time and accurate intelligent identity recognition; by accurately matching facial features and vehicle information, it ensures effective recognition from different perspectives and restores the user's true identity; by combining real-time monitoring and historical data, it enhances the system's ability to understand the driver's status and behavior and supports continuous optimization; through weighted fusion strategies, it enhances the impact of multi-dimensional information on recognition results, thereby ensuring that the system can respond quickly and accurately in complex and changing driving environments. Through the integration and optimization of steps, the entire system's capabilities in intelligent recognition, real-time monitoring, and risk assessment have been significantly enhanced, providing a solid technical foundation for applications in the fields of intelligent transportation, customs inspection, etc.
[0052] Example 10: Fig.10 As shown, based on Example 1, the process of comparing information sets provided by the embodiment of the present invention includes the following steps: S301: Obtain similarity scores in the information set, compare the similarity scores with a set threshold, and make a decision; S302: If the similarity score reaches or exceeds the similarity threshold, the comparison result is recorded as qualified; if the comparison result does not reach the similarity threshold, a warning message is generated, including the driver's name, identity information, pre-stored vehicle information and the obtained similarity score; S303: Trigger an audible and visual alarm based on the warning information, and play a warning that the driver's identity information does not match the vehicle's driving license information. Please confirm immediately.
[0053] The working principle and beneficial effects of the above technical solution are as follows: the present embodiment first obtains the similarity score in the information set, compares the similarity score with the set threshold, and makes a decision; secondly, if the similarity score reaches or exceeds the similarity threshold, the comparison result is recorded as qualified; if the comparison result does not reach the similarity threshold, a warning message is generated, the content of which includes the driver's name, identity information, pre-stored vehicle information and the obtained similarity score, etc.; finally, an audible and visual alarm is triggered according to the warning message, and the driver's identity information does not match the vehicle license information, please confirm immediately. Step S301 of the above solution obtains the similarity score and compares the threshold, extracts features from the information set, and calculates the similarity score through an algorithm (such as cosine similarity, Euclidean distance, etc.) to reflect the degree of match between the driver's identity information and the vehicle license information; the obtained similarity score is compared with a preset threshold (such as 0.85) to evaluate the matching effect of the information. Significance achieved: By comparing the set threshold, the accuracy of the system's identity authentication is ensured, avoiding blind acceptance or rejection of the comparison results; effectively preventing the possibility of misjudgment and missed judgment, and not causing unnecessary safety hazards due to improper threshold settings. Step S302 records the comparison results or generates warning information. If the comparison result reaches or exceeds the threshold, the comparison result will be automatically recorded as "inspection qualified", and a traceable log will be generated at the same time, including: driver's name, ID number, vehicle information, similarity score and timestamp, etc.; if the comparison fails, a warning message containing specific information is generated for subsequent processing. Significance achieved: By recording the comparison results, a complete audit trail is provided to ensure that it can be verified in the event of disputes or questions; the generated warning information enables the system to quickly respond to potential problems and provide a basis for subsequent processing. Step S303 triggers the sound and light alarm. According to the generated warning information, the sound and light alarm is triggered to notify relevant personnel of potential safety hazards; the sound and light alarm equipment can quickly attract the attention of on-site staff and provide clear instructions. Significance achieved: Through the rapid response mechanism, timely review of low-matching information is ensured to prevent possible illegal activities and truly protect the security of entry and exit; through the dual prompts of sound and vision, operators are clearly informed of the specific operations that need to be performed (such as immediate confirmation of identity information and vehicle information), thereby improving the overall processing efficiency.
[0054] This embodiment solves the following technical problems: by comparing similarity scores and setting thresholds, it ensures that the identity is only considered valid when the confidence is high, effectively reducing the security risks caused by identity information forgery; through early warning mechanisms and sound and light alarms, it improves active defense capabilities, so that potential identity matching problems can be discovered and handled in a timely manner; it builds a complete information comparison, feedback and processing process, which greatly facilitates the identification of safety hazards by on-site staff and improves the efficiency and safety of the entire inspection process. In general, this process and this embodiment improves the security and convenience of vehicle and driver identity verification through technical means, and solves the key problem of how to maintain a balance between accuracy and efficiency of customs inspection when quickly comparing information.
[0055] Example 11: Fig.11 As shown, based on Embodiments 1 to 10, the driver's biometric and license information integrated collection system provided by the embodiment of the present invention includes: The position calculation module is responsible for actively sending a wireless signal when a vehicle equipped with an RFID tag enters the preset distance of the port inspection channel. The wireless signal contains the vehicle's driving license information; the height of the vehicle's cab is obtained from the vehicle's driving license information, and the driver's position is calculated based on the height; The information association module is responsible for moving the face recognition device to the front of the vehicle cab, matching the position, obtaining face information, obtaining the identity information of the current driver through face information comparison, and associating the vehicle license information with the identity information to obtain an information set; The result verification module is responsible for comparing the information set with the pre-stored vehicle license information and identity information. If the comparison result reaches the similarity threshold, the verification is qualified; if the comparison result does not reach the similarity threshold, the content that does not reach the similarity threshold will be reported.
[0056] The working principle and beneficial effects of the above technical solution are as follows: when a vehicle equipped with an RFID tag enters a preset distance of the port inspection channel, the position calculation module of this embodiment actively sends a wireless signal, and the wireless signal contains the vehicle driving license information; the height of the vehicle cab is obtained by screening from the vehicle driving license information, and the driver's position is calculated according to the height; the information association module moves the face recognition device to the front of the vehicle cab, matches the position, obtains the face information, obtains the identity information of the current driver by comparing the face information, associates the vehicle driving license information with the identity information, and obtains an information set; the result verification module compares the information set with the pre-stored vehicle driving license information and identity information, and if the comparison result reaches the similarity threshold, the inspection is qualified; if the comparison result does not reach the similarity threshold, the content that does not reach the similarity threshold is broadcast. When a vehicle equipped with an RFID tag approaches the preset distance of the port inspection channel, the location calculation module of the above scheme actively sends a wireless signal, including the vehicle driving license information; the height of the vehicle cab is screened from the vehicle driving license information, and the driver's position is calculated based on the height; the specific position of the driver in the vehicle can be effectively determined. Significance achieved: Through the active transmission of wireless signals, the system can obtain vehicle information in a timely manner, thereby achieving rapid response without manual intervention; by applying the vehicle's cab height information, the system can accurately determine the relative position of the driver, which is convenient for subsequent biometric feature collection (such as face recognition) and verification. The information association module moves the face recognition device to the front of the vehicle cab according to the calculated driver's position in order to obtain clear face information; by comparing the acquired face information with the face image in the database, the identity information of the current driver is obtained; at the same time, the vehicle driving license information is associated with the identity information to form an information set. Significance achieved: Information from different sources (face information and vehicle license information) are associated to form a complete information set, which is convenient for subsequent comparison and verification processes; through accurate face recognition, the ability to verify the driver's identity can be improved, thereby ensuring the safety and legality of the operation. The result verification module compares the information set formed in the previous step with the pre-stored vehicle license information and identity information to obtain a similarity score; if the comparison result reaches the set similarity threshold (such as 0.85), the output is that the inspection is qualified; if it does not reach it, a corresponding warning message is generated and broadcast. Significance achieved: By comparing the similarity, the authenticity of the information can be effectively judged, and the potential risk of identity forgery or inconsistent vehicle information can be identified in a timely manner, thereby reducing safety hazards; the reporting mechanism when the threshold is not reached can quickly alarm and promptly remind on-site staff to conduct further manual confirmation and intervention, thereby enhancing the safety of the overall inspection.
[0057] This embodiment integrates biometric technology and automatic identification of vehicle information, realizes automatic data collection, association and verification, and greatly improves the efficiency of inspection; through the active transmission of wireless information and the rapid feedback mechanism, it can monitor the identity of the vehicle and driver in real time to ensure the efficiency and safety of the inspection process. The significance achieved is that through the integrated design, multiple steps in the traditional inspection process are simplified, the inspection time is shortened, and the overall efficiency is improved; through the automated comparison and alarm functions, the security management of inbound and outbound vehicles and driver identities is enhanced, the risk of counterfeiting and illegal driving is reduced, and the accurate collection and security verification of driver and vehicle information is realized, which improves the overall safety and work efficiency, and significantly optimizes the deficiencies in the traditional customs inspection identity review process.
[0058] Example 12: Fig.12 As shown, based on Embodiment 1 to Embodiment 10, an embodiment of the present invention provides an embodiment of an electronic device. In this embodiment, the electronic device includes a processor and a memory coupled to the processor.
[0059] The memory stores program instructions for implementing the integrated driver biometric and license information collection method of any of the above embodiments.
[0060] The processor is used to execute program instructions stored in the memory to collect the driver's biometric and license information in an integrated manner.
[0061] The processor may also be referred to as a CPU (Central Processing Unit). The processor may be an integrated circuit chip with signal processing capabilities. The processor may also be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.
[0062] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention belong to the scope of equivalent technologies of the present invention, the present invention is also intended to include these modifications and variations.
Claims
1. A method for collecting driver's biometric and license information in an integrated manner, characterized in that: The following steps are involved: When a vehicle equipped with an RFID tag enters the preset distance of the port inspection channel, it actively sends a wireless signal containing the vehicle's driving license information; the height of the vehicle's cab is obtained from the vehicle's driving license information, and the driver's position is calculated based on the height; Move the face recognition device to the front of the vehicle cab, match it with the position, obtain face information, obtain the identity information of the current driver through face information comparison, associate the vehicle license information with the identity information, and obtain an information set; The information set is compared with the pre-stored vehicle license information and identity information. If the comparison result reaches the similarity threshold, the inspection is qualified; if the comparison result does not reach the similarity threshold, the content that does not reach the similarity threshold is reported.
2. The integrated driver biometric and license information collection method according to claim 1, characterized in that: The process of calculating the driver's position based on altitude includes the following steps: Get the perception distance that triggers the vehicle license information program. The perception distance is calculated by the initialization time of the face recognition device and the current vehicle speed. Set a unified world coordinate system, where the ordinate represents the height of the vehicle and its cab in space, and the abscissa and depth coordinates are used to determine the specific position of the vehicle. Filter the data fields from the vehicle license information to obtain the preliminary height of the cab; set a standard height of the driver relative to the bottom of the cab according to the preliminary height of the cab and the coordinates of the driver sitting on the driver's seat; Get the 3D coordinates of the driver in the world coordinate system.
3. The integrated driver biometric and license information collection method according to claim 1, characterized in that: The process of obtaining the height of the cab relative to the ground includes the following steps: The name, structure and attribute of the preset data field identification are used to generate attribute indexes for the items of vehicle license information to match the vehicle height, thereby obtaining the preliminary height of the cab; When the real-time vehicle license information is obtained, the names of the various items of the vehicle license information are obtained according to the attribute index, and the items of the approved passenger capacity and outer dimensions are searched to obtain the approved passenger capacity and outer dimensions under the items; The number of seats behind the cab is determined based on the approved passenger capacity, and the number of seats is transmitted to the facial recognition device to provide a reference for obtaining the coordinates of the driver sitting in the driver's seat. The overall height of the vehicle is obtained through the outer dimensions, and the vehicle height is used as the preliminary height of the cab.
4. The integrated driver biometric and license information collection method according to claim 1, characterized in that: The process of obtaining the information set includes the following steps: After receiving the vehicle's driving license information, the facial recognition device automatically adjusts its height and direction based on the obtained cab height; combined with the built-in level, the lens of the facial recognition device is flush with the driver's eyes; the facial recognition device analyzes the sensitive layout of the vehicle, predicts obstructions, and adjusts the lens position; After the lens is adjusted, under the control of the image acquisition program, the lens is started to synchronously acquire high-resolution images; the driver's facial image is captured in a multi-directional panoramic manner, including recording snapshots from different angles, from the front to the side, and then to a 45-degree tilt angle, to form a set of facial feature points; the target features are extracted and a facial feature model is generated, including facial contours, eye contact and smiles at the corners of the mouth; Combine image features to form a profile describing the driver's facial features; associate the facial feature model with the vehicle license information to create a comprehensive information set; and quickly compare it with pre-stored driver identity information to calculate the matching similarity score.
5. The integrated driver biometric and license information collection method according to claim 4, characterized in that: The process of adjusting the lens position includes the following steps: Combined with the time-of-flight sensor, the face recognition device collects three-dimensional data of the cab and generates a dense point cloud map of the interior environment in real time; Based on the point cloud image, pixel-level segmentation is performed to identify obstacles that block the driver's face, including mirrors, roof lights, seat backs, and fixed objects in the car. After predicting potential obstructions, the height and angle of the lens are adjusted in real time through the built-in electric adjuster of the face recognition device; after each adjustment, the depth information is obtained again to confirm whether the new position of the lens meets expectations. If not, continue to adjust.
6. The integrated driver biometric and license information collection method according to claim 5, characterized in that: in, Use homogeneous coordinates and transformation matrices to represent the adjustment of the camera position: Homogeneous transformation matrix It consists of a rotation matrix and a displacement vector: Rotation matrix: Rotation matrix around the x-axis : Rotation matrix around the y axis : Rotation matrix around the z-axis : Displacement vector: The final homogeneous transformation matrix: New position of the lens It is expressed as: By constantly adjusting and , realize real-time and precise adjustment of the lens and construct the optimization objective function: The optimization objective function is used to minimize the distance between the adjusted lens position and the driver's eye coordinates, thereby achieving high-precision lens position adjustment; represents the three-dimensional coordinates of the driver's eyes, Indicates the current three-dimensional coordinates of the lens, Indicates the offset of the lens adjustment, Indicates the rotation angle of the lens adjustment. Indicates the amount of movement of the lens in each direction. Indicates the rotation angle of the lens on each axis. The homogeneous transformation matrix representing the lens is obtained through mathematical model and optimization method.
7. The integrated driver biometric and license information collection method according to claim 4, characterized in that: The process of forming a set of facial feature points includes the following steps: The camera direction is quickly adjusted according to the preset viewing angle. Multiple cameras work in parallel to obtain images of the driver's face at different angles at the same time. The accelerometer and gyroscope are used to record the dynamic changes of each angle in real time, and the camera position is tracked and corrected to be level with the driver's eyes. Using the natural marks of the corners of the eyes, nose and mouth in the image, combined with the active point cloud, a set of facial feature points is generated in real time to automatically calibrate the important feature points in the image; Real-time monitoring of driver's facial expression changes through micro sensors; Get the basic facial contour layer, analyze the detailed skin texture, light and shadow changes, and dynamic expression layer, synthesize images from different perspectives, generate a comprehensive view, and combine the analysis results and the comprehensive view to form a multi-dimensional facial feature model.
8. The integrated driver biometric and license information collection method according to claim 7, characterized in that: The process of forming a multi-dimensional facial feature model includes the following steps: The initial layer of the convolutional neural network is used to extract the static features of the edge and texture of the face. The network layer analyzes the texture and light and shadow changes of the facial skin, and performs different convolution operations on each area of the eyes and mouth to capture the changes in expression and dynamic features. The subsequent layers use long short-term memory networks to process time series data and capture the dynamic changes in expression. Perform Fourier transform on the captured facial expression changes to extract frequency domain features; By analyzing the amplitude spectrum and phase spectrum in the frequency domain features, the frequency features are extracted to reflect the frequency information of expression changes; facial expression features are mapped, and the time domain information is vertically integrated with the features generated in the frequency domain to construct a dynamic feature representation; The facial feature points are extracted from multi-view images to generate point cloud data, the feature points are aligned, and all the aligned feature points are integrated to generate a three-dimensional facial model.
9. An integrated driver biometric and license information collection system, characterized in that: Include: The position calculation module is responsible for actively sending a wireless signal when a vehicle equipped with an RFID tag enters the preset distance of the port inspection channel. The wireless signal contains the vehicle's driving license information; the height of the vehicle's cab is obtained from the vehicle's driving license information, and the driver's position is calculated based on the height; The information association module is responsible for moving the face recognition device to the front of the vehicle cab, matching the position, obtaining face information, obtaining the identity information of the current driver through face information comparison, and associating the vehicle license information with the identity information to obtain an information set; The result verification module is responsible for comparing the information set with the pre-stored vehicle license information and identity information. If the comparison result reaches the similarity threshold, the verification is qualified; if the comparison result does not reach the similarity threshold, the content that does not reach the similarity threshold will be reported.
10. An electronic device, characterized in that: It includes a processor and a memory coupled to the processor, the memory storing program instructions executable by the processor; when the processor executes the program instructions stored in the memory, the integrated driver biometric and license information collection method as described in any one of claims 1 to 8 is implemented.
Citation Information
Patent Citations
Port big data processing method and system
CN112506993A
Customs business data structured management method and device, computer equipment group and storage medium
CN116450753A
Customs port intelligent identification gate release system computing power platform
CN117251703A
Road entrance automatic card-issuing system and method
CN104463991A
Novel intelligent passenger transport station management system
CN110033543A
Cited By
Control system and method of self-service beverage dispenser
CN119625885A
Driving skill training method and system combined with virtual reality
CN119763403A
