Driving authority management method and device based on biological characteristic verification and medium

Abstract

The invention provides a driving authority management method and device based on biological feature verification and a medium, and belongs to the technical field of vehicles. The method comprises the steps of collecting facial features, voiceprint data and driving behavior data by detecting a starting operation of a current driver; the identity of the current driver is recognized by using a multi-modal biological recognition algorithm, and the accuracy and anti-counterfeiting capability of identity verification are improved by adopting a bimodal fusion scheme of face recognition and voiceprint recognition; when it is determined that identity recognition of the current driver succeeds, a driving account is determined to judge whether the driver has the use permission or not, a binding relation of driver identity-account-function permission is established, and accurate matching of the intelligent driving permission and the driver qualification is achieved; the open state of the intelligent driving function is dynamically controlled based on a permission verification result, if the permission exists, the intelligent driving function is automatically prepared, if the permission does not exist, the function is locked, a clear prompt is given, and the safety risk that the intelligent driving function is used before being learned is avoided from the source.

Description

Technical Field

[0001] This application relates to the field of vehicle technology, and in particular to a method, device and medium for driving access management based on biometric verification. Background Technology

[0002] Currently, facial recognition technology is the mainstream application of in-vehicle biometrics in the intelligent vehicle field, with the highest installation rate. Its core applications are vehicle unlocking, account login, and loading of basic personalized settings. While some high-end models have attempted multimodal solutions, they haven't deeply integrated access control with core driving safety functions. Furthermore, access control for combined driver assistance functions generally adopts a static "one-time authentication, long-term validity" model, lacking a dynamic linkage mechanism based on driver qualifications, experience, and real-time behavior. Overall, existing technologies suffer from insufficient reliability, weak functional linkage, and a lack of incentives, failing to meet the safety management needs and user experience upgrade demands of combined driver assistance systems. Summary of the Invention

[0003] The main objective of this application is to propose a driving permission management method, device, and medium based on biometric verification, so as to reduce the safety risks caused by the abuse of driver assistance functions and improve users' acceptance and stickiness to the driver assistance system.

[0004] To achieve the above objectives, one aspect of this application proposes a driving access management method based on biometric verification, the method comprising: The system detects the current driver's startup operation, generates a trigger command based on the startup operation, and collects facial features, voiceprint data, and driving behavior data based on the trigger command. The multimodal biometric algorithm is used to fuse facial features and voiceprint data for matching and verification, and the identity of the current driver is determined based on the driving behavior data. When the current driver's identity is successfully identified, the driving account corresponding to the current driver is determined based on the matching result, and the driving account is used to determine whether the driver has the right to use the combined driving assistance functions. If it is determined that there is no permission to use the combined driving assistance function, the combined driving assistance function will be locked, and the core display will show a permission restriction message.

[0005] In some embodiments, detecting the current driver's initiation operation and generating a trigger command based on the initiation operation includes: In response to the vehicle unlocking command, the vehicle seat entry action, door closing action and seat belt triggering operation are detected one by one according to the vehicle unlocking command; Based on the vehicle seating action, the door closing action, and the seat belt triggering operation, determine whether a triggering condition has been formed; When the triggering condition is determined to be met, the triggering instruction is generated.

[0006] In some embodiments, the fusion of the facial features and voiceprint data for matching verification includes: Feature extraction is performed on the facial features, the voiceprint data, and the driving behavior data to obtain facial feature vectors, voiceprint embedding vectors, and behavior pattern fingerprints. Based on the facial feature vector and the voiceprint embedding vector, a multimodal biometric fusion strategy is used to preliminarily determine the identity. The behavioral pattern fingerprint is dynamically time-normalized and matched with historical behavioral patterns to determine the identity again, and the matching result is output to determine whether the recognition is successful.

[0007] In some embodiments, determining the driving account corresponding to the current driver based on the matching results includes: Based on the matching results, the current driver's identity is determined, and based on the driver's identity, the driving account is determined; Based on the driving account, the system calls the database associated with the set account permissions to determine the usage permissions.

[0008] In some embodiments, determining whether the current driver's identity has been successfully identified further includes: If the current driver's identity recognition fails, the system will retain the currently logged-in account on the vehicle's infotainment system, while the core display will show a recognition failure message.

[0009] In some embodiments, determining whether one has permission to use the combined driving assistance functions further includes: Once it is determined that there is permission to use the combined driving assistance function, a permission confirmation request is generated. Based on the permission confirmation request, the corresponding combined driving assistance function is activated, and the corresponding combined driving assistance function enters the function enabled state.

[0010] In some embodiments, the method further includes: The core display carrier displays the identity recognition progress, permission matching results, and function activation status in real time, while the auxiliary display carrier simplifies and renders the identity recognition progress, permission matching results, and function activation status.

[0011] In some embodiments, the operation of retaining the currently logged-in account on the vehicle system includes: If identity verification fails, check the current login status; Based on the current login status, if it is determined that there is already a logged-in account, then the logged-in account will be maintained. Based on the current login status, if it is determined that there is no logged-in account, the login status will remain unchanged.

[0012] To achieve the above objectives, another aspect of this application provides a vehicle control device, including a memory, a processor, and a program stored in the memory and executable on the processor. When the program is executed by the processor, it implements the above-described biometric-based driving access management method.

[0013] To achieve the above objectives, another aspect of the embodiments of this application proposes a computer-readable storage medium storing a computer program that, when executed by a processor, implements the above-described biometric-based driving access management method.

[0014] The embodiments of this application include at least the following beneficial effects: This application provides a driving permission management method, device, and medium based on biometric verification. This scheme collects facial features, voiceprint data, and driving behavior data by detecting the current driver's startup operation. Using "getting in and closing the door" as the key trigger point, it initiates multimodal biometric recognition without manual operation, adapting to the scenario-based needs before driving. The scheme utilizes the established multimodal biometric recognition algorithm to determine whether the current driver's identity has been successfully identified. It employs a dual-modal fusion scheme of facial recognition and voiceprint recognition to compensate for the reliability deficiencies of single facial recognition in scenarios such as occlusion, makeup changes, and complex lighting, thereby improving the accuracy of identity verification. Accuracy and anti-counterfeiting capabilities: When the current driver's identity is successfully verified, the driving account is identified to determine whether the user has the necessary permissions. This breaks through the limitations of existing technologies that only associate with entertainment account permissions, establishing a binding relationship between "driver identity - account - function permissions" to achieve precise matching between intelligent driving permissions and driver qualifications. Based on the permission verification results, the open status of intelligent driving functions is dynamically controlled. If permissions are granted, the functions are automatically ready; if permissions are not granted, the functions are locked and a clear prompt is given. This avoids the security risks of "using before learning" from the source, reduces the security risks caused by the abuse of assisted driving functions, continuously strengthens the driving safety defense line, and enhances users' recognition and stickiness to the assisted driving system. Attached Figure Description

[0015] Figure 1 This is a flowchart of a driving access management method based on biometric verification provided in an embodiment of this application; Figure 2 This is a schematic diagram of the hardware structure framework of the vehicle control device provided in the embodiments of this application. Detailed Implementation

[0016] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to limit it. In the following description, when referring to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with those of this application; they are merely examples of apparatuses and methods consistent with some aspects of the embodiments of this application as detailed in the appended claims.

[0017] It is understood that the terms "first," "second," etc., used in this application may be used to describe various concepts herein, but unless otherwise specified, these concepts are not limited by these terms. These terms are only used to distinguish one concept from another. For example, without departing from the scope of embodiments of this application, Ethernet signaling information may also be referred to as interface signaling information, and similarly, interface signaling information may also be referred to as Ethernet signaling information. Depending on the context, the words "if" or "when" as used herein may be interpreted as "when," "in response to a determination," or "in the event of a determination."

[0018] As used in this application, the terms "at least one", "multiple", "each", "any", etc., "at least one" includes one, two or more, "multiple" includes two or more, "each" refers to each of the corresponding multiples, and "any" refers to any one of the multiples.

[0019] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0020] In some embodiments of one aspect of the present invention Figure 1 This is an optional flowchart of the driving access management method based on biometric verification provided in the embodiments of this application. Figure 1 The method may include, but is not limited to, steps S100 to S400.

[0021] Step S100: Detect the current driver's start operation, generate a trigger command based on the start operation, and collect facial features, voiceprint data, and driving behavior data based on the trigger command.

[0022] Step S200: Using the established multimodal biometric algorithm, facial features and voiceprint data are fused for matching and verification, and the identity of the current driver is determined based on driving behavior data.

[0023] Step S300: When it is confirmed that the current driver's identity has been successfully identified, the driving account corresponding to the current driver is determined according to the matching result, and the driving account is used to determine whether the driver has the right to use the combined driving assistance function.

[0024] In step S400, when it is determined that there is no permission to use the combined driving assistance function, the combined driving assistance function is locked, and the core display carrier displays a permission restriction prompt message.

[0025] Steps S100 to S400, as illustrated in this embodiment, detect the current driver's start-up operation to collect facial features, voiceprint data, and driving behavior data. Using "getting in and closing the door" as the key trigger point, multimodal biometric recognition is initiated, eliminating the need for manual operation and adapting to pre-driving scenario requirements. The multimodal biometric recognition algorithm determines whether the current driver's identity has been successfully identified. A dual-modal fusion scheme of facial and voiceprint recognition is employed to compensate for the reliability deficiencies of single facial recognition in scenarios with occlusion, makeup changes, and complex lighting, thereby improving the accuracy and anti-forgery capabilities of identity verification. When it is determined that the current driver... When the driver's identity is successfully verified, the driving account is determined to determine whether the user has the necessary permissions. This breaks through the limitations of existing technologies that only associate with entertainment account permissions, establishing a binding relationship between "driver identity - account - function permissions" to achieve precise matching between intelligent driving permissions and driver qualifications. Based on the permission verification results, the open status of intelligent driving functions is dynamically controlled. If the user has the necessary permissions, the function is automatically ready; if not, the function is locked and a clear prompt is given. This avoids the safety risks of "using before learning" from the source, reduces the safety risks caused by the abuse of assisted driving functions, continuously strengthens the driving safety defense line, and enhances users' recognition and stickiness to the assisted driving system.

[0026] In some embodiments of S100, the startup operation triggered by the current driver entering the vehicle is detected, and based on the startup operation, it is determined whether a triggering condition exists. If so, a triggering command is generated, and based on the triggering command, the multimodal recognition module is activated, and the driver's facial features, voiceprint data, and driving behavior data are collected through the in-vehicle acquisition components. The display carrier displays a progress prompt of "Account login in progress".

[0027] The trigger condition is that the driver unlocks the vehicle, gets in, closes the door, and fastens the seat belt.

[0028] In this embodiment, facial features can be collected through a DMS camera, voiceprint data can be collected through an in-vehicle microphone, and driving behavior data can be collected through a steering wheel pressure sensor, a driver's eye tracking module, and in-vehicle sensor components.

[0029] Using "getting on the bus and closing the door" as the key trigger point, multimodal biometrics such as facial recognition and voiceprint recognition are activated, and the algorithm completes the matching and verification of identity and account.

[0030] In some embodiments of S200, the multimodal biometric algorithm is used to fuse and analyze facial features and voiceprint data, and then, with the assistance of driving behavior data, the identity of the current driver is matched and verified to obtain a matching result. Based on the matching result, the identity of the current driver is identified, and it is determined whether the identification is successful, thus completing the identity matching verification.

[0031] In some embodiments of S300, the identity of the current driver is identified. If the identification is successful, it is assumed that the current driver has a driving account. Based on the matching result, the current driver's driving account is determined, and the driver is automatically logged into the driving account to enter the account permission verification process.

[0032] Based on the driving account, the system calls the database associated with the set account permissions to query the permission information of the currently logged-in account and determine whether the account has the permission to use the combined driving assistance functions.

[0033] By accurately linking driver identity and account through multimodal biometrics, it can quickly verify whether the account has the right to use combined driving assistance functions, avoiding the risk of novice drivers or non-owners using the functions before they have learned them; it strengthens the driving safety defense line from a technical perspective and improves the safety and standardization of the use of assisted driving functions.

[0034] In some embodiments of S400, when it is determined that there is no permission to use the combined driving assistance functions, the driving assistance functions of the current vehicle are locked. The core display carrier renders and displays a prompt message indicating the permission restriction.

[0035] The permission restriction message is: There is no permission to use the combined driving assistance function during this driving journey. If you wish to use the combined driving assistance function, please complete the learning process before using the relevant intelligent driving function.

[0036] The auxiliary display device simplifies the above prompts and renders the simplified information to avoid distracting the driver. For example, the head-up display system may display: "There is currently no permission to use combined driver assistance functions during this driving trip."

[0037] In one embodiment, a multi-terminal collaborative display mode is adopted. The core display carriers include, but are not limited to, the in-vehicle central control screen and the instrument panel, while the auxiliary display carriers include, but are not limited to, the HUD head-up display system and remote screens. The core display carriers will display the identity recognition progress, permission matching results, and function activation status in real time; the instrument panel will push account and permission adjustment prompts; the HUD in the auxiliary display carriers will simplify the display of core information while driving, displaying simplified information to avoid distracting the driver's attention.

[0038] In some embodiments of this invention, in S100, the process of generating the trigger instruction specifically includes the following steps: S110, in response to the vehicle unlocking command, detects the vehicle seating action, door closing action and seat belt triggering operation one by one according to the vehicle unlocking command.

[0039] S120 determines whether the triggering conditions are met based on the vehicle seating action, door closing action, and seat belt triggering operation.

[0040] S130: When the triggering conditions are determined, a triggering command is generated.

[0041] In this embodiment, the triggering condition is the key node of the driver getting into the vehicle, specifically including: the driver unlocking the vehicle, getting into the seat, closing the door, and fastening the seat belt.

[0042] The system responds to vehicle unlock commands, which activate in-vehicle detection components to monitor seat, door, and seatbelt status. Vehicle unlock commands can be generated remotely or via a vehicle unlock button; this embodiment does not impose any restrictions.

[0043] The system detects the status of the vehicle seats, doors, and seat belts to sequentially detect actions such as seating, door closing, and seat belt activation. Therefore, the activation actions are the seating, door closing, and seat belt activation actions.

[0044] The system detects whether a vehicle is being seated based on the seat status. If so, it detects whether a door is closing based on the door status. Once the door is confirmed to be closed, it checks whether a seatbelt trigger operation is detected based on the seatbelt status. If a seatbelt trigger operation is detected, the trigger condition is considered to have been met, thus achieving step-by-step detection.

[0045] When the triggering conditions are determined, a trigger command is generated, which automatically activates multimodal recognition and begins to collect facial images and voiceprint data. The core display carrier displays the progress prompts for account login.

[0046] The S110 to S130 systems initiate the identification process based on trigger conditions, using multimodal biometric technology to confirm the driver's identity, and then querying the permission database to match their access rights to the combined driving assistance functions. Taking "getting into the vehicle and closing the door" as the key trigger point, multimodal biometric recognition, including facial and voiceprint recognition, is initiated. Algorithms verify the match between the driver's identity and the account. Then, based on the database linking accounts and permissions, the system queries and determines whether the account has permission to use the combined driving assistance functions. This ultimately forms a coherent logic of identity recognition, account login, permission verification, and the availability of combined driving assistance functions, ensuring that these functions are only accessible to authorized drivers, achieving dual control over compliance and safety.

[0047] In some embodiments of this invention, in step S200, the matching verification process specifically includes the following steps: S210 extracts features from facial features, voiceprint data, and driving behavior data to obtain facial feature vectors, voiceprint embedding vectors, and behavioral pattern fingerprints.

[0048] S220: Based on facial feature vectors and voiceprint embedding vectors, a multimodal biometric fusion strategy is used to initially determine identity.

[0049] S230 performs dynamic time-normalized matching of behavioral pattern fingerprints with historical behavioral patterns, re-determines identity, and outputs the matching result to determine whether the recognition was successful.

[0050] In this embodiment, a 128-dimensional feature vector, including facial key points and textures, is extracted based on facial features to obtain a facial feature vector. Based on the voiceprint data, speech spectrum features are extracted to generate a voiceprint embedding vector.

[0051] Based on driving behavior data, temporal features such as steering habits and / or acceleration / deceleration habits are extracted to construct behavioral pattern fingerprints.

[0052] For example, a deep learning model (such as FaceNet) can be used to extract 128-dimensional features such as facial key points and textures into vectors, thereby obtaining a facial feature vector; speech spectrum features can be extracted using the MFCC algorithm, and voiceprint embedding vectors can be generated by combining x-vector or ECAPA-TDNN model.

[0053] The facial feature vector and voiceprint embedding vector are normalized, and a multimodal biometric fusion strategy is adopted to generate a comprehensive biometric template. The template is then matched using the established driver template library to preliminarily determine the identity of the current driver.

[0054] The behavioral pattern fingerprint is dynamically time-normalized and matched with the historical behavioral pattern. If the similarity between the two behaviors is higher than the set threshold, the identity of the current driver is determined again.

[0055] In another embodiment, if the initial biometric matching is successful, but the behavioral pattern fails the subsequent verification, a secondary verification can be triggered.

[0056] Based on the initial identity determination and the results of the second identification, the system outputs the current driver's identification and matching result, and determines whether the identification was successful, thus completing the identity matching verification. In some embodiments of this invention, in step S300, the process of determining the driver's account includes: S310: Based on the matching results, determine the current driver's identity, and based on the driver's identity, determine the driving account.

[0057] S320, based on the driver's account, calls the database again to query the set account permission association to determine the usage permissions.

[0058] In this embodiment, the current driver's identity is determined by the matching results, and the current driver's driving account is determined based on the current driver's identity. The driver's account is then automatically logged in, and the account permission verification process begins.

[0059] Based on the driving account, the system calls the database associated with the set account permissions to query the permission information of the currently logged-in account and determine whether the account has the permission to use the combined driving assistance functions.

[0060] In this application, a database linking driver accounts and combined driving assistance permissions is constructed, namely, the database linking account permissions. At the data level, the driver's permission information is stored and managed through the account system, supporting permission query and verification.

[0061] In some embodiments of this invention, the determination result of whether the identification was successful also includes: S301: When it is confirmed that the current driver's identity recognition fails, the system will retain the currently logged-in account on the vehicle system, and the core display carrier will display a recognition failure message.

[0062] In this embodiment, if the current driver's identity does not have a corresponding driving account and identity recognition fails, the current login status of the vehicle is detected. Based on the current login status, the operation of retaining the currently logged-in account of the vehicle system is performed, and at the same time, the core display carrier displays a prompt message indicating recognition failure.

[0063] Specifically, if the current driver's identity does not have a corresponding driving account and identity verification fails, the current login status of the entire vehicle is checked. Based on the current login status, if the vehicle system has a previously logged-in account, the logged-in account is maintained for driving. If no previously logged-in account is present, the vehicle remains logged out for driving.

[0064] In some embodiments of this invention, the result of the permission determination also includes: S401, when it is determined that there is permission to use the combined driving assistance function, a permission confirmation request is generated. Based on the permission confirmation request, the corresponding combined driving assistance function is activated and enters the function enabled state.

[0065] In this embodiment, when the database is associated with the set account permissions and it is determined that the current driving account has permission to use the combined driving assistance function, a permission confirmation request is generated. The permission confirmation is completed in the background. Based on the permission confirmation request, the combined driving assistance function is activated, driving the corresponding combined driving assistance function into the function-enabled state, and the current driver can use the combined driving assistance related functions normally. There are no special pop-up prompts on the core display carrier and the auxiliary display carrier.

[0066] The following is a detailed description and explanation of the solutions in the embodiments of the present invention, in conjunction with specific scenarios: Scenario 1: Reliability defects and lack of permission binding in single-modal facial recognition User profile: User A has completed the intelligent driving test (account has combined driving assistance permissions), habitually wears a mask during commuting, and wears light makeup at work, but wears heavy makeup when attending events on weekends.

[0067] With this invention, when user A gets into the car, sits down, closes the door, and fastens the seatbelt, a start operation is initiated, generating a trigger command. User A logs into their personal account, the vehicle activates facial recognition, triggering multimodal recognition of face and voiceprint. Based on the established account permission database, identity authentication is completed, and the access permissions for combined driving assistance functions, namely "intelligent driving," are automatically associated. User A can seamlessly log in to their account and obtain intelligent driving permissions without multiple operations, enhancing the user's driving experience.

[0068] Scenario 2: Risk of abuse of intelligent driving privileges due to the lack of an information recognition system User profile: User B has completed the combined driving assistance function course and exam; their family member User C has not completed the intelligent driving course and exam. The two share a car.

[0069] Existing technology: Vehicles lack driver recognition functionality. By default, once the owner completes the course and exam for the combined driving assistance functions, full intelligent driving permissions are granted to the vehicle. This means all users can access all intelligent driving functions when using the vehicle. When family member C was driving alone, they confidently used the combined driving assistance functions. However, due to a lack of training and unfamiliarity with the function's operation logic and the risks associated with existing "intelligent driving" capabilities, they harbored dangerous thoughts such as "intelligent driving can replace human driving; I don't need to do anything after activating it, I can sleep." Their slow response to the system prompting "Please take over the steering wheel" nearly caused a rear-end collision, posing a serious safety hazard. In contrast, this invention addresses this issue: Upon user C entering the vehicle, the system automatically triggers multimodal recognition, confirming their identity through algorithmic matching and matching against the intelligent driving permission database. If user C is found to lack combined driving assistance permissions, the system immediately displays on the central control screen: "No intelligent driving function permissions available; please complete training before use." Simultaneously, the advanced intelligent driving function buttons are locked (physical buttons become unresponsive), mitigating risks at the source.

[0070] This invention aims to construct a precise driver identity matching and intelligent switching mechanism through multimodal biometric recognition technology that integrates facial recognition and voiceprint recognition. It establishes a dynamic management system based on driver qualifications and the access rights to combined driving assistance functions. This system accurately distinguishes the function access rights of different drivers, preventing the safety hazards of novice drivers using advanced driver assistance functions before they have learned them. Simultaneously, it establishes a quantitative assessment and positive incentive mechanism for driving behavior, guiding users to develop standardized usage habits and strengthening drivers' awareness of proper operation through methods such as permission upgrades and unlocking exclusive functions. This reduces the safety risks caused by the abuse of driver assistance functions, continuously strengthens the driving safety defense line, and increases user acceptance and stickiness to the driver assistance system.

[0071] Another embodiment of this application provides a vehicle control device, which includes a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the aforementioned driving access management method based on biometric verification. This vehicle control device can be any smart terminal, including a tablet computer or an in-vehicle computer.

[0072] It is understood that the content of the above method embodiments is applicable to this device embodiment. The specific functions implemented by this device embodiment are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0073] Please see Figure 2 , Figure 2 The hardware structure of a vehicle control device according to another embodiment is illustrated. The vehicle control device includes: The processor can be implemented using a general-purpose CPU (Central Processing Unit), microprocessor, application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to achieve the technical solutions provided in the embodiments of this application. The memory can be implemented in the form of read-only memory (ROM), static storage device, dynamic storage device, or random access memory (RAM). The memory can store the operating system and other applications. When the technical solutions provided in the embodiments of this specification are implemented through software or firmware, the relevant program code is stored in the memory and called and executed by the processor to execute the biometric verification-based driving access management method of the embodiments of this application. Input / output interfaces are used to implement information input and output; The communication interface is used to enable communication and interaction between this device and other devices. Communication can be achieved through wired means (such as USB, Ethernet cable, etc.) or wireless means (such as mobile network, WIFI, Bluetooth, etc.). A bus is used to transfer information between various components of a device, such as processors, memory, input / output interfaces, and communication interfaces. The processor, memory, input / output interfaces, and communication interfaces communicate with each other within the device via a bus.

[0074] This invention also provides a vehicle that includes the driving permission management method based on biometric verification described above.

[0075] The vehicle can be a private car, such as a sedan, SUV, MPV, or pickup truck. It can also be a commercial vehicle, such as a van, bus, small truck, or large semi-trailer. The vehicle must have an electric motor capable of outputting power or acting as a generator to store mechanical energy. When the vehicle is a new energy vehicle, it can be a hybrid or a pure electric vehicle.

[0076] Since the vehicle applies all the technical solutions of the above-described vehicle control device, it has at least all the beneficial effects brought about by the technical solutions of the above embodiments, which will not be repeated here.

[0077] Another embodiment of the present invention provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the above-described biometric-based driving access management method.

[0078] It is understood that the content of the above method embodiments is applicable to this storage medium embodiment. The specific functions implemented in this storage medium embodiment are the same as those in the above method embodiments, and the beneficial effects achieved are also the same as those achieved in the above method embodiments.

[0079] Memory, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs and non-transitory computer-executable programs. Furthermore, memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, memory may optionally include memory remotely located relative to the processor, and these remote memories can be connected to the processor via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

[0080] The embodiments described in this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided by the embodiments of this application. As those skilled in the art will know, with the evolution of technology and the emergence of new application scenarios, the technical solutions provided by the embodiments of this application are also applicable to similar technical problems.

[0081] Those skilled in the art will understand that the technical solutions shown in the figures do not constitute a limitation on the embodiments of this application, and may include more or fewer steps than shown, or combine certain steps, or different steps.

[0082] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0083] Those skilled in the art will understand that all or some of the steps in the methods disclosed above, as well as the functional modules / units in the systems and devices, can be implemented as software, firmware, hardware, or suitable combinations thereof.

[0084] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms “comprising” and “having,” and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0085] It should be understood that in this application, "at least one (item)" means one or more, and "more than" means two or more. "And / or" is used to describe the relationship between related objects, indicating that three relationships can exist. For example, "A and / or B" can represent three cases: only A exists, only B exists, and both A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one (item) of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (item) of a, b, or c can represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.

[0086] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0087] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0088] The preferred embodiments of the present application have been described above with reference to the accompanying drawings, but this does not limit the scope of the claims of the present application. Any modifications, equivalent substitutions, and improvements made by those skilled in the art without departing from the scope and substance of the embodiments of the present application shall be within the scope of the claims of the present application.

Claims

1. A driving access management method based on biometric verification, characterized in that, The method includes: The system detects the current driver's startup operation, generates a trigger command based on the startup operation, and collects facial features, voiceprint data, and driving behavior data based on the trigger command. The multimodal biometric algorithm is used to fuse facial features and voiceprint data for matching and verification, and the identity of the current driver is determined based on the driving behavior data. When the current driver's identity is successfully identified, the driving account corresponding to the current driver is determined based on the matching result, and the driving account is used to determine whether the driver has the right to use the combined driving assistance functions. If it is determined that there is no permission to use the combined driving assistance function, the combined driving assistance function will be locked, and the core display will show a permission restriction message.

2. The driving access management method based on biometric verification according to claim 1, characterized in that, The detection of the current driver's initiation operation, and the generation of a trigger command based on the initiation operation, include: In response to the vehicle unlocking command, the vehicle seat entry action, door closing action and seat belt triggering operation are detected one by one according to the vehicle unlocking command; Based on the vehicle seating action, the door closing action, and the seat belt triggering operation, determine whether a triggering condition has been formed; When the triggering condition is determined to be met, the triggering instruction is generated.

3. The driving access management method based on biometric verification according to claim 1, characterized in that, The process of fusing the facial features and voiceprint data for matching and verification includes: Feature extraction is performed on the facial features, the voiceprint data, and the driving behavior data to obtain facial feature vectors, voiceprint embedding vectors, and behavior pattern fingerprints. Based on the facial feature vector and the voiceprint embedding vector, a multimodal biometric fusion strategy is used to preliminarily determine the identity. The behavioral pattern fingerprint is dynamically time-normalized and matched with historical behavioral patterns to determine the identity again, and the matching result is output to determine whether the recognition is successful.

4. The driving access management method based on biometric verification according to claim 1, characterized in that, Based on the matching results, the driving account corresponding to the current driver is determined, including: Based on the matching results, the current driver's identity is determined, and based on the driver's identity, the driving account is determined; Based on the driving account, the system calls the database associated with the set account permissions to determine the usage permissions.

5. The driving access management method based on biometric verification according to claim 1, characterized in that, The determination of whether the current driver's identity has been successfully identified also includes: If the current driver's identity recognition fails, the system will retain the currently logged-in account on the vehicle's infotainment system, while the core display will show a recognition failure message.

6. The driving access management method based on biometric verification according to claim 1, characterized in that, The determination of whether one has permission to use the combined driving assistance functions also includes: Once it is determined that there is permission to use the combined driving assistance function, a permission confirmation request is generated. Based on the permission confirmation request, the corresponding combined driving assistance function is activated, and the corresponding combined driving assistance function enters the function enabled state.

7. The driving access management method based on biometric verification according to claim 1, characterized in that, The method further includes: The core display carrier displays the identity recognition progress, permission matching results, and function activation status in real time, while the auxiliary display carrier simplifies and renders the identity recognition progress, permission matching results, and function activation status.

8. The driving permission management method based on biometric verification according to claim 5, wherein the step of retaining the currently logged-in account on the vehicle system includes: If identity verification fails, check the current login status; Based on the current login status, if it is determined that there is already a logged-in account, then the logged-in account will be maintained. Based on the current login status, if it is determined that there is no logged-in account, the login status will remain unchanged.

9. A vehicle control device, characterized in that, The device includes a memory, a processor, and a program stored in the memory and executable on the processor, wherein the program, when executed by the processor, implements the biometric verification-based driving access management method as described in any one of claims 1 to 8.

10. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it implements the driving access management method based on biometric verification as described in any one of claims 1 to 8.

Images