Face check-in method, system and device, intelligent device and storage medium

Abstract

The application is suitable for the technical field of intelligent sign-in, and provides a face sign-in method, system and device, intelligent equipment and a storage medium. The method is applied to a supervision device, and includes: acquiring a face image, vehicle information of a vehicle and identity information of a user, wherein the face image, the vehicle information and the identity information are uploaded after being collected and processed by a mobile device calling a specified application program; verifying whether the user and the vehicle match according to the vehicle information and the identity information; if the user and the vehicle match, updating an image database based on the face image, the vehicle information and the identity information, and the face image stored in the image database is used for face sign-in by a vehicle-mounted device. The method can guarantee the legality and effectiveness of the photo used for face sign-in comparison on the vehicle-mounted device, and further guarantee the timeliness and accuracy of face sign-in.

Description

Facial recognition check-in methods, systems, devices, smart devices, and storage media Technical Field

[0001] This application relates to the field of intelligent check-in technology, and in particular to a facial recognition check-in method, system, device, intelligent device, and storage medium. Background Technology

[0002] Facial recognition for authentication has become widespread, for example, in taxis and other commercial vehicles where it's commonly used for driver check-in. Unlike most mobile facial recognition functions, to ensure the timeliness of in-vehicle facial recognition and considering the complexity of the in-vehicle environment (vehicles may lack internet connectivity or have limited SIM card bandwidth), facial recognition is typically performed locally on the in-vehicle device, rather than uploading facial images to a cloud server for comparison and then sending the results back to the in-vehicle device.

[0003] The so-called local facial recognition refers to the process where the in-vehicle device captures the driver's facial image using a local camera, and then directly compares it with the driver's facial photo stored locally on the in-vehicle device to obtain the comparison result. The result is then used to determine whether the check-in is complete.

[0004] Therefore, ensuring the legality and validity of the photos used for facial recognition check-in on in-vehicle devices, in order to guarantee the timeliness and accuracy of facial recognition check-in, is a problem that needs to be considered. Summary of the Invention

[0005] This application provides a face check-in method, system, device, smart device, and storage medium, which can ensure the legality and validity of photos used for face check-in comparison on vehicle-mounted devices, thereby ensuring the timeliness and accuracy of face check-in.

[0006] In a first aspect, embodiments of this application provide a facial recognition check-in method, applied to monitoring equipment, including:

[0007] The system acquires facial images, vehicle information, and user identity information. The facial images, vehicle information, and user identity information are collected, processed, and uploaded by a mobile device using a designated application.

[0008] Based on the vehicle information and the identity information, verify whether the user and the vehicle are a match;

[0009] If a match is found, the image database is updated based on the face image, the vehicle information, and the identity information. The face images stored in the image database are used by the in-vehicle device for face check-in.

[0010] In one possible implementation of the first aspect, the facial recognition check-in method further includes:

[0011] Obtain the information download request sent by the vehicle-mounted device, wherein the information download request carries target vehicle information;

[0012] Determine the facial image corresponding to the target vehicle information;

[0013] The facial image corresponding to the target vehicle information is sent to the in-vehicle device.

[0014] In one possible implementation of the first aspect, the designated application includes a first designated application and a second designated application;

[0015] The facial image, the identity information, and the vehicle information are collected, processed, and uploaded by the mobile device using a designated application, including:

[0016] The mobile device acquires scan information of a preset image at a designated location of an in-vehicle device in the vehicle. The scan information includes vehicle information and information collection and processing instructions. Based on the information collection and processing instructions, the first designated application is invoked to collect a facial image. The second designated application is invoked to verify the collected facial image. If the verification is successful, the facial image, the vehicle information, and the identity information verified by the second designated application are uploaded to the monitoring device.

[0017] In one possible implementation of the first aspect, if a match is found, updating the image database based on the face image, the vehicle information, and the identity information includes:

[0018] If a match is found, the face image, the vehicle information, and the identity information are bound together and stored in the image database.

[0019] Update the information version number of the user corresponding to the identity information.

[0020] Secondly, embodiments of this application provide a facial recognition check-in method, applied to a mobile device, including:

[0021] The scanning information of a preset image at a designated location of an onboard device in a vehicle is acquired. The scanning information includes vehicle information and information acquisition and processing instructions.

[0022] Based on the information collection and processing instructions, the specified application is invoked to collect and process facial images, and the identity information of the user corresponding to the facial image is obtained;

[0023] The facial image, vehicle information, and identity information are uploaded to the monitoring device. The facial image, vehicle information, and identity information are used to update the image database in the monitoring device. The facial images stored in the image database are used by the vehicle-mounted device for facial check-in.

[0024] In one possible implementation of the second aspect, the designated application includes a first designated application and a second designated application;

[0025] The step of invoking a specified application to collect and process facial images based on the information collection and processing instruction, and obtaining the identity information of the user corresponding to the facial images, includes:

[0026] Based on the information collection and processing instructions, the first designated application is invoked to collect facial images;

[0027] The second specified application is invoked to authenticate the collected face image;

[0028] If the authentication is successful, the user's identity information in the second specified application is obtained.

[0029] Thirdly, embodiments of this application provide a facial recognition check-in system, including: a mobile device, a monitoring device, and an in-vehicle device, wherein:

[0030] The mobile device is used to acquire scanning information of a preset image at a designated location of an in-vehicle device in the vehicle. The scanning information includes vehicle information and information collection and processing instructions. Based on the information collection and processing instructions, a designated application is invoked to collect a facial image and obtain the identity information of the user corresponding to the facial image. The facial image, the vehicle information, and the identity information are then uploaded to the monitoring device.

[0031] The monitoring device is used to verify whether the user and the vehicle match based on the vehicle information and the identity information; if they match, the image database is updated based on the facial image, the vehicle information, and the identity information.

[0032] The vehicle-mounted device is used to capture a target face image, match and compare the target face image with a pre-stored face image locally, the pre-stored face image is downloaded from the image database of the monitoring device to the local device, and the check-in result is determined based on the matching and comparison result.

[0033] Fourthly, embodiments of this application provide a facial recognition check-in device, applied to monitoring equipment, comprising:

[0034] The information acquisition unit is used to acquire facial images, vehicle information, and user identity information. The facial images, vehicle information, and identity information are collected, processed, and uploaded by a mobile device calling a designated application.

[0035] An image verification unit is used to verify whether the user matches the vehicle based on the vehicle information and the identity information.

[0036] The first face check-in unit is used to update the image database based on the face image, the vehicle information, and the identity information if a match is found. The face images stored in the image database are used by the in-vehicle device for face check-in.

[0037] Fifthly, embodiments of this application provide an intelligent device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the facial recognition check-in method as described in the first aspect above.

[0038] Sixthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the face check-in method as described in the first or second aspect above.

[0039] In a seventh aspect, embodiments of this application provide a computer program product that, when run on a smart device, causes the smart device to execute the face check-in method as described in the first or second aspect above.

[0040] In this embodiment, the monitoring device acquires facial images, vehicle information, and identity information uploaded after being collected and processed by a designated application called by a mobile device. Based on the vehicle information and the identity information, it verifies whether the user matches the vehicle, which can effectively ensure the legality and validity of the facial image. If the user matches the vehicle, the image database is updated based on the facial image, the vehicle information, and the identity information. The facial images stored in the image database are used for facial check-in by the in-vehicle device. This application can ensure the legality and validity of the photos used for facial check-in locally by the in-vehicle device, and can also ensure the timeliness and accuracy of local facial check-in by the in-vehicle device. Attached Figure Description

[0041] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0042] Figure 1 is a system architecture diagram of a face check-in system provided in an embodiment of this application;

[0043] Figure 2 is a flowchart illustrating the implementation of the facial recognition check-in method on the monitoring device side provided in this embodiment of the application.

[0044] Figure 3 is a flowchart of a specific implementation of step S103 in the face check-in method on the monitoring device side provided in the embodiment of this application;

[0045] Figure 4 is a flowchart illustrating a specific implementation of the face image distribution method in the monitoring device-side face check-in method provided in this embodiment of the application.

[0046] Figure 5 is a flowchart illustrating the implementation of the mobile device-side face check-in method provided in this application embodiment;

[0047] Figure 6 is a flowchart of a specific implementation of step S202 in the mobile device-side face check-in method provided in the embodiments of this application;

[0048] Figure 7 is a structural block diagram of a face check-in device provided in an embodiment of this application;

[0049] Figure 8 is a structural block diagram of another face check-in device provided in an embodiment of this application;

[0050] Figure 9 is a schematic diagram of the smart device provided in an embodiment of this application. Detailed Implementation

[0051] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.

[0052] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.

[0053] It should also be understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0054] As used in this application specification and the appended claims, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrase "if determined" or "if detected [the described condition or event]" may be interpreted, depending on the context, as meaning "once determined," "in response to determination," "once detected [the described condition or event]," or "in response to detection [the described condition or event]."

[0055] Furthermore, in the description of this application and the appended claims, the terms "first," "second," "third," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0056] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0057] Facial recognition has become widely used for driver check-in in taxis and other commercial vehicles. To ensure the timeliness of facial recognition on the in-vehicle device and to take into account the complexity of the in-vehicle environment, facial recognition is usually performed locally on the in-vehicle device. However, this raises the question of how to ensure the legality and validity of the facial images used for comparison locally on the in-vehicle device, as well as the timeliness and accuracy of facial check-in.

[0058] Current technology involves regulatory authorities organizing drivers to have their photos taken and uploaded to a platform, or drivers submitting their own photos to the regulatory authorities, who then upload them to the platform. The in-vehicle device connects to the platform and downloads the driver's photo locally. However, organizing drivers to take photos offline is time-consuming and labor-intensive, while voluntary driver submissions may fail to meet requirements, significantly reducing the effectiveness of facial recognition check-in.

[0059] To address the aforementioned issues, this application provides a facial recognition check-in method, system, device, smart device, and storage medium. Without consuming significant manpower and time, it ensures the legality and validity of photos used for facial recognition check-in comparison on in-vehicle devices, thereby guaranteeing the timeliness and accuracy of facial recognition check-in. See the following description for details.

[0060] Figure 1 shows a system architecture diagram of a face check-in system provided in an embodiment of this application, which is described in detail below: For ease of explanation, only the parts related to the embodiments of the present invention are shown.

[0061] Referring to Figure 1, the facial recognition check-in system includes a mobile device 1, a monitoring device 2, and a vehicle-mounted device 3, wherein:

[0062] The mobile device 1 is used to acquire scanning information of a preset image at a specified location of the vehicle-mounted device 3, the scanning information including vehicle information and information collection and processing instructions; based on the information collection and processing instructions, call a specified application to collect a face image and obtain the identity information of the user corresponding to the face image; and upload the face image, the vehicle information and the identity information to the monitoring device 2.

[0063] The monitoring device 2 is used to verify whether the user and the vehicle match based on the vehicle information and the identity information; if they match, the image database is updated based on the facial image, the vehicle information, and the identity information.

[0064] The vehicle-mounted device 3 is used to capture the target face image, match and compare the target face image with the pre-stored face image locally. The pre-stored face image is downloaded from the image database of the monitoring device 2 to the local device, and the check-in result is determined based on the matching and comparison result.

[0065] In one possible implementation of this application, the vehicle-mounted device 3 sends an information download request to the monitoring device 2, requesting a facial image corresponding to the target vehicle information, as well as vehicle information, user identity information, and the user's usage time period. The facial image, vehicle information, user identity information, and user usage time period are stored locally. After capturing the target facial image, the target facial image is matched and compared with locally stored facial images, and it is verified whether the current time falls within the user's usage time period.

[0066] In this embodiment, the same vehicle may correspond to multiple users, and different users may use the vehicle for different periods. The on-board device 3 verifies whether the target face image matches the local face image, and also verifies whether the current time is within the user's usage period. If the target face image matches the local face image and the current time is within the user's usage period, then the user's check-in is confirmed as successful. If the target face image does not match the local face image, or if the current time is not within the user's usage period (the user's check-in time has not yet arrived), then the user's check-in is confirmed as failed.

[0067] In this embodiment, the monitoring device 2 is a smart device applied to the monitoring platform. Mobile devices 1 include, but are not limited to, mobile phones, laptops, tablets, smart wearable devices, and other mobile devices with communication capabilities. Mobile devices 1 and vehicle-mounted devices 3 can be wirelessly connected to the monitoring device 2 for remote communication. The monitoring device 2 can communicate with multiple mobile devices 1 and multiple vehicle-mounted devices 3.

[0068] In this embodiment, the mobile device 1 acquires scanning information of a preset image at a designated location of the vehicle-mounted device 3. Based on the information collection and processing instructions in the scanning information, a designated application is invoked to collect a facial image and obtain the identity information of the user corresponding to the facial image to ensure consistency between the facial image and the identity information. Then, the facial image, vehicle information from the scanning information, and the identity information are uploaded to the monitoring device 2. The monitoring device 2 verifies whether the user and the vehicle match based on the vehicle information and the identity information. This eliminates the need for manual facial collection and verification, saving manpower and time. If the user and the vehicle match, the image database is updated based on the facial image, vehicle information, and identity information, thereby ensuring the legality and validity of the facial images stored in the image database. The vehicle-mounted device 3 downloads the facial image from the image database of the monitoring device 2 and stores it locally. Then, by capturing a target facial image, the target facial image is matched and compared with the locally stored facial image. The check-in result is determined based on the matching and comparison result, which effectively ensures the timeliness and accuracy of check-in, improves the efficiency of facial check-in, and enhances the user experience.

[0069] Figure 2 illustrates the implementation flow of the face check-in method provided in this application embodiment. The method flow includes steps S101 to S103. In this embodiment, the execution subject of the process is the monitoring device 2 shown in Figure 1. The specific implementation principle of each step is as follows:

[0070] Step S101: Obtain a face image, vehicle information, and user identity information. The face image, vehicle information, and user identity information are collected, processed, and uploaded by the mobile device using a designated application.

[0071] The aforementioned monitoring equipment is used by a qualified monitoring platform, and this equipment can be a smart device, a server, etc. In this embodiment, the monitoring platform does not need to organize drivers to collectively take compliant facial images, saving manpower and time.

[0072] The monitoring equipment acquires facial images, vehicle information, and user information uploaded by mobile devices. These images, information, and user data are collected, processed, and uploaded by the user from a designated application accessed by the mobile device. The designated application can utilize the mobile device's camera to capture images.

[0073] As one possible implementation of this application, the designated application includes a first designated application and a second designated application; the step of uploading the aforementioned face image, identity information, and vehicle information after being collected and processed by the mobile device using the designated application includes:

[0074] The mobile device acquires scanning information of a preset image at a designated location of an in-vehicle device. The preset image is an image containing scannable information, such as a QR code. The scanning information includes vehicle information and an information collection and processing instruction. The information collection and processing instruction is used to launch a specified application. Based on the information collection and processing instruction, a first specified application is invoked to collect a facial image. The first specified application is an application that can use the mobile device's camera to capture a facial image. A second specified application is invoked to authenticate the collected facial image. The second specified application is an application where the user has already completed authentication, such as WeChat or Alipay. If the authentication is successful, the facial image, the vehicle information, and the authentication information obtained by the second specified application are uploaded to the monitoring device.

[0075] In this embodiment, a face image is captured by a mobile device using a first designated application, and the face image captured by the first designated application is authenticated by a second designated application to verify the legality of the face image and confirm that the face in the face image is consistent with the user's identity information. No manual verification is required, which can ensure the validity of the face image uploaded by the mobile device and save the time of manual verification.

[0076] Step S102: Verify whether the user and the vehicle match based on the vehicle information and the identity information.

[0077] The vehicle information includes information that identifies the vehicle, such as license plate information, device ID, and other vehicle-identifying information. The identity information includes information that identifies the user, such as an ID card number. In this embodiment, after obtaining the vehicle information and user information uploaded by the mobile device, the monitoring device verifies whether the vehicle corresponding to the vehicle information matches the user corresponding to the user information, that is, verifies whether the user is the user bound to the vehicle.

[0078] In one possible implementation, the monitoring device pre-stores the correspondence between vehicle information and user identity information. Based on this pre-stored correspondence, it verifies whether the user and the vehicle match according to the vehicle information and the identity information.

[0079] In one possible implementation, the same vehicle may be associated with more than one user.

[0080] In this embodiment, the monitoring device verifies whether the vehicle information uploaded by the mobile device matches the identity information, which can effectively ensure the validity and legality of the uploaded facial image, thereby improving the accuracy and effectiveness of facial check-in.

[0081] Step S103: If a match is found, the image database is updated based on the face image, the vehicle information, and the identity information. The face images stored in the image database are used by the in-vehicle device for face check-in.

[0082] In this embodiment, the image database is used to store facial images, user identity information, and vehicle information, and also includes the correspondence between the facial images, user identity information, and vehicle information.

[0083] As one possible implementation of this application, Figure 3 illustrates a specific implementation in which, if a match is found, the image database is updated based on the face image, the vehicle information, and the identity information, as detailed below:

[0084] A1: If a match is found, the face image, vehicle information, and identity information are bound together and stored in the image database. Binding the face image, vehicle information, and identity information means establishing a correspondence between them.

[0085] A2: Update the information version number of the user corresponding to the identity information.

[0086] In this embodiment, the image database stores vehicle information and user information. The user information includes the user's identity information and the correspondence between the identity information and the vehicle information. When the vehicle information and identity information uploaded by the mobile device match the vehicle information and identity information stored in the image database, the face image uploaded by the mobile device is stored in the image database, and the correspondence between the face image and the vehicle information and the user's identity information in the image database is stored. Based on this, the information version number of the user information is updated.

[0087] For example, the image database only includes user identity information and the correspondence between identity information and vehicle information; the information version number is 0. When a user's facial image is stored in the image database, the correspondence between the facial image and vehicle information and identity information is added to the user information, and the information version number is updated to 1. When the user's facial image in the image database is updated, or the user's corresponding vehicle information is updated, the information version number is also updated.

[0088] In one possible implementation, if the user and vehicle are verified to match, before updating the image database based on the facial image, vehicle information, and identity information, an image validity check is performed on the facial image uploaded by the mobile device. This image validity check determines whether the facial image meets the requirements for facial check-in, for example, by checking whether the image size, the position of the face in the image, and the brightness of the light on the face meet preset facial check-in requirements. After confirming that the facial image passes the image validity check, the image database is then updated based on the facial image, vehicle information, and identity information.

[0089] In some possible implementations, if the image validity check of the face image fails, the face image is subjected to preset processing and then the image validity check is performed again. The preprocessing includes image processing based on the reason for the failure of the first image validity check, such as adjusting the image size, the position of the face in the image, and the brightness of the light on the face. If the check still fails, the face image is reported as unqualified to the mobile device.

[0090] In one possible implementation, if the user and the vehicle are not matched, a verification failure message is sent to the mobile device to inform the user of the verification failure. In some implementations, the verification failure message includes a reason for the failure, such as the vehicle and user not matching, or the matching information having expired.

[0091] As one possible implementation of this application, as shown in Figure 4, the face check-in method further includes:

[0092] B1: Obtain the information download request sent by the vehicle-mounted device, the information download request carrying target vehicle information. The target vehicle information includes the vehicle information of the vehicle where the vehicle-mounted device is located, the license plate number, or the device ID.

[0093] In this embodiment of the application, a connection request from the vehicle-mounted device is obtained, and a communication connection is established with the vehicle-mounted device based on the connection request; based on the communication connection, an information download request sent by the vehicle-mounted device is obtained.

[0094] B2: Determine the facial image corresponding to the target vehicle information.

[0095] Based on the target vehicle information carried in the information download request, the monitoring equipment searches for vehicle information that matches the target vehicle information in the image database, and determines the facial image corresponding to the target vehicle information according to the correspondence between vehicle information, facial image and identity information in the image database.

[0096] B3: Send the facial image corresponding to the target vehicle information to the vehicle-mounted device.

[0097] In this embodiment, the monitoring device is communicatively connected to the vehicle-mounted device, and based on the information download request sent by the vehicle-mounted device, the monitoring device sends the required facial image to the vehicle-mounted device, which is simple and convenient. In some embodiments, the monitoring device also sends user information to the vehicle-mounted device simultaneously.

[0098] In this embodiment, the monitoring device acquires a facial image, vehicle information, and user identity information uploaded after being collected and processed by a designated application on a mobile device. Based on the vehicle information and identity information, it verifies whether the user matches the vehicle, effectively ensuring the legality and validity of the facial image. If the user matches the vehicle, the image database is updated based on the facial image, vehicle information, and identity information. The facial images stored in the image database are used for facial check-in by the in-vehicle device. This application can ensure the legality and validity of photos used locally for facial check-in by the in-vehicle device, and can also ensure the timeliness and accuracy of local facial check-in by the in-vehicle device.

[0099] Figure 5 illustrates the implementation flow of the face check-in method provided in this application embodiment. The method flow includes steps S201 to S203. In this embodiment, the executing entity of the process is the mobile device 1 shown in Figure 1. The specific implementation principle of each step is as follows:

[0100] Step S201: Obtain scanning information of a preset image at a designated location of the vehicle-mounted device, wherein the scanning information includes vehicle information and information acquisition and processing instructions.

[0101] The preset image is an image containing scannable information, such as a QR code image. The vehicle information includes information that identifies the vehicle, such as license plate information, device ID, and other vehicle-identifying information.

[0102] In some implementations, the designated location may be the user interface of an in-vehicle device.

[0103] In this embodiment, the mobile device has a specific scanning function, or an application with scanning capabilities is installed. The user scans a preset image at a designated location on the in-vehicle device using the mobile device to obtain vehicle information and information collection and processing instructions.

[0104] Step S202: Based on the information collection and processing instruction, call the specified application to collect and process the face image, and obtain the identity information of the user corresponding to the face image.

[0105] The information collection and processing instruction is used to launch the specified application.

[0106] For example, the information collection and processing instruction includes a jump link, which can be used to call a specified application to collect and process facial images and obtain the identity information of the user corresponding to the facial image.

[0107] As one possible implementation of this application, the designated application includes a first designated application and a second designated application. Figure 6 illustrates a specific implementation flow in an embodiment of this application, based on the information collection and processing instruction, calling the designated application to collect and process facial images and obtain the identity information of the user corresponding to the facial images, which is detailed below:

[0108] C1: Based on the information collection and processing instruction, invoke the first designated application to collect facial images. The first designated application is an application that can call the camera of a mobile device to capture facial images.

[0109] C2: Invoke the second designated application to authenticate the collected facial image. The second designated application is an application where the user has already completed authentication, and the user's identity information in the second designated application has been verified for legitimacy. For example, the second designated application can be WeChat, Alipay, etc.

[0110] In this embodiment, the second designated application is invoked to authenticate the collected facial image. Specifically, the collected facial image is matched with the facial image of the user who has successfully authenticated on the second designated application. If they match, the user corresponding to the collected facial image is deemed to have successfully authenticated. If they do not match, authentication is deemed to have failed.

[0111] For example, a user pre-verifies their identity using their ID card information in a second designated application, and then compares the captured facial image with the facial image corresponding to the ID card information. If they match, the user's identity verification is confirmed.

[0112] C3: If the authentication is successful, obtain the user's identity information in the second designated application. The identity information includes information that can identify the user, such as an ID card number.

[0113] In this embodiment of the application, the mobile device uses a first designated application to collect facial images and uses a second designated application to authenticate the facial images collected by the first designated application, verifying the legality of the collected facial images and confirming that the face in the facial image is consistent with the user's identity information. No manual verification is required, which can ensure the validity of the facial images uploaded to the monitoring device and save manpower and verification time.

[0114] Step S203: Upload the face image, the vehicle information, and the identity information to the monitoring device. The face image, the vehicle information, and the identity information are used to update the image database in the monitoring device. The face images stored in the image database are used by the vehicle-mounted device for face check-in.

[0115] In this embodiment, the mobile device uploads the facial image, vehicle information, and identity information to the monitoring device to update the image database in the monitoring device. The facial images stored in the image database are used by the in-vehicle device for facial recognition check-in. The monitoring device updates the image database based on the facial image, vehicle information, and identity information only after verifying that the user matches the vehicle based on the vehicle information and identity information.

[0116] In one possible implementation, before uploading the facial image, vehicle information, and identity information to the monitoring device, the facial image uploaded by the mobile device undergoes an image legality check. This check determines whether the facial image meets the requirements for facial check-in, for example, by checking whether the image size, the position of the face within the image, and the brightness of the light on the face meet preset facial check-in requirements. The facial image that passes the image legality check, along with the vehicle information and identity information, is then uploaded to the monitoring device.

[0117] In some possible implementations, if the image validity check of the face image fails, the face image is subjected to preset processing before undergoing the image validity check again. The preprocessing includes image processing based on the reason for the initial failure of the image validity check, such as adjusting the image size, the position of the face in the image, and the brightness of the light on the face. If the check still fails, the user is prompted that the current face image is unqualified.

[0118] In this embodiment, the mobile device acquires scanning information of a preset image at a designated location on an in-vehicle device. This scanning information includes vehicle information and information collection and processing instructions. Based on these instructions, a designated application is invoked to collect and process a facial image, obtaining the user's identity information corresponding to the facial image. This ensures the authenticity and consistency of the facial image and identity information. The facial image, vehicle information, and identity information are then uploaded to a monitoring device. These elements are used to update the image database on the monitoring device. The monitoring device updates the image database based on these elements only after verifying a match between the user and the vehicle. The facial images stored in the image database are used for facial check-in on the in-vehicle device. This solution ensures the legality and validity of the photos used for facial check-in comparison on the in-vehicle device, thereby guaranteeing the timeliness and accuracy of facial check-in.

[0119] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0120] Corresponding to the face check-in method described in the above embodiments, Figure 7 shows a structural block diagram of a face check-in device provided in this application embodiment. This face check-in device is applied to a monitoring device. For ease of explanation, only the parts related to this application embodiment are shown.

[0121] Referring to Figure 7, the facial recognition check-in device includes: an information acquisition unit 71, an image verification unit 72, and a first check-in unit 73, wherein:

[0122] The information acquisition unit 71 is used to acquire facial images, vehicle information, and user identity information. The facial images, vehicle information, and identity information are collected, processed, and uploaded by a mobile device calling a designated application.

[0123] Image verification unit 72 is used to verify whether the user and the vehicle match based on the vehicle information and the identity information;

[0124] The first check-in unit 73 is used to update the image database based on the face image, the vehicle information, and the identity information if a match is found. The face images stored in the image database are used by the vehicle-mounted device for face check-in.

[0125] As one possible implementation of this application, the above-mentioned face check-in device further includes:

[0126] The download request acquisition unit is used to acquire the information download request sent by the vehicle-mounted device, wherein the information download request carries target vehicle information;

[0127] An image determination unit is used to determine the face image corresponding to the target vehicle information;

[0128] The image distribution unit is used to distribute the facial image corresponding to the target vehicle information to the vehicle-mounted device.

[0129] As one possible implementation of this application, the specified application includes a first specified application and a second specified application; the information acquisition unit 71 is specifically used for:

[0130] The mobile device acquires scan information of a preset image at a designated location of an in-vehicle device in the vehicle. The scan information includes vehicle information and information collection and processing instructions. Based on the information collection and processing instructions, the first designated application is invoked to collect a facial image. The second designated application is invoked to verify the collected facial image. If the verification is successful, the facial image, the vehicle information, and the identity information verified by the second designated application are uploaded to the monitoring device.

[0131] As one possible implementation of this application, the first check-in unit 73 includes:

[0132] An information binding and storage module is used to bind the face image, the vehicle information, and the identity information and store them in the image database if a match is found.

[0133] The data update module is used to update the information version number of the user corresponding to the identity information.

[0134] Figure 8 shows a structural block diagram of a face check-in device provided in an embodiment of this application. The face check-in device is applied to a mobile device. For ease of explanation, only the parts related to the embodiment of this application are shown.

[0135] Referring to Figure 8, the facial recognition check-in device includes: an information scanning unit 81, an information collection unit 82, and a second facial recognition check-in unit 83, wherein:

[0136] The information scanning unit 81 is used to acquire scanning information of a preset image at a designated location of an on-board device in the vehicle. The scanning information includes vehicle information and information acquisition and processing instructions.

[0137] The information acquisition unit 82 is used to call a specified application to acquire and process a face image based on the information acquisition and processing instruction, and to obtain the identity information of the user corresponding to the face image;

[0138] The second facial recognition check-in unit 83 uploads the facial image, vehicle information, and identity information to the monitoring device. The facial image, vehicle information, and identity information are used to update the image database in the monitoring device. The facial images stored in the image database are used by the vehicle-mounted device for facial recognition check-in.

[0139] As one possible implementation of this application, the designated application includes a first designated application and a second designated application; the information acquisition unit 82 includes:

[0140] The image acquisition module is used to call the first specified application to acquire a face image based on the information acquisition and processing instruction;

[0141] An authentication module is used to call the second specified application to authenticate the collected face image;

[0142] The identity information acquisition module is used to acquire the user's identity information in the second specified application if the identity verification is successful.

[0143] It should be noted that the information interaction and execution process between the above-mentioned devices / units are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, and they will not be repeated here.

[0144] This application also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps of any of the face check-in methods shown in Figures 2 to 6.

[0145] This application also provides an intelligent device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the steps of any of the face check-in methods shown in Figures 2 to 6.

[0146] This application also provides a computer program product that, when run on a smart device, causes the smart device to execute steps to implement any of the face check-in methods shown in Figures 2 to 6.

[0147] Figure 9 is a schematic diagram of a smart device provided in an embodiment of this application. As shown in Figure 9, the smart device 9 of this embodiment includes: a processor 90, a memory 91, and a computer program 92 stored in the memory 91 and executable on the processor 90. When the processor 90 executes the computer program 92, it implements the steps in the various face check-in method embodiments described above, such as steps S101 to S103 and steps S201 to S203 shown in Figure 2. Alternatively, when the processor 90 executes the computer program 92, it implements the functions of each module / unit in the various device embodiments described above, such as the functions of units 71 to 73 shown in Figure 7 and the functions of units 81 to 83 shown in Figure 8.

[0148] For example, the computer program 92 may be divided into one or more modules / units, which are stored in the memory 91 and executed by the processor 90 to complete this application. The one or more modules / units may be a series of computer-readable instruction segments capable of performing a specific function, which describe the execution process of the computer program 92 in the smart device 9.

[0149] The intelligent device 9 may include, but is not limited to, a processor 90 and a memory 91. Those skilled in the art will understand that Figure 9 is merely an example of the intelligent device 9 and does not constitute a limitation on the intelligent device 9. It may include more or fewer components than illustrated, or combine certain components, or different components. For example, the intelligent device 9 may also include input / output devices, network access devices, buses, etc.

[0150] The processor 90 can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.

[0151] The memory 91 can be an internal storage unit of the smart device 9, such as a hard drive or memory of the smart device 9. The memory 91 can also be an external storage device of the smart device 9, such as a plug-in hard drive, Smart Media Card (SMC), Secure Digital (SD) card, or Flash Card equipped on the smart device 9. Furthermore, the memory 91 can include both internal and external storage units of the smart device 9. The memory 91 is used to store the computer program and other programs and data required by the smart device. The memory 91 can also be used to temporarily store data that has been output or will be output.

[0152] It should be noted that the information interaction and execution process between the above-mentioned devices / units are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, and they will not be repeated here.

[0153] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0154] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments of this application can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include at least: any entity or device capable of carrying computer program code to a device / terminal equipment, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium. Examples include USB flash drives, portable hard drives, magnetic disks, or optical disks. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electrical carrier signals or telecommunication signals.

[0155] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0156] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A facial recognition check-in method, characterized in that, This system, applied to monitoring equipment, includes: acquiring facial images, vehicle information, and user identity information. The facial images, vehicle information, and identity information are collected, processed, and uploaded by a mobile device using a designated application. Specifically, it includes: acquiring scanning information of a preset image at a designated location on an in-vehicle device via the mobile device; the scanning information includes vehicle information and information collection and processing instructions; based on the information collection and processing instructions, calling the designated application to collect a facial image and acquiring the identity information of the user corresponding to the facial image; uploading the facial image, vehicle information, and identity information to the monitoring equipment; verifying whether the user matches the vehicle based on the vehicle information and identity information; if a match is found, updating the image database based on the facial image, vehicle information, and identity information. The image database stores facial images for in-vehicle device face check-in. The face check-in method further includes: obtaining an information download request sent by the in-vehicle device; determining the facial image corresponding to the target vehicle information; and sending the facial image corresponding to the target vehicle information, vehicle information, user identity information, and user usage time to the in-vehicle device. The in-vehicle device stores the facial image corresponding to the target vehicle information, vehicle information, user identity information, and user usage time locally. After capturing the target facial image, it matches and compares the captured target facial image with the locally stored facial image and verifies whether the current time is within the user's usage time. If the captured target facial image matches the locally stored facial image, and the current time is within the user's usage time, then the user's check-in is confirmed as successful.

2. The method according to claim 1, characterized in that, The designated application includes a first designated application and a second designated application; the facial image, the vehicle information, and the identity information are collected, processed, and uploaded by the mobile device using the designated application, including: obtaining scanning information of a preset image at a designated location of an in-vehicle device in the vehicle through the mobile device, the scanning information including vehicle information and information collection and processing instructions; based on the information collection and processing instructions, calling the first designated application to collect the facial image; calling the second designated application to verify the identity of the collected facial image; if the identity verification is successful, uploading the facial image, the vehicle information, and the identity information verified by the second designated application to the monitoring device.

3. The method according to claim 1, characterized in that, If a match is found, the image database is updated based on the face image, the vehicle information, and the identity information. This includes: if a match is found, binding the face image, the vehicle information, and the identity information and storing them in the image database; and updating the information version number of the user corresponding to the identity information.

4. A facial recognition check-in method, characterized in that, Applied to mobile devices, the method includes: acquiring scanning information of a preset image at a designated location on an in-vehicle device in a vehicle, the scanning information including vehicle information and information collection and processing instructions; based on the information collection and processing instructions, calling a designated application to collect and process a facial image, and acquiring the identity information of the user corresponding to the facial image; uploading the facial image, the vehicle information, and the identity information to a monitoring device, so that the monitoring device verifies whether the user and the vehicle match based on the vehicle information and identity information; if they match, updating the image database based on the facial image, vehicle information, and identity information; the facial images stored in the image database are used by the in-vehicle device for facial recognition check-in; wherein, the monitoring device acquires... The in-vehicle device sends an information download request to determine the facial image corresponding to the target vehicle information; it then sends the facial image, vehicle information, user identity information, and user usage time to the in-vehicle device; the in-vehicle device stores the facial image, vehicle information, user identity information, and user usage time locally, and after capturing the target facial image, it matches and compares the captured target facial image with the locally stored facial image, and verifies whether the current time is within the user's usage time; if the captured target facial image matches the locally stored facial image, and the current time is within the user's usage time, then the user's check-in is confirmed to be successful.

5. The method according to claim 4, characterized in that, The designated application includes a first designated application and a second designated application; the step of calling the designated application to collect and process facial images based on the information collection and processing instruction, and obtaining the identity information of the user corresponding to the facial images, includes: calling the first designated application to collect facial images based on the information collection and processing instruction; calling the second designated application to verify the identity of the collected facial images; and if the verification is successful, obtaining the user's identity information in the second designated application.

6. A facial recognition check-in system, characterized in that, include: The system comprises a mobile device, a monitoring device, and an in-vehicle device, wherein: the mobile device is used to acquire scanning information of a preset image at a designated location in the in-vehicle device, the scanning information including vehicle information and information collection and processing instructions; based on the information collection and processing instructions, it calls a designated application to collect a facial image and obtains the identity information of the user corresponding to the facial image; it uploads the facial image, the vehicle information, and the identity information to the monitoring device; the monitoring device is used to verify whether the user matches the vehicle based on the vehicle information and the identity information; if they match, it updates the image database based on the facial image, the vehicle information, and the identity information; the in-vehicle device is used to capture a target facial image, match and compare the target facial image with locally pre-stored facial images, the pre-stored facial images being downloaded from the monitoring device's image database to the local device, and determine the check-in result based on the matching and comparison result; wherein, if the target facial image matches a facial image in the image database, and the current time is within the user's usage time period, the user's check-in is determined to be successful.

7. A facial recognition check-in device, characterized in that, The device, applied to monitoring equipment, includes: an information acquisition unit for acquiring facial images, vehicle information, and user identity information, wherein the facial images, vehicle information, and identity information are collected, processed, and uploaded by a mobile device calling a designated application; specifically, the unit acquires scanning information of a preset image at a designated location of an in-vehicle device in the vehicle via the mobile device, the scanning information including vehicle information and information acquisition and processing instructions; based on the information acquisition and processing instructions, it calls a designated application to acquire a facial image and obtains the identity information of the user corresponding to the facial image; and uploads the facial image, vehicle information, and identity information to the monitoring equipment; an image verification unit for verifying whether the user matches the vehicle based on the vehicle information and the identity information; and a first check-in unit for, if a match is found, checking the user's identity based on the facial image and vehicle information. The system updates the identity information image database, where facial images stored are used for facial check-in by the in-vehicle device. The monitoring device also receives information download requests from the in-vehicle device to determine the facial image corresponding to the target vehicle information. It then sends the facial image, vehicle information, user identity information, and user usage time to the in-vehicle device. The in-vehicle device stores the facial image, vehicle information, user identity information, and user usage time locally. After capturing the target facial image, it matches and compares the captured image with the locally stored facial image, verifying that the current time falls within the user's usage time. If the captured facial image matches the locally stored image and the current time falls within the user's usage time, the user's check-in is confirmed as successful.

8. A smart device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the face check-in method as described in any one of claims 1 to 5.

9. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it implements the face check-in method as described in any one of claims 1 to 5.

Images