A vehicle OTA upgrade method, system and storage medium based on face recognition

Abstract

The present invention discloses a vehicle OTA upgrade method, system and storage medium based on face recognition. The method includes: an OTA application receives software upgrade service information sent by an OTA server and displays it to a user; after confirmation by the user, the OTA application starts face recognition authentication, collects face feature data through a face detection engine and sends it to the OTA server; the OTA server requests face recognition and owner identity verification from the face recognition engine based on the acquired face feature data; the face recognition engine calls the saved face information to perform face recognition and identity verification on the acquired face feature data, and returns the face recognition and owner identity verification results to the OTA server; the OTA server successfully sends the upgrade package to the OTA application based on face recognition and owner identity verification; the OTA application completes the upgrade. The present invention can effectively identify the identity of the owner, thereby pushing the corresponding software OTA upgrade service to the owner who has purchased the software service.

Description

Technical Field

[0001] The present invention relates to the technical field of automobile OTA upgrade, and in particular to a vehicle OTA upgrade method, system and storage medium based on face recognition. Background Art

[0002] After selling a vehicle, traditional car companies are unable to further tap the potential of the vehicle controller, enrich the functions of the car entertainment software, and continuously improve the vehicle experience due to the weak vehicle software capabilities. As a result, after the car companies generate revenue from the sale of the vehicle, they cannot continue to generate sustained revenue through vehicle services. Therefore, today's car companies are paying more and more attention to the status of software development in car driving.

[0003] The rise of the software industry has made software-defined cars a reality. In order to further improve user experience, identify key corporate customers, and achieve precision marketing, vehicle customers can be divided into VIP car owners and ordinary car owners. VIP car owners are considered users who are willing to purchase software services and focus on car experience, while ordinary car owners are considered users who will not purchase software services.

[0004] In traditional vehicle upgrade services, the upgrade target is the vehicle, which is pushed by region and model version. The vehicle receives the upgrade task, and the user accepts the upgrade task to achieve the upgrade. In the new vehicle upgrade service, the upgrade target is the user. How to effectively identify and distinguish the identity of VIP car owners, so as to push the entertainment and other software product upgrade services enjoyed by VIP customers and protect the rights and interests enjoyed by VIP car owners has become a key factor. Summary of the invention

[0005] In view of the above-mentioned deficiencies in the prior art, the purpose of the present invention is to solve the problem that the existing automobile software OTA upgrade service cannot be pushed to the car owners in a differentiated manner, resulting in the inability to protect the software product upgrade service rights and interests enjoyed by the car owners who have purchased the software service. A vehicle OTA upgrade method, system and storage medium based on face recognition are provided, which can effectively identify the identity of the car owner, thereby pushing the corresponding software OTA upgrade service to the car owner who has purchased the software service, protecting the rights and interests enjoyed by the car owners and improving user satisfaction.

[0006] In order to solve the above technical problems, the present invention adopts the following technical solutions:

[0007] A vehicle OTA upgrade method based on face recognition includes the following steps:

[0008] The OTA application receives the software upgrade service information sent by the OTA server and displays it to the user;

[0009] After the user confirms, the OTA application starts face recognition authentication, collects face feature data through the face detection engine and sends it to the OTA server;

[0010] The OTA server requests facial recognition and owner identity verification from the facial recognition engine based on the acquired facial feature data;

[0011] The face recognition engine uses the saved face information to perform face recognition and identity authentication on the acquired face feature data, and returns the face recognition and owner identity verification results to the OTA server;

[0012] The OTA server successfully sends the upgrade package to the OTA application based on face recognition and owner identity verification;

[0013] OTA application upgrade completed.

[0014] Among them, the software upgrade service information sent by the OTA server includes vehicle controller software upgrade and vehicle entertainment software upgrade.

[0015] Furthermore, while the OTA application sends the collected facial feature data to the OTA server, the OTA application also sends the vehicle information and upgrade service information to the OTA server.

[0016] Furthermore, the vehicle owner's identity information and facial data entered in advance are stored in the facial recognition engine.

[0017] Furthermore, the face collection engine is integrated in the OTA application end or in the OTA server end.

[0018] Furthermore, the OTA server successfully sends the upgrade package to the OTA application based on face recognition and owner identity verification, including two cases where the upgrade task is free or paid;

[0019] When the OTA server detects that the upgrade task is free, it directly sends the upgrade package to the OTA application;

[0020] When the OTA server detects that the upgrade task requires payment, the OTA server first sends a payment connection to the OTA application. After the OTA server receives the payment confirmation result, it sends the upgrade package to the OTA application.

[0021] The present invention also provides a vehicle OTA upgrade system based on face recognition, which is used in the method described above and includes an OTA server, an OTA application, a face management module and an in-vehicle camera;

[0022] The OTA server is used to send software upgrade service information to the OTA application; it is also used to send a face detection request to the face detection engine, obtain the face feature data collected by the face detection engine, request face recognition and owner identity authentication to the face recognition engine and obtain the verification result; it is also used to send an upgrade package to the OTA application that has successfully verified;

[0023] The OTA application is used to receive software upgrade service information sent by the OTA server and display it to the user; it is also used to receive the upgrade package sent by the OTA server and complete the upgrade;

[0024] The face management module is deployed with a face detection engine and a face recognition engine; the face detection engine is used to call the in-car camera to collect face feature data, and send the collection results of face feature data to the OTA application; the face recognition engine has 1:N face comparison, liveness recognition, action recognition, and lip recognition functions, and is used to receive calls from the OTA server to perform face recognition and owner identity authentication, and return the verification results to the OTA server; the face management module is also used to save the owner's face information, identity information, and associated vehicle information;

[0025] The in-car camera is used to receive the call of the face detection engine and complete the collection of face feature data.

[0026] Furthermore, it also includes a payment module; the payment module is used to receive a payment request sent by the OTA server and return the payment result to the OTA server.

[0027] The present invention also provides a storage medium, which stores one or more programs. When the one or more programs are run by a processor, the steps of the vehicle OTA upgrade method based on face recognition are executed.

[0028] Compared with the prior art, the present invention has the following beneficial effects:

[0029] The vehicle OTA upgrade method provided by the present invention confirms the identity of the car owner based on face recognition, and can effectively identify the identity of the car owner, so as to push the corresponding software OTA upgrade service to the car owner who has purchased the software service, protect the rights and interests enjoyed by the car owner, and improve user satisfaction. In addition, it can also prevent the software upgrade service customized for the car owner from being misused by others based on the car owner's identity authentication; at the same time, it can also continue to provide the OTA upgrade service of the purchased software to the new car owner after the vehicle is transferred, and collect the software usage preferences of the new car owner in time, so as to provide software services to the new car owner in a more targeted manner. At the same time, it is also beneficial for car companies to accurately push software to car owners who have purchased software services, so that car companies can generate continuous profits through software services while satisfying users. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 The present invention is a flow chart of a vehicle OTA upgrade method based on face recognition.

[0031] Figure 2 This is a flow chart of the free vehicle software upgrade service based on face recognition in Example 2 of the present invention.

[0032] Figure 3 This is a flow chart of the vehicle software paid upgrade service based on face recognition in Example 3 of the present invention.

[0033] Figure 4 This is a schematic diagram of a vehicle OTA upgrade system based on face recognition according to the present invention. DETAILED DESCRIPTION

[0034] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0035] Embodiment 1

[0036] This embodiment discloses a vehicle OTA upgrade method based on face recognition.

[0037] A vehicle OTA upgrade method based on face recognition, see Figure 1 , including the following steps,

[0038] The OTA application receives the software upgrade service information sent by the OTA server and displays it to the user.

[0039] After the user confirms, the OTA application starts face recognition authentication, collects facial feature data through the face detection engine and sends it to the OTA server.

[0040] The OTA server requests facial recognition and owner identity verification from the facial recognition engine based on the acquired facial feature data.

[0041] The face recognition engine calls the saved face information to perform face recognition and identity authentication on the acquired face feature data, and returns the face recognition and owner identity verification results to the OTA server.

[0042] The OTA server successfully sends the upgrade package to the OTA application based on facial recognition and owner identity verification.

[0043] OTA application upgrade completed.

[0044] In specific implementation, the software upgrade service information sent by the OTA server includes vehicle controller software upgrade and vehicle entertainment software upgrade.

[0045] While the OTA application sends the collected facial feature data to the OTA server, the OTA application also sends the vehicle information and upgrade service information to the OTA server.

[0046] The face recognition engine stores the owner's identity information and face data entered in advance. The face collection engine can be integrated in the OTA application end or in the OTA server end.

[0047] During specific implementation, the OTA server successfully sends the upgrade package to the OTA application based on face recognition and owner identity verification, including two situations where the upgrade task is free or paid.

[0048] When the OTA server detects that the upgrade task is free, it directly sends the upgrade package to the OTA application.

[0049] When the OTA server detects that the upgrade task requires payment, the OTA server first sends a payment connection to the OTA application. After the OTA server receives the payment confirmation result, it sends the upgrade package to the OTA application.

[0050] The vehicle OTA upgrade method provided by the embodiment of the present invention confirms the identity of the car owner based on face recognition, and can effectively identify the identity of the car owner, so as to push the corresponding software OTA upgrade service to the car owner who has purchased the software service, protect the rights and interests enjoyed by the car owner, and improve user satisfaction. In addition, it is also possible to prevent the software upgrade service customized for the car owner from being misused by others based on the car owner's identity authentication. At the same time, it is also possible to continue to provide the OTA upgrade service of the purchased software to the new car owner after the vehicle is transferred, and provide them with new software and services, and accurately push the software, so as to satisfy the users and enable the car companies to generate continuous income through software services.

[0051] Embodiment 2

[0052] In order to further illustrate the actual effect of the vehicle OTA upgrade method based on face recognition of the present invention, this embodiment discloses a vehicle OTA upgrade method based on face recognition implemented based on embodiment one and its application scenario.

[0053] This embodiment is an OTA upgrade method when the upgrade task is free. Figure 2 , including the following steps,

[0054] The operator sends upgrade service messages to VIP car owners through the OTA server.

[0055] The OTA application detects the upgrade service, and the car owner clicks to receive the upgrade service.

[0056] The OTA application launches the face recognition page, and the owner points his face to the camera in the car for face recognition.

[0057] The OTA application collects image data transmitted by the camera and collects facial feature data through the face detection engine.

[0058] The OTA application sends the owner's facial feature extraction data, vehicle information, and upgrade service information to the OTA server. After receiving the face data, the OTA server requests face verification from the face recognition engine.

[0059] The face recognition engine returns the face recognition success result and the owner identity verification success information to the OTA server.

[0060] The OTA server detects that the upgrade task is free and directly initiates the upgrade to the OTA application.

[0061] OTA application upgrade completed.

[0062] In this way, when providing free OTA upgrade services to car owners who have purchased software services, automatic OTA upgrades can be achieved by simply confirming the owner's identity through face recognition, making the upgrade service convenient and fast. Since the owner's identity authentication is required before the upgrade, it can prevent the software upgrade service customized for the car owner from being misused by others.

[0063] Embodiment 3

[0064] In order to further illustrate the practical effect of the vehicle OTA upgrade method based on face recognition of the present invention, this embodiment discloses a vehicle OTA upgrade method based on face recognition implemented based on embodiment one and its application scenario.

[0065] This embodiment is an OTA upgrade method when the upgrade task is free. Figure 3 , including the following steps,

[0066] The operator sends upgrade service messages to VIP car owners through the OTA server.

[0067] The OTA application detects the upgrade service, and the car owner clicks to receive the upgrade service.

[0068] The OTA application launches the face recognition page, and the owner points his face to the camera in the car for face recognition.

[0069] The OTA application collects image data transmitted by the camera and collects facial feature data through the face detection engine.

[0070] The OTA application sends the owner's facial feature extraction data, vehicle information, and upgrade service information to the OTA server. After receiving the face data, the OTA server requests face verification from the face recognition engine.

[0071] The face recognition engine returns the face recognition success result and the owner identity verification success information to the OTA server.

[0072] The OTA server detects that the upgrade task requires payment and first sends a payment connection to the OTA application. After the car owner receives the payment link and confirms the payment, the OTA server receives the payment confirmation result and sends the upgrade package to the OTA application.

[0073] OTA application upgrade completed.

[0074] In this way, when providing paid OTA upgrade services to car owners who have purchased software services, the first step is to confirm the identity of the car owner through facial recognition, and then send the upgrade package for upgrade based on the car owner's payment result, providing the car owner with paid software upgrade services, thereby achieving the purpose of identifying customers, providing customers with customized software services, and improving the user experience. When the car owner changes, the software usage preferences of the new car owner can also be collected in time, so as to provide more targeted software services to the new car owner.

[0075] Embodiment 4

[0076] Based on the first embodiment, this embodiment discloses a vehicle OTA upgrade system based on face recognition, which is used in the method.

[0077] The present invention also provides a vehicle OTA upgrade system based on face recognition, which is used in the method described.

[0078] A vehicle OTA upgrade system based on face recognition, see Figure 4 , including OTA server, OTA application, face management module and in-car camera.

[0079] The OTA server is used to send software upgrade service information to the OTA application. It is also used to send a face detection request to the face detection engine, obtain the face feature data collected by the face detection engine, request face recognition and owner identity verification from the face recognition engine and obtain the verification result. It is also used to send an upgrade package to the OTA application that has successfully verified.

[0080] The OTA application is used to receive software upgrade service information sent by the OTA server and display it to the user. It is also used to receive the upgrade package sent by the OTA server and complete the upgrade.

[0081] The face management module is deployed with a face detection engine and a face recognition engine. The face detection engine is used to call the in-car camera to collect face feature data, and send the collection results of face feature data to the OTA application. The face recognition engine has 1:N face comparison, liveness recognition, action recognition, and lip recognition functions, and is used to receive calls from the OTA server to perform face recognition and owner identity authentication, and return the verification results to the OTA server. The face management module is also used to save the owner's face information, identity information, and associated vehicle information.

[0082] The in-car camera is used to receive the call of the face detection engine and complete the collection of face feature data.

[0083] In a specific implementation, a payment module is also included. The payment module is used to receive a payment request sent by the OTA server and return the payment result to the OTA server.

[0084] In this way, the system composed of the OTA server, OTA application, face management module and in-car camera can realize the identification and authentication of the car owner's identity, so that the corresponding software OTA upgrade service can be pushed to the car owners who have purchased the software service, thereby protecting the rights and interests of the car owners and improving user satisfaction.

[0085] Embodiment 5

[0086] This embodiment discloses a storage medium based on the first embodiment.

[0087] A storage medium storing one or more programs, wherein when the one or more programs are executed by a processor, the steps of the vehicle OTA upgrade method based on face recognition are executed. The computer-readable storage medium may be a USB flash drive, a hard disk, or other device with storage function.

[0088] As described above, the reminder system of the present invention is not limited to the configuration described above, and other systems that can implement the embodiments of the present invention may fall within the scope of protection of the present invention.

[0089] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention rather than to limit the technical solution. Those skilled in the art should understand that those modifications or equivalent substitutions of the technical solution of the present invention that do not depart from the purpose and scope of the technical solution should be included in the scope of the claims of the present invention.

Claims

1. A vehicle OTA upgrade method based on face recognition, characterized in that: Including OTA server, OTA application, face management module and in-car camera; The OTA server is used to send software upgrade service information to the OTA application; it is also used to send a face detection request to the face detection engine, obtain the face feature data collected by the face detection engine, request face recognition and vehicle owner identity verification from the face recognition engine and obtain the verification result; It is also used to send upgrade packages to OTA applications that have been successfully verified; The OTA application is used to receive software upgrade service information sent by the OTA server and display it to the user; It is also used to receive the upgrade package sent by the OTA server and complete the upgrade; The face management module is deployed with a face detection engine and a face recognition engine; The face detection engine is used to call the in-vehicle camera to collect face feature data, and send the collection result of the face feature data to the OTA application; The face recognition engine is used to receive a call from the OTA server to perform face recognition and owner identity authentication, and return the verification result to the OTA server; The face management module is also used to store the owner's face information, identity information and associated vehicle information; The in-vehicle camera is used to receive the call of the face detection engine and complete the collection of face feature data; The following steps are included: The OTA application receives the software upgrade service information sent by the OTA server and displays it to the user; After the user confirms, the OTA application starts face recognition authentication, collects face feature data through the face detection engine and sends it to the OTA server; The OTA server requests facial recognition and owner identity verification from the facial recognition engine based on the acquired facial feature data; The face recognition engine uses the saved face information to perform face recognition and identity authentication on the acquired face feature data, and returns the face recognition and owner identity verification results to the OTA server; The OTA server successfully sends the upgrade package to the OTA application based on face recognition and owner identity verification; OTA application upgrade completed.

2. The vehicle OTA upgrade method based on face recognition according to claim 1, characterized in that: The software upgrade service information sent by the OTA server includes vehicle controller software upgrade and vehicle entertainment software upgrade.

3. The vehicle OTA upgrade method based on face recognition according to claim 1, characterized in that: While the OTA application sends the collected facial feature data to the OTA server, the OTA application also sends the vehicle information and upgrade service information to the OTA server.

4. The vehicle OTA upgrade method based on face recognition according to claim 1, characterized in that: The face recognition engine stores the car owner's identity information and face data entered in advance.

5. The vehicle OTA upgrade method based on face recognition according to claim 1, characterized in that: The OTA server successfully sends the upgrade package to the OTA application based on face recognition and owner identity verification, including free and paid upgrade tasks; When the OTA server detects that the upgrade task is free, it directly sends the upgrade package to the OTA application; When the OTA server detects that the upgrade task requires payment, the OTA server first sends a payment connection to the OTA application. After the OTA server receives the payment confirmation result, it sends the upgrade package to the OTA application.

6. A vehicle OTA upgrade system based on face recognition, characterized in that: Including OTA server, OTA application, face management module and in-car camera; The OTA server is used to send software upgrade service information to the OTA application; it is also used to send a face detection request to the face detection engine, obtain the face feature data collected by the face detection engine, request face recognition and vehicle owner identity verification from the face recognition engine and obtain the verification result; It is also used to send upgrade packages to OTA applications that have been successfully verified; The OTA application is used to receive software upgrade service information sent by the OTA server and display it to the user; It is also used to receive the upgrade package sent by the OTA server and complete the upgrade; The face management module is deployed with a face detection engine and a face recognition engine; The face detection engine is used to call the in-vehicle camera to collect face feature data, and send the collection result of the face feature data to the OTA application; The face recognition engine is used to receive a call from the OTA server to perform face recognition and owner identity authentication, and return the verification result to the OTA server; The face management module is also used to store the owner's face information, identity information and associated vehicle information; The in-car camera is used to receive the call of the face detection engine and complete the collection of face feature data.

7. According to claim 6, the vehicle OTA upgrade system based on face recognition also includes a payment module; the payment module is used to receive a payment request sent by the OTA server and return the payment result to the OTA server.

8. A storage medium, characterized in that: The storage medium stores one or more programs, and when the one or more programs are executed by the processor, the steps of the vehicle OTA upgrade method based on face recognition as described in any one of claims 1 to 5 are executed.

Images