Configurable vehicle authorization using local biometric authentication

Abstract

A biometric authenticator for use by an application executing on an infotainment system of a vehicle performs a biometric authentication process tailored to adapt to dynamically changing contextual information obtained by vehicle sensors.

Description

Background Technology

[0001] It has become increasingly common for software applications to perform sensitive tasks. In such cases, it is beneficial for the application to know beforehand that the person requesting the task is not an imposter. In other words, it is advantageous to be able to authenticate the person.

[0002] One way to detect an imposter is to request the password. Alternatives include requesting information that the imposter is unlikely to know.

[0003] These methods have certain flaws. Passwords can be guessed. And when an imposter knows the person well enough, they might know the supposedly secret information just as well as the real person.

[0004] These shortcomings can be overcome to some extent by relying on a person's actual physical characteristics. Examples include checking fingerprints, analyzing voiceprints, or performing facial recognition. This type of authentication is often referred to as "biometric" authentication. Summary of the Invention

[0005] Humans possess certain physical characteristics useful for biometric authentication. To a large extent, these are the characteristics humans use to identify each other. Such characteristics include spoken language and facial features.

[0006] The collection of all such physical characteristics shall be referred to herein as a person's "biometric set". Each element of the set shall be referred to as a "biometric characteristic". A "biometric authentication pattern" shall refer to biometric authentication using a subset of the biometric set. This subset defines a "biometric badge". Examples include those in which the subset consists of a single biometric characteristic and those in which the subset consists of a combination of two or more biometric characteristics. Examples of biometric authentication patterns include the use of voice identification, facial recognition, fingerprints, features found on the iris, and the composition of volatile groups.

[0007] Modern motor vehicles are typically equipped with one or more sensors, such as microphones (often used in voice recognition systems), cameras (from which the driver's alertness can be estimated), and weight detectors in the seats (such as those used to control seatbelt warnings). The output from these sensors can be used to receive information about elements of the aforementioned set of biometrics.

[0008] Typical vehicles also include an "infotainment system" that can run software applications. These applications are usually required to perform tasks that are inherently sensitive enough to be useful in detecting imposters. Whether an application takes measures to identify imposters is outlined in the application's "authentication policy."

[0009] An "authentication policy" defines the authentication process performed by the application under a specific set of conditions. An example of an authentication policy is one that depends on the specific user seeking authentication. Another example is a policy that depends on the specific vehicle the application is executing on. This is particularly useful for defining authentication policies that apply to multiple vehicles.

[0010] This invention provides a biometric authenticator that receives information from the aforementioned sensors and uses that information to perform biometric authentication. This invention is based in part on the understanding that the optimal biometric authentication process in a vehicle can change with changing conditions. Therefore, it is advantageous to move away from strictly defined authentication strategies to allow for adaptation to changes in conditions specific to the current state of the vehicle.

[0011] The biometric authenticator described and claimed herein adaptively programs the use of such sensors to authenticate transactions in different ways depending on the conditions of the vehicle at any given time. Furthermore, the biometric authenticator does this in a manner that conforms to the changing conditions within the vehicle and is also subject to constraints imposed by an authentication strategy that defines the requirements of the transaction.

[0012] Such a system provides a safer in-vehicle user experience through improved external service authorization, particularly a streamlined payment process. It achieves this by leveraging local and secure biometric authentication, local and secure data storage, and remote configuration capabilities via cloud-based management services.

[0013] On one hand, biometric authenticators include vehicle components and remote components.

[0014] The authenticator's vehicle component includes an embedded application that runs within the infotainment system already installed in the vehicle. This vehicle component supports multiple biometric authentication modes. These biometric authentication modes can be used independently or in combination. The vehicle component selects the biometric authentication mode based on the authentication policy.

[0015] The remote components of an authenticator are typically cloud-based management services that can be remotely configured to enable the configuration of one or more authentication policies.

[0016] The local component retrieves the authentication policy from the remote component in a secure manner. It does this by using a secure application programming interface (API) that employs asymmetric encryption, tokens, and / or other security challenges. This reduces the risk of unauthorized systems or users altering the biometric authenticator's configuration and policies.

[0017] Vehicle components provide secure biometric certification that can be used by other applications running in the infotainment system.

[0018] In some cases, applications running the infotainment system will attempt to perform their own authentication process or "authentication flow." Among the services provided to the authenticator by the vehicle components are services that streamline this authentication process. In some embodiments, the vehicle components do this by storing the user's credentials under a biometric lock. In other embodiments, it achieves this by providing passwordless authentication with compatible services.

[0019] The biometric authenticator also provides a secure storage area for storing biometric information that will be used as biometric user credentials for one or more other applications running on the infotainment system. This biometric information is stored securely and separately within the infotainment system from application data and non-biometric user credentials associated with that application.

[0020] The biometric authenticator uses a dedicated application interface to store these credentials. Once securely stored, credentials can only be retrieved (if applicable) using the biometric information of the specified user or a specified backup authentication method.

[0021] When required by the authentication policy, the biometric authenticator performs non-biometric authentication processes in addition to the biometric authentication process. In some embodiments, the process of first registering a user includes pairing a non-biometric external factor (an example being a smartphone) with the user. This further enhances security. In this case, successful authentication requires both the presence of an external security factor and consistency between the measured biometric information and the stored biometric information.

[0022] Other embodiments include local access policies that specify which applications running on the vehicle's infotainment system are permitted to use, or require to use, a biometric authenticator, and what level of security is required in either case. Examples include local access policies that specify which biometric authentication mode to use and whether authentication requires external security factors. In some cases, such policies specify which users from a candidate user set can or should use a biometric authenticator. In one embodiment, the vehicle manufacturer defines which applications can or should use a biometric authenticator for an improved user experience. In another embodiment, a company (such as one that owns or maintains a fleet) specifies for each vehicle in the fleet which specific applications require biometric authentication and which users require such authentication.

[0023] In a preferred embodiment, the biometric authenticator implements a pre-designed and developed verbal dialogue that guides the user through the authentication process. The dialogue used depends on the specific biometric authentication mode being used.

[0024] In one aspect, the invention is characterized by a method for using a vehicle's infotainment system to control the ability of an application to perform a task requested by the vehicle's occupants. This application is one of several possible applications that execute on the infotainment system.

[0025] In some cases, the application is prevented from performing tasks. In other embodiments, it is allowed to perform tasks. Which of these possibilities is implemented depends on the outcome of the biometric authentication process.

[0026] The nature of this biometric process is far from static. It depends on dynamically changing contextual information. Therefore, the nature of the biometric process varies depending on the circumstances. This makes it possible to tailor biometric certification procedures to the specific circumstances present at the time of biometric certification. Thus, it is quite possible that the same application, already required to perform the same task, may still require different biometric certification procedures.

[0027] The method described and claimed herein includes the following steps: a vehicle component performing a biometric authenticator on an infotainment system, a remote component performing a biometric authenticator on a processing system other than the infotainment system, and providing data communication between a local component and a remote component of the biometric authenticator.

[0028] The method continues by executing an application on the infotainment system, after the occupant has requested the application to perform a task. This is followed by retrieving an authentication policy originating from a remote component of the biometric authenticator at the local component of the biometric authenticator. This authentication policy specifies the authentication process to be executed by the application for authenticating the occupant. Successful occupant authentication is a prerequisite for performing the task. The method also includes determining whether biometric authentication is required for the authentication process.

[0029] The method further continues to receive information indicating dynamically changing circumstances. This information is derived from information about the vehicle's state. Once this information is available, the method continues by modifying the authentication process based on the context and performing biometric authentication of the vehicle's occupants using the modified authentication process. Finally, a determination is made as to whether the biometric authentication process has successfully authenticated the occupants' identities, and the application is notified accordingly. If authentication is successful, the application executes its task; otherwise, it does not.

[0030] In practice, the context-based modification of the authentication process includes determining that the authentication process requires the measurement of a first biometric feature, and replacing the measurement of the first biometric feature with the measurement of a second biometric feature.

[0031] In practice, this invention also includes modifying the authentication process based on context, including selecting biometric features for authentication based at least in part on context.

[0032] Other practices include replacing camera-based measurements with microphone-based measurements, and vice versa. More generally, given the availability of specific contextual information, the authentication process is modified to increase the probability of correct authentication.

[0033] In other practices, the certification process includes deselecting a biometric feature that would otherwise be relied upon for certification, based on the determined circumstances that would make reliance on that biometric feature unsatisfactory. For example, in some cases, the light level inside a vehicle compartment may be insufficient to use a specific biometric feature as the basis for certification. Alternatively, the noise level inside the compartment may be too high to allow the use of a specific biometric feature as the basis for certification.

[0034] In some practices, the context includes the vehicle's kinematic characteristics, such as its acceleration vector, its velocity vector, or its position vector. In these practices, modifying the authentication process includes practices that deselect dependent biometric features used for authentication based on the vehicle's direction of travel, and practices that modify the authentication process including practices that deselect dependent biometric features used for authentication based on the vehicle's speed.

[0035] In some cases, the actual process of acquiring the necessary biometric information requires the cooperation of the occupants. For example, an occupant may need to face a specific camera or perform specific utterances. In such embodiments, performing occupant biometric authentication includes having a dialogue manager engage in an interactive dialogue with the occupant to guide them in providing the biometric information used in the biometric authentication.

[0036] In some cases, the certification process depends on the nature of the occupant seeking certification. For example, some practices include those that modify the certification process based on the premise that the occupant seeking certification is a passenger in the vehicle.

[0037] Other practices include arranging vehicle components of biometric authenticators to incorporate sensors within the vehicle to collect different types of biometric information in response to changing conditions that occur during vehicle operation.

[0038] In other practices, context-based modification of the certification process also includes enabling vehicle components of the biometric certifier to define biometric badges to serve as the basis for biometric certification. These biometric badges are based on different types of biometric information that have been weighted based on contextual information obtained from sensors in the vehicle.

[0039] These practices also include context-based modification of the authentication process, which involves defining dynamically changing biometric badges as the basis for biometric authentication. These dynamically changing biometric badges are overlays of different biometric information sources, where the overlay is selected based on contextual information.

[0040] Various tasks are envisioned for the application to perform. Among these tasks are payment-related tasks and tasks involving operating devices outside a vehicle, such as opening a garage door, opening a house door, or operating appropriately activated residential appliances.

[0041] Other practices include receiving instructions to modify authentication policies at remote components.

[0042] Some embodiments include maintaining multiple authentication policies at remote components. These include policies that apply only to the first fleet, policies that apply to the second fleet, policies that apply to a specific set of occupants, policies that apply only to a specific geographic location and not to other geographic locations, and policies that apply only to certain time intervals and not to other time intervals.

[0043] On the other hand, the invention is characterized by an apparatus comprising an infotainment system in a vehicle. The infotainment system is configured to control the ability of applications to perform tasks requested by the vehicle's occupants. In some cases, the apparatus prevents the task from being performed, and in other cases, it allows the task to be performed. Which of these occurs depends on the outcome of performing biometric authentication of the occupant.

[0044] The device includes a biometric authenticator with a vehicle component and a remote component. The vehicle component, which operates on the infotainment system, communicates with the remote component of the biometric authenticator system, which operates on a processing system other than the infotainment system.

[0045] The device also includes a policy repository that stores authentication policies retrieved from remote components. Each authentication policy specifies the authentication process used to authenticate the vehicle's occupants. A successful biometric authentication process is a prerequisite for performing the tasks that the application has been asked to perform.

[0046] The device also includes a context source that provides dynamically changing context to the vehicle components of the biometric authenticator. This context is derived from information about the vehicle's status. Local components of the biometric authenticator are configured to modify one or more aspects of the authentication process in response to the dynamically changing context, to attempt to biometrically authenticate the vehicle occupants based on the authentication process, and to notify the occupants that the attempt to biometrically authenticate them has failed or succeeded.

[0047] On another front, the present invention features a method for use with an application executed on a vehicle's infotainment system. The method includes receiving information from the application indicating that a vehicle occupant has requested to perform a task; selecting a first strategy from a plurality of strategies, each strategy corresponding to a different task; the first strategy defining a task-specific first biometric authentication procedure; generating a second strategy based on the first strategy; performing the occupant's biometric authentication using the second strategy; and authorizing the execution of the task based on the result of the biometric authentication. The second strategy defines a second biometric authentication procedure different from the first biometric authentication procedure.

[0048] In practice of the aforementioned method, there are practices in which generating a second strategy includes modifying a first strategy based on contextual information, wherein the contextual information indicates the state of the vehicle, wherein generating a second strategy includes determining that the first strategy requires the measurement of a first biometric feature and using the measurement of a second biometric feature in the second strategy, and wherein generating a second strategy includes selecting a biometric feature for authentication that is relied upon in the second strategy, based at least in part on contextual information indicating the state of the vehicle.

[0049] Further practices include those where policies are stored on remote servers.

[0050] Other practices include those in which a first strategy requires biometric authentication using a first method selected from a group consisting of facial recognition and speech recognition, and generating a second strategy includes requiring biometric authentication using a second method selected from a group consisting of facial recognition and speech recognition, the second method being different from the first method.

[0051] Other practices include those in which generating a second strategy involves determining that the light level inside the vehicle compartment is insufficient to use the biometric features relied upon in the first strategy as the basis for authentication, and those in which generating a second strategy involves determining that there is too much noise to use the biometric features relied upon in the first strategy.

[0052] Other practices include those practices in which the generation of a second strategy involves selecting biometric features for authentication that are relied upon in the second strategy, based on the direction of travel of the vehicle, the magnitude of the vehicle's speed, or the vehicle's velocity vector.

[0053] In other practices, performing occupant biometric authentication involves having a dialogue manager engage in an interactive dialogue with the occupant to guide them in providing biometric information for biometric authentication.

[0054] In practice, the invention also includes the following practices: generating a second strategy includes modifying the first biometric authentication process based on the determination that the occupant seeking authentication is a passenger in the vehicle; generating a second strategy includes orchestrating sensors in the vehicle to collect different types of biometric information in response to changes occurring during vehicle operation; generating a second strategy includes defining biometric badges as the basis for biometric authentication in the second strategy, the biometric badges being based on different types of biometric information weighted based on contextual information obtained from sensors in the vehicle; generating a second strategy includes defining dynamically changing biometric badges as the basis for biometric authentication in the second strategy, the dynamically changing badges being an overlay of different biometric information sources, the overlay being selected based on contextual information; and generating a second strategy includes modifying the first strategy based on the number of occupants in the vehicle.

[0055] Various tasks were envisioned. These tasks included transferring resources from a first location to a second location. Examples of resources included financial resources and resources of value. The envisioned tasks also included operating equipment external to the vehicle.

[0056] Other practices include receiving instructions to modify authentication policies at remote components.

[0057] Other practices include maintaining multiple authentication policies at remote components. These policies include policies that apply only to the first fleet, policies that apply to the second fleet (which is different from the first fleet), policies that apply to a specific set of occupants, policies that apply only to a specific geographic location and not to other geographic locations, and policies that apply only to certain time intervals and not to other time intervals.

[0058] On another front, the invention features a biometric authenticator that communicates data with an application running on a vehicle's infotainment system. The biometric authenticator includes a vehicle component running on the infotainment system and a remote component running on a remote server. The biometric authenticator also includes a policy repository storing authentication policies, each policy corresponding to a different task. The policies include a first policy that defines a first biometric authentication process dedicated to a first task. The biometric authenticator is configured to generate a second policy based on the first policy and perform biometric authentication of a vehicle occupant who has requested to perform the first task. The biometric authenticator is also configured to use the second policy to perform the occupant's biometric authentication and to authorize the execution of the first task based on the result of the biometric authentication. This second policy defines a second biometric authentication process different from the first biometric authentication process.

[0059] In another aspect, the invention is characterized by executing a first instance and a second instance of an application in the infotainment systems of corresponding first and second vehicles. The respective occupants in the vehicles have requested the first and second instances of the application to perform corresponding first and second identical tasks. The method also includes causing the first instance of the application to perform a first biometric authentication process to authenticate the first occupant, and causing the second instance of the application to perform a second biometric authentication process to authenticate the second occupant. Because the first and second vehicles are in different states, the first and second biometric authentication processes differ from each other. These different states cause corresponding differences in the contextual information of the first and second vehicles.

[0060] All methods and systems described herein are non-abstract implementations. Descriptions of abstract implementations have been omitted. When properly interpreted, all claims cover only non-abstract implementations. The applicant, as his own lexicographer, hereby defines "non-abstract" as the opposite or complement of "abstract," as the term has been interpreted by the U.S. courts prior to the filing date of this application. Anyone who interprets a claim to cover an abstract implementation will merely demonstrate that the person is unable to interpret the claims according to the description as required by law. Attached Figure Description

[0061] These and other features of the invention will be apparent from the following detailed description and accompanying drawings, wherein:

[0062] Figure 1 The components of the biometric authenticator are shown;

[0063] Figure 2 It shows the result of Figure 1 The realization of transactions conducted by the biometric authenticator;

[0064] Figure 3 Showing the user registration to use Figure 1 The steps performed when using a biometric authenticator;

[0065] Figure 4 This shows the process during certification. Figure 1 The steps performed by the biometric authenticator;

[0066] Figure 5 This illustrates the steps performed when an application manages a biometric lock used for secure storage of credentials;

[0067] Figure 6 The document illustrates the credential management steps taken by vehicle components to enable the application to perform biometric authentication.

[0068] Figure 7 This shows the method for accessing certain credentials. Figure 1 Biometric authenticator;

[0069] Figure 8 It shows how to interact with the car assistant. Figure 1 The operation of the biometric authentication device; and

[0070] Figure 9 This shows the user's startup. Figure 1 The process following its application. Detailed Implementation

[0071] Figure 1 A biometric authenticator 10 with a vehicle component 12 and a remote component 14 is shown. The vehicle component 12 works in conjunction with one or more applications 16 on an infotainment system 18 within a motor vehicle 20.

[0072] In many cases, the application 16 running on the infotainment system 18 wirelessly communicates with the corresponding cloud service 22. The cloud service 22 facilitates the application's ability to perform bidirectional communication (for performing certain tasks) and the technical effects of certain information. Such tasks include both commercial and non-commercial tasks, including completing certain transactions, such as payment transactions and the operation of certain hardware devices. The application 16 provides certain information to the cloud service 22 to allow secure interaction with it. Such information includes user credentials, information for performing passwordless authentication, or information for performing another authentication method desired by the cloud service 22.

[0073] The remote component 14 of the biometric authenticator operates on a cloud-based server 24, which wirelessly communicates with the infotainment system 18. The interface between the remote component 14 and the vehicle component 12 allows the local component 12 to perform the technical function of retrieving authentication policies 26 and / or configuration information for the vehicle 20 or one or more of its users, and also allows the remote component 14 to receive telemetry information from the local component 12.

[0074] Remote component 14 specifies a policy 26 for using biometric authenticator 10. Such policy 26 includes policies specifying when to use biometric authenticator 10, policies specifying how to use it, and combinations thereof. Human policy manager 27 communicates with remote component 14 to set various policies 26. Vehicle component 12 receives new policies or updates to existing policies and stores them in a policy repository 36 within vehicle 20.

[0075] In some examples, authentication policy 26 requires application 16 to always use biometric authenticator 10. In other examples, authentication policy 26 requires biometric authenticator 10 to be used for authentication requests originating from one or more vehicles 20 or from all vehicles in a fleet 20. In still other examples, authentication policy 26 requires biometric authenticator 10 to be used for all authentication requests originating from a specific person or group of people.

[0076] Examples of specifying how the biometric authenticator 10 is used include specifying the type of authentication to be used. For example, some authentication strategies 26 require the use of facial recognition, other authentication strategies may require voiceprint identification, and still others may require a combination of both.

[0077] Other examples of specifying how to use the biometric authenticator 10 include setting a specific confidence threshold or specifying whether an external security factor should be used in conjunction with the biometric authenticator 10 and the nature of that security factor.

[0078] A typical certification strategy 26 includes information about what the strategy 26 applies to. For example, a specific certification strategy 26 applied to one vehicle 20 may differ from a certification strategy applied to another vehicle. In some cases, a single certification strategy 26 applies to all vehicles 20 in a fleet. The certification strategy 26 also specifies the type of transaction it applies to. For example, a strategy 26 for purchasing gasoline may differ from a strategy 26 for approving engine overhauls. The certification strategy 26 then identifies the certification method and whether biometric certification is required.

[0079] In addition to maintaining authentication policy 26, remote component 14 also performs certain monitoring tasks. Examples of such tasks include collecting usage statistics and telemetry information. Such information indicates how many vehicles 20 have used biometric authenticator 10 and the status of each such use. Other information collected by remote component 14 includes statistics indicating the success or failure rate of authentication attempts. Such information can be used to identify specific vehicles with a high biometric authentication failure rate, and thus to identify information regarding imposter attacks targeting those specific vehicles 20.

[0080] The various sensors equipped on vehicle 20 are collectively referred to as "biometric input 28". The various component sensors of biometric input 28 provide biometric information for authentication. Examples of such signals include signals received from a microphone, signals received from a camera, and signals received from sensors, including tactile sensors, infrared sensors, and sensors that receive energy and convert it into electrical energy.

[0081] Because biometric input 28 provides multiple sources of biometric information, it is possible to select and choose which biometric information should be used. The biometric information actually used for authentication is referred to as a "biometric badge." Therefore, a "biometric badge" is a subset of the information available at biometric input 28 that can be used by the biometric authenticator 10. In some embodiments, the subset is a true subset. In other cases, it is not a true subset.

[0082] Application 16 and vehicle component 12 interface with dialogue manager 30, which runs either in infotainment system 10 as shown or on remote server 24. In response to an authentication request, dialogue manager 30 initiates an appropriate dialogue to guide the user through the authentication process. The authentication process and therefore the appropriate dialogue depend on the nature of the authentication request, the vehicle's status, and any constraints imposed by the relevant authentication policy 26.

[0083] Authentication policy 26 applies to both unidentified users and identified users, such as those who are already logged in. In some cases, authentication policy 26 also extends to specific users. Authentication policy 26 determines an authentication process for each of these different categories of users. In doing so, it also relies on additional context. This context is obtained based on the vehicle's state.

[0084] As an example, for some authentication flows, it may be expected that the user will utter a specific phrase indicating their intent. In this situation, the dialogue manager 30 prompts the user to understand what their intent might be. This can be done either by analyzing the context or by asking the user to utter the specific phrase. In other cases, the authentication process may require some other activity from the user. As an example, if facial recognition is required, the dialogue manager 30 could prompt the user by saying, "Please turn right and look at the camera until the light stops flashing."

[0085] Furthermore, application 16 and vehicle component 12 interface directly with each other to allow retrieval of authentication status, policy information, and user credentials. This information is available through the interface between vehicle component 12 and credential repository 32, biometric repository 34, key repository 35, and the aforementioned policy repository 36. Credential repository 32 stores user credentials from application 16 that uses biometric authentication. Biometric repository 34 stores actual biometric information, such as voiceprints, and is stored separately from other storage. Key repository 35 stores private keys. Policy repository 36 stores authentication policies 26 associated with a specific vehicle 20 and / or one or more specific users 42.

[0086] Vehicle component 12 also includes access to contextual information 38. This contextual information 38 indicates the current state of vehicle 20 and its environment, as inferred from information provided by contextual information source 40. Examples of contextual information source 40 include information provided by biometric input 28 and information from other devices such as clocks, GPS devices, photoelectric sensors, noise sensors, weather sensors, and combinations thereof. Contextual information 38 includes the activities of vehicle 20 (e.g., its location and speed), the population within vehicle 20, and the external environment of the vehicle (e.g., whether it is day or night, rain or sunshine).

[0087] Vehicle component 12 relies on this contextual information 38 as the basis for dynamically modifying the biometric badge based on changing conditions. In some practices, vehicle component 12 modifies the authentication process based on the vehicle's external environment.

[0088] In one example, contextual information 38 indicates that it is nighttime in the vehicle environment. Vehicle component 12 infers that facial recognition may be unreliable in low-light conditions. Strategy 26 instructs the biometric badge to include information generated by facial recognition. However, vehicle component 12 recognizes that low-light conditions are detrimental to accurate facial identification. Therefore, vehicle component 12 effectively vetoes strategy 26 by adaptively changing the requirements of the biometric badge to use something more reliable, such as a voiceprint, instead of in low-light conditions.

[0089] In some practices, vehicle component 12 changes the nature of the biometric badge in response to vehicle activity.

[0090] In one example, contextual information 38 instructs vehicle 20 to move backward, for example, while parallel parking. Vehicle component 12 infers that the driver is facing backward and therefore not visible to a camera for easy positioning. Strategy 26 instructs the biometric badge to rely on information from facial recognition for authentication. Upon recognizing the possibility that the user is facing the wrong direction during this movement, vehicle component 12 rejects strategy 26 and uses a biometric badge that relies on voiceprints instead of facial recognition.

[0091] In another example, contextual information 38 indicates that the vehicle's environment is noisy. Strategy 26 specifies that the biometric badge includes a voiceprint. In this situation, vehicle component 12 rejects the use of a biometric badge that relies on a voiceprint. Instead, vehicle component 12 modifies the biometric badge so that it relies on information that is more reliable in noisy conditions, such as facial recognition.

[0092] In yet another example, contextual information 38 indicates that the passenger, rather than the driver, is seeking authentication. Therefore, the authentication process is not constrained by the need to avoid excessively attracting the driver's attention. Consequently, vehicle component 12 rejects the authentication process specified in strategy 26 to take advantage of this opportunity to use an authentication process that would otherwise be unavailable.

[0093] These examples demonstrate that vehicle component 12 functions as a sensor orchestrator, guiding the activity of various sensors, including biometric input 28, in response to changing environments. This sensor orchestration results in appropriate biometric badges, which have been customized to suit the context in which vehicle 20 is situated.

[0094] As described in the previous example, vehicle component 12 constructs a biometric badge by enabling one sensor (e.g., a camera or microphone) and disabling other sensors. However, this can be viewed as a limiting case of constructing a biometric badge using a weighted sum of sensor outputs, where only one sensor has a non-zero weight. In principle, a biometric badge can be constructed that includes a weighted sum of information from different sources, where, in some extreme cases, some weights are set to zero. The resulting dynamically changing biometric badge is a superposition of different biometric information sources, where a particular superposition is selected based on contextual information 38 derived from contextual information source 40.

[0095] In some embodiments, successful authentication results in the completion of a commercial transaction. However, successful authentication may also lead to other activities, such as unlocking certain data that has been encrypted and stored within vehicle 20 or executing certain commands, such as opening the garage door.

[0096] Typically, user 42 interacts with application 16 to perform actions requiring authentication. Application 16 obtains the relevant authentication policy for that action from vehicle component 12. After determining the relevant policy 26, application 16 then uses dialogue manager 30 to initiate a dialogue that prompts user 42 to perform certain actions conforming to policy 26. User 42 then provides relevant biometric information. Ultimately, application 16 makes a decision on whether the action should be permitted, at least in part, based on the results of the biometric authentication.

[0097] Figure 2 The use of the biometric authenticator 10 in conjunction with a specific task is illustrated.

[0098] The process begins when user 42 opens or otherwise launches application 16 (step 44). Application 16 then communicates with the vehicle component 12 of the biometric authenticator (step 46). Vehicle component 12 checks the policy repository 36 to identify the appropriate policy for the requested task (step 48) and confirms that this type of task actually requires biometric authentication. Furthermore, vehicle component 12 checks the context information 38 to determine whether policy 26 should be modified (step 50).

[0099] Assuming strategy 26 requires biometric authentication of the user's voice, and vehicle 20 actually has a microphone for receiving the user's voice, then vehicle component 12 will transmit the request for a voice sample back to application 16.

[0100] Then, application 16 instructs dialogue manager 30 to instruct user 42 to obtain relevant biometric information for constructing the biometric badge (step 52). In response, user 42 provides the relevant biometric information (step 54) and any confirmation statements that the relevant strategy may require.

[0101] The relevant biometric information is provided to vehicle component 12, which attempts to verify the user's identity (step 56), for example by matching the provided biometric information with the biometric information stored in biometric repository 34 (step 58).

[0102] Application 16 continues to retrieve user credentials (step 60) and then sends a payment request to cloud service 22 (step 62). If everything is successful, cloud service 22 will authorize the payment (step 64). Upon learning of the successful authorization, application 16 informs user 42 of this fact (step 66).

[0103] Before using the biometric authenticator 10, user 42 registered using application 16. For example... Figure 3 As shown, application 16 communicates with vehicle component 12 to register a specific user 42 for biometric authentication (step 68). In response, vehicle component 12 initiates biometric engine 70 (step 72). Biometric engine 70 collects relevant biometric information and prints and stores the corresponding biometric imprint in biometric repository 34 (step 74).

[0104] Then, vehicle component 12 causes encryption engine 78 to create a private key for user 42 (step 76), and then stores it in key repository 35 (step 82).

[0105] In alternative practices, remote component 14 is used instead of vehicle component 12 for execution. Figure 3 The process described in [the document]. The remainder of the process will be similar to that already combined... Figure 3 The process described.

[0106] Figure 4 The process by which application 16 relies on vehicle component 12 in retrieving user credentials is illustrated. The process begins with application 16 requesting vehicle component 12 to verify the user's identity via biometric authentication (step 83). Biometric input 28 retrieves a biometric badge from the claimed user 42 (step 96) and then provides it to vehicle component 12 (step 97). The vehicle component then provides the biometric badge to biometric engine 70 for authentication (step 84). Biometric engine 70 retrieves the stored biometric badge for user 42 from biometric repository 34 and matches it against the retrieved biometric badge (step 85).

[0107] Assuming biometric authentication is successful, vehicle component 12 causes encryption engine 78 to retrieve the user's private key (step 86). Encryption engine 78 then retrieves the private key from key repository 35 (step 88). This private key is now available to application 16 to decrypt the user's credentials, which are stored in encrypted form in credential repository 32 (step 90). Application 16 then uses these credentials to authenticate transactions with cloud service 22 (step 91).

[0108] Figure 5 Shows something like Figure 4 The process is shown, but mediation by the dialog manager 30 is added.

[0109] like Figure 5 As shown, user 42 initiates application 16 (step 92). Application 16 receives information regarding the required biometric authorization. Dialogue manager 30 prompts user 42 with a calculated dialogue to allow user 42 to provide relevant biometric information (step 94). Biometric input 28 receives the relevant biometric information (step 96) and provides it to vehicle component 12 (step 97). The remainder of the process, as already combined... Figure 4 As discussed.

[0110] Figure 6 The steps are shown when user 42, who registered later, attempts to perform a task.

[0111] The process begins when user 42 first launches application 16 (step 98). In response, application 16 prompts user 42 for credentials and offers the option to use biometric authentication in future interactions (step 100). User 42 then provides the credentials to application 16 and also opts to join biometric authentication (step 102).

[0112] In response, application 16 communicates with cloud service 22 to authenticate user 42 (step 104). It also initiates dialogue manager 30. During the subsequent interactive dialogue, dialogue manager 30 instructs user 42 on the steps required to obtain the relevant biometric information (step 106). User 42 provides the requested biometric information according to the instructions of the dialogue manager (step 108). Application 16 then requests the storage of user credentials under a biometric lock (step 110).

[0113] In response, vehicle component 12 performs biometric authentication in a manner described in conjunction with the preceding figures (step 112). After doing so, vehicle component 12 securely stores the user's credentials and a user key stored in association with the user's relevant biometric profile (step 114).

[0114] At a later time, user 42 relaunches application 16 (step 116). Once again, dialogue manager 30 is invoked to provide a dialogue that guides user 42 through the process of providing biometric information (step 118). User 42 then provides appropriate biometric information, for example, by speaking a phrase or by presenting their face to the camera (step 120). Application 16 then sends a request for user credentials to vehicle component 12 (step 122).

[0115] Upon receiving a request, vehicle component 12 performs the standard biometric authentication process described in conjunction with the previous figures (step 124) and retrieves credentials using the user key (step 126). These credentials are provided to application 16, which then uses them in conjunction with authentication from cloud service 22 (step 128).

[0116] Figure 7 A credential access method performed by biometric authenticator 10 is illustrated. The method begins with vehicle component 12 receiving certain credentials from user 42, including a biometric badge, from application 16 (step 130). Vehicle component 12 performs biometric authentication in a manner described in conjunction with the previous figures (step 132). Assuming successful biometric authentication, vehicle component 12 proceeds to retrieve the user's private key from key repository 35 (step 134). The private key is then used to decrypt the user credentials (step 136). Application 16 then presents these user credentials to cloud service 22 for authenticating user 42 (step 138).

[0117] In some cases, application 16 takes the form of a car assistant, where transactions typically involve features that control vehicle 20, or features of a nearby device configured to receive instructions from application 16. Therefore, the transaction is no longer commercial in nature. A car assistant is typically an application that operates on infotainment system 18 and understands and executes user commands by interpreting speech, text, gestures, or combinations thereof.

[0118] Figure 8 An example of application 16 operating as a car assistant is shown. After receiving a voice command from user 42 (step 142), the car assistant typically sends a signal to another device 154 to perform a task. Examples of such a device 154 are devices inside the vehicle 20, such as mechanisms for rolling windows up or down or climate control systems. Other examples include devices 154 outside the vehicle 20, such as garage door openers, in which case the task would be to open the garage door. In this case, expecting some type of authentication is necessary and not unreasonable.

[0119] Application 16 provides the utterance to speech recognizer 144, which determines the content of the utterance (step 146). Upon learning that the user's intent is to operate device 154 (which requires authentication before operation), application 16 consults vehicle component 12 to determine the correct authentication strategy for performing the task (step 148). Vehicle component 12 returns the relevant strategy (step 150).

[0120] When it is determined that the certification strategy requires biometric certification, application 16 sends a certification request to vehicle component 12. Upon receiving a message indicating successful biometric certification, application 16 sends a signal to device 154 to perform a related task, such as opening the garage door (step 152).

[0121] Figure 9 An embodiment of user 42 initiating application 16 (step 156) is shown. Application 16 then communicates with vehicle component 12 to indicate that it has been requested to perform a specific task (step 158). Vehicle component 12 then requests vehicle policy manager 13 to evaluate relevant policy 26 (step 160). Vehicle policy manager 13 analyzes policy 26 based on contextual information 38 and checks available sensors in biometric input 28 (step 162). It then determines that modifications are needed, such as authentication upgrades or changes to biometric measurements (step 164). Vehicle policy manager 13 then provides this information to vehicle component 12, which instructs dialogue manager 30 to collect relevant biometric information (step 166). Dialogue manager 30 and user 42 then engage in a dialogue with the collection of relevant biometric information as its final outcome (step 168). Once the biometric information has been collected, authentication proceeds in the previously discussed manner, and application 16 is notified accordingly (step 170).

[0122] It should be understood that the foregoing description is intended to illustrate, not limit, the scope of the invention, which is defined by the appended claims. Other embodiments are within the scope of the following claims.

Claims

1. A method for using an application executed on a vehicle's infotainment system, the method comprising: The application receives information indicating that the occupant of the vehicle has requested to perform a task. A first strategy is selected from multiple strategies, each strategy corresponding to a different task. The first strategy defines a first biometric authentication process dedicated to the task. A second strategy is generated based on the first strategy. The second strategy is used to perform the occupant's biometric authentication process. Based on the result of the biometric authentication, the execution of the task is authorized. The second strategy defines a second biometric authentication process that is different from the first biometric authentication process.

2. The method of claim 1, wherein generating the second strategy comprises: The first strategy is modified based on contextual information, wherein the contextual information indicates the state of the vehicle.

3. The method of claim 1, wherein generating the second strategy comprises: The first strategy is determined to require the measurement of a first biometric feature, and the second strategy uses the measurement of a second biometric feature.

4. The method of claim 1, wherein generating the second strategy comprises: The biometric features used for authentication, which are relied upon in the second strategy, are selected based at least in part on contextual information indicating the state of the vehicle.

5. The method according to claim 1, wherein, The multiple policies are stored on a remote server.

6. The method of claim 1, wherein the first strategy requires biometric authentication using a first method selected from the group consisting of facial recognition and speech recognition, and generating the second strategy includes causing the second strategy to require biometric authentication using a second method selected from the group consisting of facial recognition and speech recognition, the second method being different from the first method.

7. The method of claim 1, wherein generating the second strategy comprises: The light level inside the vehicle's cabin is determined to be insufficient to utilize the biometric features relied upon in the first strategy, which serve as the basis for the authentication.

8. The method of claim 1, wherein generating the second strategy comprises: It was determined that there was too much noise and the biometric features on which the first strategy relied could not be used.

9. The method of claim 1, wherein generating the second strategy comprises: The biometric feature used for authentication, which is relied upon in the second strategy, is selected based on the direction in which the vehicle is traveling.

10. The method of claim 1, wherein generating the second strategy comprises: The biometric feature used for authentication, which is relied upon in the second strategy, is selected based on the speed of the vehicle.

11. The method according to claim 1, wherein, Performing the occupant's biometric authentication includes: enabling a dialogue manager to conduct an interactive dialogue with the occupant to guide the occupant to provide biometric information for use in the biometric authentication.

12. The method of claim 1, wherein generating the second strategy comprises: The first biometric authentication process is modified based on the fact that the occupant seeking authentication is a passenger in the vehicle.

13. The method of claim 1, wherein generating the second strategy comprises: The sensors in the vehicle are programmed to collect different types of biometric information in response to changes that occur during the operation of the vehicle.

14. The method of claim 1, wherein generating the second strategy comprises: A biometric badge is defined to serve as the basis for biometric authentication in the second strategy. The biometric badge is based on different types of biometric information, which have been weighted based on contextual information obtained from sensors in the vehicle.

15. The method of claim 1, wherein generating the second strategy comprises: Define a dynamically changing biometric badge to serve as the basis for biometric authentication in the second strategy, wherein the dynamically changing badge is an overlay of different biometric information sources, and the overlay is selected based on contextual information.

16. The method according to claim 1, wherein, The task is the transfer of resources from a first location to a second location.

17. The method according to claim 1, wherein, The task is to operate the equipment outside the vehicle.

18. The method of claim 1, further comprising receiving an instruction to modify the authentication policy at the remote component.

19. The method of claim 1, wherein generating the second strategy comprises: The first strategy is modified based on the number of occupants in the vehicle.

20. The method according to claim 1, further comprising: Multiple authentication policies are maintained at the remote component, including policies applicable only to a first fleet, policies applicable to a second fleet, policies applicable to a specific set of occupants, policies applicable only to a specific geographic location and not to other geographic locations, and policies applicable only to certain time intervals and not to other time intervals, wherein the second fleet is different from the first fleet.

21. An apparatus comprising a biometric authenticator that communicates data with an application running on an infotainment system of a vehicle, the biometric authenticator including vehicle components running on the infotainment system and remote components running on a remote server, wherein the biometric authenticator further includes a policy repository storing authentication policies, each authentication policy corresponding to a different task, the policies including a first policy defining a first biometric authentication process dedicated to a first task, wherein the biometric authenticator is configured to generate a second policy based on the first policy and perform biometric authentication of an occupant of the vehicle who has requested to perform the first task, wherein the biometric authenticator is further configured to use the second policy to perform biometric authentication of the occupant and, based on the result of the biometric authentication, authorize the execution of the first task, wherein the second policy defines a second biometric authentication process different from the first biometric authentication process.

22. A method comprising executing a first instance and a second instance of an application in the infotainment systems of corresponding first and second vehicles, wherein, The corresponding occupant in the vehicle has requested the first and second instances of the application to perform a corresponding first and second task, wherein the first and second tasks are the same. The method further includes causing the first instance of the application to perform a first biometric authentication process to authenticate the first occupant, and causing the second instance of the application to perform a second biometric authentication process to authenticate the second occupant. Since the first vehicle and the second vehicle are in different states, the first biometric authentication process is different from the second biometric authentication process, and the different states cause corresponding differences in the context information of the first vehicle and the second vehicle.

Images