Safety certification from automobiles
Voice biometric authentication with acoustic watermarks and vehicle sensor data enhances transaction security, preventing fraud in credit card transactions.
Patent Information
- Application Number
- JP2023505754
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2020-07-30
- Filing Date
- 2021-05-03
- Publication Date
- 2025-08-01
- Estimated Expiration
- 2041-05-03
AI Technical Summary
Credit cards are vulnerable to fraudulent transactions, necessitating improved security measures.
A secure transaction authentication method using voice biometric authentication combined with an acoustic watermark embedded in audio data, enhanced with vehicle sensor information, and verified through a remote data processing system.
Enhances transaction security by preventing eavesdropping and recorded audio insertion, ensuring authentic transactions.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Technical Field
[0001] Cross - reference to related applications This application claims the benefit of the priority date of U.S. Provisional Patent Application No. 63 / 058,867, July 30, 2020, the content of which is incorporated herein by reference.
[0002] The present invention relates to payment processing, and in particular, to the authentication of payments.
Background Art
[0003] Credit cards are a convenient way to make payments. However, there are cases where they can be arranged to be used for fraudulent transactions.
[0004] To reduce the possibility of such transactions, it is known to implement various security measures.
Summary of the Invention
Means for Solving the Problems
[0005] The present invention realizes a secure method for authenticating transactions when in a vehicle by combining voice biometric authentication as an additional means. In some embodiments, the transaction is a credit card transaction.
[0006] In one example, the method relies on an acoustic watermark derived in part from voice biometric authentication.
[0007] Therefore, the audio watermark is associated with the raw audio file for creating the watermarked audio data. This watermark contains secret and inaudible information associated with the audio file. In some embodiments, this associated information results from the watermark being hidden in the raw audio file. In other embodiments, the association becomes more apparent when the raw audio file is associated with the watermark file. In this case, since the watermark is no longer encrypted, it is advantageous to encrypt the watermark file.
[0008] Next, the watermarked audio data is enhanced by encoding information derived from the sensors of the vehicle itself. Such information includes, for example, the position derived from the GPS system.
[0009] Subsequently, the resulting enhanced watermarked audio data is transmitted to a remote data processing system. The remote data processing system contains data that can authenticate the speaker based on voice biometrics. However, the information from the vehicle sensors provides a basis for independent verification. In some examples, independent verification may be performed by communicating with the vehicle's telematics server.
[0010] In some implementations, the watermark may be extracted by the remote data processing system before performing the matching.
[0011] As another example, since the watermark represents only the vehicle's identification information, variable information may be omitted. In this embodiment, the data processing system learns to accept only the utterances by the person in the vehicle.
[0012] The method described herein makes it more difficult to commit fraud. In particular, this method prevents eavesdropping on the communication between the client and the server and the insertion of recorded audio.
[0013] In one aspect, the present invention features a method executed by a verification device that communicates with a telematics server that communicates with a plurality of vehicles including a first vehicle, the method including receiving verification data from the first vehicle. The verification data includes enhanced watermarked voice data including an acoustic watermark, a voice file, and first vehicle information. The method then extracts a voiceprint and the first vehicle information and performs voice biometric authentication on the voiceprint. Based on the results of these operations, the method then receives from the telematics server first telemetry data provided by the first vehicle to the telematics server, and determines whether the first vehicle information and the first telemetry data Integration meet the criteria and authenticate the transaction.
[0014] Examples of the method include the first vehicle information and the first telemetry data including GPS information indicating the location of the first vehicle, them including the position of the first vehicle, them including the identification information of the first vehicle, them including both the position of the first vehicle and the identification information of the first vehicle, them including time-varying driving parameters of the first vehicle, and them including information provided by an on-board diagnostic system of the first vehicle.
[0015] In an embodiment where the first vehicle information and the first telemetry data include first and second time-varying driving parameters of the first vehicle, examples of the method also include inspecting whether the first and second time-varying driving parameters Integration meet the criteria.
[0016] A further example includes the presented transaction being a transaction in which a credit card is presented.
[0017] Also, some examples of the method include identifying a telematics server from among a plurality of corresponding telematics servers that each receive telemetry data from a plurality of corresponding vehicles before receiving the first telemetry data.
[0018] In some embodiments, receiving, from a second vehicle, second verification data including both an audio file and an acoustic watermark, and second telemetry data from a telematics server to which the second vehicle transmits telemetry data; and determining, based on the second verification data and the second telemetry data, that the second vehicle information and the second telemetry data Non-integration are as described; and providing information indicating that the third vehicle information and the fourth vehicle information do not match.
[0019] In embodiments where the verification data is encoded, the method further includes decoding the encoded data to obtain a voiceprint and first vehicle information.
[0020] In further embodiments, performing voice biometric authentication on the voiceprint includes determining that the voiceprint matches a voiceprint from a voiceprint library.
[0021] When the first vehicle information includes a first time-varying driving parameter and a second time-varying driving parameter of the first vehicle, in some embodiments, Non-integration identifying the relationship between the first time-varying driving parameter and the second time-varying driving parameter is also included.
[0022] Some embodiments further include at least one of extracting a voiceprint and first vehicle information, determining that the voiceprint matches a voiceprint from a voiceprint library, receiving second vehicle information from a telematics server communicating with the vehicle, determining that the first vehicle information and the second vehicle information match, and authenticating a presented transaction, being performed without the occurrence of non-abstract and / or mental steps, particularly without the occurrence of mental steps performed by a human mental organ.
[0023] In some embodiments, the watermark is embedded in the audio file by steganography, and the watermark is hidden in the audio file, and the watermark is an encrypted watermark associated with the audio file. In still other embodiments, the audio file includes non-audible data.
[0024] In another aspect, the present invention features an apparatus including a biometric verification device. The biometric verification device includes a voiceprint library, a decoder, and a verification channel for receiving telemetry data from a telematics server that receives telemetry data from a vehicle. The decoder is configured to extract vehicle information and voiceprint information from received verification data including enhanced watermarked audio data. The biometric verification device is further configured to compare the voiceprint information with voiceprints in the voiceprint library and compare the vehicle information with telemetry received from the telematics server.
[0025] Some embodiments of the verification device include a multiplexer that switches the verification channel by receiving telemetry data from a first telematics server rather than from a second telematics server.
[0026] In another aspect, the present invention features an apparatus including a biometric verification device that communicates with a telematics server that communicates with a plurality of vehicles including a first vehicle. Such a biometric verification device includes a decoder, a communication channel, a voiceprint library, and a matching engine. The decoder receives verification data from the first vehicle. The verification data includes an audio file, first vehicle information, and an acoustic watermark. The decoder extracts a voiceprint and first vehicle information from the verification data. The communication channel receives first telemetry data from the telematics server. The first telemetry data would be provided to the telematics server by the first vehicle. The voiceprint library is accessed by the matching engine while performing voice biometric authentication on the voiceprint, and the first vehicle information and the first telemetry data are IntegrationIt is used in relation to the determination of the matching engine. The telemetry data and the first vehicle information Integration In response to identifying, the biometric authentication verification device transmits a signal for authenticating the presented transaction, which is, as an example, a credit card or debit card transaction.
[0027] In an embodiment, the decoder is configured to decode verification data including GPS information indicating the location of the first vehicle Report In an embodiment, the decoder is configured to decode verification data including the location of the first vehicle Report In an embodiment, the decoder is configured to decode verification data including the identification of the first vehicle where the first vehicle information is the first vehicle Information In an embodiment, the decoder is configured to decode verification data including the location of the first vehicle Report The location of the first vehicle and the identification of the first vehicle Information In an embodiment, the decoder is configured to decode verification data including the location and identification of the first vehicle, and Report In an embodiment, the decoder is configured to decode verification data including the time-varying driving parameters of the first vehicle.
[0028] In some embodiments, the first vehicle information and the first telemetry data include first time-varying driving parameters and second time-varying driving parameters for the first vehicle. In such an embodiment, the biometric authentication verification device checks whether the first time-varying driving parameters and the second time-varying driving parameters Integration are the same.
[0029] In other embodiments, the first vehicle information and the first telemetry data include information provided by the on-board diagnostic system of the first vehicle.
[0030] In other embodiments, the biometric authentication verification device is further configured to identify a telematics server from among a plurality of telematics servers that receive telemetry data from a plurality of corresponding vehicles before receiving the first telemetry data.
[0031] In yet other embodiments, the biometric authentication device receives second verification data from a second vehicle from a telematics server to which the second vehicle sends telemetry data, and based on the second verification data and the second telemetry data, determines that the second verification data and the second telemetry data are Non-integration and is further configured to provide information indicating this Non-integration .
[0032] Some embodiments may include that the verification data is encoded and the decoder is configured to decode the encoded data to obtain a voiceprint and first vehicle information.
[0033] In some embodiments, the matching engine is configured to determine that the voiceprint matches the voiceprint from the voiceprint library.
[0034] In other embodiments, the first vehicle information includes first time-varying driving parameters and second time-varying driving parameters for the first vehicle. In such embodiments, the matching engine is configured to check whether the first time-varying driving parameters and the second time-varying driving parameters are Non-integration .
[0035] In yet other embodiments, the biometric authentication device is configured to stop receiving the first telemetry data and start receiving second telemetry data associated with the second vehicle. etc
[0036] Embodiments may further include that the decoder is configured to identify that a watermark is embedded in the audio file by steganography and the decoder is configured to identify an encrypted watermark associated with the audio file.
[0037] Further embodiments may include that the audio file includes non-audible data.
[0038] In addition, among the embodiments of the biometric authentication verification device, there is one that includes a multiplexer that transfers a verification channel between receiving telemetry data from a first telematics server and receiving telemetry data from a second telematics server.
[0039] The method described in this specification is composed of substances, particularly baryon substances, consumes energy, and is executed only by a processing system that generates waste heat in a non-abstract manner. Note that the description of abstract implementations is omitted for clarity. Therefore, the claims refer to non-abstract subjects. The term "non-abstract" described in this specification is the opposite of the term "abstract" as understood by the US courts at the time of this application. Therefore, anyone who interprets the claims as "abstract" is either misunderstanding or using this term in a way that contradicts its legal meaning.
Brief Description of the Drawings
[0040]
Figure 1
Figure 2
Figure 3
Embodiments for Carrying Out the Invention
[0041] FIG. 1 shows a vehicle 10 that transports a passenger 12 who starts a secure transaction by forming an utterance 14 that includes an audio passphrase 16.
[0042] Vehicle 10 is equipped with an in-vehicle communication system 18 equipped with a microphone 20 and a loudspeaker 22. The microphone 20 receives speech 14 and generates a corresponding electrical waveform 24. The in-vehicle communication system 18 receives the waveform 24 and, after several processing steps, causes the authentication data 25 to be transmitted to the biometric verification device 28 via the antenna 26. This verification data 25 includes the voice of the occupant and Integration enhanced watermarked voice data for the identification of the occupant 12 Information to be possible.
[0043] In a preferred embodiment, the transmission to the biometric verification device 28 includes passing the information including the speech 14 to an encoder 30. The encoder 30 encodes an acoustic watermark 32 onto this information.
[0044] Referring now to FIG. 2, the biometric verification device 28 provides a voice biometric service. To provide such a service, the biometric verification device 28 includes a decoder 34, a matching engine 40, and a voiceprint library 36. The decoder 34 is configured to decode the information provided by the encoder 30. The matching engine 40 verifies the authenticity of the speaker's voice based on a part of the library 36.
[0045] In addition, the biometric verification device 28 features a verification channel 38 and a matching engine 40. The verification channel 38 connects to a telematics server 42 that receives telemetry data 50 from the vehicle 10. The matching engine 40 performs a comparison between the information provided by the vehicle 10, the information provided by the telematics server 42, and the information present in the voiceprint library 36.
[0046] In some embodiments, the biometric authentication verification device 28 is connected to one or more additional telematics servers 66. In such embodiments, the biometric authentication verification device 28 further includes a multiplexer 68 for selecting which telematics servers 66, 42 should be connected to the verification channel 38. Such a selection is made based on vehicle information 46 that is transmitted as part of the verification data 25 from the vehicle 10.
[0047] Referring back to FIG. 1, the vehicle 10 further includes a sensor 44 that provides vehicle information 46 to the telematics transmitter 48. The telematics transmitter 48 converts this information into telemetry data 50 and then transmits this to the telematics server 42. The telematics server 42 routinely receives telemetry data 50 from many vehicles 10 via the cellular network. This vehicle information 46 is also provided to the encoder 30 for eventual transmission to the biometric authentication verification device 28.
[0048] In some embodiments, the vehicle 10 includes an on-board diagnostic system 52. In such embodiments, the sensor 44 includes one or more sensing elements associated with the on-board diagnostic system 52.
[0049] The output of the sensors described herein includes vehicle information 46 collected by one or more sensing elements distributed across the vehicle 10, including those associated with the on-board diagnostic system 52. Embodiments include those in which the sensor 44 includes one or more sensing elements selected from the group consisting of a geolocation device 54, an accelerometer 56, a speedometer 58, a fuel level sensor 60, a thermometer 62, and a pressure sensor 64.
[0050] Examples of vehicle information 46 include the vehicle's instantaneous location, its trajectory as a function of time of that location, or any dynamic parameter such as acceleration or speed. This type of vehicle information 46 can be obtained from one or more of the geolocation device 54, accelerometer 56, and speedometer 58.
[0051] As another example of the vehicle information 46, time-varying driving parameters such as the fuel level provided by the fuel level sensor 60, the temperature inside and outside the vehicle provided by the thermometer 62, and the tire pressure measured by the pressure sensor 64 can be mentioned.
[0052] The vehicle information 46 does not have to be limited to the information collected by the sensor 44. For example, in some embodiments, the vehicle information 46 includes information such as the frequency to which the vehicle's wireless is synchronized and the vehicle identification number (VIN) of the vehicle.
[0053] Referring now to FIG. 3, the verification process 65 that starts with the verification server receiving the verification data 25 from the encoder 30 is carried out (step 66).
[0054] The decoder 34 decodes the verification data 25 to extract the acoustic watermark 32, the vehicle information 46, and the voice passphrase 16 (step 68). Next, the matching engine 40 attempts to match the voice of the occupant with the voiceprint from the voiceprint library 36 (step 70).
[0055] The decoder 34 also extracts the vehicle information 46 generated from the vehicle 10 (step 72) and identifies the telematics server 42 that communicates with the vehicle 10. Next, the biometric verification device 28 establishes communication with the identified telematics server (step 74), and then the matching engine 40 compares the vehicle information 46 received from the vehicle 10 with the corresponding telemetry data 50 that the vehicle 10 independently sent to the telematics server 42 (step 76).
[0056] If the comparison is favorable, the biometric verification device 28 provides a signal indicating that the presented transaction is likely to be genuine (step 80). On the other hand, if the comparison is not favorable, the biometric verification device 28 provides a signal indicating that the presented transaction is likely not to be genuine (step 82).
[0057] In some embodiments, the vehicle information 46 isIntegration It includes several operating parameters that can be checked against each other. For example, an outside air temperature below freezing or the spatial coordinates where the vehicle 10 is located within the tropical region would be something that would raise some doubts by the biometric verification device 28.
[0058] The present invention and its preferred embodiments have been described, but what is newly guaranteed by the patent certificate is as follows.
Claims
1. An apparatus comprising a plurality of vehicles including a first vehicle, and a biometric authentication verification device that communicates with each of the plurality of vehicles and a telematics server that communicates with the plurality of vehicles, wherein the telematics server receives telemetry data including vehicle information of each of the plurality of vehicles provided from each of the plurality of vehicles, The biometric authentication verification device, Receives verification data including an audio file of an occupant of the first vehicle, first vehicle information provided from the first vehicle, and an acoustic watermark from the first vehicle, and extracts a voiceprint and the first vehicle information from the verification data, a decoder; A communication channel for receiving first telemetry data provided to the telematics server by the first vehicle from the telematics server; A voiceprint library; Performs voice biometric authentication on the voiceprint extracted by the decoder using the library, and compares the first vehicle information extracted by the decoder with the vehicle information included in the corresponding first telemetry data, a matching engine for determining that the first vehicle information and the first telemetry data match And comprising, In response to identifying that the first vehicle information and the first telemetry data match, the biometric authentication verification device transmits a signal for authenticating a presented transaction.
2. The apparatus according to claim 1, wherein the decoder is configured to decode verification data in which the first vehicle information includes GPS information indicating the location of the first vehicle.
3. The apparatus according to claim 1, wherein the decoder is configured to decode verification data in which the first vehicle information includes the position of the first vehicle.
4. The apparatus according to claim 1, wherein the decoder is configured to decode verification data in which the first vehicle information includes identification information of the first vehicle.
5. The apparatus according to claim 1, wherein the decoder is configured to decode verification data in which the first vehicle information includes the position of the first vehicle and the identification information of the first vehicle.
6. The apparatus according to claim 1, wherein the decoder is configured to decode verification data in which the first vehicle information includes time-varying driving parameters of the first vehicle.
7. The first vehicle information and the first telemetry data include first time-varying driving parameters and second time-varying driving parameters for the first vehicle. The biometric authentication verification device according to claim 1, wherein the biometric authentication verification device is configured to inspect whether the first time-varying driving parameter and the second time-varying driving parameter of the first vehicle information and the corresponding first telemetry data match.
8. The device according to claim 1, wherein the presented transaction is a credit card transaction.
9. The device according to claim 1, wherein the first vehicle information and the first telemetry data include information provided by an on-vehicle diagnostic system of the first vehicle.
10. The biometric authentication verification device according to claim 1, wherein the biometric authentication verification device is configured to identify the telematics server from among a plurality of telematics servers that receive telemetry data from a plurality of corresponding vehicles before receiving the first telemetry data.
11. The decoder is further configured to receive second verification data from a second vehicle. The communication channel is further configured to receive second telemetry data from a second telematics server through which the second vehicle sends second telemetry data. The matching engine is further configured to determine that the second vehicle information and the second telemetry data match by comparing the second vehicle information extracted by the decoder with the vehicle information included in the corresponding second telemetry data. The biometric authentication verification device according to claim 1, wherein the biometric authentication verification device is further configured to provide information indicating a mismatch in response to identifying that the second vehicle information and the second telemetry data do not match.
12. The device according to claim 1, wherein the verification data is encoded, and the decoder is configured to decode the encoded data to obtain the voiceprint and the first vehicle information.
13. The matching engine according to claim 1 is configured to determine that the voiceprint matches a voiceprint from a voiceprint library.
14. The first vehicle information includes a first time-varying driving parameter and a second time-varying driving parameter of the first vehicle, and the matching engine is configured to identify an inconsistency between the first time-varying driving parameter and the second time-varying driving parameter. The apparatus according to claim 1.
15. The biometric authentication verification device is configured to stop receiving the first telemetry data and start receiving second telemetry data associated with a second vehicle. The apparatus according to claim 1.
16. The decoder is configured to identify that a watermark is embedded in the audio file by steganography. The apparatus according to claim 1.
17. The decoder is configured to identify an encrypted watermark associated with the audio file. The apparatus according to claim 1.
18. The audio file includes non-audible data. The apparatus according to claim 1.
19. The apparatus according to claim 1, further comprising a multiplexer configured to transfer a verification channel between receiving telemetry data from a first telematics server and receiving telemetry data from a second telematics server.
20. A method executed by a biometric authentication verification device that communicates with a plurality of vehicles including a first vehicle, a telematics server that communicates with the plurality of vehicles, respectively, wherein the telematics server receives telemetry data including vehicle information of each of the plurality of vehicles provided from each vehicle, receiving verification data including an audio file of an occupant of the first vehicle, first vehicle information provided from the first vehicle, and an acoustic watermark from the first vehicle, extracting the voiceprint and the first vehicle information from the verification data, performing voice biometric authentication on the voiceprint, receiving, from the telematics server, first telemetry data provided to the telematics server by the first vehicle based on a result of performing the voice biometric authentication, determining that the first vehicle information and the first telemetry data are consistent by comparing the first vehicle information extracted from the verification data with the corresponding first telemetry data. Authenticating the presented transaction based on determining that the first vehicle information extracted from the verification data matches the first telemetry data A method comprising the above.