In-vehicle payment method and apparatus, and vehicle

Abstract

Disclosed in the present invention are an in-vehicle payment method and apparatus, and a vehicle. The method comprises: displaying a payment interface on a piece of windshield, and inputting numbers by means of voice to complete password input, which comprises: acquiring a plurality of different images, and corresponding all passwords to the images, such that each password corresponds to at least one image, wherein the payment interface comprises a group of images, the rule of which is that the group of images at least includes at least one image respectively corresponding to all the passwords in a preset password group, and each image in the group of images also corresponds to one number; inputting a group of numbers by means of voice, acquiring, on the basis of a correspondence between the numbers, the images and the passwords, a password group corresponding to the group of numbers input by means of voice, and performing password comparison on the password group and the preset password group; moreover, performing voice identity recognition on the basis of voice; and if the password comparison and the voice identity recognition are both passed, completing payment.

Description

Automobile payment method, device and vehicle

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] The embodiments of this application are based on and claim the priority of Chinese patent application with application number 202311027905.3 and application date August 15, 2023. The entire contents of the Chinese patent application are hereby introduced into the embodiments of this application as a reference. Technical Field

[0003] The present invention belongs to the technical field of automobile payment, and in particular relates to an automobile payment method, device and vehicle. Background Art

[0004] With increasing levels of intelligence, modern cars offer not only mobility but also a "third space" for entertainment, social interaction, office work, and mobile payments. Traditionally, when using the in-vehicle infotainment (IVI) system to search for restaurants, book hotels, and perform other payment operations, the process involves entering a financial account password. However, when other passengers are present, drivers are uncomfortable and unwilling to enter their account passwords in front of them. Therefore, a method for protecting in-vehicle payment passwords becomes particularly important.

[0005] In addition, even if other passengers remember the security code entered by the car owner, it must be ensured that if the car owner is not driving the car, the passengers who remember the security code will not be able to use the car's payment function.

[0006] Summary of the Invention

[0007] The purpose of the present invention is to provide a car payment method, device and vehicle to solve the problem that the car owner is inconvenient and unwilling to enter the account number and password in front of other passengers when paying by car.

[0008] The technical solutions of the present invention are as follows:

[0009] A car payment method is applied to the electronic equipment of the vehicle.

[0010] The payment interface is displayed on the windshield, and the password is entered by voice input, including:

[0011] Obtain multiple different images and match all passwords to images so that each password corresponds to at least one image;

[0012] Displaying a payment interface on the windshield, the payment interface comprising a set of images, wherein the set of images comprises at least one image corresponding to each of the passwords in the preset password set, and each image in the set of images corresponds to a number;

[0013] Input a group of numbers by voice, obtain the password group corresponding to the voice-input number group based on the correspondence between numbers, images and passwords, and compare the password with the preset password group;

[0014] At the same time, voice identity recognition is performed based on the voice; if both the password comparison and voice identity recognition are passed, the payment is completed.

[0015] Based on the same inventive concept, the present invention further provides a car payment device for implementing any of the above-mentioned car payment methods, the device comprising:

[0016] In-vehicle infotainment system (IVI), used to provide a payment interface;

[0017] The password setting and conversion module is integrated into the IVI and is used to set a preset password group and complete the correspondence between the password and the image, and generate the image group according to the rules;

[0018] Head-up display (HUD), used to display the payment interface on the windshield;

[0019] A speech recognition module for voice identification and recognition of digital groups input by voice;

[0020] The payment control module is used to compare passwords and receive voice identity recognition results to ultimately complete payment decisions.

[0021] Based on the same inventive concept, the present invention also provides a vehicle, which adopts any one of the above-mentioned car payment methods.

[0022] Compared with the prior art, the present invention has the following advantages and beneficial effects:

[0023] The present invention displays the payment interface on the windshield and completes the password input by inputting numbers through voice, so that the driver does not need to take his eyes off the front and his hands do not need to leave the steering wheel when paying, thereby improving driving safety; and the payment interface displays a group of images, which can be randomly generated according to the rules. Even for the same preset password group, the image group displayed each time can be different, including the two situations where the image group itself is different and the order of images in the image group is different, thereby avoiding the problem of being inconvenient and unwilling to enter the account password in front of other passengers; at the same time, voice identity recognition is also performed based on voice, even if the passenger remembers the image password, he cannot use the car payment function, thereby further improving the security of payment.

[0024] Furthermore, all passwords are matched with images according to preferences to facilitate memorizing the corresponding relationship between passwords and images. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 is a diagram of the architecture of a car payment device;

[0026] Figure 2 is a password and image mapping diagram;

[0027] Figure 3 is an image text substitution cipher diagram;

[0028] Figure 4 is an image-based password setting diagram;

[0029] Figure 5 is a diagram of the payment interface;

[0030] FIG6 is a flow chart of a method for protecting a car payment password;

[0031] FIG7 is a flowchart of password input and driver identity authentication;

[0032] Figure 8 is a payment flow chart;

[0033] FIG9 is a diagram of a car payment device. DETAILED DESCRIPTION

[0034] In order to make the objectives, technical solutions and advantages of the present invention more clearly understood, the present invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only intended to illustrate the present invention and are not intended to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below may be combined with each other as long as they do not conflict with each other.

[0035] As cars become increasingly intelligent, they are becoming a "third living space" for people, serving as a place for mobility, work, leisure, and entertainment. While providing users with information about locations and surrounding services, the car cabin also needs to offer payment functionality on demand. This necessitates a car payment system. Furthermore, if other passengers are present, the cabin is no longer a completely private space, making payment password protection a crucial component of this system. Even if another passenger remembers the security password entered by the driver, the car's payment function must be unavailable to those who remember the password unless the driver is driving.

[0036] The present invention provides an automobile payment system and device, as well as a password protection method, which can effectively solve the above problems.

[0037] Driver cognition encompasses attention, perception, memory, learning, planning, reasoning, and decision-making. Driver activities in the vehicle are categorized as primary tasks (driving tasks) and secondary tasks (non-driving tasks). Both types of tasks consume the driver's cognitive resources, increasing their mental workload and thus impacting driving safety.

[0038] Drivers acquire driving information through vision, hearing, and touch, with vision being the primary channel. If a driver's gaze wanders beyond the road for more than two seconds, it can be dangerous for the vehicle. Even in today's Level 3 autonomous vehicles, the driver's field of vision remains constant.

[0039] When using the payment function in a vehicle, the driver takes more than 2 seconds to operate it. Therefore, the present invention follows design psychology and proposes the following design principles:

[0040] (1) When entering the payment password, the driver does not need to look away from the front and does not need to take his hands off the steering wheel;

[0041] (2) If there are other passengers in the vehicle, the privacy and security of the password must be guaranteed.

[0042] The automobile payment system of the present invention is shown in FIG1 :

[0043] The app payment interface in the car's IVI (In-Vehicle Infotainment) system is displayed on the car's front windshield;

[0044] The driver can enter a password into the IVI through voice interaction, while the DMS's facial recognition and voice recognition technologies can simultaneously confirm the driver's identity. Voice recognition can be implemented using neural networks, sound processing, voiceprint feature extraction, and other methods.

[0045] The voice command password is subject to password protection. Car payment password protection method:

[0046] Generally, passwords are composed of numbers or letters. By visualizing the digital password and presenting it to the driver through graphic symbols, it can help the driver to identify it and also play a good role in keeping it confidential. The specific contents are as follows:

[0047] Password Setting: Based on the number of actual passwords (e.g., N), the driver selects N images in advance (image content is not limited and can be based on the driver's preferences, such as landscapes, people, symbols, text, etc.). Alternatively, the driver selects a single photo and segments it to generate N images. The images are then associated with the password numbers, with one image corresponding to one password, as shown in Figure 2.

[0048] Of course, you can also make one password correspond to multiple images. In this case, the number of images needs to be greater than the number of passwords.

[0049] For example, a text image can replace a password: six images of the phrase "I want to drive safely" can replace the six digits of the numeric password "454323," as shown in Figure 3. The driver first enters the password and then selects an image based on the corresponding image, pairing it with the password. In this case, all passwords can be associated with images based on preferences, making it easier to remember the corresponding relationship between passwords and images. For example, a favorite image can be associated with a password in a preset password group, while a disliked image can be associated with a password outside the preset password group. Alternatively, the generated sub-images can be sequentially associated with passwords, so that the image in the upper left corner corresponds to the first password, making it easier to remember.

[0050] For example, to set a password using a photo (e.g., of Audrey Hepburn), you first need to select a photo and then split it into N images (corresponding to N passwords). Again, using the six-digit password "454323" as an example, use the Audrey Hepburn image as the password. First, select the Audrey Hepburn photo, then specify the number of passwords (N, in this case, 6). Split the Audrey Hepburn image, as shown in Figure 4, and then match the passwords according to the split images ①, ②, ③, ④, ⑤, and ⑥.

[0051] Password interface transformation: The password interface is transformed into one with images, and password images are randomly placed on the password interface. Again, using the example of six images of text and images ("I want to drive safely"), the converted password is "159732," which represents the real password "454323," as shown in Figure 5.

[0052] The rule for generating an image group according to the preset password group is: the image group at least contains at least one image corresponding to each of the passwords in the preset password group, and each image in the image group corresponds to a number.

[0053] For example, the image group only includes at least one image corresponding to each of the passwords in the preset password group; or the image group includes, in addition to at least one image corresponding to each of the passwords in the preset password group, at least one image corresponding to at least one password outside the preset password group, and the at least one image corresponding to at least one password outside the preset password group can serve the purpose of disturbing other passengers.

[0054] Furthermore, each password can correspond to multiple images. When generating an image group, at least one image can be selected from the multiple images corresponding to the password. The driver can then select only one of the images during voice input. If there are duplicate passwords in the preset password group, the driver can select only one image or multiple images. For example, in Figure 5, "159732" corresponds to the preset password "454323," and "151737" also corresponds to the preset password "454323," effectively preventing passengers from cracking the password rules.

[0055] Each time payment is made, the image group is randomly generated according to the rules. At this time, for the same preset password group, the image group displayed each time can also be different, including two situations in which the image group itself is different and the order of the images in the image group is different.

[0056] Finally, when displayed, the image group can be arranged regularly, and the numbers corresponding to the images can be displayed in the image or next to the image, or omitted. When omitted, as shown in Figure 5, the numbers have a corresponding relationship with the positions of the regularly arranged images, so the numbers can be omitted; when the image group is arranged irregularly, the numbers corresponding to the images are displayed in the image or next to the image.

[0057] This invention ensures driving safety by maintaining a constant field of vision in front of the vehicle and eliminating the need for manual password entry. Using a HUD payment interface, the driver voice-enters a converted password (not the original password, such as "159732"). This secure and efficient password entry is achieved through the DMS's dual identity verification technology, using both facial and voice recognition, as shown in Figures 6, 7, and 8.

[0058] The present invention can ensure driving safety when entering a password: the driver's eyes can be ahead and his hands can hold the steering wheel; password conversion can achieve good privacy protection of the driver's password when there are other passengers in the car; triple payment identity authentication can ensure that non-car owners cannot use the car's payment function.

[0059] It should be noted that, in order to ensure safety, the car payment method of the present invention can be used when the car is parked or at a low speed; in addition, it can be used by multiple people together, that is, each person can set a payment password and a corresponding voice recognition identity.

[0060] As shown in FIG9 , the car payment system and password protection device based on driver cognition include:

[0061] IVI: Provides an in-vehicle application and a payment interface when payment is required.

[0062] Password setting and conversion module: Converts the real password into an image password according to the driver's needs. This module can be integrated into the IVI.

[0063] HUD: Synchronously displays the IVI password payment interface, allowing the driver to keep their eyes on the road ahead.

[0064] Voice recognition module: recognizes the driver's voice password and identifies the driver's identity.

[0065] Face recognition module: Identify the driver through vision.

[0066] Payment Control Module: This module recognizes the voice password input and receives identity information from the voice recognition module and the face recognition module. It ultimately determines password authentication and notifies the IVI to complete the payment.

[0067] The present invention also provides a vehicle, which adopts any one of the above-mentioned automobile payment methods.

[0068] In summary, the present invention proposes a car password input method: the driver does not need to take his eyes off the front, and the driver does not need to take his hands off the steering wheel. The HUD and voice digital input technology solve the driving safety problem when the driver enters the password. The present invention also proposes a car payment password privacy protection method and a password conversion method, which converts the real password into an image password (the image can be a digital image, text image, symbol image, person image, object image, landscape image, etc.), and uses the image password to replace the real password to ensure that the driver's real password will not be leaked when there are passengers. The present invention also proposes a car payment security authentication method, which performs triple identity authentication through inputting the payment password, voice recognition authentication and face recognition authentication; through the triple payment authentication and identification technology, even if the passenger remembers the image password, he cannot use the car payment function, thereby improving payment security.

[0069] It should be pointed out that, according to the needs of implementation, the various steps / components described in this application can be split into more steps / components, or two or more steps / components or partial operations of steps / components can be combined into new steps / components to achieve the purpose of the present invention.

[0070] It will be easily understood by those skilled in the art that the above are merely preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A car payment method, applied to an electronic device of a vehicle, characterized in that: The payment interface is displayed on the windshield, and the password is entered by voice input, including: Obtain multiple different images, and match all passwords to the images so that each password corresponds to at least one image; Displaying a payment interface on the windshield, wherein the payment interface includes a group of images, and the rule is: the image group includes at least one image corresponding to each of all passwords in the preset password group, and each image in the image group corresponds to a number; Input a group of numbers by voice, obtain the password group corresponding to the voice-input number group according to the corresponding relationship between numbers, images and passwords, and compare the password with the preset password group; At the same time, voice identity recognition is performed based on the voice; if both the password comparison and voice identity recognition are passed, the payment is completed.

2. The automobile payment method according to claim 1, characterized in that: The password consists of numbers, letters, or a combination of them.

3. The automobile payment method according to claim 1, characterized in that: The multiple different images are multiple different complete images or multiple sub-images generated by segmenting at least one complete image.

4. The automobile payment method according to claim 1, characterized in that: Match all passwords with images according to your preferences to facilitate memorizing the correspondence between passwords and images.

5. The automobile payment method according to claim 1, characterized in that: Each time a payment is made, the image group is randomly generated according to the rules.

6. The automobile payment method according to claim 1, characterized in that: When displayed, the image group is arranged regularly, and the numbers corresponding to the images are displayed in or next to the images or omitted. When omitted, the numbers have a corresponding relationship with the positions of the regularly arranged images; when the image group is arranged irregularly, the numbers corresponding to the images are displayed in or next to the images.

7. The automobile payment method according to claim 1, characterized in that: The method also includes: performing facial recognition; if the facial recognition is also passed, the payment is completed.

8. The automobile payment method according to claim 1, characterized in that: The payment interface is displayed on the windshield using the head-up display (HUD).

9. A car payment device for implementing the car payment method according to any one of claims 1 to 8, characterized in that: The device includes: In-vehicle infotainment system IVI, used to provide a payment interface; A password setting and conversion module, integrated in the IVI, is used to set a preset password group and complete the correspondence between the password and the image, and generate an image group according to the rules; Head-up display HUD, used to display the payment interface on the windshield; A speech recognition module for speech identity recognition and recognition of speech input digital groups; The payment control module is used to compare passwords and receive voice identification results to ultimately complete payment decisions.

10. A vehicle, characterized in that: The vehicle adopts the automobile payment method described in any one of claims 1 to 8.

Images