Intelligent glasses payment method, device and equipment, storage medium and program product

Abstract

The invention relates to an intelligent glasses payment method, device and equipment, a storage medium, a program product and intelligent equipment, and relates to the technical field of intelligent equipment, and the method comprises the steps: recognizing a two-dimensional code image, obtaining two-dimensional code recognition information, responding to a target application corresponding to the two-dimensional code recognition information, and carrying out voice interaction based on the target application, the voice interaction information is obtained, the payment order is generated according to the voice interaction information, the payment order is responded to the payment instruction for the payment order, the payment operation is executed on the payment order, through voice interaction between the intelligent glasses and the user, payment and other operations are completed, the application scene of the intelligent glasses is widened, and the user experience is improved.

Description

Technical Field

[0001] This disclosure relates to the field of smart device technology, and in particular to a smart glasses payment method, device, equipment, storage medium, and program product. Background Technology

[0002] As an emerging wearable computing platform, smart glasses are striving to integrate more intelligent functions to improve the convenience and efficiency of users in their daily lives and work. However, current smart glasses can only complete simple interactions with users through feedback, which limits their application scenarios.

[0003] It should be noted that the information disclosed in the background section above is only used to enhance the understanding of the background of this disclosure, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0004] To overcome the problems existing in related technologies, this disclosure provides a smart glasses payment method, device, equipment, storage medium, and program product.

[0005] According to a first aspect of the present disclosure, a smart glasses payment method is provided, comprising:

[0006] Scan the QR code image using the image acquisition device installed on the smart glasses;

[0007] The QR code image is recognized to obtain QR code recognition information;

[0008] In response to the QR code recognition information corresponding to the target application, voice interaction is performed based on the target application to obtain voice interaction information;

[0009] Generate a payment order based on voice interaction information;

[0010] In response to a payment instruction for a payment order, perform a payment operation on the payment order.

[0011] In one embodiment of this disclosure, the method further includes:

[0012] In response to the QR code recognition information corresponding to a payment link, payment guidance information is played.

[0013] In response to a payment instruction for a payment order, perform a payment operation on the payment order.

[0014] In one embodiment of this disclosure, the method further includes:

[0015] Play payment guidance information corresponding to the payment order. The payment guidance information includes at least one of the payment object and the amount to be paid.

[0016] In one embodiment of this disclosure, in response to a payment instruction for a payment order, a payment operation is performed on the payment order, including:

[0017] Obtain the payment instructions via voice for the payment order;

[0018] Perform semantic recognition and voiceprint detection on payment instruction voice;

[0019] In response to the semantic recognition result of the payment instruction indicating confirmation of payment and the voiceprint detection passing, the payment operation is executed on the payment order.

[0020] In one embodiment of this disclosure, the method further includes:

[0021] The QR code recognition information is parsed to obtain the parsing result;

[0022] In response to at least one of the target application identifier, startup parameters, initial page path, and service provider information contained in the parsing result, it is determined that the QR code identification information corresponds to the target application.

[0023] In one embodiment of this disclosure, voice interaction based on a target application includes:

[0024] Display the first display interface corresponding to the target application on the display device set on the smart glasses;

[0025] Receive the user's first voice message;

[0026] In response to the first voice message, a second display interface corresponding to the target application is displayed on the display device;

[0027] Receive the user's second voice message.

[0028] In one embodiment of this disclosure, voice interaction based on a target application includes:

[0029] Play the first playback information corresponding to the target application through the voice playback device set on the smart glasses;

[0030] Receive third-party voice information from users;

[0031] In response to the third voice information, the second playback information corresponding to the target application is played through the voice playback device;

[0032] Receive the user's fourth voice message.

[0033] In one embodiment of this disclosure, generating a payment order based on voice interaction information includes:

[0034] Semantic recognition is performed on at least one of the first speech information, the second speech information, the third speech information, and the fourth speech information to obtain the first semantic recognition information;

[0035] A payment order is generated based on the first semantic recognition information.

[0036] In one embodiment of this disclosure, generating a payment order based on voice interaction information includes:

[0037] Extract at least one order generation element from the voice interaction information;

[0038] In response to the fulfillment of the order generation requirements, a payment order is generated based on at least one order generation requirement.

[0039] In one embodiment of this disclosure, generating a payment order based on voice interaction information includes:

[0040] Semantic recognition is performed on the voice interaction information to obtain the second semantic recognition information;

[0041] In response to the second semantic recognition information including an order generation instruction, a payment order is generated based on the second semantic recognition information.

[0042] According to a second aspect of the present disclosure, a smart glasses payment device is provided, comprising:

[0043] The scanning module is used to scan QR code images using an image acquisition device installed on the smart glasses;

[0044] The recognition module is used to recognize the QR code image and obtain the QR code recognition information;

[0045] The interaction module is used to respond to the QR code recognition information corresponding to the target application, perform voice interaction based on the target application, and obtain voice interaction information.

[0046] The generation module is used to generate payment orders based on voice interaction information;

[0047] The first payment module is used to execute payment operations on payment orders in response to payment instructions.

[0048] In one embodiment of this disclosure, the apparatus further includes:

[0049] The first playback module is used to play payment guidance information in response to the QR code recognition information corresponding to the payment link;

[0050] The second payment module is used to execute payment operations on payment orders in response to payment instructions.

[0051] In one embodiment of this disclosure, the apparatus further includes:

[0052] The second playback module is used to play payment guidance information corresponding to the payment order. The payment guidance information includes at least one of the payment object and the amount to be paid.

[0053] In one embodiment of this disclosure, the first payment module includes:

[0054] The acquisition unit is used to acquire the voice payment instructions for the payment order;

[0055] The detection unit is used to perform semantic recognition and voiceprint detection on the voice of payment instructions;

[0056] The payment unit is used to execute the payment operation on the payment order in response to the semantic recognition result of the payment instruction indicating confirmation of payment and the voiceprint detection passing.

[0057] In one embodiment of this disclosure, the apparatus further includes:

[0058] The parsing module is used to parse the QR code recognition information and obtain the parsing result;

[0059] The determination module is used to determine that the QR code recognition information corresponds to the target application in response to at least one of the target application identifier, startup parameters, initial page path, and service provider information contained in the parsing result.

[0060] In one embodiment of this disclosure, the interaction module includes:

[0061] The first display unit is used to display a first display interface corresponding to the target application on a display device set on the smart glasses;

[0062] The first receiving unit is used to receive the user's first voice information;

[0063] The second display unit, in response to the first voice information, displays a second display interface corresponding to the target application on a display device;

[0064] The second receiving unit is used to receive the user's second voice information.

[0065] In one embodiment of this disclosure, the interaction module includes:

[0066] The first playback unit is used to play the first playback information corresponding to the target application through the voice playback device set on the smart glasses;

[0067] The third receiving unit is used to receive the user's third voice information;

[0068] The second playback unit is used to respond to the third voice information and play the second playback information corresponding to the target application through the voice playback device;

[0069] The fourth receiving unit is used to receive the user's fourth voice information.

[0070] In one embodiment of this disclosure, the generation module includes:

[0071] The first recognition unit is used to perform semantic recognition on at least one of the first speech information, the second speech information, the third speech information, and the fourth speech information to obtain first semantic recognition information;

[0072] The first generation unit is used to generate a payment order based on the first semantic recognition information.

[0073] In one embodiment of this disclosure, the generation module includes:

[0074] An extraction unit is used to extract at least one order generation element from voice interaction information;

[0075] The second generation unit is used to generate a payment order based on at least one order generation requirement in response to the fulfillment of the order generation conditions.

[0076] In one embodiment of this disclosure, the generation module includes:

[0077] The recognition unit is used to perform semantic recognition on the voice interaction information to obtain second semantic recognition information;

[0078] The third generation unit is used to generate a payment order based on the second semantic recognition information in response to the order generation instruction included in the second semantic recognition information.

[0079] According to a fourth aspect of the present disclosure, an electronic device is provided, comprising:

[0080] processor;

[0081] Memory used to store processor-executable instructions;

[0082] The processor is configured to implement any of the smart glasses payment methods described in the first aspect above.

[0083] According to a fifth aspect of the present disclosure, a non-transitory computer-readable storage medium is provided, which, when the instructions in the storage medium are executed by a terminal's processor, enables the terminal to execute any of the smart glasses payment methods described in the first aspect.

[0084] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects:

[0085] This disclosure utilizes an image acquisition device mounted on smart glasses to scan QR code images, recognize the QR code images, obtain QR code recognition information, respond to the QR code recognition information corresponding to a target application, perform voice interaction based on the target application, obtain voice interaction information, generate a payment order based on the voice interaction information, and execute the payment operation on the payment order in response to the payment instruction. By completing payment and other operations through voice interaction between smart glasses and the user, this expands the application scenarios of smart glasses and improves the user experience.

[0086] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0087] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0088] Figure 1 This is a flowchart of a smart glasses payment method according to an exemplary embodiment of the present disclosure. Figure 1 .

[0089] Figure 2 This is a flowchart of a smart glasses payment method according to an exemplary embodiment of the present disclosure. Figure 2 .

[0090] Figure 3 This is a flowchart of a smart glasses payment method according to an exemplary embodiment of the present disclosure. Figure 3 .

[0091] Figure 4 This is a flowchart of a smart glasses payment method according to an exemplary embodiment of the present disclosure. Figure 4 .

[0092] Figure 5 This is a flowchart of a smart glasses payment method according to an exemplary embodiment of the present disclosure. Figure 5 .

[0093] Figure 6 This is a flowchart of a smart glasses payment method according to an exemplary embodiment of the present disclosure. Figure 6 .

[0094] Figure 7 This is a flowchart of a smart glasses payment method according to an exemplary embodiment of the present disclosure. Figure 7 .

[0095] Figure 8 This is a flowchart of a smart glasses payment method according to an exemplary embodiment of the present disclosure. Figure 8 .

[0096] Figure 9 This is a flowchart of a smart glasses payment method according to an exemplary embodiment of the present disclosure. Figure 9 .

[0097] Figure 10 This is a scene diagram illustrating a smart glasses payment method according to an exemplary embodiment of this disclosure.

[0098] Figure 11 This is a block diagram of a smart glasses payment device according to an exemplary embodiment of the present disclosure.

[0099] Figure 12 This is a block diagram illustrating an electronic device according to an exemplary embodiment of the present disclosure. Detailed Implementation

[0100] Exemplary embodiments of this disclosure will be described in detail herein, examples of which are illustrated in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings denote the same or similar elements unless otherwise indicated. Various changes, modifications, and equivalents of the methods, apparatus, and / or systems described herein will become apparent upon understanding this disclosure. For example, the order of operations described herein is merely illustrative and is not limited to those orders set forth herein, but can be changed as will become apparent upon understanding this disclosure, except for operations that must be performed in a particular order. Furthermore, for clarity and brevity, descriptions of features known in the art may be omitted.

[0101] The embodiments described below, which are examples of some of the embodiments of this disclosure, do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0102] The specific implementation methods of the embodiments of this disclosure will now be described in detail with reference to the accompanying drawings.

[0103] Figure 1 This is a flowchart of a smart glasses payment method according to an exemplary embodiment of the present disclosure. Figure 1 Smart glasses payment methods can also be used on electronic devices with image recognition and voice interaction capabilities, such as smartwatches, AR headsets, smart in-vehicle devices, and smartphones.

[0104] like Figure 1 As shown, it includes the following steps:

[0105] The S110 uses an image acquisition device on the smart glasses to scan QR code images.

[0106] In some embodiments, smart glasses include monocular smart glasses and binocular smart glasses. The image acquisition device on the smart glasses can be positioned in a location that does not obstruct the user's line of sight. It should be noted that the image acquisition device can be an always-on camera (AONCamera), which can capture images of the surrounding environment in real time. Furthermore, the smart glasses can be configured with multiple image acquisition devices. This disclosure does not limit the number of image acquisition devices.

[0107] In some embodiments, smart glasses can determine the image to be captured based on the user's gaze. For example, if the user's gaze lingers on a target area for more than a preset duration, an image of the target area can be captured. The user's gaze can be determined by acquiring images of the user's eyes. The user's gaze is determined by comparing images of the user's eyes over a continuous time period.

[0108] In some embodiments, scanning a QR code image using an image acquisition device on smart glasses avoids the need for users to take out their smartphones to complete the QR code image acquisition, thus enabling cross-device interaction in such application scenarios using smart glasses.

[0109] S120: Recognize the QR code image to obtain QR code recognition information.

[0110] In some embodiments, QR code identification information may include text information, URLs / links, numerical and encoded data, structured data, and application data. The application data may include application identifiers, launch parameters, initial page paths, and possible merchant or service provider information.

[0111] In some embodiments, recognizing a QR code image may include performing at least one image transformation operation among grayscale conversion, noise reduction, binarization, and correction on the QR code image, locating the QR code using a positioning marker, performing networked and modular parsing based on the positioning result of the QR code, and then decoding and outputting the QR code.

[0112] In some embodiments, QR code image recognition via smart glasses avoids the need to send the QR code image to other devices for recognition, simplifying the data transmission process and improving the response rate of smart glasses.

[0113] S130, in response to the QR code recognition information corresponding to the target application, performs voice interaction based on the target application and obtains voice interaction information.

[0114] In some embodiments, the target application may include a web application, app, application, or other interactive program configured on a smartphone or server. The QR code identification information corresponding to the target application may include establishing a connection with the smartphone or server configured with the target application by scanning a QR code.

[0115] In some embodiments, voice interaction based on a target application may include the smart glasses establishing a connection with a smart device configured with the target application by scanning a QR code, the smart device sending instructions to the smart glasses to send relevant information to the user through image display or voice playback, and the smart glasses receiving the reply information sent by the user, thereby completing the interaction between the target application carried by the smart glasses and the user.

[0116] In some embodiments, smart glasses can instantly recognize and parse the user's voice information and commands sent by smart devices configured with the target application.

[0117] In some embodiments, voice interaction between smart glasses and users enables interaction between users and various types of applications, using smart glasses as a platform. This completes the interaction without the involvement of other smart devices, simplifying the interaction process and avoiding the cumbersome issues associated with using multiple smart devices. Furthermore, it broadens the application scenarios for smart glasses.

[0118] S140 generates a payment order based on voice interaction information.

[0119] In some embodiments, generating a payment order may include initiating a payment process for the target application.

[0120] S150, in response to a payment instruction for a payment order, executes a payment operation on the payment order.

[0121] In some embodiments, payment instructions may include commands sent by the user via voice or gesture. For example, a user may issue payment instructions to the smart glasses using specific gestures, blinking, or other actions.

[0122] In some embodiments, performing a payment operation on a payment order may include the smart glasses sending a payment instruction to the corresponding application, and the application completing the payment operation based on the payment instruction.

[0123] In some embodiments, performing a payment operation on a payment order may include sending a payment request containing the payment amount, payee identifier, transaction serial number, securely encrypted user identity and device information to a target application. The target application then completes the payment based on the payment request.

[0124] This disclosure utilizes an image acquisition device mounted on smart glasses to scan QR code images, recognize the QR code images, obtain QR code recognition information, respond to the QR code recognition information corresponding to a target application, perform voice interaction based on the target application, obtain voice interaction information, generate a payment order based on the voice interaction information, and execute the payment operation on the payment order in response to the payment instruction. By completing payment and other operations through voice interaction between smart glasses and the user, this expands the application scenarios of smart glasses and improves the user experience.

[0125] Figure 2 This is a flowchart of a smart glasses payment method according to an exemplary embodiment of the present disclosure. Figure 2 . Figure 2 In steps S210, S220 and S240 and Figure 1 Steps S110, S120, and S150 correspond to each other and will not be repeated here, as follows: Figure 2 As shown, in Figure 1 In addition to the implementation process shown, the following steps are also included:

[0126] S230, in response to the QR code recognition information corresponding to the payment link, plays payment guidance information.

[0127] In some embodiments, the payment link may include a link for completing the payment. It should be noted that the payment link may include identifiers, content, and parameters related to the payment application.

[0128] In some embodiments, payment guidance information may include at least one of a payment application, a payment target, and a payment amount. It should be noted that the payment target may include the merchant to whom payment is to be made. Playing the payment guidance information may involve smart glasses playing the payment guidance information via a configured voice playback module. For example, after the smart glasses recognize a QR code and obtain QR code recognition information, the QR code recognition information can be parsed. If the parsed QR code recognition information contains identifiers, content, and parameters related to the payment application, it is determined that the QR code recognition information corresponds to a payment link. Then, a connection is established between the QR code recognition information and the application corresponding to the payment link, the application receives instruction information sent by the application, parses the instruction information, and plays the parsed payment guidance information. It should be noted that the application may include web applications, mini-programs, and other applications.

[0129] In this embodiment of the disclosure, in response to the QR code recognition information corresponding to a payment link, payment guidance information is played; in response to the payment instruction for the payment order, a payment operation is performed on the payment order. The payment operation is completed directly through the interaction between the smart glasses and the user, without the need for the participation of other smart devices during the payment process, simplifying the user's operation process and improving the user experience.

[0130] Figure 3 This is a flowchart of a smart glasses payment method according to an exemplary embodiment of the present disclosure. Figure 3 . Figure 3 In the middle steps S310 to S340 and S360 and Figure 1 Steps S110 to S140 and S150 correspond to each other and will not be repeated here, as follows: Figure 3 As shown, in Figure 1 In addition to the implementation process shown, the following steps are also included:

[0131] S350, Play payment guidance information corresponding to the payment order, the payment guidance information including at least one of the payment object and the amount to be paid.

[0132] In some embodiments, the amount to be paid may include the amount the user needs to pay. By playing the object to be paid and / or the amount to be paid, the problem of accidental payment caused by unclear payment amount or object can be avoided.

[0133] Figure 4 This is a flowchart of a smart glasses payment method according to an exemplary embodiment of the present disclosure. Figure 4 . Figure 4 In the middle steps S410 to S440 and Figure 1 Steps S110 to S140 correspond to each other and will not be repeated here, as follows: Figure 4 As shown, in Figure 1 In addition to the implementation process shown, the following steps are also included:

[0134] S450: Obtain payment instructions via voice for payment orders.

[0135] In some embodiments, the payment instruction voice may include voice information issued by the user to confirm payment for the payment order.

[0136] In some embodiments, the voice payment instruction for the corresponding payment order can be obtained through the voice acquisition module configured on the smart glasses.

[0137] The S460 performs semantic recognition and voiceprint detection on payment instructions via voice.

[0138] In some embodiments, semantic recognition and voiceprint detection of payment instruction voice may include performing both speech recognition and voiceprint detection on one or more collected payment instruction voice recordings. This disclosure does not limit the order in which semantic recognition and voiceprint detection are performed.

[0139] In some embodiments, semantic recognition may include converting speech information into text information and recognizing the corresponding text information. Voiceprint detection may include first acquiring the user's standard voiceprint information, then detecting the acquired payment instruction speech to obtain the voiceprint information corresponding to the payment instruction speech, and comparing the standard voiceprint information with the voiceprint information corresponding to the payment instruction speech.

[0140] In some embodiments, the intelligent model configured in the smart glasses can perform semantic recognition and voiceprint detection on the payment instruction voice. This avoids the cumbersome process caused by the interaction between the smart glasses and other smart devices.

[0141] For example, a Voiceprint Recognition (VPR) module can be used for voiceprint detection. Voiceprint detection based on the VPR module can include preprocessing the payment instruction speech, extracting features, modeling the voiceprint, calculating similarity, and making decisions and outputting results to obtain the voiceprint detection results.

[0142] S470, in response to the semantic recognition result of the payment instruction indicating confirmation of payment and the voiceprint detection passing, executes the payment operation on the payment order.

[0143] It should be noted that payment can only be executed if the semantic recognition result of the payment instruction indicates confirmation of payment and the voiceprint detection passes. If the voice recognition result indicates confirmation of payment but the voiceprint detection fails, the smart glasses can play a first prompt message, which alerts the user to payment risks. If the voice recognition result does not indicate confirmation of payment but the voiceprint detection passes, the smart glasses can play a second prompt message, which prompts the user to resend the payment instruction voice message.

[0144] In some embodiments, in response to the semantic recognition result of the payment instruction indicating confirmation of payment and the voiceprint detection passing, performing a payment operation on a payment order may include: if the semantic recognition result of the payment instruction indicates confirmation of payment and the voiceprint detection passing, the smart glasses generate a payment instruction and send the payment instruction to the corresponding application to complete the payment.

[0145] In this embodiment, the payment instruction voice of the payment order is obtained, semantic recognition and voiceprint detection are performed on the payment instruction voice, and in response to the semantic recognition result of the payment instruction indicating confirmation of payment and the voiceprint detection passing, the payment operation is executed on the payment order. By performing semantic recognition and voiceprint detection on the payment instruction voice, the payment operation is executed only after confirming that the user intends to pay the order and the user's voiceprint detection passes, which avoids interference from the voice information of non-current users in the payment process and improves the security of order payment.

[0146] Figure 5 This is a flowchart of a smart glasses payment method according to an exemplary embodiment of the present disclosure. Figure 5 . Figure 5 In the middle steps S510, S520 and S550 to S570 and Figure 1 Steps S110, S120, and S130 to S150 correspond to each other and will not be repeated here. Figure 5 As shown, in Figure 1 In addition to the implementation process shown, the following steps are also included:

[0147] S530 parses the QR code recognition information and obtains the parsing result.

[0148] In some embodiments, a smart model configured on smart glasses can be used to parse the QR code recognition information to obtain the parsing result. As described above, the QR code recognition information can include text information, URLs / links, numerical and encoded data, structured data, and application data. This QR code recognition information can be input into the smart model to obtain the parsing result.

[0149] S540, in response to at least one of the target application identifier, startup parameters, initial page path, and service provider information contained in the parsing result, determines that the QR code identification information corresponds to the target application.

[0150] In some embodiments, the QR code identification information may correspond to a target application or payment link, and the specific correspondence of the QR code identification information can be determined based on the content of the parsing results. It should be noted that different environments can be loaded based on the correspondence of the QR code identification information.

[0151] In this embodiment, the QR code recognition information is parsed to obtain the parsing result, and the QR code device information is determined to correspond to the target application based on the content of the parsing result. By scanning, recognizing, and parsing the QR code, the smart glasses can directly connect with the target application, paving the way for interaction between the smart glasses and the target application, expanding the application scenarios of the smart glasses, and improving the user experience.

[0152] Figure 6This is a flowchart of a smart glasses payment method according to an exemplary embodiment of the present disclosure. Figure 6 . Figure 6 In steps S610, S620, S670, and S680, and Figure 1 Steps S110, S120, S140, and S150 correspond to each other and will not be repeated here. Figure 6 As shown, in Figure 1 In addition to the implementation process shown, the following steps are also included:

[0153] The S630 displays a first display interface corresponding to the target application on the display device set on the smart glasses.

[0154] In some embodiments, the display device on the smart glasses may include the lenses of the smart glasses. It should be noted that when the display device on the smart glasses displays a first display interface, it will not affect the user's view.

[0155] In some embodiments, the first display interface corresponding to the target application may include a page containing information to be displayed by the target application. For example, smart glasses may replace a smartphone, displaying the first display interface on the smart glasses' display device through rendering or other methods. The first display interface may include at least one of the following: information corresponding to the target application page, executable operation option information, and preset scene flow information of the target application.

[0156] By displaying a first display interface on smart glasses and interacting with the user based on that interface, users can interact with target applications more intuitively through the smart glasses, thus improving the user experience.

[0157] The S640 receives the user's first voice message.

[0158] In some embodiments, the first voice information may include user selection information of controls in the first display interface, or supplementary information based on prompts in the first display interface.

[0159] In some embodiments, the smart glasses can convert the aforementioned first voice information into corresponding text information, then recognize the text information, and send interactive instructions to the target application based on the recognition result of the text information.

[0160] For example, an Automatic Speech Recognition (ASR) module can be used to convert the first speech information into text information, and a Natural Language Understanding (NLU) module can be used to recognize the text information.

[0161] S650, in response to the first voice information, displays a second display interface corresponding to the target application on the display device.

[0162] In some embodiments, displaying a second display interface corresponding to a target application on a display device in response to first voice information may include: after the target application receives an interaction instruction, sending a response instruction to the smart glasses, and the smart glasses displaying the second display interface on the smart glasses based on the response instruction.

[0163] In some embodiments, the second display interface may be the same as the first display interface. If the first voice message instructs the user to repeatedly view the first display interface, the second display interface may not need to be replaced.

[0164] In some embodiments, the second display interface may display at least one of error messages, confirmation messages, and help messages. For example, if the first voice message indicates that the user cannot understand, the operation has failed, or a request for help is made, a second display interface including the aforementioned information may be shown to the user.

[0165] In some embodiments, while displaying the first display interface and the second display interface, voice information corresponding to the first display interface or the second display interface can be played.

[0166] The S660 receives the user's second voice message.

[0167] In some embodiments, the method for receiving the second voice information may be the same as the method for receiving the first voice information, and will not be described in detail here.

[0168] In this embodiment of the disclosure, a first display interface and a second display interface are displayed through a display device, and first voice information and second voice information from the user are received. Interaction with the target application is completed through image display and receiving user voice. Interaction with the target application can be completed solely through smart glasses, avoiding the cumbersome interaction problems caused by introducing other smart devices and improving the user experience.

[0169] Figure 7 This is a flowchart of a smart glasses payment method according to an exemplary embodiment of the present disclosure. Figure 7 . Figure 7 In the middle steps S710, S720, S770 and S780 and Figure 1 Steps S110, S120, S140, and S150 correspond to each other and will not be repeated here. Figure 7 As shown, in Figure 1 In addition to the implementation process shown, the following steps are also included:

[0170] The S730 plays the first playback information corresponding to the target application through the voice playback device set on the smart glasses.

[0171] In some embodiments, the first playback information may include information to be displayed by the target application. For example, the first playback information may include at least one of the following: information corresponding to the target application page, executable operation option information, and preset scene flow information of the target application.

[0172] For example, the first playback message may include "You have entered the ordering mini-program. You are currently on the menu homepage. You can say 'Browse the set menu,' 'Search for dish keywords,' or simply tell me the dishes and quantities you want to order." or "You have entered the parking lot to pay. Please provide your license plate number so we can check your parking order."

[0173] The S740 receives third-party voice information from the user.

[0174] In some embodiments, the third voice information may be the same as the first voice information, and the method of receiving the third voice information may be the same as the method of receiving the first voice information, which will not be described in detail here.

[0175] S750, in response to third voice information, plays second playback information corresponding to the target application via a voice playback device.

[0176] The S760 receives the user's fourth voice message.

[0177] In some embodiments, the fourth voice information may be the same as the third voice information, and the method for receiving the third voice information may be the same as the method for receiving the fourth voice information, which will not be described in detail here.

[0178] In this embodiment of the disclosure, a first playback information interface and a second playback information interface are played through a voice playback device, and the user's first voice information and second voice information are received. Interaction with the target application is completed through voice. Interaction with the target application can be completed solely through smart glasses, avoiding the cumbersome interaction problems caused by introducing other smart devices and improving the user experience.

[0179] Figure 8 This is a flowchart of a smart glasses payment method according to an exemplary embodiment of the present disclosure. Figure 8 . Figure 8 In the middle steps S810 to S830 and S860 and Figure 1 Steps S110 to S130 and S150 correspond to each other and will not be repeated here, as follows: Figure 8 As shown, in Figure 1 In addition to the implementation process shown, the following steps are also included:

[0180] S840 extracts at least one order generation element from voice interaction information.

[0181] In some embodiments, extracting at least one order generation element from voice interaction information may include extracting the order generation element from at least one of first voice information, second voice information, third voice information, and fourth voice information.

[0182] In some embodiments, order generation requirements may include a user's intent to generate an order. Voice interaction information can be recognized, and if voice information corresponding to the user's intent to generate an order is recognized in the voice interaction information, the order generation requirements can be determined to be extracted.

[0183] It should be noted that the order generation requirements differ for different target applications. These requirements may include user-provided information, user-selected information, and user-instructed order generation.

[0184] S850, in response to the fulfillment of the order generation requirements, generates a payment order based on at least one order generation requirement.

[0185] In some embodiments, the voice interaction information may include multiple order generation requirements. Meeting these requirements may include the completion of all pre-payment interactions. For example: the restaurant order has been finalized; parking fees have been calculated based on the license plate and duration, and the shared service has ended; the system has obtained the final amount to be paid from the target application or interaction and received an order generation instruction from the user.

[0186] In this embodiment, at least one order generation element is extracted from the voice interaction information. In response to the order generation element meeting the order generation conditions, a payment order is generated. This avoids the problem of payment process chaos caused by generating a payment order before the interaction process ends.

[0187] Figure 9 This is a flowchart of a smart glasses payment method according to an exemplary embodiment of the present disclosure. Figure 9 . Figure 9 In the middle steps S910 to S930 and S960 and Figure 1 Steps S110 to S130 and S150 correspond to each other and will not be repeated here, as follows: Figure 9 As shown, in Figure 1 In addition to the implementation process shown, the following steps are also included:

[0188] S940 performs semantic recognition on the voice interaction information to obtain second semantic recognition information.

[0189] In some embodiments, the method for semantic recognition has been described in detail in the above embodiments and will not be repeated here.

[0190] S950, in response to the second semantic recognition information including an order generation instruction, a payment order is generated based on the second semantic recognition information.

[0191] In some embodiments, the order generation instruction may include information corresponding to the user's intention to generate an order.

[0192] In some embodiments, the method for generating payment orders has been described in detail in the above embodiments and will not be repeated here.

[0193] In this embodiment of the disclosure, semantic recognition is performed on the voice interaction information to obtain second semantic recognition information. In response to the second semantic recognition information including an order generation instruction, a payment order is generated based on the second semantic recognition information, thus avoiding the problem of payment process chaos caused by generating a payment order when the interaction process has not ended.

[0194] To provide a detailed description of this disclosure, an exemplary embodiment is provided. This exemplary embodiment includes ordering food using smart glasses. Figure 10 This is a scene diagram illustrating a smart glasses payment method according to an exemplary embodiment of this disclosure. For example... Figure 10 As shown:

[0195] The smart glasses 1010 recognizes the QR code image used for ordering food in the restaurant, and obtains QR code recognition information. The QR code recognition information is then parsed to obtain a first parsing result. This first parsing result contains at least one of the following: the identifier of the target application, startup parameters, initial page path, and service provider information, confirming that the QR code recognition information corresponds to the target application. The target application can be configured on the terminal 1030 or the server 1040.

[0196] The smart glasses 1010 sends a connection request to the target application. The target application sends a first response message to the smart glasses 1010. Upon receiving the first response message, the smart glasses 1010 parses the first response message to obtain a second parsing result. Based on the second parsing result, the smart glasses 1010 displays a first display interface through a display device configured on the smart glasses 1010; or, based on the second parsing result, plays first playback information through a voice playback device configured on the smart glasses 1010. It should be noted that the first display interface may include images of multiple dishes and the corresponding price for each dish. The first playback information may include prompts reminding the user to order (1020) and / or dish information.

[0197] The smart glasses 1010 receive first voice information from user 1020, which may include user 1020's selection of dishes. The smart glasses 1010 recognizes the first voice information, generates a selection instruction based on the recognized selection information, and sends the selection instruction to the target application. During the recognition process of the first voice information, the smart glasses 1010 also needs to identify whether the first voice information contains order generation requirements or an order generation instruction. If the first voice information contains order generation requirements or an order generation instruction, the smart glasses 1010 sends an order generation instruction to the target application, enabling the target application to generate a payment order based on the order generation instruction.

[0198] If the first voice message does not contain order generation requirements or an order generation instruction, the selection instruction is sent to the target application. The second response message sent by the target application is received and parsed to obtain a third parsing result. Based on the third parsing result, the smart glasses 1010 displays a second display interface through a display device configured on the smart glasses 1010; or, based on the third parsing result, plays second playback information through a voice playback device configured on the smart glasses 1010. It should be noted that the second display interface may include image information confirming the selection made by the user 1020. The second playback information may include relevant information confirming the menu item selected by the user 1020.

[0199] Based on the same inventive concept, this disclosure also provides a smart glasses 1010 payment device, as shown in the following embodiment. Since the principle by which this device embodiment solves the problem is similar to that of the above method embodiment, the implementation of this device embodiment can refer to the implementation of the above method embodiment, and repeated details will not be described again.

[0200] It should be noted that the acquisition, storage, use, and processing of information or data in this disclosed technical solution comply with the relevant provisions of national laws and regulations.

[0201] Figure 11 This is a block diagram illustrating a smart glasses payment device according to an exemplary embodiment of the present disclosure. (Refer to...) Figure 11 The device 1100 includes:

[0202] The scanning module 1110 is used to scan QR code images using an image acquisition device installed on the smart glasses;

[0203] The recognition module 1120 is used to recognize the QR code image and obtain QR code recognition information;

[0204] Interaction module 1130 is used to respond to the QR code recognition information corresponding to the target application, perform voice interaction based on the target application, and obtain voice interaction information;

[0205] The generation module 1140 is used to generate a payment order based on the voice interaction information;

[0206] The first payment module 1150 is used to perform payment operations on a payment order in response to a payment instruction.

[0207] In one embodiment of this disclosure, the apparatus further includes:

[0208] The first playback module is used to play payment guidance information in response to the QR code recognition information corresponding to the payment link;

[0209] The second payment module is used to execute payment operations on payment orders in response to payment instructions.

[0210] In one embodiment of this disclosure, the apparatus further includes:

[0211] The second playback module is used to play payment guidance information corresponding to the payment order. The payment guidance information includes at least one of the payment object and the amount to be paid.

[0212] In one embodiment of this disclosure, the first payment module 1150 includes:

[0213] The acquisition unit is used to acquire the voice payment instructions for the payment order;

[0214] The detection unit is used to perform semantic recognition and voiceprint detection on the voice of payment instructions;

[0215] The payment unit is used to execute the payment operation on the payment order in response to the semantic recognition result of the payment instruction indicating confirmation of payment and the voiceprint detection passing.

[0216] In one embodiment of this disclosure, the apparatus further includes:

[0217] The parsing module is used to parse the QR code recognition information and obtain the parsing result;

[0218] The determination module is used to determine that the QR code recognition information corresponds to the target application in response to at least one of the target application identifier, startup parameters, initial page path, and service provider information contained in the parsing result.

[0219] In one embodiment of this disclosure, the interaction module 1130 includes:

[0220] The first display unit is used to display a first display interface corresponding to the target application on a display device set on the smart glasses;

[0221] The first receiving unit is used to receive the user's first voice information;

[0222] The second display unit, in response to the first voice information, displays a second display interface corresponding to the target application on a display device;

[0223] The second receiving unit is used to receive the user's second voice information.

[0224] In one embodiment of this disclosure, the interaction module 1130 includes:

[0225] The first playback unit is used to play the first playback information corresponding to the target application through the voice playback device set on the smart glasses;

[0226] The third receiving unit is used to receive the user's third voice information;

[0227] The second playback unit is used to respond to the third voice information and play the second playback information corresponding to the target application through the voice playback device;

[0228] The fourth receiving unit is used to receive the user's fourth voice information.

[0229] In one embodiment of this disclosure, the generation module 1140 includes:

[0230] The first recognition unit is used to perform semantic recognition on at least one of the first speech information, the second speech information, the third speech information, and the fourth speech information to obtain first semantic recognition information;

[0231] The first generation unit is used to generate a payment order based on the first semantic recognition information.

[0232] In one embodiment of this disclosure, the generation module 1140 includes:

[0233] An extraction unit is used to extract at least one order generation element from voice interaction information;

[0234] The second generation unit is used to generate a payment order based on at least one order generation requirement in response to the fulfillment of the order generation conditions.

[0235] In one embodiment of this disclosure, the generation module 1140 includes:

[0236] The recognition unit is used to perform semantic recognition on the voice interaction information to obtain second semantic recognition information;

[0237] The third generation unit is used to generate a payment order based on the second semantic recognition information in response to the order generation instruction included in the second semantic recognition information.

[0238] Figure 12This is a block diagram illustrating an electronic device according to an exemplary embodiment of the present disclosure. For example, device 1200 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, or other smart device.

[0239] Reference Figure 12 The device 1200 may include one or more of the following components: a processing component 1202, a memory 1204, a power supply component 1206, a multimedia component 12012, an audio component 1210, an input / output (I / O) interface 1212, a sensor component 1214, and a communication component 1216.

[0240] Processing component 1202 typically controls the overall operation of device 1200, such as operations associated with display, telephone calls, data communication, camera operation, and recording operations. Processing component 1202 may include one or more processors 1220 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 1202 may include one or more modules to facilitate interaction between processing component 1202 and other components. For example, processing component 1202 may include a multimedia module to facilitate interaction between multimedia component 12012 and processing component 1202.

[0241] Memory 1204 is configured to store various types of data to support the operation of device 1200. Examples of such data include instructions for any application or method operating on device 1200, contact data, phonebook data, messages, pictures, videos, etc. Memory 1204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0242] Power supply component 1206 provides power to various components of device 1200. Power supply component 1206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to device 1200.

[0243] Multimedia component 12012 includes a screen that provides an output interface between device 1200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of touch or swipe actions but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 12012 includes a front-facing camera and / or a rear-facing camera. When device 1200 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0244] Audio component 1210 is configured to output and / or input audio signals. For example, audio component 1210 includes a microphone (MIC) configured to receive external audio signals when device 1200 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 1204 or transmitted via communication component 1216. In some embodiments, audio component 1210 also includes a speaker for outputting audio signals.

[0245] I / O interface 1212 provides an interface between processing component 1202 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0246] Sensor assembly 1214 includes one or more sensors for providing state assessments of various aspects of device 1200. For example, sensor assembly 1214 may detect the on / off state of device 1200, the relative positioning of components such as the display and keypad of device 1200, changes in the position of device 1200 or a component of device 1200, the presence or absence of user contact with device 1200, the orientation or acceleration / deceleration of device 1200, and temperature changes of device 1200. Sensor assembly 1214 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 1214 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 1214 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, or a temperature sensor.

[0247] Communication component 1216 is configured to facilitate wired or wireless communication between device 1200 and other devices. Device 1200 can access wireless networks based on communication standards, such as Wi-Fi, 3G, 4G, 5G, other communication standards, or combinations thereof. In some embodiments of this disclosure, communication component 1216 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In some embodiments of this disclosure, communication component 1216 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0248] In some embodiments of this disclosure, the apparatus 1200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0249] In some embodiments of this disclosure, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 1204 including instructions, which can be executed by a processor 1220 of the device 1200 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0250] In some embodiments of this disclosure, a non-transitory computer-readable storage medium enables a terminal to execute a smart glasses payment method when instructions in the storage medium are executed by a terminal's processor.

[0251] In some embodiments of this disclosure, a computer program product is also provided, including a computer program / instructions that, when executed by a processor, implement a smart glasses payment method.

[0252] Those skilled in the art will also understand that the various illustrative logical blocks and steps listed in the embodiments of this application can be implemented by electronic hardware, computer software, or a combination of both. Whether such functionality is implemented through hardware or software depends on the specific application and the overall system design requirements. Those skilled in the art can implement the functionality using various methods for each specific application, but such implementation should not be construed as exceeding the scope of protection of the embodiments of this application.

[0253] Those skilled in the art will also understand that the various illustrative logical blocks and steps listed in the embodiments of this application can be implemented by electronic hardware, computer software, or a combination of both. Whether such functionality is implemented through hardware or software depends on the specific application and the overall system design requirements. Those skilled in the art can implement the functionality using various methods for each specific application, but such implementation should not be construed as exceeding the scope of protection of the embodiments of this application.

[0254] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.

[0255] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A payment method for smart glasses, characterized in that, include: Scan the QR code image using the image acquisition device installed on the smart glasses; The QR code image is recognized to obtain QR code recognition information; In response to the QR code recognition information corresponding to a target application, voice interaction is performed based on the target application to obtain voice interaction information; A payment order is generated based on the voice interaction information; In response to the payment instruction for the payment order, a payment operation is performed on the payment order.

2. The method according to claim 1, characterized in that, The method further includes: In response to the QR code recognition information corresponding to a payment link, payment guidance information is played; In response to the payment instruction for the payment order, a payment operation is performed on the payment order.

3. The method according to claim 1, characterized in that, The method further includes: Play payment guidance information corresponding to the payment order, the payment guidance information including at least one of the payment object and the amount to be paid.

4. The method according to claim 1, characterized in that, The step of performing a payment operation on the payment order in response to a payment instruction includes: Obtain the payment instruction voice for the payment order; Perform semantic recognition and voiceprint detection on the voice of the payment instruction; In response to the semantic recognition result of the payment instruction indicating confirmation of payment and the voiceprint detection passing, the payment operation is executed on the payment order.

5. The method according to claim 1, characterized in that, The method further includes: The QR code recognition information is parsed to obtain the parsing result; In response to at least one of the target application's identifier, startup parameters, initial page path, and service provider information contained in the parsing result, it is determined that the QR code identification information corresponds to the target application.

6. The method according to claim 1, characterized in that, The voice interaction based on the target application includes: A first display interface corresponding to the target application is displayed on a display device installed on the smart glasses; Receive the user's first voice message; In response to the first voice information, a second display interface corresponding to the target application is displayed on the display device; Receive the user's second voice information.

7. The method according to claim 1, characterized in that, The voice interaction based on the target application includes: The first playback information corresponding to the target application is played through the voice playback device installed on the smart glasses; Receive third-party voice information from users; In response to the third voice information, the second playback information corresponding to the target application is played through the voice playback device; Receive the user's fourth voice message.

8. The method according to claim 1, characterized in that, The step of generating a payment order based on the voice interaction information includes: Extract at least one order generation element from the voice interaction information; In response to the fulfillment of the order generation requirements, the payment order is generated based on the at least one order generation requirement.

9. The method according to claim 1, characterized in that, The step of generating a payment order based on the voice interaction information includes: The voice interaction information is semantically recognized to obtain second semantic recognition information; In response to the second semantic recognition information including an order generation instruction, the payment order is generated according to the second semantic recognition information.

10. A smart glasses payment device, characterized in that, include: The scanning module is used to scan QR code images using an image acquisition device installed on the smart glasses; The recognition module is used to recognize the QR code image and obtain QR code recognition information; The interaction module is used to respond to the QR code recognition information corresponding to the target application, perform voice interaction based on the target application, and obtain voice interaction information; The generation module is used to generate a payment order based on the voice interaction information; The first payment module is used to perform a payment operation on the payment order in response to the payment instruction of the payment order.

11. The apparatus according to claim 10, characterized in that, The device further includes: The first playback module is used to play payment guidance information in response to the QR code recognition information corresponding to a payment link; The second payment module is used to perform a payment operation on the payment order in response to the payment instruction of the payment order.

12. The apparatus according to claim 10, characterized in that, The first payment module further includes: The acquisition unit is used to acquire the voice payment instruction for the payment order; The detection unit is used to perform semantic recognition and voiceprint detection on the payment instruction voice; The payment unit is used to perform a payment operation on the payment order in response to the semantic recognition result of the payment instruction indicating confirmation of payment and the voiceprint detection passing.

13. An electronic device, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to implement the smart glasses payment method according to any one of claims 1 to 9.

14. A non-transitory computer-readable storage medium, wherein instructions in the storage medium, when executed by a processor of a terminal, enable the terminal to perform the steps of a smart glasses payment method according to any one of claims 1 to 9.

15. A computer program product, said computer program product comprising a computer program or computer instructions, characterized in that, The computer program or the computer instructions are loaded and executed by the processor to enable the computer to implement the steps of the smart glasses payment method as described in any one of claims 1-9.

Images