Payment processing based on ar device

Abstract

Provided are a payment processing method and apparatus based on an AR device. The payment processing method based on an AR device comprises: receiving a payment recommendation message synchronized by a user terminal, and providing a message prompt (S202); acquiring a settlement instruction submitted by a merchant device, and on the basis of merchant information included in the settlement instruction, generating a payment prompt element and displaying same (S204); performing speech recognition on collected speech data, and on the basis of a payment amount obtained by means of the recognition and a collected environment image, rendering and displaying a payment confirmation element (S206); and on the basis of a user payment instruction, transmitting the payment amount and the merchant information to the user terminal for performing payment processing (S208).

Description

Payment processing based on AR device TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of data processing, and particularly relates to payment processing based on AR device. BACKGROUND

[0002] With the continuous development of Internet technology and the continuous improvement of user living standards, AR (Augmented Reality) technology begins to be widely used in the daily life of users, and devices equipped with AR technology also begin to be used by more and more users. With the continuous development of AR technology and the continuous updating of hardware, more and more users begin to have more demands for devices equipped with AR technology, and more and more users hope that AR technology can be applied to more scenarios. How to better use AR technology has become the focus of attention of all parties. SUMMARY

[0003] One or more embodiments of the present disclosure provide a payment processing method based on AR device, applied to an AR device, the method comprising: receiving a payment recommendation message synchronized by a user terminal and performing message prompting. The payment recommendation message is generated after detecting that the user position is within the range of a merchant. A settlement instruction submitted by a merchant device is obtained, and a payment prompting element is generated and displayed based on merchant information contained in the settlement instruction. The merchant device is configured within the range of the merchant and is adapted to the AR device. Voice recognition is performed on collected voice data, and payment confirmation elements are rendered and displayed according to the payment amount obtained by recognition and the collected environment image. The payment amount and the merchant information are transmitted to the user terminal according to the user payment instruction, so as to perform payment processing.

[0004] One or more embodiments of the present disclosure provide another payment processing method based on AR device, applied to a user terminal, the method comprising: obtaining a payment recommendation message for payment through an AR device issued by a server. The payment recommendation message is generated after detecting that the user position is within the range of a merchant. The payment recommendation message is transmitted to the AR device to perform message prompting on the AR device. A settlement instruction transmitted by a merchant device through an established communication connection is received and forwarded to the AR device, so that the AR device renders and displays payment confirmation elements based on collected voice data and environment images. The merchant device is configured within the range of the merchant and is adapted to the AR device. Payment information sent by the AR device is received, and a payment request is generated according to the payment information and submitted to the server, so as to perform payment processing.

[0005] One or more embodiments of the present disclosure provide an AR device-based payment processing apparatus running on an AR device, the apparatus comprising: a message reminding module configured to receive a payment recommendation message synchronized by a user terminal and perform message reminding. The payment recommendation message is generated after detecting that a user location is within a merchant range. A payment reminder element display module is configured to obtain a settlement instruction submitted by a merchant device, and generate and display a payment reminder element based on merchant information contained in the settlement instruction. The merchant device is configured within the merchant range and is adapted to the AR device. A payment confirmation element rendering module is configured to perform voice recognition on collected voice data, and perform rendering and display of a payment confirmation element based on a payment amount obtained by recognition and collected environmental images. A payment amount transmission module is configured to transmit the payment amount and the merchant information to the user terminal according to a user payment instruction, to perform payment processing.

[0006] One or more embodiments of the present disclosure provide another AR device-based payment processing apparatus running on a user terminal, the apparatus comprising: a payment recommendation message obtaining module configured to obtain a payment recommendation message for payment through an AR device issued by a server. The payment recommendation message is generated after detecting that a user location is within a merchant range. A payment recommendation message transmission module is configured to transmit the payment recommendation message to the AR device to perform message reminding on the AR device. A settlement instruction forwarding module is configured to receive a settlement instruction transmitted by a merchant device through an established communication connection and forward the settlement instruction to the AR device, to enable the AR device to render and display a payment confirmation element based on collected voice data and environmental images. The merchant device is configured within the merchant range and is adapted to the AR device. A payment request submission module is configured to receive payment information sent by the AR device, generate a payment request according to the payment information, and submit the payment request to the server to perform payment processing.

[0007] One or more embodiments of the present disclosure provide an AR device, comprising: a processor; and a memory configured to store computer executable instructions, the processor executing the computer executable instructions to implement the following processes: receiving a payment recommendation message synchronized by a user terminal and performing message reminding. The payment recommendation message is generated after detecting that a user location is within a merchant range. Obtaining a settlement instruction submitted by a merchant device, and generating and displaying a payment reminder element based on merchant information contained in the settlement instruction. The merchant device is configured within the merchant range and is adapted to the AR device. Performing voice recognition on collected voice data, and performing rendering and display of a payment confirmation element based on a payment amount obtained by recognition and collected environmental images. Transmitting the payment amount and the merchant information to the user terminal according to a user payment instruction, to perform payment processing.

[0008] One or more embodiments of the present disclosure provide a user terminal, comprising: a processor; and a memory configured to store computer executable instructions, the processor executes the computer executable instructions to implement the following processes: obtaining a payment recommendation message for payment through an AR device issued by a server. The payment recommendation message is generated after detecting that a user location is within a merchant range. Transmitting the payment recommendation message to the AR device to perform message prompting on the AR device. Receiving a settlement instruction transmitted by a merchant device through an established communication connection and forwarding to the AR device to enable the AR device to render and display a payment confirmation element based on collected voice data and environmental images. The merchant device is configured within the merchant range and is adapted to the AR device. Receiving payment information sent by the AR device and generating a payment request according to the payment information and submitting to the server for payment processing.

[0009] One or more embodiments of the present disclosure provide a computer readable storage medium for storing computer executable instructions, which when executed implement the following processes: receiving a payment recommendation message synchronized by a user terminal and performing message prompting; the payment recommendation message is generated after detecting that a user location is within a merchant range. Obtaining a settlement instruction submitted by a merchant device, and generating a payment reminder element and displaying based on merchant information contained in the settlement instruction. The merchant device is configured within the merchant range and is adapted to the AR device. Performing voice recognition on the collected voice data, and rendering and displaying a payment confirmation element according to the payment amount obtained by recognition and the collected environmental images. Transmitting the payment amount and the merchant information to the user terminal according to the user payment instruction for payment processing.

[0010] One or more embodiments of the present disclosure provide another computer readable storage medium for storing computer executable instructions, which when executed implement the following processes: obtaining a payment recommendation message for payment through an AR device issued by a server. The payment recommendation message is generated after detecting that a user location is within a merchant range. Transmitting the payment recommendation message to the AR device to perform message prompting on the AR device. Receiving a settlement instruction transmitted by a merchant device through an established communication connection and forwarding to the AR device to enable the AR device to render and display a payment confirmation element based on collected voice data and environmental images. The merchant device is configured within the merchant range and is adapted to the AR device. Receiving payment information sent by the AR device and generating a payment request according to the payment information and submitting to the server for payment processing. BRIEF DESCRIPTION OF DRAWINGS

[0011] In order to more clearly illustrate the technical solutions in the one or more embodiments of the present disclosure or the related art, the drawings needed to be used in the embodiment or related art description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments described in the present disclosure, and for those skilled in the art, other drawings can also be obtained from these drawings without creative labor.

[0012] FIG. 1 is a schematic diagram of an AR device-based payment processing method implementation environment according to one or more embodiments of the present disclosure;

[0013] FIG. 2 is a flowchart of an AR device-based payment processing method according to one or more embodiments of the present disclosure;

[0014] FIG. 3 is a schematic diagram of a payment recommendation message according to one or more embodiments of the present disclosure;

[0015] FIG. 4 is a schematic diagram of a payment reminder element according to one or more embodiments of the present disclosure;

[0016] FIG. 5 is a schematic diagram of a payment confirmation element according to one or more embodiments of the present disclosure;

[0017] FIG. 6 is a schematic diagram of a payment result window according to one or more embodiments of the present disclosure;

[0018] FIG. 7 is a timing diagram of an AR device-based payment processing method applied to an AR payment scenario according to one or more embodiments of the present disclosure;

[0019] FIG. 8 is a flowchart of another AR device-based payment processing method according to one or more embodiments of the present disclosure;

[0020] FIG. 9 is a schematic diagram of an AR device-based payment processing apparatus according to one or more embodiments of the present disclosure;

[0021] FIG. 10 is a schematic diagram of another AR device-based payment processing apparatus according to one or more embodiments of the present disclosure;

[0022] FIG. 11 is a schematic diagram of an AR device according to one or more embodiments of the present disclosure;

[0023] FIG. 12 is a schematic diagram of a user terminal according to one or more embodiments of the present disclosure. DETAILED DESCRIPTION

[0024] In order to make the person skilled in the art better understand the technical solutions in one or more embodiments of the present disclosure, the technical solutions in one or more embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in one or more embodiments of the present disclosure. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all the embodiments. Based on one or more embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without creative labor should belong to the protection scope of the present disclosure.

[0025] The AR device-based payment processing method provided by one or more embodiments of the present embodiment can be applied to an implementation environment for making payment based on a group account. Referring to FIG. 1, the implementation environment at least includes an AR device 101, which can be an AR-enabled smart wearable device, such as AR glasses. The AR device 101 is configured to perform message prompting of a payment recommendation message and to identify a payment amount, and to cooperate with a user terminal 102 to perform payment processing.

[0026] The implementation environment at least includes the user terminal 102, which can be a smart phone, a tablet computer, an e-book reader, a wearable device, and a device for information interaction based on other technologies. The user terminal 102 is configured to transmit a payment recommendation message and a settlement instruction to the AR device 101, and to cooperate with the AR device 101 to perform payment processing.

[0027] The implementation environment can further include a server 103, which can be one or more servers, a server cluster composed of several servers, or a cloud server of a cloud computing platform. The server 103 is configured to generate and send a payment recommendation message, and to perform payment processing.

[0028] The implementation environment can include a merchant device 104, which can be a terminal device configured with a communication component. The merchant device 104 can be configured to cooperate with the AR device 101 and the user terminal 102 to perform message transmission and payment processing.

[0029] In the implementation environment, the server 103 first sends a payment recommendation message for payment through the AR device 101 to the user terminal 102, the user terminal 102 forwards the payment recommendation message to the AR device 101 for message reminding through the AR device 101, the merchant device 104 sends a settlement instruction to the user terminal 102, the user terminal 102 forwards the settlement instruction to the AR device 101, the AR device 101 generates and displays a payment reminding element based on the settlement instruction, and performs voice collection and voice recognition, renders and displays a payment confirmation element according to the payment amount obtained through recognition and the collected environment image, to obtain a user payment instruction, and transmits the payment amount and merchant information contained in the settlement instruction to the user terminal 102 according to the user payment instruction, so that the user terminal 102 generates a payment request based on the payment amount and the merchant information and submits the payment request to the server 103 for payment processing, thereby realizing the payment mode of cooperation between the AR device and the merchant device for payment, and increasing the functions of the AR device and the merchant device.

[0030] One or more embodiments of the AR device-based payment processing method provided by the present disclosure are as follows.

[0031] Referring to FIG. 2, the AR device-based payment processing method provided by the present embodiment is applied to an AR device, and specifically includes steps S202 to S208.

[0032] In step S202, a payment recommendation message synchronized by a user terminal is received and message reminding is performed.

[0033] In actual application, a user can use a smart wearable device to replace part of the functions of a user terminal, so as to avoid frequent taking out and putting back the user terminal, for example, message display and page display through the AR device instead of the screen of the user terminal; in view of this, the present embodiment uses the cooperation between the AR device and the user terminal to perform message display and page display through the AR device, and performs payment confirmation through the AR device and the user interaction to perform payment processing, thereby increasing the payment function of the AR device and improving the usability of AR payment.

[0034] In specific implementation, the server first sends a payment recommendation message to the user terminal, to remind the user that the merchant can use the AR device for payment, and the user terminal receives the payment recommendation message and transmits it to the AR device; the AR device receives the payment recommendation message and displays it.

[0035] In this embodiment, the payment recommendation message is used to remind the user that the merchant can use the AR device for payment processing. The payment recommendation message is generated and sent after detecting that the location information of the user is within the range of the merchant. Specifically, the payment recommendation message can be displayed in the AR device screen through a message pop-up window. Optionally, the payment recommendation message is generated after detecting that the user's location is within the range of the merchant. In this embodiment, the AR device is a device with AR function. Specifically, the AR device can be a wearable device configured with an image acquisition component, a processor, a microphone, and / or a screen. The AR device can also be configured with a communication component, which can be a communication component of a local area network, such as a Bluetooth component of a Bluetooth network. The AR device can connect with the user terminal through the Bluetooth component to connect to the Internet through the user terminal. The AR device can also establish a communication connection with the merchant device through the Bluetooth component. In addition, the communication component can also be a communication component of the Internet, such as an Internet network card. The AR device can connect to the Internet through the network card to interact with the server. The AR device can also be configured with a Bluetooth component and an Internet network card to simultaneously interact with the server, the user terminal, and the merchant device.

[0036] In the specific implementation process, the payment recommendation message can be generated and sent by the server. Specifically, the server can detect whether the user is within the range of the merchant through electronic fences, location fences, etc. After detecting that the user bound to the AR device is within the range of the merchant, the server generates a payment recommendation message and sends it to the user. In an optional embodiment provided in this embodiment, the payment recommendation message is generated in the following manner.

[0037] Detect whether the user has a binding relationship with the AR device. If yes, detect whether the location information is within the range of the merchant. If no, no processing is required. If yes, generate a payment recommendation message for payment through the AR device and send it to the AR device.

[0038] Optionally, the range of the merchant is determined based on the merchant address registered by the merchant in the application program.

[0039] Specifically, the user location information can be determined by the location component configured in the AR device, or the terminal location information of the user terminal connected to the AR device can be used as the user location information. After detecting that the user location information is within the range of the merchant, the server queries whether the user has a binding relationship with the AR device in the database. If yes, a payment recommendation message is generated and sent to the user terminal to transmit to the AR device through the user terminal, or the server can also send the payment recommendation message to the AR device. Specifically, the merchant can register the address of at least one store in the application program to determine the range of the merchant based on the address of at least one store.

[0040] For example, the server generates a payment recommendation message and sends it to the user terminal after detecting that the user binding the AR device enters the scope of the merchant, so as to transmit the payment recommendation message to the AR device through the user terminal, and display the payment recommendation message 301 in the screen of the AR device as shown in FIG. 3.

[0041] It should be noted that in the present embodiment, the AR device can be AR glasses with a transparent screen, that is, the payment recommendation message 301 and the state information and time information in the upper right corner shown in FIG. 3 are displayed in the screen of the AR device, and the rest of the images and / or pictures are real images and are not displayed in the screen of the AR device, but are displayed in the drawings due to the transparent screen. Correspondingly, the AR device also collects and renders real images through the image collection component and displays them together with the payment recommendation message, state information and / or time information in the screen. The present embodiment does not limit this.

[0042] In addition, the merchant device can also detect whether the user position is within the scope of the merchant through the configured component, such as detecting the device type and device position of the connected device through the Bluetooth Beacon component. The merchant device can submit a message sending request to the server after detecting that the user position is within the scope of the merchant, so that the server sends a payment recommendation message to the AR device based on the message sending request, thereby reducing the processing pressure of the server and increasing the function of the merchant device. In an optional implementation provided by the present embodiment, the payment recommendation message is generated in the following manner.

[0043] The merchant submits a message sending request, and the server extracts the device identifier and message content carried in the message sending request. The server generates the payment recommendation message according to the message content and sends the payment recommendation message to the user binding the device identifier through the message service of the application.

[0044] Optionally, the message sending request is submitted to the server through the device detection component of the merchant device in the case of detecting that the connected device is an AR device, so as to send the message through the server.

[0045] Specifically, the AR device can establish a communication connection with the merchant device after entering the scope of the merchant and / or the communication connection range of the merchant device. The merchant device calls the device detection component to detect whether the connected device is an AR device, reads the device identifier of the AR device and generates a message sending request based on the device identifier and the message content, and submits it to the server. The server extracts the device identifier and message content carried in the message sending request and generates a payment recommendation message, and sends the payment recommendation message of the merchant to the user terminal of the user binding the device identifier through the message service of the application.

[0046] In actual applications, in order to improve the pertinence of the payment recommendation message and avoid sending the payment recommendation message to a user who does not use an AR device, the user can perform device registration in advance for the AR device and establish a binding relationship between the user and the AR device, so that the server detects that the user who binds the AR device enters the range of the merchant and / or the merchant device detects that a communication connection is established with the registered AR device, and then the generation operation of the payment recommendation message is performed. In an optional embodiment provided by the present embodiment, the method further includes: the user obtains a device identifier after registering the AR device in the application program; the user establishes a binding relationship between the AR device and the user after registering the AR device in the application program; correspondingly, the AR device is registered in the following manner: obtaining a device registration request submitted by the user, reading a device identifier of the AR device connected to the user terminal based on the device registration request; establishing a binding relationship between the AR device and the user based on the device identifier, and writing the device identifier into a device registration table.

[0047] Further, the server can also detect whether the device identifier of the AR device of the user is recorded in the device registration table before generating the payment recommendation message, so as to avoid that the AR device bound by the user has been disabled, or the AR device connected by the merchant device does not support the AR payment function. Correspondingly, before the generation of the two payment recommendation messages provided above, the method further includes: reading the device identifier of the AR device and querying whether the device identifier of the AR device exists in the device registration table; if not, no processing is performed; if yes, the execution processing of the payment recommendation message is performed.

[0048] It should be noted that the payment recommendation message can also be issued by the server to the AR device, so that the payment recommendation message is received by the pass-through component configured by the AR device and a message reminder is performed. That is, step S202 can be replaced by receiving the payment recommendation message issued by the server and performing a message reminder.

[0049] In step S204, the settlement instruction submitted by the merchant device is obtained, and a payment reminder element is generated and displayed based on the merchant information contained in the settlement instruction.

[0050] In this embodiment, the merchant device is a device configured with a communication component, which is configured in the store of the merchant, that is, in the range of the merchant. Specifically, the merchant device can be configured with a Bluetooth component and a Bluetooth Beacon function. The merchant device can interact with the user terminal and / or the AR device through the function of the communication component to complete the AR payment. The merchant device can also be configured with a communication component connected to the Internet, that is, an Internet card. The merchant device can interact with the server through the Internet to process the payment recommendation message. In addition, the merchant device can also be connected with the cash register terminal of the merchant to obtain the settlement instruction transmitted by the cash register terminal of the merchant and send it to the user terminal and / or the AR device. In addition, the merchant device can also be adapted to other devices such as the user terminal and the wearable device through the communication component. Optionally, the merchant device is configured in the range of the merchant and is adapted to the AR device.

[0051] In specific implementation, the merchant device receives the settlement instruction sent by the merchant and / or the cash register terminal, and sends the settlement instruction to the AR device and / or the user terminal, so that the AR device generates and displays the payment reminder element after receiving the settlement instruction. Specifically, the AR device can generate and display the payment reminder element after detecting the settlement instruction submitted by the merchant device and containing the merchant information.

[0052] In the specific execution process, the AR device can pre-store the payment reminder element and, after detecting the settlement instruction containing the merchant information, call the service component of the application program to obtain the payment reminder element and render and display the payment reminder element according to the element data. Further, to improve the user's perception of payment, the merchant identifier element of the merchant can be displayed on the screen of the AR device to block the merchant device in the real image, that is, the merchant identifier element is configured in the screen of the AR device at the position corresponding to the merchant device in the real image, so as to display the preset reminder element in the central area of the screen and display the merchant identifier element at the position of the merchant device. The merchant identifier element and the preset reminder element are called payment reminder elements. In an optional embodiment provided in this embodiment, the payment reminder element is generated and displayed based on the merchant information contained in the settlement instruction, which includes running the service component of the application program to obtain the merchant identifier element corresponding to the merchant information and the preset reminder element; performing edge detection on the environment image, determining the identification display area according to the edge detection result, configuring the merchant identifier element in the identification display area, and configuring the preset reminder element in the central area for display.

[0053] Specifically, the service component running the application program queries the merchant identifier element corresponding to the merchant information and the preset reminder element in the database of the application program, performs edge detection on the environment image collected by the image collection component of the AR device, determines the area where the merchant device is located according to the edge detection result, and determines the identification display area of the merchant device corresponding to the screen of the AR device according to the area of the merchant device in the environment image, so as to display the merchant identifier element in the identification display area and display the preset reminder element in the central area of the screen of the AR device, and perform display processing of the payment reminder element containing the merchant identifier element and the preset reminder element.

[0054] As shown in FIG. 4, according to the area of the merchant device in the environment image, the identification display area of the merchant identifier element 402 in the screen of the AR device is determined and displayed, and the preset reminder element 401 is displayed in the central area of the screen of the AR device. In FIG. 4, the frame of the preset reminder element 401 is only used to represent the area where the preset reminder element 401 is located, and is not displayed in the screen, and as described above, the preset reminder element 401 and the merchant identifier element 402 can be displayed in the transparent screen of the AR device.

[0055] It should be noted that the payment reminder element can also be generated and displayed after the settlement instruction submitted by the merchant device is obtained, so as to cooperate with the server to perform payment processing based on the merchant information contained in the settlement instruction through the user terminal, that is, step S204 can be replaced by: after detecting the payment instruction submitted by the merchant device, generating and displaying the payment reminder element.

[0056] In step S206, the collected voice data is subjected to voice recognition, and the payment confirmation element is rendered and displayed according to the payment amount obtained by recognition and the collected environment image.

[0057] The embodiment enables the user to perform payment in the AR scene while avoiding frequent taking of the user terminal for payment interaction and / or AR interaction processing by replacing part of the function of the user terminal with the AR device, and determining the amount of money to be transferred to the merchant and / or paid by the voice recognition capability of the AR device.

[0058] In specific implementation, the AR device calls the voice collection component to collect voice data in the real environment, and calls the image collection component to collect an environment image in the real environment, performs voice recognition on the voice data to obtain a payment amount, and performs rendering and display processing of a payment confirmation element according to the payment amount and the environment image. Specifically, the voice data can be subjected to voice recognition, and the amount keyword contained in the voice recognition result is filtered as the payment amount, an amount element corresponding to the payment amount is generated, and the amount element is configured in a screen area of the screen of the AR device corresponding to the image position of the merchant member image based on the image position of the merchant member image in the environment image.

[0059] In this embodiment, the payment confirmation element is generated according to the payment amount contained in the voice recognition result, so as to make the user confirm the payment amount through the payment confirmation element and input the user confirmation instruction after confirmation; specifically, the payment confirmation element can be generated by rendering through the AR device, or can be generated by rendering through the rendering interface of the user terminal and / or the application program; in an optional implementation provided by this embodiment, the payment confirmation element is generated in the following manner.

[0060] The rendering interface of the application program is called based on the payment amount to perform element rendering, and the payment confirmation element is generated according to element data returned by the interface call; or, the rendering component of the user terminal is called by the application program based on the payment amount to perform element rendering, and the payment confirmation element is generated according to element data returned by the user terminal.

[0061] In the specific voice recognition process, in order to improve the voice recognition efficiency, the voice recognition component of the application program can be configured in the AR device to perform voice recognition processing through the AR device, or the voice recognition interface of the application program can also be called to perform voice recognition, and the voice recognition result returned by the interface call is obtained; specifically, the payment amount can be obtained by recognizing through the AR device, can be transmitted to the AR device after being recognized through the user terminal, can be obtained by calling the voice recognition interface of the application program by the AR device, or can be transmitted to the AR device by the user terminal after calling the voice recognition interface of the application program; in an optional implementation provided by this embodiment, the voice recognition includes: running the voice recognition component of the application program based on the voice data to perform voice recognition, and determining the payment amount according to the voice recognition result.

[0062] Optionally, the voice recognition component calls the voice recognition interface of the application program with the voice data as input data, and obtains the voice recognition result output by the interface call.

[0063] Specifically, after the AR device collects the voice data, the voice recognition component of the application program installed in the AR device is run, the voice recognition interface of the application program is called by the voice recognition component with the voice data as input data, the voice recognition result returned by the interface call is obtained, and the payment amount is obtained by screening through the voice recognition component.

[0064] In actual application, there is a case that the voice recognition of the AR device is not accurate. In response to this, a control for re-performing voice recognition can be provided to the user, so that the user triggers the control to perform secondary voice recognition in the case of inaccurate voice recognition, and performs rendering and display of the payment confirmation element according to the recognition result of the secondary recognition and the re-collected environmental image. In an optional implementation provided in the embodiment, after the rendering and display of the payment confirmation element according to the payment amount obtained by recognition and the collected environmental image, the method further includes: if the secondary recognition instruction input by the user is detected, performing secondary voice recognition; and performing rendering and display of the first confirmation element according to the first payment amount obtained by secondary recognition and the first environmental image collected.

[0065] Specifically, the secondary recognition instruction can be input by the user triggering the hardware control configured on the AR device, such as a fingerprint recognition button configured on the AR device. The secondary recognition instruction can also be input by the user through an AR technology-related gesture, such as the user wearing an AR device-related ring, wristband, or other peripheral device, and inputting the secondary recognition instruction through a preset gesture.

[0066] In addition, in the case that the user perceives that the voice recognition result is incorrect, that is, the payment amount displayed by the payment confirmation element is inaccurate, the user can also input a secondary recognition instruction to perform code scanning payment of the AR device. Specifically, after the user inputs the secondary recognition instruction, the AR device calls the image collection component to obtain the payment code image displayed by the merchant device, performs voice recognition based on the decoding result, to perform secondary voice recognition and rendering and display of the first confirmation element.

[0067] In the specific execution process, to increase the AR interaction effect of the user, the voice data collected from the user and / or the merchant member and containing the payment amount can be subjected to voice recognition to obtain the payment amount, the voice element corresponding to the payment amount is rendered and configured in the screen of the AR device at a position corresponding to the merchant member in the environmental image, so as to provide the user with an augmented reality effect through the transparent screen of the AR device, such as configuring the voice element in the screen of the AR device, so that the voice element is visually configured at the mouth of the merchant member. In an optional implementation provided in the embodiment, the rendering and display of the payment confirmation element according to the payment amount and the environmental image includes: performing feature recognition on the merchant member image contained in the environmental image, determining a target image area according to the feature recognition result, and determining an element display area according to the target image area; rendering the payment confirmation element containing the amount element and the voice element corresponding to the payment amount, configuring the voice element in the element display area, and configuring the amount element in the center area for display processing.

[0068] Specifically, facial feature recognition is performed on the merchant member image contained in the environment image to obtain a feature recognition result of a mouth of the merchant member in the merchant member image, a target image region corresponding to the mouth of the merchant member is determined according to the feature recognition result, and the target image region is mapped into a screen position of the AR device to determine an element display region in the screen of the AR device, a payment confirmation element containing an amount element and a voice element corresponding to the payment amount is rendered, the voice element is configured in the element display region, that is, a region corresponding to the mouth of the merchant member in the environment image, and the amount element is configured in a central region of the screen of the AR device, so as to perform rendering and display processing of the payment confirmation element.

[0069] As shown in FIG. 5, the amount element 501 and the voice element 502 corresponding to the payment amount are rendered, the voice element 502 is configured in a screen region corresponding to the mouth of the merchant member, and the amount element 501 is configured in a central region of the screen of the AR device, so that the user perceives the combination of the payment scene and the AR scene; as described above, the frame of the voice element 502 is only used for illustration, and a background region outside the amount element 501 and the voice element 502 can be a real environment or an image rendered in the screen of the AR device.

[0070] It should be noted that the rendering and display process of the payment confirmation element can also be used for rendering and display processing of the first confirmation element. The rendering and display processing of the first confirmation element is taken as an example of the rendering and display processing of the payment confirmation element, and details are not described herein again.

[0071] In step S208, the payment amount and the merchant information are transmitted to the user terminal according to the user payment instruction to perform payment processing.

[0072] The embodiment combines the AR scene and the payment scene, provides the user with the ability of augmented reality for payment processing, increases the payment function of the AR device, and enhances the perception ability of the user when using the AR device to make payment.

[0073] In a specific implementation, the user inputs a user payment instruction to the AR device, and transmits the payment amount obtained through voice recognition and merchant information contained in the settlement instruction to the user terminal; after receiving the payment amount and the settlement instruction, the user terminal generates a payment request according to the payment amount and the merchant information and sends the payment request to the server, so that the server transfers the payment amount corresponding fund from the fund account to the merchant account of the merchant based on the fund account of the user. Specifically, the user payment instruction can be input through a software and / or hardware control configured by the user to trigger the AR device, or can be input through a gesture. The specific input method can refer to the input method of the secondary recognition instruction described above, and details are not described herein again.

[0074] In actual application, after the payment processing is completed, a payment success message can also be generated to be sent to the user terminal and / or the AR device, so as to generate a payment result element and / or a payment success window based on the payment success message, and the payment result element and / or the payment success window is displayed on the screen of the AR device, and after the display time is detected to be expired, the closing processing of the payment result element and / or the payment success window is performed, for example, the payment result element and / or the payment success window is closed after being displayed for 3 seconds. In an optional implementation of the embodiment, after the payment amount and the merchant information are transmitted to the user terminal based on the user payment instruction to perform the payment processing, the method further includes: receiving a payment success message sent by the user terminal, and generating a payment result window containing the payment success message; displaying the payment result window, and closing the payment result window after the display time is detected to be expired.

[0075] As shown in FIG. 6, the server sends a payment success message to the user terminal through the application program after the payment processing is completed, the user terminal transmits the payment success message to the AR device, the AR device generates a payment result window 601 containing the payment success message based on the payment success message, and displays the payment result window 601 in the center of the screen of the AR device, and closes the payment result window 601 after the display time is detected to be expired; that is, the payment result window 601 is closed after being displayed for 3 seconds.

[0076] In summary, the one or more payment processing methods based on the AR device provided by the embodiment are applied to the AR device, in the payment process, the payment recommendation message synchronized by the user terminal is received and a message reminder is performed, the settlement instruction submitted by the merchant device is acquired, and a payment reminder element is generated and displayed based on the merchant information contained in the settlement instruction, the collected voice data is subjected to voice recognition, the payment confirmation element is rendered and displayed based on the payment amount obtained by the recognition and the collected environment image, the payment amount and the merchant information are transmitted to the user terminal based on the user payment instruction to perform the payment processing, and the payment scene is combined with the AR scene, so that the augmented reality processing in the payment process is realized, and the perception degree of the user using the AR device for payment is improved.

[0077] The implementation process of the payment processing method based on the AR device provided above can be performed by the AR device, and the implementation process of another payment processing method based on the AR device provided by the following method embodiment can be performed by the user terminal, and the two can cooperate with each other in the implementation process. Therefore, the corresponding content of the another payment processing method based on the user terminal can be referred to by reading the above implementation process, and correspondingly, the corresponding content of the above method embodiment can also be referred to by reading the another payment processing method based on the user terminal.

[0078] The AR device-based payment processing method provided in the embodiment is further described below by taking the application of the AR device-based payment processing method in an AR payment scenario as an example. Referring to FIG. 7, the AR device-based payment processing method applied in the AR payment scenario specifically includes the following steps.

[0079] In step S706, the user terminal synchronously receives a payment recommendation message and performs message prompting.

[0080] In step S710, the user terminal forwards a settlement instruction, and a service component of an application program acquires a merchant identifier element corresponding to merchant information contained in the settlement instruction and a preset prompting element.

[0081] In step S712, mechanical edge detection is performed on the collected environmental image, a display area of the identifier is determined according to the edge detection result, the merchant identifier element is configured in the display area of the identifier, and the preset prompting element is configured in the central area to display the payment prompting element.

[0082] In step S714, voice recognition is performed on the collected voice data to obtain a payment amount, feature recognition is performed on a merchant member image contained in the environmental image, a target image area is determined according to the feature recognition result, and an element display area is determined according to the target image area.

[0083] In step S716, a payment confirmation element containing an amount element and a voice element corresponding to the payment amount is rendered, the voice element is configured in the element display area, and the amount element is configured in the central area to perform display processing.

[0084] In step S724, a payment success message sent by the user terminal is received, and a payment result window containing the payment success message is generated.

[0085] In step S726, the payment result window is displayed, and the payment window is closed after the display time is detected to be up.

[0086] The steps S706, S710-S716, and S724-S726 provided in the embodiment are executed by the AR device. It should be noted that the steps S706, S710-S716, and S724-S726 executed by the AR device can be mutually matched with the steps S702-S706 and S720-S722 executed by the user terminal in the execution process. Therefore, when reading the embodiment, refer to the corresponding content of the steps S702-S706 and S720-S722 provided in the following method embodiment, and refer to the corresponding content of the steps S706, S710-S716, and S724-S726 provided in the embodiment when reading the following method embodiment.

[0087] One or more embodiments of another AR device-based payment processing method provided by the present disclosure are as follows.

[0088] Referring to FIG. 8, the AR device-based payment processing method provided by the present embodiment is applied to a user terminal and specifically includes steps S802 to S808.

[0089] In step S802, a payment recommendation message for making a payment through an AR device is acquired from a server.

[0090] In actual applications, a user can use a smart wearable device to replace part of the functions of a user terminal, so as to avoid frequently taking out and putting away the user terminal, such as using an AR device to replace the screen of a user terminal to display messages and pages, and the like. In view of this, in the present embodiment, the AR device is used in cooperation with a user terminal to display messages and pages, and the like, and the AR device is used to interact with a user to confirm a payment and to process the payment, thereby increasing the payment function of the AR device and improving the usability of AR payment.

[0091] In a specific implementation, the server first sends a payment recommendation message to the user terminal, so as to remind the user that the merchant can use the AR device to make a payment, and the user terminal acquires the payment recommendation message.

[0092] In the present embodiment, the server can be a server to which an application belongs. Specifically, the server of the application can be deployed in the server to provide services to devices of clients to which the application is deployed, such as generating and sending a payment recommendation message, rendering and sending a payment confirmation element, and rendering and sending a payment reminder element.

[0093] In this embodiment, the payment recommendation message is used to remind the user that the merchant can use the AR device for payment processing. The payment recommendation message is generated and sent after detecting that the location information of the user is within the range of the merchant. Specifically, the payment recommendation message can be displayed in the AR device screen through a message pop-up window. Optionally, the payment recommendation message is generated after detecting that the user's location is within the range of the merchant. In this embodiment, the AR device is a device with AR function. Specifically, the AR device can be a wearable device configured with an image acquisition component, a processor, a microphone, and / or a screen. The AR device can also be configured with a communication component, which can be a communication component of a local area network, such as a Bluetooth component of a Bluetooth network. The AR device can connect with the user terminal through the Bluetooth component to connect to the Internet through the user terminal. The AR device can also establish a communication connection with the merchant device through the Bluetooth component. In addition, the communication component can also be a communication component of the Internet, such as an Internet network card. The AR device can connect to the Internet through the network card to interact with the server. The AR device can also be configured with a Bluetooth component and an Internet network card to simultaneously interact with the server, the user terminal, and the merchant device.

[0094] In the specific implementation process, the payment recommendation message can be generated and sent by the server. Specifically, the server can detect whether the user is within the range of the merchant through an electronic fence, a location fence, or the like. After detecting that the user bound to the AR device is within the range of the merchant, the server generates a payment recommendation message and sends it to the user. In an optional implementation provided in this embodiment, the payment recommendation message is generated in the following manner.

[0095] If the user is bound to the AR device, the server detects whether the location information is within the range of the merchant. If not, no processing is performed. If yes, the server generates a payment recommendation message for payment through the AR device and sends it to the AR device.

[0096] Optionally, the range of the merchant is determined based on the merchant address registered by the merchant in the application program.

[0097] Specifically, the user location information can be determined by the location component configured in the AR device, or the terminal location information of the user terminal connected to the AR device can be used as the user location information. After detecting that the user location information is within the range of the merchant, the server queries whether the user is bound to the AR device in the database. If yes, the server generates a payment recommendation message and sends it to the user terminal to transmit it to the AR device through the user terminal, or the server can also send the payment recommendation message to the AR device. Specifically, the merchant can register the address of at least one store in the application program to determine the range of the merchant based on the address of the at least one store.

[0098] Further, the merchant device can also detect whether the user position is within the merchant range through the configured component, for example, through the Bluetooth Beacon component to detect the device type and the device position of the connected device, and the merchant device can submit a message sending request to the server after detecting that the user position is within the merchant range, so that the server issues a payment recommendation message to the AR device based on the message sending request, which reduces the processing pressure of the server and increases the function of the merchant device. In an optional implementation provided in the embodiment, the payment recommendation message is generated in the following manner.

[0099] The merchant submits a message sending request, and the server receives the message sending request and extracts the device identifier and the message content carried in the message sending request; the payment recommendation message is generated according to the message content, and the payment recommendation message is sent to the user bound with the device identifier through the message service of the application program.

[0100] Optionally, the message sending request is submitted to the server through the device detection component called by the merchant device to detect the AR device, so as to send the message through the server.

[0101] Specifically, the AR device can establish a communication connection with the merchant device after entering the communication connection range of the merchant device and / or the merchant range, the merchant device calls the device detection component to detect the AR device, so as to detect whether the connected device is an AR device, in the case that the connected device is detected as an AR device, the device identifier of the AR device is read and a message sending request is generated based on the device identifier and the message content and submitted to the server; the server extracts the device identifier and the message content carried in the message sending request and generates a payment recommendation message, and sends the payment recommendation message of the merchant to the user terminal of the user bound with the device identifier through the message service of the application program.

[0102] In actual applications, in order to improve the pertinence of the payment recommendation message and avoid sending the payment recommendation message to a user who does not use an AR device, the user can perform device registration in advance for the AR device and establish a binding relationship between the user and the AR device, so that the server detects that the user who binds the AR device enters the scope of the merchant and / or the merchant device detects that a communication connection is established with the registered AR device, and then the generation operation of the payment recommendation message is performed. In an optional implementation provided in the embodiment, the method further includes: the user obtains a device identifier after registering the AR device in the application program; the user establishes a binding relationship between the AR device and the user after registering the AR device in the application program; correspondingly, the AR device is registered in the following manner: obtaining a device registration request submitted by the user, reading a device identifier of the AR device connected to the user terminal based on the device registration request; establishing a binding relationship between the AR device and the user based on the device identifier, and writing the device identifier into a device registration table.

[0103] Further, the server can also detect whether the device identifier of the AR device of the user is recorded in the device registration table before generating the payment recommendation message, so as to avoid that the AR device bound by the user has been disabled, or the AR device connected by the merchant device does not support the AR payment function. Correspondingly, before the generation of the two payment recommendation messages provided above, the method further includes: reading the device identifier of the AR device and querying whether the device identifier of the AR device exists in the device registration table; if not, no processing is performed; if yes, the execution processing of the payment recommendation message is performed.

[0104] It should be noted that the payment recommendation message can also be issued by the server to the AR device, so that the payment recommendation message is received by the pass-through component configured in the AR device and a message reminder is performed. That is, step S202 can be replaced by receiving the payment recommendation message issued by the server and performing a message reminder.

[0105] Step S804: transmitting the payment recommendation message to the AR device, so that the AR device performs a message reminder.

[0106] In specific implementation, the user terminal transmits the payment recommendation message to the AR device; after receiving the payment recommendation message, the AR device performs a message reminder on the screen of the AR device.

[0107] Step S806: receiving a settlement instruction transmitted by the merchant device through the established communication connection and forwarding the settlement instruction to the AR device, so that the AR device renders and displays a payment confirmation element based on the collected voice data and environmental images.

[0108] In this embodiment, the merchant device is a device configured with a communication component, which is configured in the store of the merchant, that is, in the range of the merchant. Specifically, the merchant device can be configured with a Bluetooth component and a Bluetooth Beacon function, and the merchant device can interact with the user terminal and / or the AR device through the function of the communication component to complete the AR payment. The merchant device can also be configured with a communication component connected to the Internet, that is, an Internet card, and the merchant device can interact with the server through the Internet to process the payment recommendation message. In addition, the merchant device can also be connected with the cash register terminal of the merchant to obtain the settlement instruction transmitted by the cash register terminal of the merchant and send it to the user terminal and / or the AR device. In addition, the merchant device can also be adapted to other devices such as the user terminal and the wearable device through the communication component. Optionally, the merchant device is configured in the range of the merchant and is adapted to the AR device.

[0109] In specific implementation, the user terminal establishes a communication connection with the merchant device based on the communication connection request broadcasted by the merchant device, receives the settlement instruction transmitted by the merchant device through the communication connection, and forwards the settlement instruction to the AR device. After receiving the settlement instruction, the AR device generates a payment reminder element based on the merchant information contained in the settlement instruction and displays it on the screen, and sends the payment information to the user terminal after receiving the user confirmation instruction. Specifically, the user terminal can analyze the settlement instruction to obtain the merchant information contained in the settlement instruction, and then forward the settlement instruction to the AR device to enable the AR device to perform voice recognition based on the settlement instruction.

[0110] In the specific execution process, the AR device can pre-store the payment reminder element and, after detecting the settlement instruction containing the merchant information, call the service component of the application program to obtain the payment reminder element and render and display the payment reminder element according to the element data. Further, to improve the user's perception of payment, the merchant's merchant identification element can be displayed on the screen of the AR device to block the merchant device in the real image, that is, the merchant identification element is configured in the screen of the AR device at the position corresponding to the merchant device in the real image, so as to display the preset reminder element in the central area of the screen and display the merchant identification element at the position of the merchant device. The merchant identification element and the preset reminder element are referred to as the payment reminder element. In an optional implementation provided in this embodiment, the payment reminder element is generated and displayed based on the merchant information contained in the settlement instruction, which includes running the service component of the application program to obtain the merchant identification element corresponding to the merchant information and the preset reminder element; performing edge detection on the environment image, determining an identification display area according to the edge detection result, configuring the merchant identification element in the identification display area, and configuring the preset reminder element in the central area for display.

[0111] Specifically, the service component running the application program queries the merchant identifier element corresponding to the merchant information and the preset reminder element in the database of the application program, performs edge detection on the environment image collected by the image collection component of the AR device, determines the area where the merchant device is located according to the edge detection result, and determines the identification display area of the merchant device corresponding to the screen of the AR device according to the area of the merchant device in the environment image, so as to display the merchant identifier element in the identification display area and display the preset reminder element in the central area of the AR device, and perform display processing of the payment reminder element containing the merchant identifier element and the preset reminder element.

[0112] In the embodiment, the payment confirmation element is generated according to the payment amount contained in the voice recognition result, so as to make the user confirm the payment amount through the payment confirmation element and input a user confirmation instruction after confirmation; in the specific payment confirmation element rendering process, the AR device calls the voice collection component to collect voice data in the real environment, and calls the image collection component to collect an environment image in the real environment, performs voice recognition on the voice data to obtain a payment amount, and performs rendering and display processing of the payment confirmation element according to the payment amount and the environment image. In an optional implementation provided by the embodiment, the payment confirmation element is generated in the following manner: calling a rendering interface of an application program based on the payment amount to perform element rendering, and generating the payment confirmation element according to element data returned by the interface call; or, calling a rendering component of a user terminal through the application program based on the payment amount to perform element rendering, and generating the payment confirmation element according to element data returned by the user terminal.

[0113] In the specific voice recognition process, in order to improve the voice recognition efficiency, a voice recognition component of an application program can be configured in the AR device to perform voice recognition processing through the AR device, or a voice recognition interface of the application program can be called to perform voice recognition, and the voice recognition result returned by the interface call can be obtained. Specifically, the payment amount can be obtained by recognizing through the AR device, can be transmitted to the AR device after being recognized through the user terminal, can be obtained by calling the voice recognition interface of the application program by the AR device, or can be transmitted to the AR device after the payment amount returned by the interface call is called by the voice recognition interface of the application program. In an optional implementation provided by the embodiment, the voice recognition includes: running a voice recognition component of an application program based on the voice data to perform voice recognition, and determining the payment amount according to the voice recognition result.

[0114] Optionally, the voice recognition component identifies the voice data as input data of a voice recognition interface of the application program to perform interface call, and obtains the voice recognition result output by the interface call.

[0115] Specifically, after the AR device collects the voice data, a voice recognition component of an application installed on the AR device is run, the voice recognition component calls a voice recognition interface of the application by taking the voice data as input data, obtains a voice recognition result returned by the interface call, and screens the voice recognition result by using the voice recognition component to obtain the payment amount.

[0116] In actual applications, the voice recognition of the AR device may not be accurate. In this case, a control for re-performing voice recognition can be provided to the user, so that the user can trigger the control to perform secondary voice recognition in the case of inaccurate voice recognition, and render and display the payment confirmation element according to the recognition result of the secondary recognition and the re-collected environmental image. In an optional implementation of the embodiment, after the payment amount obtained by recognition and the collected environmental image are used to render and display the payment confirmation element, the method further includes: detecting a secondary recognition instruction input by the user, performing secondary voice recognition; and rendering and displaying a first confirmation element according to a first payment amount obtained by secondary recognition and a first environmental image collected.

[0117] Specifically, the secondary recognition instruction can be input by the user triggering a hardware control configured on the AR device, such as a fingerprint recognition button configured on the AR device. The secondary recognition instruction can also be input by the user through an AR technology-related gesture, such as the user wearing an external device such as a ring or a wristband related to the AR device, and inputting the secondary recognition instruction through a preset gesture.

[0118] In addition, in the case where the user perceives that the voice recognition result is incorrect, that is, in the case where the payment amount displayed by the payment confirmation element is inaccurate, the user can also input a secondary recognition instruction to perform a code scanning payment of the AR device. Specifically, after the user inputs the secondary recognition instruction, the AR device calls an image collection component to obtain a payment code image displayed by the merchant device, performs voice recognition based on a decoding result, to perform secondary voice recognition and render and display the first confirmation element.

[0119] In a specific implementation process, to increase the AR interaction effect of the user, the voice data collected from the user and / or the merchant member outputting the payment amount is subjected to voice recognition to obtain the payment amount, a voice element corresponding to the payment amount is rendered and configured in the screen of the AR device at a position corresponding to the merchant member in the environmental image, so as to provide the user with an augmented reality effect through the transparent screen of the AR device, for example, the voice element is configured in the screen of the AR device, so that the voice element is visually configured at the mouth of the merchant member. In an optional implementation of the present embodiment, the rendering and display of the payment confirmation element according to the payment amount and the environmental image comprises: performing feature recognition on the merchant member image contained in the environmental image, determining a target image area according to the feature recognition result and determining an element display area according to the target image area; rendering a payment confirmation element containing an amount element and a voice element corresponding to the payment amount, configuring the voice element in the element display area and configuring the amount element in the center area for display processing.

[0120] Specifically, the facial feature recognition is performed on the merchant member image contained in the environmental image to obtain a feature recognition result of the mouth of the merchant member in the merchant member image, a target image area corresponding to the mouth of the merchant member is determined according to the feature recognition result, and the target image area is mapped to a screen position of the AR device to determine an element display area in the screen of the AR device. The payment confirmation element containing an amount element and a voice element corresponding to the payment amount is rendered, the voice element is configured in the element display area, that is, the area corresponding to the mouth of the merchant member in the environmental image, and the amount element is configured in the center area of the screen of the AR device, so as to perform the rendering and display processing of the payment confirmation element.

[0121] It should be noted that the rendering and display process of the payment confirmation element can also be used for the rendering and display processing of the first confirmation element. The rendering and display processing of the first confirmation element is taken as an example of the rendering and display processing of the payment confirmation element, and the present embodiment will not be described here.

[0122] In step S808, the payment information sent by the AR device is received, a payment request is generated according to the payment information, and the server is submitted to perform payment processing.

[0123] The embodiment makes the user pay in the AR scene while interacting with the AR device, the user terminal and the merchant device, replaces part of the function of the user terminal with the AR device to avoid frequent taking of the user terminal for payment interaction and / or AR interaction processing, determines the amount of money transferred to the merchant and / or paid through the voice recognition capability of the AR device, combines the AR scene with the payment scene, provides the user with the augmented reality capability through the AR device for payment processing, increases the payment function of the AR device, and enhances the perception capability of the user when using the AR device for payment.

[0124] In a specific implementation, the payment information including the payment amount and the merchant information sent by the AR device is received, and a payment request is generated according to the payment information and sent to the server, so that the server establishes a payment order according to the payment request and performs order payment processing. Specifically, the user terminal can also receive only the payment amount sent by the AR device, and generate a payment request based on the payment amount and the merchant information obtained by analyzing the settlement instruction, and send it to the server, that is, the AR device can send the payment amount to the user terminal to generate a payment request.

[0125] In actual application, after the payment processing is completed, a payment success message can also be generated and sent to the user terminal and / or the AR device, to generate a payment result element and / or a payment success window on the screen of the AR device for display, and after detecting that the display time is up, the payment result element and / or the payment success window are closed, for example, closed after 3 seconds of display. In an optional implementation of the embodiment, after the payment amount and the merchant information are transmitted to the user terminal according to the user payment instruction for payment processing, the payment success message sent by the server is received, and the payment success message is forwarded to the AR device, so that the AR device generates a payment result window including the payment success message and performs closing processing of the payment result window after detecting that the time is up.

[0126] In summary, the one or more payment processing methods based on the AR device provided by the embodiment are applied to the user terminal, in the payment process, the payment recommendation message sent by the server through the AR device is obtained, the payment recommendation message is transmitted to the AR device for message prompting in the AR device, the settlement instruction transmitted by the merchant device through the established communication connection is received and forwarded to the AR device, so that the AR device renders and displays the payment confirmation element based on the collected voice data and environmental image, receives the payment information sent by the AR device and generates a payment request according to the payment information and submits it to the server for payment processing, realizes the augmented reality processing in the payment process, and improves the perception degree of the user using the AR device for payment.

[0127] The AR device-based payment processing method provided in the embodiment is further described below by taking the application of the AR device-based payment processing method in an AR payment scenario as an example. Referring to FIG. 7, the AR device-based payment processing method applied in the AR payment scenario specifically includes the following steps.

[0128] In step S702, the payment recommendation message sent by the server is acquired.

[0129] In step S704, the payment recommendation message is transmitted to the AR device.

[0130] In step S708, the settlement instruction sent by the merchant device through the established communication connection is received, and the settlement instruction is forwarded to the AR device.

[0131] In step S720, the payment amount and the merchant information sent by the AR device are received, and a payment request is generated according to the payment amount and the merchant information and submitted to the server.

[0132] In step S722, the payment success message issued by the server is acquired, and the payment success message is forwarded to the AR device.

[0133] The AR device-based payment processing device provided in the disclosure is implemented as follows: in the above-mentioned embodiment, the AR device-based payment processing method is provided, and corresponding to the AR device-based payment processing method, an AR device-based payment processing device is also provided, which is described below in combination with the accompanying drawings.

[0134] Referring to FIG. 9, a schematic diagram of an embodiment of the AR device-based payment processing device provided in the embodiment is shown.

[0135] Since the device embodiment corresponds to the method embodiment, the description is relatively simple, and the related parts can be referred to the above-mentioned corresponding description of the method embodiment. The device embodiment described below is only schematic.

[0136] The embodiment provides a payment processing device based on an AR device, which runs on the AR device, and the device comprises: a message reminding module 902 configured to receive a payment recommendation message synchronized by a user terminal and perform message reminding; the payment recommendation message is generated after detecting that a user position is in a merchant range; a payment reminding element display module 904 configured to acquire a settlement instruction submitted by a merchant device, and generate and display a payment reminding element based on merchant information contained in the settlement instruction; the merchant device is configured in the merchant range and is adapted to the AR device; a payment confirmation element rendering module 906 configured to perform speech recognition on collected speech data, and perform rendering and display of a payment confirmation element according to a payment amount obtained through recognition and collected environment images; and a payment amount transmission module 908 configured to transmit the payment amount and the merchant information to the user terminal according to a user payment instruction, so as to perform payment processing.

[0137] The embodiment provides another payment processing device based on an AR device, which is implemented as follows: in the above-mentioned embodiment, another payment processing method based on an AR device is provided, and corresponding, another payment processing device based on an AR device is also provided, which is described below with reference to the accompanying drawings.

[0138] Referring to FIG. 10, a schematic diagram of an embodiment of a payment processing device based on an AR device is shown.

[0139] Since the device embodiment corresponds to the method embodiment, the description is relatively simple, and the related part can be referred to the above-mentioned corresponding description of the method embodiment. The device embodiment described below is only illustrative.

[0140] The embodiment provides a payment processing device based on an AR device, which runs on a user terminal, and the device comprises: a payment recommendation message acquisition module 1002 configured to acquire a payment recommendation message for payment through an AR device, which is generated after detecting that a user position is in a merchant range; a payment recommendation message transmission module 1004 configured to transmit the payment recommendation message to the AR device, so as to perform message reminding on the AR device; a settlement instruction forwarding module 1006 configured to receive a settlement instruction transmitted by a merchant device through an established communication connection and forward the settlement instruction to the AR device, so that the AR device renders and displays a payment confirmation element based on collected speech data and environment images; the merchant device is configured in the merchant range and is adapted to the AR device; and a payment request submission module 1008 configured to receive payment information sent by the AR device, generate a payment request according to the payment information, and submit the payment request to a server, so as to perform payment processing.

[0141] The AR device provided by the present disclosure implements, for example, the AR device-based payment processing method described above. Based on the same technical concept, one or more embodiments of the present disclosure also provide an AR device for executing the AR device-based payment processing method provided above. FIG. 11 is a structural schematic diagram of an AR device provided by one or more embodiments of the present disclosure.

[0142] The AR device provided by the present embodiment includes, as shown in FIG. 11, one or more processors 1101 and memories 1102, and the memories 1102 can store one or more storage applications or data. The memories 1102 can be temporary storage or persistent storage. The applications stored in the memories 1102 can include one or more modules (not shown in the figure), and each module can include a series of computer executable instructions in the AR device. Furthermore, the processor 1101 can be configured to communicate with the memories 1102 and execute the series of computer executable instructions in the memories 1102 on the server. The server can also include one or more power supplies 1103, one or more wired or wireless network interfaces 1104, one or more input / output interfaces 1105, one or more keyboards 1106, and the like.

[0143] In one specific embodiment, the AR device includes a memory and one or more programs, wherein one or more programs are stored in the memory, and the one or more programs can include one or more modules, and each module can include a series of computer executable instructions in the AR device, and the one or more processors configured to execute the one or more programs include computer executable instructions for: receiving a payment recommendation message synchronized by a user terminal and performing message prompting; the payment recommendation message is generated after detecting that the user position is within the range of a merchant; obtaining a settlement instruction submitted by a merchant device, and generating a payment prompting element and displaying based on the merchant information contained in the settlement instruction; the merchant device is configured in the merchant range and is adapted to the AR device; performing voice recognition on the collected voice data, and rendering and displaying a payment confirmation element according to the payment amount obtained by recognition and the collected environmental image; and transmitting the payment amount and the merchant information to the user terminal according to the user payment instruction to perform payment processing.

[0144] The user terminal provided by the embodiment of the present disclosure includes: corresponding to the another AR device-based payment processing method described above, based on the same technical concept, the one or more embodiments of the present disclosure further provide a user terminal for executing the another AR device-based payment processing method provided above, and FIG. 12 is a structural schematic diagram of a user terminal provided by the one or more embodiments of the present disclosure.

[0145] The user terminal provided by the embodiment of the present disclosure includes: corresponding to the another AR device-based payment processing method described above, based on the same technical concept, the one or more embodiments of the present disclosure further provide a user terminal for executing the another AR device-based payment processing method provided above, and FIG. 12 is a structural schematic diagram of a user terminal provided by the one or more embodiments of the present disclosure.

[0146] In one specific embodiment, the user terminal includes a memory and one or more programs, wherein one or more programs are stored in the memory, and the one or more programs can include one or more modules, and each module can include a series of computer executable instructions in the user terminal, and the one or more processors are configured to execute the one or more programs, and the one or more programs include computer executable instructions for: obtaining a payment recommendation message for payment through an AR device issued by a server; the payment recommendation message is generated after detecting that the user position is within the range of a merchant; transmitting the payment recommendation message to the AR device to prompt the AR device; receiving a settlement instruction transmitted by a merchant device through the established communication connection and forwarding to the AR device, so that the AR device renders and displays a payment confirmation element based on the collected voice data and environmental images; the merchant device is configured in the merchant range and is adapted to the AR device; receiving payment information sent by the AR device and generating a payment request according to the payment information and submitting to the server to process payment.

[0147] The computer readable storage medium provided by the present disclosure is implemented as follows: a payment processing method based on an AR device corresponding to the above description, and based on the same technical concept, one or more embodiments of the present disclosure also provide a computer readable storage medium.

[0148] The computer readable storage medium provided by the present embodiment is used to store computer executable instructions, and the computer executable instructions realize the following processes when executed: receiving a payment recommendation message synchronized by a user terminal and performing message prompting; the payment recommendation message is generated after detecting that the user position is within the range of a merchant; obtaining a settlement instruction submitted by a merchant device, and generating a payment prompting element and displaying based on the merchant information contained in the settlement instruction; the merchant device is configured within the merchant range and is adapted to the AR device; performing voice recognition on the collected voice data, and rendering and displaying a payment confirmation element according to the payment amount obtained by recognition and the collected environment image; transmitting the payment amount and the merchant information to the user terminal according to the user payment instruction to perform payment processing.

[0149] It should be noted that the embodiments of the computer readable storage medium in the present disclosure and the embodiments of the payment processing method based on the AR device in the present disclosure are based on the same inventive concept, so the specific implementation of this embodiment can refer to the implementation of the corresponding method described above, and the repeated parts will not be described again.

[0150] Another computer readable storage medium provided by the present disclosure is implemented as follows: another payment processing method based on an AR device corresponding to the above description, and based on the same technical concept, one or more embodiments of the present disclosure also provide another computer readable storage medium.

[0151] The computer readable storage medium provided by the present embodiment is used to store computer executable instructions, and the computer executable instructions realize the following processes when executed: obtaining a payment recommendation message for payment through an AR device issued by a server; the payment recommendation message is generated after detecting that the user position is within the range of a merchant; transmitting the payment recommendation message to the AR device to perform message prompting on the AR device; receiving a settlement instruction transmitted by a merchant device through an established communication connection and forwarding to the AR device, so that the AR device renders and displays a payment confirmation element based on collected voice data and environment image; the merchant device is configured within the merchant range and is adapted to the AR device; receiving payment information sent by the AR device and generating a payment request according to the payment information and submitting to the server to perform payment processing.

[0152] It should be noted that the embodiment of the present disclosure about another computer readable storage medium is based on the same inventive concept as the embodiment of the present disclosure about another AR device-based payment processing method, and therefore the specific implementation of this embodiment can refer to the implementation of the corresponding method as described above, and the repeated parts will not be described herein.

[0153] The various embodiments in the present disclosure are described in a progressive manner, and the same or similar parts between the various embodiments can be referred to each other. Each embodiment focuses on the difference from other embodiments, such as the device embodiment, the equipment embodiment and the storage medium embodiment, which are similar to the method embodiment, and therefore the description is relatively simple. The relevant content in the device embodiment, the equipment embodiment and the storage medium embodiment can be referred to the part of the method embodiment.

[0154] The above describes specific embodiments of the present disclosure. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in a different order and still achieve desirable results. Additionally, the processes depicted in the figures do not necessarily require the particular order shown or sequential order in order to achieve the desired results. In some implementations, multitasking and parallel processing can be advantageous or necessary.

[0155] In the 1930s, it was clear to distinguish whether an improvement in a technology was in hardware (e.g., improvement in circuit structure of diodes, transistors, switches, etc.) or in software (e.g., improvement in method flow). However, as technology has evolved, many improvements in method flow today can be considered as direct improvements in hardware circuit structure. Designers almost always obtain the corresponding hardware circuit structure by programming the improved method flow into the hardware circuit. Therefore, it cannot be said that an improvement in a method flow cannot be implemented by a hardware entity module. For example, a programmable logic device (PLD) (e.g., a field programmable gate array (FPGA)) is an integrated circuit whose logic function is determined by user programming of the device. A digital system is "integrated" on a PLD by the designer programming it, rather than by asking a chip manufacturer to design and fabricate a custom integrated circuit chip. Moreover, instead of manually fabricating an integrated circuit chip, this programming is now mostly implemented by "logic compiler" software, which is similar to software compilers used in program development, and the original code to be compiled is written in a specific programming language, called a hardware description language (HDL), of which there are many, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc., the most commonly used being VHDL (Very-High-Speed Integrated Circuit Hardware Description Language) and Verilog. It will be clear to those skilled in the art that, by simply logically programming a method flow in one of the above hardware description languages and programming it into an integrated circuit, a hardware circuit implementing the logical method flow can be easily obtained.

[0156] The controller can be implemented in any suitable manner, for example, the controller can take the form of a microprocessor or processor and a computer readable medium storing computer readable program code (e.g. software or firmware) executable by the (micro)processor, logic gates, switches, an Application Specific Integrated Circuit (ASIC), a programmable logic controller and an embedded microcontroller, examples of which include but are not limited to the following microcontrollers: ARC 626D, Atmel AT151SAM, Microchip PIC18F26K20 and Silicone Labs C8061F320, the memory controller can also be implemented as part of the control logic of the memory. It will also be appreciated by those skilled in the art that in addition to being implemented in purely computer readable program code the controller can equally well be implemented by logic programming the method steps in logic gates, switches, an ASIC, a programmable logic controller and an embedded microcontroller to achieve the same functionality. The controller can thus be considered as a hardware component and the means included therein for achieving the various functions can be considered as structures within the hardware component. Alternatively, or even, the means for achieving the various functions can be considered as both a software module implementing the method and as a structure within the hardware component.

[0157] The systems, apparatuses, modules or units illustrated by the above embodiments can be specifically implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer can be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0158] For the sake of brevity, the above apparatuses are described in functional form in various units. Of course, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0159] Those skilled in the art will appreciate that one or more embodiments of the disclosure can be provided as a method, a system or a computer program product. Accordingly, one or more embodiments of the disclosure can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the disclosure can take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROMs, optical storage devices, etc.) embodying computer readable program code.

[0160] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks.

[0161] These computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart block or blocks.

[0162] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks.

[0163] In one typical configuration, the computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0164] The memory can include non-persistent memory and / or volatile memory, such as random access memory (RAM) and / or cache memory, for storing, in general, data and / or program instructions. The memory can also include non-volatile memory, such as read-only memory (ROM), electrically programmable read-only memory (EPROM), electrically erasable read-only memory (EEPROM), flash memory, or non-volatile random access memory (NVRAM), for storing, in general, data and / or program instructions. The memory is an example of computer readable media.

[0165] Computer-readable media includes permanent and non-permanent, movable and non-movable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette, magnetic tape disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible to a computing device. According to the definition herein, computer-readable media does not include transitory media such as modulated data signals and carriers.

[0166] It should also be noted that the terms "comprising", "containing", or any other variant thereof are intended to cover non-exclusive inclusions, so that a process, method, article or apparatus that includes a list of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or apparatus. Without more limitations, the element defined by the statement "comprising a" does not exclude the presence of additional identical elements in the process, method, article or apparatus that includes the element.

[0167] One or more embodiments of the present disclosure can be described in the general context of computer-executable instructions being executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, and the like that perform particular tasks or implement particular abstract data types. One or more embodiments of the present disclosure can also be practiced in distributed computing environments where tasks are performed by remote processing devices that are connected through a communication network. In a distributed computing environment, program modules can be located in both local and remote computer storage media including storage devices.

[0168] The above only describes the embodiments of the present disclosure and is not intended to limit the present disclosure. The present disclosure can have various modifications and changes for those skilled in the art. Any modification, equivalent replacement, improvement, etc. within the spirit and principle of the present disclosure shall be included in the scope of claims of the present disclosure.

Claims

1. A payment processing method based on an AR device, applied to an AR device, the method comprising: Receive payment recommendation messages synchronized from user terminals and send message reminders; The payment recommendation message is generated after detecting that the user's location is within the merchant's area; Obtain the settlement instruction submitted by the merchant's device, and generate and display a payment reminder element based on the merchant information contained in the settlement instruction; The merchant's equipment is configured within the merchant's area and is adapted to the AR device; The system performs speech recognition on the collected voice data and renders and displays payment confirmation elements based on the recognized payment amount and the collected environmental images. The payment amount and merchant information are transmitted to the user terminal according to the user's payment instruction for payment processing.

2. The payment processing method based on an AR device according to claim 1, wherein rendering and displaying payment confirmation elements based on the identified payment amount and the collected environmental image includes: The merchant member images contained in the environmental image are subjected to feature recognition, and the target image region is determined based on the feature recognition results, and the element display area is determined based on the target image region; Render a payment confirmation element that corresponds to the payment amount, including an amount element and a voice element. Place the voice element in the element display area and the amount element in the center area for display processing.

3. The payment processing method based on an AR device according to claim 1, wherein the step of performing speech recognition on the collected voice data includes: The application's voice recognition component performs voice recognition based on the voice data, and determines the payment amount based on the voice recognition result. The speech recognition component uses the speech data as input data for the speech recognition interface of the application to make a recognition interface call, and obtains the speech recognition result returned by the interface call.

4. The payment processing method based on an AR device according to claim 3, after the steps of performing voice recognition on the collected voice data and rendering and displaying payment confirmation elements based on the recognized payment amount and the collected environmental image are executed, and before the steps of transmitting the payment amount and the merchant information to the user terminal according to the user's payment instruction to perform the payment processing step, further includes: If the user's input command for secondary recognition is detected, secondary speech recognition is performed; The payment confirmation element is rendered and displayed based on the payment amount obtained from secondary recognition and the environmental image collected in the second phase.

5. The payment processing method based on an AR device according to claim 1, after the step of transmitting the payment amount and the merchant information to the user terminal according to the user's payment instruction to perform payment processing, it further includes: Receive the payment success message sent by the user terminal and generate a payment result window containing the payment success message; The payment result window is displayed, and then closed after the display time expires.

6. The payment processing method based on an AR device according to claim 1, wherein the payment confirmation element is generated in the following manner: Based on the payment amount, the application's rendering interface is called to render the element corresponding to the payment amount, and the payment confirmation element is generated based on the element data returned by the interface call. or, Based on the payment amount, the application calls the rendering component of the user terminal to render elements, and generates the payment confirmation element according to the element data returned by the user terminal.

7. The payment processing method based on an AR device according to claim 1, wherein the payment recommendation message is generated in the following manner: Detect whether there is a binding relationship between the user and the AR device; if so, detect whether the user's location is within the merchant's area. If so, generate the payment recommendation message for payment via the AR device and send it to the AR device; in, The merchant range is determined based on the merchant address registered in the application.

8. The payment processing method based on an AR device according to claim 1, wherein generating and displaying a payment reminder element based on the merchant information included in the settlement instruction includes: The service component running the application obtains the merchant identification element and preset reminder element corresponding to the merchant information; Edge detection is performed on the environmental image, and the signage display area is determined based on the edge detection results. The merchant signage element is then placed in the signage display area, and the preset reminder element is placed in the central area for display.

9. The payment processing method based on an AR device according to claim 1, wherein the payment recommendation message is generated in the following manner: Receive a message sending request submitted by the merchant, and extract the device identifier and message content carried in the message sending request; The payment recommendation message is generated according to the message content, and the payment recommendation message is sent to the user bound to the device identifier through the application's message service; in, The message sending request calls the device detection component through the merchant's device to perform AR device detection, and submits it to the server based on the device detection results so that the message can be sent through the server.

10. The payment processing method based on an AR device according to claim 9, wherein the device identifier is obtained by the user registering the AR device in the application, and a binding relationship between the AR device and the user is established after registration; Accordingly, the AR device is registered in the following manner: Obtain the device registration request submitted by the user, and read the device identifier of the AR device connected to the user terminal based on the device registration request; The AR device and the user are bound together based on the device identifier, and the device identifier is written into the device registration form.

11. A payment processing method based on an AR device, applied to a user terminal, the method comprising: Retrieve payment recommendation messages from the server for payments made via AR devices; The payment recommendation message is generated after detecting that the user's location is within the merchant's area; The payment recommendation message is synchronized to the AR device to provide a message reminder on the AR device; The system receives settlement instructions transmitted by the merchant device through an established communication connection and forwards them to the AR device, enabling the AR device to render and display payment confirmation elements based on the collected voice data and environmental images; the merchant device is configured within the merchant's area and is adapted to the AR device. The system receives payment information sent by the AR device, generates a payment request based on the payment information, and submits it to the server for payment processing.

12. The payment processing method based on an AR device according to claim 11, wherein the step of rendering and displaying payment confirmation elements based on collected voice data and environmental images includes: The merchant member images contained in the environmental image are subjected to feature recognition, and the target image region is determined based on the feature recognition results, and the element display area is determined based on the target image region; Render a payment confirmation element that corresponds to the payment amount, including an amount element and a voice element. Place the voice element in the element display area and the amount element in the center area for display processing.

13. The payment processing method based on an AR device according to claim 11, wherein the payment information includes the payment amount obtained through voice recognition and the merchant information contained in the settlement instruction; Accordingly, the speech recognition process includes: The application's voice recognition component performs voice recognition based on the voice data, and determines the payment amount based on the voice recognition result. The speech recognition component uses the speech data as input data to the speech recognition interface of the application, calls the recognition interface, and obtains the speech recognition result output by the interface call.

14. The payment processing method based on an AR device according to claim 13, after the sub-step of performing voice recognition based on the voice data and determining the payment amount according to the voice recognition result by the voice recognition component of the application, the method further includes: If the user's input command for secondary recognition is detected, secondary speech recognition is performed; The payment confirmation element is rendered and displayed based on the payment amount obtained from secondary recognition and the environmental image collected in the second phase.

15. The payment processing method based on an AR device according to claim 11, after the step of receiving payment information sent by the AR device, generating a payment request based on the payment information, and submitting it to the server for payment processing, further includes: The system receives a payment success message from the server and forwards the message to the AR device, enabling the AR device to generate a payment result window containing the message and close the window after a timeout period.

16. The payment processing method based on an AR device according to claim 11, wherein the payment confirmation element is generated in the following manner: The application's rendering interface is called based on the payment amount to render the element corresponding to the payment amount, and the payment confirmation element is generated based on the element data returned by the interface call. or, Based on the payment amount, the application calls the rendering component of the user terminal to render elements, and generates the payment confirmation element according to the element data returned by the user terminal.

17. The payment processing method based on an AR device according to claim 11, wherein the payment recommendation message is generated in the following manner: Detect whether there is a binding relationship between the user and the AR device; if so, detect whether the user's location is within the merchant's area. If so, generate the payment recommendation message for payment via the AR device and send it to the AR device; in, The merchant range is determined based on the merchant address registered in the application.

18. The payment processing method based on an AR device according to claim 11, wherein the payment recommendation message is generated in the following manner: Receive the message sending request submitted by the merchant, and extract the device identifier and message content carried in the message sending request; The payment recommendation message is generated according to the message content, and the payment recommendation message is sent to the user bound to the device identifier through the merchant's message service in the application; in, The message sending request calls the device detection component through the merchant's device to perform AR device detection, and submits it to the server based on the device detection results so that the message can be sent through the server.

19. The payment processing method based on an AR device according to claim 18, wherein the device identifier is obtained by the user registering the AR device in the application, and a binding relationship between the AR device and the user is established after registration; Accordingly, the AR device is registered in the following manner: Obtain the device registration request submitted by the user, and read the device identifier of the AR device connected to the user terminal based on the device registration request; The AR device and the user are bound together based on the device identifier, and the device identifier is written into the device registration form.

20. A payment processing device based on an AR device, operating on an AR device, the device comprising: The message notification module is configured to receive payment recommendation messages synchronized from the user terminal and provide message notifications. The payment recommendation message is generated after detecting that the user's location is within the merchant's area; The payment reminder element display module is configured to obtain the settlement instruction submitted by the merchant device, generate and display the payment reminder element based on the merchant information contained in the settlement instruction; the merchant device is configured within the merchant range and adapted to the AR device; The payment confirmation element rendering module is configured to perform speech recognition on the collected voice data, and render and display the payment confirmation element based on the recognized payment amount and the collected environmental images. The payment amount transmission module is configured to transmit the payment amount and the merchant information to the user terminal according to the user's payment instruction, so as to perform payment processing.

21. A payment processing device based on an AR device, operating on a user terminal, the device comprising: The payment recommendation message acquisition module is configured to acquire payment recommendation messages sent by the server for payments made through AR devices; The payment recommendation message is generated after detecting that the user's location is within the merchant's area; The payment recommendation message transmission module is configured to transmit the payment recommendation message to the AR device to provide a message reminder on the AR device; The settlement instruction forwarding module is configured to receive settlement instructions transmitted by the merchant device through an established communication connection and forward them to the AR device, so that the AR device can render and display payment confirmation elements based on the collected voice data and environmental images; the merchant device is configured within the merchant's scope and is adapted to the AR device; The payment request submission module is configured to receive payment information sent by the AR device, generate a payment request based on the payment information, and submit it to the server for payment processing.

22. An AR device, comprising: processor; And a memory configured to store computer-executable instructions, which the processor executes to implement the following process: Receive payment recommendation messages synchronized from user terminals and send message reminders; the payment recommendation messages are generated after detecting that the user's location is within the merchant's range; Obtain the settlement instruction submitted by the merchant's device, and generate and display a payment reminder element based on the merchant information contained in the settlement instruction; The merchant's equipment is configured within the merchant's area and is adapted to the AR device; The system performs speech recognition on the collected voice data and renders and displays payment confirmation elements based on the recognized payment amount and the collected environmental images. The payment amount and merchant information are transmitted to the user terminal according to the user's payment instruction for payment processing.

23. A user terminal, comprising: processor; And a memory configured to store computer-executable instructions, which the processor executes to implement the following process: Obtain a payment recommendation message from the server for payment via AR device; the payment recommendation message is generated after detecting that the user's location is within the merchant's range; The payment recommendation message is transmitted to the AR device to provide a message reminder on the AR device; The system receives settlement instructions transmitted by the merchant device through an established communication connection and forwards them to the AR device, enabling the AR device to render and display payment confirmation elements based on the collected voice data and environmental images; the merchant device is configured within the merchant's area and is adapted to the AR device. The system receives payment information sent by the AR device, generates a payment request based on the payment information, and submits it to the server for payment processing.

24. A computer-readable storage medium for storing computer-executable instructions that, when executed, implement the steps of the method of claim 1.

25. A computer-readable storage medium for storing computer-executable instructions that, when executed, implement the steps of the method of claim 11.

Images