Payment processing method and apparatus based on ar device

Abstract

The embodiment of the present specification provides a payment processing method and device based on an AR device, wherein the payment processing method based on the AR device comprises the following steps: receiving a payment recommendation message synchronized by a user terminal and performing message reminding, obtaining a settlement instruction submitted by a merchant device, generating a payment reminding element based on merchant information contained in the settlement instruction and displaying the payment reminding element, performing voice recognition on collected voice data, performing rendering and display of a payment confirmation element according to a payment amount obtained through recognition and collected environment images, and transmitting the payment amount and the merchant information to the user terminal according to a user payment instruction to perform payment processing.

Description

TECHNICAL FIELD

[0001] The present document relates to the technical field of data processing, and in particular to a payment processing method and device based on an AR device. BACKGROUND

[0002] With the continuous development of Internet technology and the continuous improvement of user living standards, AR (Augmented Reality) technology has been widely used in users' daily life, and devices equipped with AR technology have also been used by more and more users. With the continuous development of AR technology and the continuous updating of hardware, more and more users have put forward more demands for devices equipped with AR technology, and more and more users hope that AR technology can be applied to more scenarios. How to better use AR technology has become the focus of attention of all parties. SUMMARY

[0003] One or more embodiments of the present specification provide a payment processing method based on an AR device, applied to an AR device, the method comprising: receiving a payment recommendation message synchronized by a user terminal and performing message prompting. The payment recommendation message is generated after detecting that the user position is within the range of a merchant. A settlement instruction submitted by a merchant device is obtained, and a payment prompting element is generated and displayed based on the merchant information contained in the settlement instruction. The merchant device is configured within the range of the merchant and is adapted to the AR device. Voice recognition is performed on the collected voice data, and the payment confirmation element is rendered and displayed according to the payment amount obtained by recognition and the collected environment image. The payment amount and the merchant information are transmitted to the user terminal according to the user payment instruction, so as to perform payment processing.

[0004] One or more embodiments of the present specification provide another payment processing method based on an AR device, applied to a user terminal, the method comprising: obtaining a payment recommendation message for payment through an AR device issued by a server. The payment recommendation message is generated after detecting that the user position is within the range of a merchant. The payment recommendation message is transmitted to the AR device to perform message prompting on the AR device. A settlement instruction transmitted by a merchant device through an established communication connection is received and forwarded to the AR device, so that the AR device renders and displays a payment confirmation element based on collected voice data and environment images. The merchant device is configured within the range of the merchant and is adapted to the AR device. Payment information sent by the AR device is received, and a payment request is generated according to the payment information and submitted to the server to perform payment processing.

[0005] One or more embodiments of the present specification provide an AR device-based payment processing apparatus running on an AR device, the apparatus comprising: a message reminding module configured to receive a payment recommendation message synchronized by a user terminal and perform message reminding. The payment recommendation message is generated after detecting that a user location is within a merchant range. A payment reminder element display module is configured to obtain a settlement instruction submitted by a merchant device, and generate and display a payment reminder element based on merchant information contained in the settlement instruction. The merchant device is configured within the merchant range and is adapted to the AR device. A payment confirmation element rendering module is configured to perform voice recognition on collected voice data, and perform rendering and display of a payment confirmation element based on a payment amount obtained by recognition and collected environmental images. A payment amount transmission module is configured to transmit the payment amount and the merchant information to the user terminal according to a user payment instruction, to perform payment processing.

[0006] One or more embodiments of the present specification provide another AR device-based payment processing apparatus running on a user terminal, the apparatus comprising: a payment recommendation message acquisition module configured to acquire a payment recommendation message for payment through an AR device issued by a server. The payment recommendation message is generated after detecting that a user location is within a merchant range. A payment recommendation message transmission module is configured to transmit the payment recommendation message to the AR device to perform message reminding on the AR device. A settlement instruction forwarding module is configured to receive a settlement instruction transmitted by a merchant device through an established communication connection and forward the settlement instruction to the AR device, so that the AR device renders and displays a payment confirmation element based on collected voice data and environmental images. The merchant device is configured within the merchant range and is adapted to the AR device. A payment request submission module is configured to receive payment information sent by the AR device, generate a payment request according to the payment information, and submit the payment request to the server to perform payment processing.

[0007] One or more embodiments of the present specification provide an AR device, comprising: a processor; and a memory configured to store computer executable instructions, the processor executing the computer executable instructions to implement the following processes: receiving a payment recommendation message synchronized by a user terminal and performing message reminding. The payment recommendation message is generated after detecting that a user location is within a merchant range. Obtaining a settlement instruction submitted by a merchant device, and generating and displaying a payment reminder element based on merchant information contained in the settlement instruction. The merchant device is configured within the merchant range and is adapted to the AR device. Performing voice recognition on collected voice data, and performing rendering and display of a payment confirmation element based on a payment amount obtained by recognition and collected environmental images. Transmitting the payment amount and the merchant information to the user terminal according to a user payment instruction, to perform payment processing.

[0008] One or more embodiments of the present specification provide a user terminal, comprising: a processor; and a memory configured to store computer executable instructions, the processor executes the computer executable instructions to implement the following processes: obtaining a payment recommendation message for payment through an AR device issued by a server. The payment recommendation message is generated after detecting that the user's location is within the range of a merchant. The payment recommendation message is transmitted to the AR device to prompt a message reminder on the AR device. Receiving a settlement instruction transmitted by a merchant device through an established communication connection and forwarding to the AR device to make the AR device render and display a payment confirmation element based on collected voice data and environmental images. The merchant device is configured within the merchant range and is adapted to the AR device. Receiving payment information sent by the AR device and generating a payment request according to the payment information and submitting to the server for payment processing.

[0009] One or more embodiments of the present specification provide a computer readable storage medium for storing computer executable instructions, which when executed implement the following processes: receiving a payment recommendation message synchronized by a user terminal and prompting a message reminder; the payment recommendation message is generated after detecting that the user's location is within the range of a merchant. Obtaining a settlement instruction submitted by a merchant device, and generating a payment reminder element and displaying based on the merchant information contained in the settlement instruction. The merchant device is configured within the merchant range and is adapted to the AR device. Voice recognition is performed on the collected voice data, and the payment confirmation element is rendered and displayed according to the payment amount obtained by recognition and the collected environmental images. Transmit the payment amount and the merchant information to the user terminal according to the user's payment instruction to perform payment processing.

[0010] One or more embodiments of the present specification provide another computer readable storage medium for storing computer executable instructions, which when executed implement the following processes: obtaining a payment recommendation message for payment through an AR device issued by a server. The payment recommendation message is generated after detecting that the user's location is within the range of a merchant. The payment recommendation message is transmitted to the AR device to prompt a message reminder on the AR device. Receiving a settlement instruction transmitted by a merchant device through an established communication connection and forwarding to the AR device to make the AR device render and display a payment confirmation element based on collected voice data and environmental images. The merchant device is configured within the merchant range and is adapted to the AR device. Receiving payment information sent by the AR device and generating a payment request according to the payment information and submitting to the server for payment processing. BRIEF DESCRIPTION OF DRAWINGS

[0011] In order to more clearly illustrate the technical solutions in the one or more embodiments of the present specification or the prior art, the drawings needed to be used in the embodiment or prior art description will be briefly introduced as follows. Obviously, the drawings in the following description are only some embodiments described in the present specification, and for those skilled in the art, other drawings can also be obtained from these drawings without creative labor.

[0012] Figure 1 An AR device-based payment processing method implementation environment schematic diagram is provided for one or more embodiments of the present specification;

[0013] Figure 2 An AR device-based payment processing method flowchart is provided for one or more embodiments of the present specification;

[0014] Figure 3 A payment recommendation message display schematic diagram is provided for one or more embodiments of the present specification;

[0015] Figure 4 A payment reminder element display schematic diagram is provided for one or more embodiments of the present specification;

[0016] Figure 5 A payment confirmation element display schematic diagram is provided for one or more embodiments of the present specification;

[0017] Figure 6 A payment result window display schematic diagram is provided for one or more embodiments of the present specification;

[0018] Figure 7 An AR device-based payment processing method processing timing diagram applied to an AR payment scenario is provided for one or more embodiments of the present specification;

[0019] Figure 8 Another AR device-based payment processing method processing flowchart is provided for one or more embodiments of the present specification;

[0020] Figure 9 An AR device-based payment processing device embodiment schematic diagram is provided for one or more embodiments of the present specification;

[0021] Figure 10 Another AR device-based payment processing device embodiment schematic diagram is provided for one or more embodiments of the present specification;

[0022] Figure 11 A structure schematic diagram of an AR device is provided for one or more embodiments of the present specification;

[0023] Figure 12A structural diagram of a user terminal is provided for one or more embodiments of the present specification. DETAILED DESCRIPTION

[0024] In order for those skilled in the art to better understand the technical solutions in one or more embodiments of the present specification, the technical solutions in one or more embodiments of the present specification will be clearly and completely described below with reference to the drawings in one or more embodiments of the present specification. Obviously, the described embodiments are only a part of the embodiments of the present specification, rather than all the embodiments. Based on one or more embodiments of the present specification, all other embodiments obtained by those skilled in the art without creative labor should belong to the protection scope of the present document.

[0025] The AR device-based payment processing method provided by one or more embodiments of the present embodiment can be applied to an implementation environment of making payment based on a group account. Referring to Figure 1 , the implementation environment at least includes an AR device 101, which can be an AR-enabled smart wearable device, such as AR glasses. The AR device 101 is used for message reminding of payment recommendation messages and identifying payment amounts, and cooperates with a user terminal 102 to perform payment processing.

[0026] The implementation environment also at least includes a user terminal 102, which can be a smart phone, a tablet computer, an e-book reader, a wearable device, and a device for information interaction based on other technologies. The user terminal 102 is used to transmit payment recommendation messages and settlement instructions to the AR device 101, and cooperates with the AR device 101 to perform payment processing.

[0027] The implementation environment can also include a server 103, which can be one or more servers, a server cluster composed of several servers, or a cloud server of a cloud computing platform. The server 103 is used to generate and send payment recommendation messages, and perform payment processing.

[0028] The implementation environment can include a merchant device 104, which can be a terminal device configured with a communication component. The merchant device 104 can be used to cooperate with the AR device 101 and the user terminal 102 to perform message transmission and payment processing.

[0029] In the implementation environment, the server 103 first sends a payment recommendation message to the user terminal 102 for payment through the AR device 101, the user terminal 102 forwards the payment recommendation message to the AR device 101 for message prompting through the AR device 101, the merchant device 104 sends a settlement instruction to the user terminal 102, the user terminal 102 forwards the settlement instruction to the AR device 101, the AR device 101 generates and displays a payment prompting element based on the settlement instruction, and performs voice collection and voice recognition, renders and displays a payment confirmation element according to the payment amount obtained by recognition and the environment image collected, to obtain a user payment instruction, and transmits the payment amount and merchant information contained in the settlement instruction to the user terminal 102 according to the user payment instruction, so that the user terminal 102 generates a payment request based on the payment amount and the merchant information and submits the payment request to the server 103 for payment processing, thereby realizing the payment mode of cooperation between the AR device and the merchant device for payment, and increasing the functions of the AR device and the merchant device.

[0030] One or more embodiments of the AR device-based payment processing method provided in the specification are as follows:

[0031] Referring to Figure 2 The AR device-based payment processing method provided in the embodiment is applied to an AR device and specifically includes steps S202 to S208.

[0032] Step S202, receiving a payment recommendation message synchronized by a user terminal and performing message prompting.

[0033] In actual application, a user can use a smart wearable device to replace part of the functions of the user terminal, so as to avoid frequent taking out and putting back the user terminal, for example, using the AR device to replace the screen of the user terminal to display messages and pages, etc. In view of this, the AR device and the user terminal are cooperated in the embodiment, the AR device is used to display messages and pages, etc., and the AR device is used to interact with the user to confirm payment to perform payment processing, thereby increasing the payment function of the AR device and improving the usability of AR payment.

[0034] In specific implementation, the server first sends a payment recommendation message to the user terminal, to remind the user that the merchant can use the AR device for payment, and the user terminal receives the payment recommendation message and transmits it to the AR device; the AR device receives the payment recommendation message and displays it.

[0035] In this embodiment, the payment recommendation message is used to remind the user that the merchant can use the AR device for payment processing. The payment recommendation message is generated and sent after detecting that the location information of the user is within the range of the merchant. Specifically, the payment recommendation message can be displayed in the AR device screen through a message pop-up window. Optionally, the payment recommendation message is generated after detecting that the user's location is within the range of the merchant. In this embodiment, the AR device is a device with AR function. Specifically, the AR device can be a wearable device configured with an image acquisition component, a processor, a microphone, and / or a screen. The AR device can also be configured with a communication component, which can be a local area network communication component, such as a Bluetooth component of a Bluetooth network. The AR device can connect with the user terminal through the Bluetooth component to connect to the Internet through the user terminal. The AR device can also establish a communication connection with the merchant device through the Bluetooth component. In addition, the communication component can also be an Internet communication component, such as an Internet network card. The AR device can connect to the Internet through the network card to interact with the server. The AR device can also be configured with a Bluetooth component and an Internet network card to simultaneously interact with the server, the user terminal, and the merchant device.

[0036] In the specific implementation process, the payment recommendation message can be generated and sent by the server. Specifically, the server can detect whether the user is within the range of the merchant through an electronic fence, a location fence, or the like. After detecting that the user bound to the AR device is within the range of the merchant, the server generates a payment recommendation message and sends it to the user. In an optional implementation provided in this embodiment, the payment recommendation message is generated in the following manner:

[0037] Detect whether the user has a binding relationship with the AR device. If yes, detect whether the location information is within the range of the merchant.

[0038] If no, no processing is required.

[0039] If yes, generate a payment recommendation message for payment through the AR device, and send it to the AR device.

[0040] Optionally, the range of the merchant is determined based on the merchant address registered by the merchant in the application program.

[0041] Specifically, the user position information can be determined by a position component configured by the AR device, or the terminal position information of a user terminal connected with the AR device can be used as the user position information. After detecting that the user position information is within the scope of the merchant, the server queries in the database whether the user has a binding relationship with the AR device. If yes, a payment recommendation message is generated and sent to the user terminal to be transmitted to the AR device through the user terminal, or the server can also send the payment recommendation message to the AR device. The merchant can submit the merchant address in the application program to determine the scope of the merchant. Specifically, the merchant can register based on the address of at least one store to determine the scope of the merchant according to the address of at least one store.

[0042] For example, after detecting that the user binding the AR device enters the scope of the merchant, the server generates a payment recommendation message and sends it to the user terminal to be transmitted to the AR device through the user terminal, so that the payment recommendation message 301 is displayed in the screen of the AR device as shown in Figure 3 .

[0043] It should be noted that in this embodiment, the AR device can be AR glasses with a transparent screen, that is, as shown in Figure 3 The payment recommendation message 301 and the state information and time information in the upper right corner are displayed in the screen of the AR device, and the rest of the images and / or pictures are real images and are not displayed in the screen of the AR device, but are displayed in the drawings due to the transparent screen. Accordingly, the AR device also collects and renders real images through the image collection component and displays them together with the payment recommendation message, state information, and / or time information in the screen. This embodiment does not limit this.

[0044] In addition, the merchant device can also detect whether the user position is within the scope of the merchant through the configured component, such as detecting the device type and device position of the connected device through the Bluetooth Beacon component. The merchant device can submit a message sending request to the server after detecting that the user position is within the scope of the merchant, so that the server sends a payment recommendation message to the AR device based on the message sending request, reducing the processing pressure of the server and increasing the function of the merchant device. In an optional implementation provided in this embodiment, the payment recommendation message is generated in the following way:

[0045] Receiving the message sending request submitted by the merchant, extracting the device identifier and message content carried in the message sending request;

[0046] Generating the payment recommendation message according to the message content, and sending the payment recommendation message to the user binding the device identifier through the message service of the application program.

[0047] Optionally, the message sending request is submitted to the server for AR device detection by the device detection component of the merchant device, and the server sends the message to the AR device.

[0048] Specifically, the AR device can establish a communication connection with the merchant device when entering the communication connection range of the merchant device, and the merchant device can detect whether the connected device is an AR device by calling the device detection component. If the connected device is an AR device, the device identification of the AR device is read and a message sending request is generated based on the device identification and the message content and submitted to the server. The server reads the device identification and the message content from the message sending request and generates a payment recommendation message, and sends the payment recommendation message of the merchant to the user terminal of the user bound to the device identification through the message service of the application program.

[0049] In actual application, in order to improve the pertinence of the payment recommendation message and avoid sending the payment recommendation message to the user who does not use the AR device, the user can pre-register the AR device and establish the binding relationship between the user and the AR device, so that the server can generate the payment recommendation message when the user bound to the AR device enters the range of the merchant and / or the merchant device detects that the communication connection is established with the registered AR device. In an optional embodiment provided in the embodiment, the method further comprises:

[0050] The user obtains the device identification after registering the AR device in the application program; and the user establishes the binding relationship between the AR device and the user after registering the AR device in the application program.

[0051] Correspondingly, the AR device is registered in the following way:

[0052] The device registration request submitted by the user is obtained, and the device identification of the AR device connected to the user terminal is read based on the device registration request;

[0053] The binding relationship between the AR device and the user is established based on the device identification, and the device identification is written into the device registration table.

[0054] Further, the server can detect whether the device identification of the AR device of the user is recorded in the device registration table before generating the payment recommendation message, so as to avoid that the AR device bound by the user is invalid, or the AR device connected by the merchant device does not support the AR payment function. Correspondingly, before the generation of the two payment recommendation messages provided above, the method further comprises: reading the device identification of the AR device and querying whether the device identification of the AR device exists in the device registration table; if not, no processing is performed; if yes, the execution processing of the payment recommendation message is performed.

[0055] It should be noted that the payment recommendation message can also be issued by the server to the AR device, so that the payment recommendation message is received by the pass-through component configured by the AR device and a message reminder is performed, that is, step S202 can be replaced by receiving the payment recommendation message issued by the server and performing a message reminder.

[0056] In step S204, the settlement instruction submitted by the merchant device is acquired, and a payment reminder element is generated and displayed based on the merchant information contained in the settlement instruction.

[0057] In this embodiment, the merchant device is a device configured with a communication component, which is configured in the store of the merchant, that is, in the range of the merchant. Specifically, the merchant device can be configured with a Bluetooth component and a Bluetooth Beacon function, and the merchant device can interact with the user terminal and / or the AR device through the function of the communication component to complete the AR payment. The merchant device can also be configured with a communication component connected to the Internet, that is, an Internet card, and the merchant device can interact with the server through the Internet to process the payment recommendation message. In addition, the merchant device can also be connected with the cash register terminal of the merchant to acquire the settlement instruction transmitted by the cash register terminal and sent to the user terminal and / or the AR device. In addition, the merchant device can also be adapted to other devices such as the user terminal and the wearable device through the communication component. Optionally, the merchant device is configured in the range of the merchant and is adapted to the AR device.

[0058] In specific implementation, the merchant device receives the settlement instruction sent by the merchant and / or the cash register terminal, and sends the settlement instruction to the AR device and / or the user terminal, so that the AR device generates and displays the payment reminder element after receiving the settlement instruction. After receiving the settlement instruction submitted by the merchant device, the AR device generates and displays the payment reminder element based on the merchant information contained in the settlement instruction. Specifically, the AR device can generate and display the payment reminder element after detecting the settlement instruction submitted by the merchant device and containing the merchant information.

[0059] In the specific execution process, the AR device can pre-store the payment reminder element, and after detecting the settlement instruction containing the merchant information, call the service component of the application program to acquire the payment reminder element and render and display the payment reminder element according to the element data. Further, to improve the user's perception of payment, the merchant identifier element of the merchant can be displayed on the screen of the AR device to block the merchant device in the real image, that is, the merchant identifier element is configured in the screen of the AR device corresponding to the position of the merchant device in the real image, so as to display the preset reminder element in the central area of the screen and display the merchant identifier element at the position of the merchant device. The merchant identifier element and the preset reminder element are called payment reminder elements. In an optional embodiment provided in this embodiment, the payment reminder element is generated and displayed based on the merchant information contained in the settlement instruction, which includes:

[0060] The service component running the application program acquires the merchant identification element corresponding to the merchant information and the preset reminding element;

[0061] Edge detection is performed on the environment image, an identification display area is determined according to the edge detection result, the merchant identification element is configured in the identification display area, and the preset reminding element is configured in the center area for display.

[0062] Specifically, the service component running the application program queries the merchant identification element corresponding to the merchant information and the preset reminding element in the database of the application program, performs edge detection on the environment image collected by the image collection component of the AR device, determines the area where the merchant device is located according to the edge detection result, and determines the identification display area of the merchant device on the screen of the AR device according to the area of the merchant device in the environment image, so as to display the merchant identification element in the identification display area and display the preset reminding element in the center area of the AR device, thereby performing display processing of the payment reminding element containing the merchant identification element and the preset reminding element.

[0063] As shown in Figure 4 According to the area of the merchant device in the environment image, the identification display area of the merchant identification element 402 in the screen of the AR device is determined and displayed, and the preset reminding element 401 is displayed in the center area of the screen of the AR device. Among them, Figure 4 The frame of the preset reminding element 401 in the above embodiment is only used to represent the area where the preset reminding element 401 is located, and is not displayed in the screen, and as described above, the preset reminding element 401 and the merchant identification element 402 can be displayed in the transparent screen of the AR device.

[0064] It should be noted that the payment reminding element can also be generated and displayed after the settlement instruction submitted by the merchant device is acquired, so as to cooperate with the server to perform payment processing based on the merchant information contained in the settlement instruction through the user terminal, that is, step S204 can be replaced by: after detecting the payment instruction submitted by the merchant device, generating and displaying the payment reminding element.

[0065] In step S206, the collected voice data is subjected to voice recognition, and the payment confirmation element is rendered and displayed according to the payment amount obtained by recognition and the collected environment image.

[0066] The embodiment enables the user to perform payment in the AR scene while avoiding frequent taking of the user terminal for payment interaction and / or AR interaction processing by replacing part of the function of the user terminal with the AR device, and determining the amount of money to be transferred to the merchant and / or paid by the voice recognition capability of the AR device.

[0067] In implementation, the AR device calls the voice collection component to collect voice data in the real environment, and calls the image collection component to collect environment images in the real environment, performs voice recognition on the voice data to obtain a payment amount, and performs rendering and display processing on the payment confirmation element according to the payment amount and the environment images. Specifically, the voice data can be subjected to voice recognition, and an amount keyword contained in the voice recognition result can be selected as the payment amount, an amount element corresponding to the payment amount can be generated, and the amount element can be configured in a screen area of the AR device corresponding to the image position of the merchant member image based on the image position of the merchant member image in the environment images.

[0068] In the embodiment, the payment confirmation element is generated according to the payment amount contained in the voice recognition result, so that the user confirms the payment amount through the payment confirmation element, and inputs a user confirmation instruction after confirmation. Specifically, the payment confirmation element can be generated through the rendering of the AR device, or can be generated through the rendering interface of the user terminal and / or the application program. In an optional implementation provided by the embodiment, the payment confirmation element is generated in the following manner:

[0069] The rendering interface of the application program is called based on the payment amount to perform element rendering, and the payment confirmation element is generated according to element data returned by the interface call;

[0070] Alternatively,

[0071] The rendering component of the user terminal is called based on the payment amount through the application program to perform element rendering, and the payment confirmation element is generated according to element data returned by the user terminal.

[0072] In the specific voice recognition process, the voice recognition efficiency can be improved by configuring a voice recognition component of the application program in the AR device to perform voice recognition through the AR device, or the voice recognition interface of the application program can be called to perform voice recognition, and the voice recognition result returned by the interface call can be obtained. Specifically, the payment amount can be obtained through the AR device, can be transmitted to the AR device after being recognized by the user terminal, can be obtained after the AR device calls the voice recognition interface of the application program, or can be transmitted to the AR device after the user terminal calls the voice recognition interface of the application program. In an optional implementation provided by the embodiment, the voice recognition includes:

[0073] The voice recognition component of the application program is run based on the voice data to perform voice recognition, and the payment amount is determined according to the voice recognition result.

[0074] Optionally, the voice recognition component calls the voice recognition interface of the application program with the voice data as input data, and obtains the voice recognition result returned by the interface call.

[0075] Specifically, after the AR device collects the voice data, the voice recognition component of the application program installed in the AR device is run, the voice recognition interface of the application program is called by the voice recognition component with the voice data as input data, the voice recognition result returned by the interface call is obtained, and the payment amount is obtained by screening through the voice recognition component.

[0076] In actual application, there are cases where the voice recognition of the AR device is inaccurate. In response to this, a control for re-performing voice recognition can be provided to the user, so that the user triggers the control to perform secondary voice recognition in the case of inaccurate voice recognition, and renders and displays the payment confirmation element according to the recognition result of the secondary recognition and the re-collected environmental image. In an optional implementation provided in the embodiment, after the payment confirmation element is rendered and displayed according to the payment amount obtained by recognition and the collected environmental image, the following steps are further included:

[0077] If the secondary recognition instruction input by the user is detected, secondary voice recognition is performed.

[0078] The first payment amount obtained by the secondary recognition and the first environmental image collected are used to render and display the first confirmation element.

[0079] Specifically, the secondary recognition instruction can be input by the user triggering the hardware control configured in the AR device, such as the fingerprint recognition button configured in the AR device. The secondary recognition instruction can also be input by the user through gestures related to AR technology, such as the user wearing peripheral devices related to the AR device, such as a ring, a wristband, etc., and inputting the secondary recognition instruction through a preset gesture.

[0080] In addition, in the case where the user perceives that the voice recognition result is incorrect, that is, in the case where the payment amount displayed by the payment confirmation element is inaccurate, the user can also input the secondary recognition instruction to perform the code scanning payment of the AR device. Specifically, after the user inputs the secondary recognition instruction, the AR device calls the image collection component to obtain the payment code image displayed by the merchant device, performs voice recognition based on the decoding result, to perform secondary voice recognition and rendering and display of the first confirmation element.

[0081] In a specific implementation process, to increase the AR interaction effect of the user, the voice data collected from the user and / or the merchant member and containing the payment amount is subjected to voice recognition to obtain the payment amount, a voice element corresponding to the payment amount is rendered and configured in the screen of the AR device at a position corresponding to the merchant member in the environmental image, so as to provide the user with an augmented reality effect through the transparent screen of the AR device, for example, the voice element is configured in the screen of the AR device, so that the voice element is visually configured at the mouth of the merchant member. In an optional implementation of the present embodiment, the rendering and display of the payment confirmation element according to the payment amount and the environmental image include:

[0082] performing feature recognition on the merchant member image contained in the environmental image, determining a target image area according to the feature recognition result, and determining an element display area according to the target image area;

[0083] rendering a payment confirmation element containing an amount element and a voice element corresponding to the payment amount, configuring the voice element in the element display area and configuring the amount element in the center area for display processing.

[0084] Specifically, facial feature recognition is performed on the merchant member image contained in the environmental image, a feature recognition result of the mouth of the merchant member in the merchant member image is obtained, a target image area corresponding to the mouth of the merchant member is determined according to the feature recognition result, and the target image area is mapped to a screen position of the AR device to determine an element display area in the screen of the AR device. A payment confirmation element containing an amount element and a voice element corresponding to the payment amount is rendered, the voice element is configured in the element display area, that is, the area corresponding to the mouth of the merchant member in the environmental image, and the amount element is configured in the center area of the screen of the AR device, so as to perform rendering and display processing of the payment confirmation element.

[0085] As shown in Figure 5 , the amount element 501 and the voice element 502 corresponding to the payment amount are rendered, the voice element 502 is configured in the screen area corresponding to the mouth of the merchant member, and the amount element 501 is configured in the center area of the screen of the AR device, so that the user perceives the combination of the payment scene and the AR scene. As described above, the frame of the voice element 502 is only used for illustration, and the background area outside the amount element 501 and the voice element 502 can be a real environment or an image rendered in the screen of the AR device.

[0086] It should be noted that the rendering and display process of the payment confirmation element can also be used for the rendering and display processing of the first confirmation element. The rendering and display processing of the first confirmation element is taken as an example of the rendering and display processing of the payment confirmation element, and the present embodiment will not be described here.

[0087] Step S208, transmitting the payment amount and the merchant information to the user terminal according to the user payment instruction to perform payment processing.

[0088] The embodiment combines the AR scene with the payment scene, provides the user with the ability of augmented reality through the AR device to perform payment processing, increases the payment function of the AR device, and enhances the perception ability of the user when using the AR device to perform payment.

[0089] In specific implementation, the user inputs the user payment instruction to the AR device, and transmits the payment amount obtained through voice recognition and the merchant information contained in the settlement instruction to the user terminal; after receiving the payment amount and the settlement instruction, the user terminal generates a payment request according to the payment amount and the merchant information and sends the payment request to the server, so that the server transfers the corresponding fund from the fund account of the user to the merchant account of the merchant based on the fund account of the user. Specifically, the user payment instruction can be input through the software and / or hardware control configured by the user to trigger the AR device, or can be input through a gesture. The specific input mode can refer to the input mode of the secondary recognition instruction described above, and the embodiment will not be described here.

[0090] In actual application, after the payment processing is completed, a payment success message can also be generated and sent to the user terminal and / or the AR device, so as to generate a payment result element and / or a payment success window on the screen of the AR device according to the payment success message, and after detecting that the display time is up, the payment result element and / or the payment success window are closed, for example, the payment result element and / or the payment success window are closed after being displayed for 3 seconds. In an optional implementation of the embodiment, after transmitting the payment amount and the merchant information to the user terminal according to the user payment instruction to perform payment processing, the method further includes:

[0091] receiving the payment success message sent by the user terminal, and generating a payment result window containing the payment success message;

[0092] displaying the payment result window, and closing the payment result window after detecting that the display time is up.

[0093] As shown in Figure 6 the server sends a payment success message to the user terminal through an application after the payment processing is completed, the user terminal transmits the payment success message to the AR device, the AR device generates a payment result window 601 containing the payment success message according to the payment success message, and displays the payment result window 601 at the center of the screen of the AR device, and closes the payment result window 601 after detecting that the display time is up; that is, the payment result window 601 is closed after being displayed for 3 seconds.

[0094] To sum up, the embodiment provides one or more payment processing methods based on an AR device, which is applied to the AR device. In the payment process, a payment recommendation message synchronized by a user terminal is received and a message reminder is performed. A settlement instruction submitted by a merchant device is obtained, and a payment reminder element is generated and displayed based on merchant information contained in the settlement instruction. Speech recognition is performed on collected speech data, and payment confirmation element rendering and display are performed according to a payment amount obtained through recognition and an environment image collected. The payment amount and merchant information are transmitted to the user terminal according to a user payment instruction, so that payment processing is performed. The payment scene is combined with the AR scene, and the augmented reality processing in the payment process is realized, and the perception degree of the user in using the AR device for payment is improved.

[0095] The implementation process of the payment processing method based on the AR device provided above can be performed by the AR device. The implementation process of another payment processing method based on the AR device provided in the following method embodiment can be performed by the user terminal. The two can cooperate with each other in the implementation process. Therefore, the corresponding content of the another payment processing method based on the user terminal provided in the following method embodiment can be referred to by reading the implementation process described above. Correspondingly, the corresponding content of the method embodiment described above can also be referred to by reading the another payment processing method based on the user terminal provided in the following method embodiment.

[0096] The payment processing method based on the AR device provided in the embodiment is further described below by taking the application of the payment processing method based on the AR device in an AR payment scene as an example. Referring to Figure 7 , the payment processing method based on the AR device applied to the AR payment scene specifically includes the following steps.

[0097] In step S706, a payment recommendation message synchronized by a user terminal is received and a message reminder is performed.

[0098] In step S710, a settlement instruction forwarded by a user terminal is received, and a service component of an application program is run to obtain a merchant identification element corresponding to merchant information contained in the settlement instruction and a preset reminder element.

[0099] In step S712, edge detection is performed on a collected environment image, a display area of a merchant identification is determined according to an edge detection result, the merchant identification element is configured in the display area of the merchant identification, and the preset reminder element is configured in a central area to perform payment reminder element display.

[0100] In step S714, speech recognition is performed on collected speech data to obtain a payment amount, feature recognition is performed on a merchant member image contained in the environment image, a target image area is determined according to a feature recognition result, and an element display area is determined according to the target image area.

[0101] In step S716, the payment confirmation element corresponding to the payment amount is rendered, and the payment confirmation element including the amount element and the voice element is displayed in the element display area and the central area.

[0102] In step S724, the payment success message sent by the user terminal is received, and a payment result window including the payment success message is generated.

[0103] In step S726, the payment result window is displayed, and the payment window is closed after the display time is detected to be expired.

[0104] The above steps S706, S710 to S716, and S724 to S726 provided by the embodiment are executed by the AR device. It should be noted that the above steps S706, S710 to S716, and S724 to S726 executed by the AR device can be mutually matched with the steps S702 to S706 and S720 to S722 executed by the user terminal in the following embodiment in the execution process. Therefore, when reading the embodiment, the corresponding content of the steps S702 to S706 and S720 to S722 provided by the method embodiment described below is referred to, and the corresponding content of the steps S706, S710 to S716, and S724 to S726 provided by the embodiment described below is referred to.

[0105] One or more embodiments of another AR device-based payment processing method provided by the specification are as follows:

[0106] Referring to Figure 8 The AR device-based payment processing method provided by the embodiment is applied to a user terminal, and specifically includes steps S802 to S808.

[0107] In step S802, a payment recommendation message for payment through an AR device is acquired from a server.

[0108] In actual application, the user can use the smart wearable device to replace part of the function of the user terminal, so as to avoid frequent taking out and putting back the user terminal. For example, the AR device is used to replace the screen of the user terminal to display messages and pages. In view of this, the embodiment displays messages and pages through the AR device in cooperation with the user terminal, and performs payment confirmation through the AR device and the user to perform payment processing, thereby increasing the payment function of the AR device and improving the usability of AR payment.

[0109] In specific implementation, the server first sends a payment recommendation message to the user terminal to remind the user that the AR device can be used for payment in the merchant; and the user terminal acquires the payment recommendation message.

[0110] In this embodiment, the server can be a server to which the application program belongs, specifically, the server of the application program can be deployed in the server to provide services to the device of the client to which the application program is deployed, such as generation and delivery of a payment recommendation message, rendering and delivery of a payment confirmation element, and / or rendering and delivery of a payment reminder element.

[0111] In this embodiment, the payment recommendation message is used to remind the user that the merchant can use the AR device for payment processing, and the payment recommendation message is generated and delivered after detecting that the location information of the user is within the range of the merchant. Specifically, the payment recommendation message can be displayed in the AR device screen through a message pop-up window. Optionally, the payment recommendation message is generated after detecting that the user's location is within the range of the merchant. In this embodiment, the AR device is a device with AR function, specifically, the AR device can be a wearable device configured with an image acquisition component, a processor, a microphone, and / or a screen. The AR device can also be configured with a communication component, which can be a communication component of a local area network, such as a Bluetooth component of a Bluetooth network. The AR device can connect with the user terminal through the Bluetooth component to connect to the Internet through the user terminal. The AR device can also establish a communication connection with the merchant device through the Bluetooth component. In addition, the communication component can also be a communication component of the Internet, such as an Internet network card. The AR device can connect to the Internet through the network card to interact with the server. The AR device can also be configured with a Bluetooth component and an Internet network card to simultaneously interact with the server, the user terminal, and the merchant device.

[0112] In the specific execution process, the payment recommendation message can be generated and delivered by the server. Specifically, the server can detect whether the user is within the range of the merchant through electronic fences, location fences, etc. After detecting that the user bound to the AR device is within the range of the merchant, the payment recommendation message is generated and delivered to the user. In an optional embodiment provided in this embodiment, the payment recommendation message is generated in the following way:

[0113] Detect whether the user has a binding relationship with the AR device. If yes, detect whether the location information is within the range of the merchant.

[0114] If no, no processing is required.

[0115] If yes, generate a payment recommendation message for payment through the AR device, and send it to the AR device.

[0116] Optionally, the range of the merchant is determined based on the merchant address registered by the merchant in the application program.

[0117] Specifically, the user position information can be determined by a position component configured by the AR device, or the terminal position information of a user terminal connected with the AR device can be used as the user position information. After detecting that the user position information is within the scope of the merchant, the server queries whether the user has a binding relationship with the AR device in the database. If yes, a payment recommendation message is generated and sent to the user terminal to be transmitted to the AR device through the user terminal, or the server can also send the payment recommendation message to the AR device. The merchant can submit the merchant address in the application program to determine the scope of the merchant. Specifically, the merchant can register based on the address of at least one store to determine the scope of the merchant according to the address of at least one store.

[0118] In addition, the merchant device can also detect whether the user position is within the scope of the merchant through the configured component, such as detecting the device type and device position of the connected device through the Bluetooth Beacon component. The merchant device can submit a message sending request to the server after detecting that the user position is within the scope of the merchant, so that the server sends a payment recommendation message to the AR device based on the message sending request, which reduces the processing pressure of the server and increases the function of the merchant device. In an optional implementation provided in the embodiment, the payment recommendation message is generated in the following way:

[0119] Receiving the message sending request submitted by the merchant, extracting the device identifier and message content carried in the message sending request;

[0120] Generating the payment recommendation message according to the message content, and sending the payment recommendation message to the user bound with the device identifier through the message service of the application program.

[0121] Optionally, the message sending request is submitted to the server through the merchant device calling the device detection component to detect the AR device, and the server sends the message.

[0122] Specifically, the AR device can establish a communication connection with the merchant device after entering the scope of the merchant and / or the communication connection range of the merchant device. The merchant device calls the device detection component to detect the AR device to detect whether the connected device is an AR device. In the case where the connected device type is an AR device, the device identifier of the AR device is read and a message sending request is generated based on the device identifier and the message content and submitted to the server. The server extracts the device identifier and the message content carried in the message sending request and generates a payment recommendation message. The payment recommendation message of the merchant is sent to the user terminal of the user bound with the device identifier through the message service of the application program.

[0123] In actual application, in order to improve the pertinence of the payment recommendation message and avoid sending the payment recommendation message to the user who does not use the AR device, the user can pre-register the device and establish the binding relationship between the user and the AR device, so that the server detects the user who binds the AR device entering the scope of the merchant and / or the merchant device detects the communication connection established with the registered AR device, and then the payment recommendation message is generated. In an optional embodiment provided by the embodiment, the method further comprises the following steps:

[0124] The user obtains the device identifier after registering the AR device in the application program; and the user establishes the binding relationship between the AR device and the user after registering the AR device in the application program.

[0125] Correspondingly, the AR device is registered in the following manner:

[0126] The device registration request submitted by the user is obtained, and the device identifier of the AR device connected to the user terminal is read based on the device registration request;

[0127] The binding relationship between the AR device and the user is established based on the device identifier, and the device identifier is written into the device registration table.

[0128] Further, the server can also detect whether the device identifier of the AR device of the user is recorded in the device registration table before generating the payment recommendation message, so as to avoid that the AR device bound by the user is invalid, or the AR device connected by the merchant device does not support the AR payment function. Correspondingly, before the generation of the two payment recommendation messages provided above, the method further comprises the following steps: reading the device identifier of the AR device and querying whether the device identifier of the AR device exists in the device registration table; if not, no processing is performed; if yes, the execution processing of the payment recommendation message is performed.

[0129] It should be noted that the payment recommendation message can also be issued by the server to the AR device, so that the payment recommendation message is received by the pass-through component configured by the AR device and the message is reminded. That is, step S202 can be replaced by receiving the payment recommendation message issued by the server and reminding the message.

[0130] Step S804: transmitting the payment recommendation message to the AR device, so that the AR device reminds the message.

[0131] In specific implementation, the user terminal transmits the payment recommendation message to the AR device; and the AR device reminds the message on the screen of the AR device after receiving the payment recommendation message.

[0132] Step S806: receiving the settlement instruction transmitted by the merchant device through the established communication connection and forwarding the settlement instruction to the AR device, so that the AR device renders and displays the payment confirmation element based on the collected voice data and environmental image.

[0133] In this embodiment, the merchant device is a device configured with a communication component, which is configured in the store of the merchant, that is, in the range of the merchant. Specifically, the merchant device can be configured with a Bluetooth component and a Bluetooth Beacon function. The merchant device can interact with the user terminal and / or the AR device through the function of the communication component to complete the AR payment. The merchant device can also be configured with a communication component connected to the Internet, that is, an Internet card. The merchant device can interact with the server through the Internet to process the payment recommendation message. In addition, the merchant device can also be connected with the cash register terminal of the merchant to obtain the settlement instruction transmitted by the cash register terminal of the merchant and send it to the user terminal and / or the AR device. In addition, the merchant device can also be adapted to other devices such as the user terminal and the wearable device through the communication component. Optionally, the merchant device is configured in the range of the merchant and is adapted to the AR device.

[0134] In specific implementation, the user terminal establishes a communication connection with the merchant device based on the communication connection request broadcasted by the merchant device, receives the settlement instruction transmitted by the merchant device through the communication connection, and forwards the settlement instruction to the AR device. After receiving the settlement instruction, the AR device generates a payment reminder element based on the merchant information contained in the settlement instruction and displays it on the screen. After receiving the user confirmation instruction, the AR device sends the payment information to the user terminal. Specifically, the user terminal can analyze the settlement instruction to obtain the merchant information contained in the settlement instruction, and then forward the settlement instruction to the AR device, so that the AR device performs voice recognition based on the settlement instruction.

[0135] In the specific execution process, the AR device can pre-store the payment reminder element and, after detecting the settlement instruction containing the merchant information, call the service component of the application program to obtain the payment reminder element and render and display the payment reminder element according to the element data. Further, to improve the user's perception of payment, the merchant's merchant identification element can be displayed on the screen of the AR device to block the merchant device in the real image, that is, the merchant identification element is configured in the screen of the AR device corresponding to the position of the merchant device in the real image, so as to display the preset reminder element in the central area of the screen and display the merchant identification element at the position of the merchant device. The merchant identification element and the preset reminder element are called payment reminder elements. In an optional embodiment provided in this embodiment, the payment reminder element is generated based on the merchant information contained in the settlement instruction and displayed, which includes:

[0136] The service component of the running application program obtains the merchant identification element corresponding to the merchant information and the preset reminder element.

[0137] The edge of the environment image is detected, and a display area of the merchant logo is determined according to the edge detection result. The merchant logo element is configured in the display area of the merchant logo, and the preset reminder element is configured in the central area for display.

[0138] Specifically, the service component running the application program queries the merchant logo element corresponding to the merchant information and the preset reminder element in the database of the application program, performs edge detection on the environment image collected by the image collection component of the AR device, determines the area where the merchant device is located according to the edge detection result, and determines the display area of the merchant logo element corresponding to the screen of the AR device according to the area of the merchant device in the environment image, so as to display the merchant logo element in the display area of the merchant logo and display the preset reminder element in the central area of the AR device, thereby realizing the display of the payment reminder element containing the merchant logo element and the preset reminder element.

[0139] In this embodiment, the payment confirmation element is generated according to the payment amount contained in the voice recognition result, so as to enable the user to confirm the payment amount through the payment confirmation element and input a user confirmation instruction after confirmation. In the specific rendering process of the payment confirmation element, the AR device calls the voice collection component to collect voice data in the real environment, and calls the image collection component to collect an environment image in the real environment, performs voice recognition on the voice data to obtain the payment amount, and performs rendering and display processing of the payment confirmation element according to the payment amount and the environment image. In an optional implementation provided in this embodiment, the payment confirmation element is generated in the following manner:

[0140] The rendering interface of the application program is called based on the payment amount to perform element rendering, and the payment confirmation element is generated according to the element data returned by the interface call;

[0141] Alternatively,

[0142] The rendering component of the user terminal is called by the application program based on the payment amount to perform element rendering, and the payment confirmation element is generated according to the element data returned by the user terminal.

[0143] In the specific voice recognition process, the voice recognition component of the application program can be configured in the AR device to perform voice recognition processing through the AR device, or the voice recognition interface of the application program can be called to perform voice recognition, and the voice recognition result returned by the interface call can be obtained. Specifically, the payment amount can be obtained by recognizing through the AR device, can be transmitted to the AR device after being recognized through the user terminal, can be obtained by calling the voice recognition interface of the application program by the AR device, or can be transmitted to the AR device after the payment amount returned by the interface call is called by the voice recognition interface of the application program by the user terminal. In an optional implementation provided in this embodiment, the voice recognition process comprises:

[0144] running a voice recognition component of the application program based on the voice data to perform voice recognition, and determining the payment amount according to a voice recognition result.

[0145] Optionally, the voice recognition component calls an interface of the voice recognition of the application program with the voice data as input data, and obtains the voice recognition result returned by the interface.

[0146] Specifically, after the AR device collects the voice data, the voice recognition component of the application program installed in the AR device is run, the voice recognition component calls the interface of the voice recognition of the application program with the voice data as input data, obtains the voice recognition result returned by the interface, and filters the voice recognition result through the voice recognition component to obtain the payment amount.

[0147] In actual application, the voice recognition of the AR device may not be accurate. In this case, a control for re-performing voice recognition can be provided to the user, so that the user can trigger the control to perform secondary voice recognition in the case of inaccurate voice recognition, and render and display the payment confirmation element according to the recognition result of the secondary recognition and the re-collected environmental image. In an optional embodiment provided in the embodiment, after the payment amount obtained by recognition and the environmental image collected are used to render and display the payment confirmation element, the method further includes:

[0148] If the secondary recognition instruction input by the user is detected, secondary voice recognition is performed.

[0149] The first payment amount obtained by the secondary recognition and the first environmental image collected are used to render and display the first confirmation element.

[0150] Specifically, the secondary recognition instruction can be input by the user triggering the hardware control configured in the AR device, such as a fingerprint recognition button configured in the AR device. The secondary recognition instruction can also be input by the user through an AR technology related gesture, such as the user wearing an external device such as a ring, wristband, etc. related to the AR device, and inputting the secondary recognition instruction through a preset gesture.

[0151] In addition, in the case that the user perceives that the voice recognition result is incorrect, that is, in the case that the payment amount displayed by the payment confirmation element is inaccurate, the user can also input the secondary recognition instruction to perform the code scanning payment of the AR device. Specifically, after the user inputs the secondary recognition instruction, the AR device calls the image collection component to obtain the payment code image displayed by the merchant device, performs voice recognition based on the decoding result, to perform secondary voice recognition and render and display the first confirmation element.

[0152] In a specific implementation process, to increase the AR interaction effect of the user, the voice data collected from the user and / or the merchant member and containing the payment amount is subjected to voice recognition to obtain the payment amount, a voice element corresponding to the payment amount is rendered and configured in the screen of the AR device at a position corresponding to the merchant member in the environmental image, so as to provide the user with an augmented reality effect through the transparent screen of the AR device, for example, the voice element is configured in the screen of the AR device, so that the voice element is visually configured at the mouth of the merchant member. In an optional implementation of the embodiment, the rendering and display of the payment confirmation element according to the payment amount and the environmental image comprises the following steps.

[0153] performing feature recognition on the merchant member image contained in the environmental image, determining a target image area according to the feature recognition result, and determining an element display area according to the target image area;

[0154] rendering a payment confirmation element containing an amount element and a voice element corresponding to the payment amount, configuring the voice element in the element display area and configuring the amount element in the center area for display processing.

[0155] Specifically, facial feature recognition is performed on the merchant member image contained in the environmental image to obtain a feature recognition result of the mouth of the merchant member in the merchant member image, a target image area corresponding to the mouth of the merchant member is determined according to the feature recognition result, and the target image area is mapped to a screen position of the AR device to determine an element display area in the screen of the AR device. A payment confirmation element containing an amount element and a voice element corresponding to the payment amount is rendered, the voice element is configured in the element display area, that is, the area corresponding to the mouth of the merchant member in the environmental image, and the amount element is configured in the center area of the screen of the AR device, so as to perform rendering and display processing of the payment confirmation element.

[0156] It should be noted that the rendering and display process of the payment confirmation element can also be used for the rendering and display processing of the first confirmation element. The rendering and display processing of the first confirmation element is taken as an example of the rendering and display processing of the payment confirmation element, and the embodiment will not be described here.

[0157] In step S808, the payment information sent by the AR device is received, a payment request is generated according to the payment information, and the server is submitted to perform payment processing.

[0158] The embodiment makes the user pay in the AR scene through the interaction mode of the AR device, the user terminal and the merchant device, replaces part of the function of the user terminal by the AR device to avoid frequent taking of the user terminal for payment interaction and / or AR interaction processing, determines the amount of money transferred to the merchant and / or paid through the voice recognition capability of the AR device, combines the AR scene with the payment scene, provides the user with the augmented reality capability through the AR device for payment processing, increases the payment function of the AR device, and enhances the perception capability of the user when using the AR device for payment.

[0159] In a specific implementation, the payment information including the payment amount and the merchant information sent by the AR device is received, and a payment request is generated according to the payment information and sent to the server, so that the server establishes a payment order according to the payment request and performs order payment processing. Specifically, the user terminal can also receive only the payment amount sent by the AR device, and generate a payment request based on the payment amount and the merchant information obtained by analyzing the settlement instruction and send it to the server, that is, the AR device can send the payment amount to the user terminal to generate a payment request.

[0160] In actual application, after the payment processing is completed, a payment success message can also be generated and sent to the user terminal and / or the AR device, to generate a payment result element and / or a payment success window on the screen of the AR device according to the payment success message, and to perform closing processing of the payment result element and / or the payment success window after detecting that the display time is up, for example, closing after 3 seconds of display. In an optional implementation of the embodiment, after the payment amount and the merchant information are transmitted to the user terminal according to the user payment instruction for payment processing, the method further includes:

[0161] receiving the payment success message sent by the server, and forwarding the payment success message to the AR device, so that the AR device generates a payment result window including the payment success message and performs closing processing of the payment result window after detecting that the time is up.

[0162] In summary, the one or more payment processing methods based on the AR device provided by the embodiment are applied to the user terminal. In the payment process, the payment recommendation message for payment through the AR device sent by the server is obtained, the payment recommendation message is transmitted to the AR device to remind the user in the AR device, the settlement instruction transmitted by the merchant device through the established communication connection is received and forwarded to the AR device, so that the AR device renders and displays the payment confirmation element based on the collected voice data and environmental image, receives the payment information sent by the AR device and generates a payment request according to the payment information and submits it to the server for payment processing. The augmented reality processing in the payment process is realized, and the perception degree of the user using the AR device for payment is improved.

[0163] The AR device-based payment processing method provided in the embodiment is further described below by taking the application of the AR device-based payment processing method in an AR payment scenario as an example. Referring to Figure 7 The AR device-based payment processing method applied in the AR payment scenario specifically includes the following steps.

[0164] In step S702, the payment recommendation message sent by the server is acquired.

[0165] Previously, the server

[0166] In step S704, the payment recommendation message is transmitted to the AR device.

[0167] In step S708, the settlement instruction sent by the merchant device through the established communication connection is received, and the settlement instruction is forwarded to the AR device.

[0168] In step S720, the payment amount and the merchant information sent by the AR device are received, and a payment request is generated according to the payment amount and the merchant information and submitted to the server.

[0169] In step S722, the payment success message issued by the server is acquired, and the payment success message is forwarded to the AR device.

[0170] The AR device-based payment processing device provided in the specification is implemented as follows:

[0171] In the above embodiment, the AR device-based payment processing method is provided, and a corresponding AR device-based payment processing device is also provided. The following describes the device embodiment in combination with the accompanying drawings.

[0172] Referring to Figure 9 , a schematic diagram of an AR device-based payment processing device embodiment provided in the embodiment is shown.

[0173] Since the device embodiment corresponds to the method embodiment, the description is relatively simple, and the related parts can be referred to the above-provided corresponding description of the method embodiment. The device embodiment described below is only schematic.

[0174] The AR device-based payment processing device provided in the embodiment is run on an AR device, and the device includes:

[0175] The message reminding module 902 is configured to receive the payment recommendation message synchronized by the user terminal and perform message reminding. The payment recommendation message is generated after detecting that the user position is within the range of a merchant.

[0176] The payment reminding element display module 904 is configured to obtain the settlement instruction submitted by the merchant device, and generate and display a payment reminding element based on merchant information contained in the settlement instruction; the merchant device is configured in the merchant range and is adapted to the AR device;

[0177] The payment confirmation element rendering module 906 is configured to perform voice recognition on the collected voice data, and perform rendering and display of a payment confirmation element according to a payment amount obtained by recognition and the collected environment image.

[0178] The payment amount transmission module 908 is configured to transmit the payment amount and the merchant information to the user terminal according to a user payment instruction, for payment processing.

[0179] Another AR device-based payment processing apparatus provided in the specification is implemented as follows:

[0180] In the above embodiment, another AR device-based payment processing method is provided, and a corresponding AR device-based payment processing apparatus is also provided, which will be described below with reference to the accompanying drawings.

[0181] Reference Figure 10 which shows a schematic diagram of an AR device-based payment processing apparatus embodiment provided in the embodiment.

[0182] Since the apparatus embodiment corresponds to the method embodiment, the description is relatively simple, and the related parts can be referred to the corresponding description of the method embodiment provided above. The apparatus embodiment described below is only illustrative.

[0183] The embodiment provides an AR device-based payment processing apparatus, which runs on a user terminal, and the apparatus comprises:

[0184] The payment recommendation message acquisition module 1002 is configured to acquire a payment recommendation message for payment through an AR device, which is generated after detecting that a user position is in a merchant range, which is generated after detecting that a user position is in a merchant range.

[0185] The payment recommendation message transmission module 1004 is configured to transmit the payment recommendation message to the AR device, so as to perform message reminding on the AR device.

[0186] The settlement instruction forwarding module 1006 is configured to receive a settlement instruction transmitted by a merchant device through an established communication connection and forward the settlement instruction to the AR device, so that the AR device renders and displays a payment confirmation element based on collected voice data and environment images; the merchant device is configured in the merchant range and is adapted to the AR device.

[0187] The payment request submission module 1008 is configured to receive the payment information sent by the AR device, generate a payment request according to the payment information, and submit the payment request to the server for payment processing.

[0188] The AR device provided in the specification implements, for example, the following:

[0189] According to the AR device-based payment processing method described above, based on the same technical concept, one or more embodiments of the specification also provide an AR device for executing the AR device-based payment processing method provided above, Figure 11 A structural diagram of an AR device provided for one or more embodiments of the specification.

[0190] The AR device provided in the embodiment includes:

[0191] As Figure 11 shown, the AR device can have large differences due to different configurations or performances, and can include one or more processors 1101 and memories 1102, and the memories 1102 can store one or more storage applications or data. The memory 1102 can be temporary storage or persistent storage. The application stored in the memory 1102 can include one or more modules (not shown in the figure), and each module can include a series of computer executable instructions in the AR device. Further, the processor 1101 can be configured to communicate with the memory 1102 and execute a series of computer executable instructions in the memory 1102 on the server. The server can also include one or more power supplies 1103, one or more wired or wireless network interfaces 1104, one or more input / output interfaces 1105, and the like.

[0192] In one specific embodiment, the AR device includes a memory and one or more programs, wherein one or more programs are stored in the memory, and one or more programs can include one or more modules, and each module can include a series of computer executable instructions in the AR device, and the one or more programs executed by the one or more processors include computer executable instructions for:

[0193] receiving a payment recommendation message synchronized by the user terminal and performing message prompting; the payment recommendation message is generated after detecting that the user position is within the range of the merchant;

[0194] obtaining a settlement instruction submitted by a merchant device, and generating and displaying a payment prompt element based on merchant information contained in the settlement instruction; the merchant device is configured in the merchant range and is adapted to the AR device;

[0195] The collected voice data is subjected to voice recognition, and the payment amount obtained through recognition and the collected environmental image are subjected to rendering display of a payment confirmation element;

[0196] The payment amount and the merchant information are transmitted to the user terminal according to a user payment instruction, for payment processing.

[0197] The user terminal provided in the specification may, for example, have the following implementation:

[0198] According to the above description, another AR device-based payment processing method is provided, based on the same technical concept, one or more embodiments of the specification also provide a user terminal for executing the above-mentioned another AR device-based payment processing method, Figure 12 A structural schematic diagram of a user terminal provided for one or more embodiments of the specification.

[0199] The user terminal provided in the embodiment includes:

[0200] As Figure 12 shown, the user terminal can have a large difference due to different configurations or performances, and can include one or more processors 1201 and memories 1202, and the memories 1202 can store one or more stored application programs or data. Among them, the memory 1202 can be temporary storage or persistent storage. The application programs stored in the memory 1202 can include one or more modules (not shown in the figure), and each module can include a series of computer executable instructions in the user terminal. Further, the processor 1201 can be configured to communicate with the memory 1202 and execute a series of computer executable instructions in the memory 1202 on the user terminal. The user terminal can also include one or more power supplies 1203, one or more wired or wireless network interfaces 1204, one or more input / output interfaces 1205, one or more keyboards 1206, etc.

[0201] In a specific embodiment, the user terminal includes a memory and one or more programs, wherein one or more programs are stored in the memory, and one or more programs can include one or more modules, and each module can include a series of computer executable instructions in the user terminal, and the one or more programs configured to be executed by the one or more processors include computer executable instructions for:

[0202] Obtaining a payment recommendation message for payment through an AR device issued by a server; the payment recommendation message is generated after detecting that the user position is within the range of a merchant;

[0203] transmitting the payment recommendation message to the AR device for message reminding;

[0204] receiving the settlement instruction transmitted by the merchant device through the established communication connection and forwarding to the AR device, so that the AR device renders and displays a payment confirmation element based on the collected voice data and environmental images; the merchant device is configured within the merchant range and is adapted to the AR device;

[0205] receiving the payment information sent by the AR device and generating a payment request according to the payment information and submitting to the server for payment processing.

[0206] The computer readable storage medium provided in the specification implements, for example:

[0207] According to the above description, a payment processing method based on an AR device is provided, and based on the same technical concept, one or more embodiments of the specification also provide a computer readable storage medium.

[0208] The computer readable storage medium provided in the embodiment is used to store computer executable instructions, and the computer executable instructions realize the following processes when executed.

[0209] receiving a payment recommendation message synchronized by a user terminal and performing message reminding; the payment recommendation message is generated after detecting that the user position is within the merchant range;

[0210] obtaining a settlement instruction submitted by a merchant device, and generating a payment reminder element and displaying based on the merchant information contained in the settlement instruction; the merchant device is configured within the merchant range and is adapted to the AR device;

[0211] performing voice recognition on the collected voice data, and rendering and displaying a payment confirmation element according to the payment amount obtained by recognition and the collected environmental images;

[0212] transmitting the payment amount and the merchant information to the user terminal according to the user payment instruction for payment processing.

[0213] It should be noted that the embodiments of the computer readable storage medium in the specification and the embodiments of the payment processing method based on the AR device in the specification are based on the same inventive concept, so the specific implementation of the embodiments can be referred to the implementation of the corresponding method described above, and the repeated parts will not be described here.

[0214] Another computer readable storage medium provided in the specification implements, for example:

[0215] According to another payment processing method based on an AR device described above, based on the same technical concept, one or more embodiments of the present specification also provide another computer-readable storage medium.

[0216] The computer-readable storage medium provided by the embodiment provides computer-executable instructions for storing, and the computer-executable instructions realize the following processes when executed.

[0217] Obtain a payment recommendation message for payment through the AR device issued by the server; the payment recommendation message is generated after detecting that the user position is within the scope of the merchant;

[0218] Transmit the payment recommendation message to the AR device to prompt the AR device through the message;

[0219] Receive the settlement instruction transmitted by the merchant device through the established communication connection and forward it to the AR device, so that the AR device renders and displays a payment confirmation element based on the collected voice data and environmental images; the merchant device is configured within the scope of the merchant and is adapted to the AR device;

[0220] Receive the payment information sent by the AR device and generate a payment request according to the payment information and submit it to the server for payment processing.

[0221] It should be noted that the embodiments of another computer-readable storage medium in the present specification and the embodiments of another payment processing method based on an AR device in the present specification are based on the same inventive concept, so the specific implementation of this embodiment can refer to the foregoing implementation of the corresponding method, and the repeated parts will not be described here.

[0222] Each of the embodiments in the present specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other. Each embodiment focuses on the difference from other embodiments, such as device embodiments, device embodiments and storage medium embodiments, which are similar to method embodiments, so the description is relatively simple. Please refer to the part of the method embodiment when reading the related content in the device embodiment, the device embodiment and the storage medium embodiment.

[0223] The above describes specific embodiments of the present specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in an order different from that in the embodiments and still achieve the desired result. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired result. In some embodiments, multi-task processing and parallel processing are possible or can be advantageous.

[0224] In the 1930s, it was clear to distinguish whether an improvement in a technology was in hardware (e.g., improvement in circuit structure of diodes, transistors, switches, etc.) or in software (e.g., improvement in method flow). However, as technology has evolved, many improvements in method flow today can be considered as direct improvements in hardware circuit structure. Designers almost always obtain the corresponding hardware circuit structure by programming the improved method flow into the hardware circuit. Therefore, it cannot be said that an improvement in a method flow cannot be implemented by a hardware entity module. For example, a programmable logic device (PLD) (e.g., a field programmable gate array (FPGA)) is an integrated circuit whose logic function is determined by user programming of the device. A digital system is "integrated" on a PLD by the designer programming it, rather than by asking a chip manufacturer to design and fabricate a custom integrated circuit chip. Moreover, instead of manually fabricating an integrated circuit chip, this programming is now mostly implemented by "logic compiler" software, which is similar to software compilers used in program development, and the original code to be compiled is written in a specific programming language, called a hardware description language (HDL), of which there are many, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc., the most commonly used being VHDL (Very-High-Speed Integrated Circuit Hardware Description Language) and Verilog. It should be clear to those skilled in the art that, by simply logically programming a method flow in one of the above hardware description languages and programming it into an integrated circuit, a hardware circuit implementing the logical method flow can be easily obtained.

[0225] The controller can be implemented in any suitable manner, for example, the controller can take the form of a microprocessor or processor and a computer readable medium storing computer readable program code (e.g. software or firmware) executable by the (micro)processor, logic gates, switches, an Application Specific Integrated Circuit (ASIC), a programmable logic controller and an embedded microcontroller, examples of which include but are not limited to the following microcontrollers: ARC 626D, Atmel AT151SAM, Microchip PIC18F26K20 and Silicone Labs C8061F320, the memory controller can also be implemented as part of the control logic of the memory. It will also be appreciated by those skilled in the art that in addition to being implemented in purely computer readable program code the controller can equally well be implemented by logic programming the method steps in logic gates, switches, an ASIC, a programmable logic controller and an embedded microcontroller to achieve the same functionality. The controller can thus be considered as a hardware component and the means included therein for achieving the various functions can be considered as structures within the hardware component. Alternatively, or even, the means for achieving the various functions can be considered as both a software module implementing the method and as a structure within the hardware component.

[0226] The systems, apparatuses, modules or units illustrated by the above embodiments can be specifically implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer can be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0227] For the sake of brevity, the above apparatuses are described in functional form in various units. Of course, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0228] Those skilled in the art will appreciate that one or more embodiments of the disclosure can be provided as a method, a system or a computer program product. Accordingly, one or more embodiments of the disclosure can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the disclosure can take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, magnetic disks, CD-ROMs, optical storage media, etc.) embodying computer readable program code.

[0229] The specification is presented with reference to flow diagrams and / or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the specification. It will be understood that each block of the flow diagrams and / or block diagrams, and combinations of blocks in the flow diagrams and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processing element or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flow diagrams and / or block diagrams block or blocks. Figure 1 one or more flow or multiple flows and / or blocks Figure 1 one or more flow or multiple flows and / or blocks

[0230] These computer program instructions can also be stored in a computer- readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function specified in the flow diagrams and / or block diagrams block or blocks. Figure 1 one or more flow or multiple flows and / or blocks Figure 1 one or more flow or multiple flows and / or blocks

[0231] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flow diagrams and / or block diagrams block or blocks. Figure 1 one or more flow or multiple flows and / or blocks Figure 1 Figure 1 one or more flow or multiple flows and / or blocks

[0232] In one typical configuration, the computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0233] The memory can include non-persistent memory and / or volatile memory, such as random access memory (RAM) and / or cache memory, non-volatile memory, such as read-only memory (ROM), EPROM, and / or flash memory, etc. The memory is an example of computer readable media.

[0234] Computer-readable media includes permanent and non-permanent, movable and non-movable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette, magnetic tape disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible to a computing device. According to the definition herein, computer-readable media does not include transitory media such as modulated data signals and carriers.

[0235] It should also be noted that the terms "comprising", "containing", or any other variant thereof are intended to cover non-exclusive inclusions, so that a process, method, article or apparatus that includes a list of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or apparatus. Without more limitations, the element defined by the statement "comprising a" does not exclude the presence of additional identical elements in the process, method, article or apparatus that includes the element.

[0236] One or more embodiments of the specification can be described in the general context of computer-executable instructions being executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, and the like that perform specific tasks or implement specific abstract data types. One or more embodiments of the specification can also be practiced in a distributed computing environment, in which tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media, including storage devices.

[0237] The above only describes the embodiments of the present document and is not intended to limit the present document. For those skilled in the art, the present document can have various changes and variations. Any modification, equivalent replacement, improvement, etc. within the spirit and principle of the present document shall be included in the scope of claims of the present document.

Claims

1. A payment processing method based on an AR device, applied to an AR device, the method comprising: receiving a payment recommendation message synchronized with a user terminal and performing message prompting; the payment recommendation message is generated after detecting that a user position is within a merchant range; the payment recommendation message is used to prompt the user to use the AR device to perform payment processing at the merchant; obtaining a settlement instruction submitted by a merchant device, and generating and displaying a payment prompt element based on merchant information contained in the settlement instruction; the merchant device is configured within the merchant range and is adapted to the AR device; performing voice recognition on collected voice data, and rendering and displaying a payment confirmation element according to a payment amount obtained by recognition and an environment image collected; transmitting the payment amount and the merchant information to the user terminal according to a user payment instruction to perform payment processing. 2.The payment processing method based on the AR device of claim 1, wherein the rendering and displaying of the payment confirmation element according to the payment amount obtained by recognition and the environment image collected comprises: performing feature recognition on a merchant member image contained in the environment image, determining a target image area according to a feature recognition result, and determining an element display area according to the target image area; rendering a payment confirmation element containing an amount element and a voice element corresponding to the payment amount, and displaying the voice element in the element display area and the amount element in a central area. 3.The payment processing method based on the AR device of claim 1, wherein the voice recognition on the collected voice data comprises: running a voice recognition component of an application program based on the voice data to perform voice recognition, and determining the payment amount according to a voice recognition result; wherein the voice recognition component takes the voice data as input data of a voice recognition interface of the application program to perform interface calling, and obtains the voice recognition result returned by the interface calling. 4.The payment processing method based on the AR device of claim 3, wherein after the step of performing voice recognition on the collected voice data, rendering and displaying a payment confirmation element according to a payment amount obtained by recognition and an environment image collected, and before the step of transmitting the payment amount and the merchant information to the user terminal according to a user payment instruction to perform payment processing, the method further comprises: performing secondary voice recognition if a secondary recognition instruction input by the user is detected; performing secondary rendering and displaying of a payment confirmation element according to a payment amount obtained by secondary recognition and an environment image collected secondarily. 5.The payment processing method based on the AR device of claim 1, wherein after the step of transmitting the payment amount and the merchant information to the user terminal according to a user payment instruction to perform payment processing, the method further comprises: receiving a payment success message sent by the user terminal, and generating a payment result window containing the payment success message; displaying the payment result window, and closing the payment result window after detecting that a display time has expired.

6. The AR device-based payment processing method of claim 1, wherein the payment confirmation element is generated in the following manner: calling a rendering interface of an application based on the payment amount to perform element rendering on the payment amount corresponding element, and generating the payment confirmation element based on element data returned by the interface call; or calling a rendering component of the user terminal based on the payment amount to perform element rendering, and generating the payment confirmation element based on element data returned by the user terminal.

7. The AR device-based payment processing method of claim 1, wherein the payment recommendation message is generated in the following manner: detecting whether there is a binding relationship between the user and the AR device, and if so, detecting whether the user position is within a merchant range; if so, generating the payment recommendation message for payment through the AR device, and sending the payment recommendation message to the AR device; wherein, the merchant range is determined based on a merchant address registered by the merchant in the application.

8. The AR device-based payment processing method of claim 1, wherein the payment reminder element is generated and displayed based on the merchant information contained in the settlement instruction, including: obtaining a merchant identification element corresponding to the merchant information and a preset reminder element by a service component of the application; performing edge detection on the environment image, determining an identification display area based on the edge detection result, configuring the merchant identification element in the identification display area, and configuring the preset reminder element in the center area for display.

9. The AR device-based payment processing method of claim 1, wherein the payment recommendation message is generated in the following manner: receiving a message sending request submitted by a merchant, and extracting a device identification and message content carried in the message sending request; generating the payment recommendation message according to the message content, and sending the payment recommendation message to a user bound to the device identification through a message service of the application; wherein, the message sending request is submitted to the server based on the device detection result through the device detection component of the merchant device for AR device detection, and the message is sent through the server.

10. The AR device-based payment processing method of claim 9, wherein the device identification is obtained by the user registering the AR device in the application, and a binding relationship between the AR device and the user is established after registration; correspondingly, the AR device is registered in the following manner: obtaining a device registration request submitted by the user, and reading a device identification of the AR device connected to the user terminal based on the device registration request; establishing a binding relationship between the AR device and the user based on the device identification, and writing the device identification into a device registration table.

11. An AR device-based payment processing method applied to a user terminal, the method comprising: obtaining a payment recommendation message for payment through an AR device sent by a server; the payment recommendation message is generated after detecting that the user position is within a merchant range; the payment recommendation message is used to remind the user to use the AR device for payment processing at the merchant; synchronizing the payment recommendation message to the AR device to prompt a message reminder on the AR device; receiving a settlement instruction transmitted by the merchant device through the established communication connection and forwarding the settlement instruction to the AR device, so that the AR device renders and displays a payment confirmation element based on the collected voice data and the environment image; the merchant device is configured within the merchant range and is adapted to the AR device; receiving payment information sent by the AR device, generating a payment request according to the payment information, and submitting the payment request to the server for payment processing.

12. The AR device-based payment processing method of claim 11, wherein the rendering and displaying of the payment confirmation element based on the collected voice data and the environment image comprises: performing feature recognition on a merchant member image contained in the environment image, determining a target image area according to the feature recognition result, and determining an element display area according to the target image area; rendering a payment confirmation element containing an amount element and a voice element corresponding to the payment amount, and displaying the voice element in the element display area and the amount element in the center area.

13. The AR device-based payment processing method of claim 11, wherein the payment information comprises a payment amount obtained by voice recognition, and the settlement instruction comprises merchant information; Correspondingly, the voice recognition comprises: running a voice recognition component of an application program based on the voice data to perform voice recognition, and determining the payment amount according to the voice recognition result; wherein the voice recognition component takes the voice data as input data of a voice recognition interface of the application program to perform interface calling, and obtains the voice recognition result output by the interface calling.

14. The AR device-based payment processing method of claim 13, wherein after the substep of running a voice recognition component of an application program based on the voice data to perform voice recognition and determining the payment amount according to the voice recognition result, the method further comprises: performing secondary voice recognition if a secondary recognition instruction input by the user is detected; performing secondary rendering and displaying of the payment confirmation element based on a payment amount obtained by secondary voice recognition and a secondary collected environment image.

15. The AR device-based payment processing method of claim 11, wherein after the step of receiving payment information sent by the AR device, generating a payment request according to the payment information, and submitting the payment request to the server for payment processing, the method further comprises: receiving a payment success message issued by the server, forwarding the payment success message to the AR device, so that the AR device generates a payment result window containing the payment success message and performs closing processing of the payment result window after detecting that a time limit is reached.

16. The AR device-based payment processing method of claim 11, wherein the payment confirmation element is generated in the following manner: calling a rendering interface of an application program based on the payment amount to perform element rendering of an element corresponding to the payment amount, and generating the payment confirmation element according to element data returned by the interface calling; or ​ Based on the payment amount, the rendering component of the user terminal is called by the application to render elements, and the payment confirmation element is generated according to the element data returned by the user terminal.

17. The AR device-based payment processing method of claim 11, wherein the payment recommendation message is generated in the following manner: detecting whether there is a binding relationship between the user and the AR device, and if so, detecting whether the user position is within the scope of the merchant; if so, generating the payment recommendation message for payment through the AR device, and sending the payment recommendation message to the AR device; wherein, the scope of the merchant is determined based on the merchant address registered by the merchant in the application.

18. The AR device-based payment processing method of claim 11, wherein the payment recommendation message is generated in the following manner: receiving a message sending request submitted by the merchant, and extracting the device identifier and message content carried in the message sending request; generating the payment recommendation message according to the message content, and sending the payment recommendation message to the user bound to the device identifier through the message service of the application of the merchant; wherein the message sending request is submitted to the server based on the device detection result through the device detection component of the merchant device to send the message through the server.

19. The AR device-based payment processing method of claim 18, wherein the device identifier is obtained by the user registering the AR device in the application, and the binding relationship between the AR device and the user is established after registration; correspondingly, the AR device is registered in the following manner: obtaining a device registration request submitted by the user, and reading the device identifier of the AR device connected to the user terminal based on the device registration request; establishing the binding relationship between the AR device and the user based on the device identifier, and writing the device identifier into a device registration table.

20. An AR device-based payment processing apparatus running on an AR device, comprising: a message reminding module configured to receive a payment recommendation message synchronized by a user terminal and perform message reminding; the payment recommendation message is generated after detecting that the user position is within the scope of the merchant; the payment recommendation message is used to remind the user to use the AR device for payment processing at the merchant; a payment reminder element display module configured to obtain a settlement instruction submitted by a merchant device, and generate and display a payment reminder element based on merchant information contained in the settlement instruction; the merchant device is configured within the scope of the merchant and is adapted to the AR device; a payment confirmation element rendering module configured to perform voice recognition on collected voice data, and render and display a payment confirmation element according to the payment amount obtained by recognition and the collected environment image; a payment amount transmission module configured to transmit the payment amount and the merchant information to the user terminal according to a user payment instruction, for payment processing.

21. An AR device-based payment processing apparatus running on a user terminal, comprising: The payment recommendation message obtaining module is configured to obtain a payment recommendation message for payment through the AR device issued by a server. The payment recommendation message is generated after detecting that the user position is within a merchant range. The payment recommendation message is used to remind the user to use the AR device for payment processing at the merchant. The payment recommendation message transmission module is configured to transmit the payment recommendation message to the AR device to perform message reminding on the AR device. The settlement instruction forwarding module is configured to receive a settlement instruction transmitted by a merchant device through the established communication connection and forward the settlement instruction to the AR device, so that the AR device renders and displays a payment confirmation element based on the collected voice data and environmental images. The merchant device is configured within the merchant range and is adapted to the AR device. The payment request submission module is configured to receive payment information sent by the AR device, generate a payment request according to the payment information, and submit the payment request to the server for payment processing.

22. An AR device, comprising: a processor; and a memory configured to store computer executable instructions, the processor executes the computer executable instructions to implement the following processes: receiving a payment recommendation message synchronized by a user terminal and performing message reminding; the payment recommendation message is generated after detecting that the user position is within a merchant range; the payment recommendation message is used to remind the user to use the AR device for payment processing at the merchant; obtaining a settlement instruction submitted by a merchant device, and generating and displaying a payment reminder element based on merchant information contained in the settlement instruction; the merchant device is configured within the merchant range and is adapted to the AR device; performing voice recognition on the collected voice data, and rendering and displaying a payment confirmation element according to the payment amount obtained by recognition and the collected environmental images; transmitting the payment amount and the merchant information to the user terminal according to the user payment instruction, so as to perform payment processing.

23. A user terminal, comprising: a processor; and a memory configured to store computer executable instructions, the processor executes the computer executable instructions to implement the following processes: obtaining a payment recommendation message for payment through an AR device issued by a server; the payment recommendation message is generated after detecting that the user position is within a merchant range; the payment recommendation message is used to remind the user to use the AR device for payment processing at the merchant; transmitting the payment recommendation message to the AR device to perform message reminding on the AR device; receiving a settlement instruction transmitted by a merchant device through the established communication connection and forwarding the settlement instruction to the AR device, so that the AR device renders and displays a payment confirmation element based on the collected voice data and environmental images. The merchant device is configured within the merchant range and is adapted to the AR device; receiving payment information sent by the AR device, generating a payment request according to the payment information, and submitting the payment request to the server for payment processing.

24. A computer readable storage medium for storing computer executable instructions that, when executed, implement the steps of the method of claim 1.

25. A computer readable storage medium for storing computer executable instructions that, when executed, implement the steps of the method of claim 11.

Images