Payment method, device, near-eye display device and storage medium

Abstract

This application relates to the field of electronic information technology and provides a payment method, apparatus, near-eye display device, and storage medium. The method comprises: scanning a payment code using a camera device of a near-eye display device; displaying a password input interface based on the near-eye display device after the scanning is completed; performing gesture recognition on a password input operation performed by the wearer based on the password input interface to determine the password input by the wearer, and completing the scan code payment when the password is correct. Embodiments of the present application improve the efficiency of scan code payment.

Description

Technical Field

[0001] The present application relates to the field of electronic information technology, and in particular to a payment method, apparatus, near-eye display device, and storage medium. Background Art

[0002] Nowadays, scanning code to pay is a common operation in people's daily life. Currently, users generally use smartphones to perform scanning code payment operations. The whole process requires users to take out their smartphones, unlock them, open relevant payment software, scan codes, enter passwords, and perform other operations. The scanning code payment process is cumbersome.

[0003] Therefore, how to improve the efficiency of QR code payment has become an urgent problem to be solved. Summary of the Invention

[0004] This application provides a payment method, apparatus, near-eye display device and storage medium, aiming to improve the efficiency of QR code payment.

[0005] To achieve the above objectives, the present application provides a payment method based on a near-eye display device, the payment method based on a near-eye display device comprising:

[0006] Scan the payment code using the camera of the near-eye display device;

[0007] After the scanning is completed, a password input interface is displayed based on the near-eye display device;

[0008] Gesture recognition is performed on the password input operation performed by the wearer based on the password input interface to determine the password input by the wearer, so as to complete the scan code payment when the password is correct.

[0009] In addition, to achieve the above-mentioned purpose, the present application also provides a payment device, which includes a memory and a processor;

[0010] The memory is used to store computer programs;

[0011] The processor is configured to execute the computer program and implement the steps of the above-mentioned payment method based on the near-eye display device when executing the computer program.

[0012] In addition, to achieve the above-mentioned purpose, the present application also provides a near-eye display device, which includes the payment device as described above.

[0013] In addition, to achieve the above-mentioned purpose, the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the steps of the above-mentioned payment method based on the near-eye display device.

[0014] The present application discloses a payment method, device, near-eye display device and storage medium. When a wearer wearing the near-eye display device needs to scan a code to pay, the payment code is scanned by the camera device of the near-eye display device. After the scanning is completed, a password input interface is displayed based on the near-eye display device. The wearer performs a password input operation based on the password input interface, and gesture recognition is performed to determine the password entered by the wearer. When the password is correct, the scan code payment is completed. Compared with the method of using a smartphone to scan a code to pay, the method saves the need to take out the smartphone, unlock the smartphone, and open the relevant payment software, thereby saving time and being more efficient. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0016] Figure 1 This is a schematic flow chart of the steps of a payment method based on a near-eye display device provided in an embodiment of the present application;

[0017] Figure 2 This is a schematic flow chart of steps for scanning a payment code using a camera device of a near-eye display device, provided in an embodiment of the present application;

[0018] Figure 3 This is a schematic diagram of a code scanning box provided in an embodiment of the present application;

[0019] Figure 4 It is a two-dimensional schematic diagram of the key points of the wearer's hand;

[0020] Figure 5 It is a three-dimensional schematic diagram of the key points of the wearer's hand;

[0021] Figure 6 This is another schematic diagram of displaying a code scanning box provided in an embodiment of the present application;

[0022] Figure 7 is a schematic diagram of a password input interface provided in an embodiment of the present application;

[0023] Figure 8 This is a schematic flow chart of the steps of performing gesture recognition on a password input operation performed by the wearer based on the password input interface to determine the password input by the wearer, provided by an embodiment of the present application;

[0024] Figure 9 This is a schematic block diagram of a payment device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0026] The flowcharts shown in the accompanying drawings are for illustrative purposes only and do not necessarily include all contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may be decomposed, combined, or partially merged, so the actual execution order may vary depending on the actual situation.

[0027] It should be understood that the terms used in this specification are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in this specification and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms unless the context clearly indicates otherwise.

[0028] It will also be understood that the term "and / or" used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0029] Embodiments of the present application provide a payment method, apparatus, near-eye display device, and storage medium for improving the efficiency of scan code payment.

[0030] See also Figure 1 , Figure 1 This is a flow chart of a payment method based on a near-eye display device, provided in one embodiment of the present application. This method can be applied to a payment device or a near-eye display device, and this application does not limit the application scenario of this method. Near-eye display devices include, but are not limited to, AR (Augmented Reality) glasses, VR (Virtual Reality) glasses, and other devices.

[0031] like Figure 1 As shown, the payment method based on the near-eye display device specifically includes steps S101 to S103.

[0032] S101. Scan the payment code using the camera of the near-eye display device.

[0033] Among them, the camera device can be a camera that comes with the near-eye display device. Of course, it can be understood that the camera device can also be other types of devices such as a camera mounted on the near-eye display device, and no specific restrictions are made in this application.

[0034] When the wearer of the near-eye display device needs to scan the code to pay, the corresponding control operation is performed to trigger the control instruction. When the control instruction is received, the camera device is turned on.

[0035] For example, taking the near-eye display device as AR glasses, the wearer of the AR glasses inputs a voice command such as "scan the code to pay", and when the voice command is received, the camera device is controlled to turn on.

[0036] Exemplarily, the AR glasses are provided with touch keys, for example, a touch bar is provided at the temple of the AR glasses. When the wearer of the AR glasses presses the touch bar, the camera device is controlled to be turned on.

[0037] It should be noted that the method of controlling the camera to start is not limited to the examples listed above, and is not specifically limited in this application.

[0038] After the camera device is turned on, it is aimed at the payment code to be paid and scanned, wherein the payment code includes but is not limited to a QR code.

[0039] Compared with the method of scanning code to pay with a smartphone, it saves the need to take out the phone, unlock the smartphone, and open the relevant payment software, saving scanning time and thus improving the efficiency of scanning code payment.

[0040] In some embodiments, the near-eye display device includes multiple scanning modes, such as Figure 2 As shown, step S101 may include sub-step S1011 and sub-step S1012.

[0041] S1011. Displaying a code scanning box on a code scanning interface of the near-eye display device according to a current code scanning mode of the near-eye display device, wherein different code scanning modes correspond to different display modes of the code scanning box;

[0042] S1012: When the code scanning frame is aligned with the payment code, the payment code is scanned by the camera device.

[0043] In different scanning modes, the near-eye display device uses different display methods to display the scanning box on the scanning interface. For example, the scanning box is displayed on the scanning interface in different display methods such as different scanning box display positions and different scanning box display shapes. This improves the flexibility of the scanning box display, makes scanning more flexible, and thus ensures successful scanning.

[0044] After the scan box appears on the code scanning interface, align the scan box with the payment code, that is, let the payment code enter the scan box, and scan the payment code through the camera. Since the scan box is aligned with the payment code, the code is successfully scanned.

[0045] Exemplarily, the near-eye display device includes a first mode and a second mode, wherein the first mode is a head selection mode, in which the wearer scans the payment code by turning his head; the second mode is a hand selection mode, in which the wearer scans the payment code by moving his hand.

[0046] In some embodiments, displaying a code scanning box on a code scanning interface of the near-eye display device according to a current code scanning mode of the near-eye display device includes:

[0047] If the current code scanning mode is the first mode, displaying the code scanning box on the code scanning interface according to the preset code scanning box information;

[0048] If the current scanning mode is the second mode, the scanning box information corresponding to the second mode is obtained according to the scanning box setting operation performed by the wearer based on the scanning interface, and the scanning box is displayed on the scanning interface according to the scanning box information corresponding to the second mode.

[0049] In the first mode, the near-eye display device automatically displays a scan frame on the scan interface according to the preset scan frame information, wherein the preset scan frame information includes but is not limited to the scan frame shape, vertex coordinate information, scan frame length, scan frame width and other information. Figure 3 As shown, the code scanning box will be automatically displayed in the middle of the code scanning interface. Figure 3 As shown in the dotted rectangle, the wearer turns their head to align the scanning frame with the payment code and scans it.

[0050] For example, the first mode can be pre-set as the default mode. In this way, when scanning the code to pay through the near-eye display device, the first mode is automatically entered without the wearer's manual operation, which is very convenient and improves the wearer's experience.

[0051] When the first mode is not applicable, for example, when the scanning box in the first mode is not appropriately sized and the payment code cannot be fully inserted into the scanning box, the second mode can be switched. For example, the wearer can input a voice message such as "enter the second mode", and when the voice message is received, the near-eye display device is controlled to enter the second mode. For another example, the near-eye display device is provided with a corresponding button, and the wearer can touch the button. When the touch operation is detected, the near-eye display device is controlled to enter the second mode.

[0052] In the second mode of the near-eye display device, the scan box is not fixed and is determined by the wearer performing the corresponding scan box setting operation on the scan interface. Among them, the scan box setting operation includes but is not limited to the wearer drawing the outline of the scan box on the scan interface, pointing out the vertices of the scan box on the scan interface (such as the 4 vertices of the quadrilateral scan box), etc., and the present application does not impose specific restrictions on the scan box setting operation. According to the wearer's scan box setting operation, the corresponding scan box information in the second mode is obtained, wherein the corresponding scan box information in the second mode includes but is not limited to the scan box shape, vertex coordinate information, scan box length, scan box width and other information. According to the obtained corresponding scan box information in the second mode, the scan box set by the wearer's operation is displayed on the scan interface.

[0053] In some embodiments, obtaining corresponding scanning box information in the second mode according to the scanning box setting operation performed by the wearer based on the scanning interface includes:

[0054] Performing gesture recognition on the code scanning frame setting operation to determine a first target key point on the wearer's hand;

[0055] Based on the first target key point, multiple vertices of the code scanning frame are determined, and coordinate information of each vertex is obtained.

[0056] The wearer's hand includes various key points, such as Figure 4 As shown in FIG, the dots numbered from 0 to 20 are the 21 key points of the wearer. The first target key point is determined from the key points on the wearer's hand. For example, the wearer usually uses the index finger to input the password, so the tip of the index finger can be used as the first target key point, that is, Figure 4 The key point numbered 8 is the first target key point.

[0057] When the current scanning mode of the near-eye display device is the second mode, gesture recognition is performed on the scanning frame setting operation of the wearer to determine each key point and obtain the coordinate information of each key point, including the coordinate information of the first target key point. The coordinate information includes but is not limited to 3D coordinates, for example, Figure 5 The three-dimensional schematic diagram of the key points shown is used to obtain the 3D coordinates of each key point.

[0058] In actual applications, based on the pictures taken by the camera device, gesture recognition is used to obtain the 3D coordinates of the first target key point in the camera coordinate system, and then the extrinsic parameters of the camera device and the near-eye display device are used to convert the 3D coordinates of the first target key point in the camera coordinate system into the 3D coordinates of the first target key point in the world coordinate system. Then, based on the 3D coordinates of the first target key point in the world coordinate system, projection is performed through the near-eye display device, and the wearer can see the position of the first target key point through the near-eye display device.

[0059] For convenience, the world coordinate system can be set to the 3D coordinate system of the left lens of the near-eye display device. That is, when the left lens is placed vertically, the Z axis is perpendicular to the left lens and faces forward, the X axis is vertically upward, and the XYZ axes conform to the right-hand rule. All coordinate information below is defaulted to this world coordinate system.

[0060] For example, taking the first target key point as the index fingertip, the wearer can first move the index fingertip to a suitable position, such as the upper left corner of the code scanning interface, and pause for a preset time, such as 1s, wherein the preset time can be flexibly set according to the actual situation, and is not specifically limited in this application. The position where the index fingertip is paused at this time is determined as the upper left corner vertex of the code scanning box, and the coordinate information of the upper left corner vertex is obtained, that is, the coordinate information of the position where the index fingertip is paused at this time is obtained. Afterwards, move the index fingertip to another position, such as the lower right corner of the code scanning interface, and pause for a preset time, such as 1s, and determine the position where the index fingertip is paused at this time as the lower right corner vertex of the code scanning box, and obtain the coordinate information of the lower right corner vertex, that is, the coordinate information of the position where the index fingertip is paused at this time is obtained. According to the coordinate information of the upper left corner vertex and the coordinate information of the lower right corner vertex, the code scanning box determined by the wearer performing the code scanning box setting operation can be obtained, for example, as Figure 6 As shown, the scan code box is as Figure 6 As shown in the solid rectangular box pointed by the middle and index fingers.

[0061] S102: After the scanning is completed, a password input interface is displayed based on the near-eye display device.

[0062] After the camera scan is completed, the password input interface is displayed based on the near-eye display device. The password input interface is only visible to the wearer of the near-eye display device and cannot be seen by other users. In actual applications, the password is usually a number, for example, the password input interface is as follows Figure 7 As shown, it includes numbers 0 to 9 and clear, return, and confirm controls.

[0063] The password input interface is only visible to the wearer of the near-eye display device. In this way, on the one hand, the wearer can perform password input operations through the password input interface, and on the other hand, other people cannot see the password input interface, thereby avoiding password leakage and improving security.

[0064] Exemplarily, the order of password numbers on the password input interface is randomly arranged and not fixed, thereby further ensuring security.

[0065] S103: performing gesture recognition on the password input operation performed by the wearer based on the password input interface to determine the password input by the wearer, so as to complete the scan code payment when the password is correct.

[0066] When the wearer performs a password input operation, gesture recognition is performed on the password input operation to obtain coordinate information of the second target key point. Based on the coordinate information of the second target key point, the password input by the wearer is determined. The second target key point can be the same as the first target key point, for example, the first target key point and the second target key point are both the tip of the wearer's index finger; the second target key point can also be different from the first target key point, for example, the first target key point is the tip of the wearer's index finger, and the second target key point is the tip of the wearer's middle finger. This is not specifically limited in this application.

[0067] After the wearer completes the password input operation, the password is checked to see if it is correct. If the password is correct, the payment is completed; otherwise, the payment fails. For example, when the password is incorrect and the payment fails, a prompt "wrong password" is displayed, asking the wearer to re-enter the password operation.

[0068] The entire QR code scanning and payment process only requires the use of a near-eye display device, without the need for other hardware and without incurring any additional costs.

[0069] In some embodiments, as Figure 8 As shown, step S103 may include sub-steps S1031 to S1033.

[0070] S1031, performing gesture recognition on the password input operation to determine a second target key point on the wearer's hand, and recording coordinate information of the second target key point in chronological order to obtain a coordinate information sequence set;

[0071] S1032. Determine target coordinate information of the second target key point according to the coordinate information sequence set;

[0072] S1033. Determine the password input by the wearer according to the password area corresponding to the target coordinate information.

[0073] Still taking the index fingertip as the second target key point as an example, when the wearer uses the index finger to enter the password, the index fingertip will move and the corresponding coordinate information will also change. By performing gesture recognition on the wearer's password input operation, the coordinate information of the index fingertip based on time sequence is obtained, and the various coordinate information of the index fingertip is recorded in time sequence to obtain a coordinate information sequence set.

[0074] The coordinate information sequence includes a series of coordinate information of the index fingertip during its movement, from which the coordinate information corresponding to the position of the index fingertip when entering the password is determined as the target coordinate information. The password area corresponding to the target coordinate information is the password entered by the wearer. For example, assuming that the target coordinate information corresponds to the position in Figure 7 If the password entered by the wearer is in the box area corresponding to the number 1, it is determined that the password entered by the wearer is the number 1.

[0075] In some embodiments, recording the coordinate information of the second target key point in chronological order to obtain a coordinate information sequence set includes:

[0076] Using a queue to record the coordinate information of the second target key point, after the number of coordinate information in the queue reaches a preset threshold, recording the most recently obtained coordinate information of the second target key point at the end of the queue and deleting the coordinate information at the head of the queue;

[0077] The determining the target coordinate information of the second target key point according to the coordinate information sequence set includes:

[0078] Determining whether the coordinate information of the second target key point recorded in the queue meets a preset condition;

[0079] If the preset condition is met, the target coordinate information is determined according to the coordinate information of the second target key point recorded in the queue.

[0080] For example, assume that the preset threshold is n, for example, n is 7. It should be noted that the specific value of n can be flexibly set according to actual conditions and is not specifically limited in this application. Set the queue length to be n at most, and use the queue to record the coordinate information of the second target key point in chronological order. When the queue length reaches the maximum, that is, the number of coordinate information recorded in the queue reaches n, each time the coordinate information of the second target key point is newly obtained, the coordinate information at the head of the queue is deleted, that is, the coordinate information recorded the longest in the queue is deleted, and the coordinate information of the most recently obtained second target key point is recorded at the end of the queue. Based on the coordinate information of the n second target key points recorded in the queue, the changes in the position of the second target key point in the recent time are reflected, and it is judged whether the user has currently performed a password input operation, thereby ensuring the accuracy of the password input operation judgment.

[0081] According to the coordinate information of the second target key point recorded in the queue and the preset conditions for judging whether the user has clicked to enter the password operation, it is judged whether the coordinate information of the second target key point meets the preset conditions. If the preset conditions are met, it means that the user has performed the password input operation, and the target coordinate information is determined from the coordinate information of the second target key point recorded in the queue.

[0082] In some embodiments, satisfying the preset condition includes:

[0083] The absolute depth of each coordinate information in the queue reaches a preset depth range; or

[0084] The relative depths corresponding to the first preset number of coordinate information in the queue are greater than or equal to a first preset depth value, and the relative depths corresponding to the other coordinate information in the queue are less than or equal to a second preset depth value.

[0085] One way is to set the preset condition based on absolute depth. The preset depth range can be determined as [reference_depth - depth_range, reference_depth + depth_range] based on the password input interface depth reference_depth and the preset depth change threshold depth_range. For example, if reference_depth is 30cm and depth_range is 0.5cm, the preset depth range can be determined as [29.5cm, 30.5cm].

[0086] In the queue, if the absolute depth of the coordinate information of the second target key point reaches the preset depth range, the preset condition is met. For example, if the absolute depth of the coordinate information of the second target key point in the queue changes from small to large, the minimum absolute depth reaches reference_depth-depth_range, and the maximum absolute depth reaches reference_depth+depth_range, such as increasing from 29.5cm to 30.5cm, then it is determined that the preset condition is met. Otherwise, if the preset condition is not met, the coordinate information of the second target key point continues to be recorded through the queue to perform the operation of determining whether the preset condition is met.

[0087] In the method of determining whether the preset condition is met based on absolute depth, if the preset condition is determined to be met, the coordinate information recorded at the end of the queue, that is, the most recently obtained coordinate information of the second target key point, is determined as the target coordinate information.

[0088] Another way is to set the preset conditions based on relative depth, pre-setting the first preset depth value, the second preset depth value, and the preset number. For example, the first preset depth value is 3 cm, the second preset depth value is 0.5 cm, and the preset number is 5. It should be noted that the first preset depth value, the second preset depth value, and the preset number can be flexibly set according to actual conditions, and no specific restrictions are made in this application.

[0089] In the queue, if the relative depths corresponding to the first preset number of coordinates in the queue, such as the first five coordinates in the queue, are greater than or equal to the first preset depth value, for example, the depth increases by 3 cm, the coordinate information changes simulated by the wearer clicking to enter the password. If satisfied, the next step is determined; otherwise, the coordinate information of the second target key point is recorded through the queue, and the relative depths corresponding to the first preset number of coordinates in the queue are determined to be greater than or equal to the first preset depth value.

[0090] After clicking, the wearer will generally remain still for a period of time or retract his hand. If the relative depth corresponding to the preset number of coordinate information arranged in front of the queue is greater than or equal to the first preset depth value, continue to judge whether the relative depth corresponding to other coordinate information in the queue is less than or equal to the second preset depth value. If the relative depth corresponding to other coordinate information in the queue is less than or equal to the second preset depth value, for example, the maximum queue length is 7, the depth corresponding to the first 5 coordinate information in the queue increases by 3cm, and the depth corresponding to the last 2 coordinate information in the queue increases by 0.2cm, that is, less than 0.5cm, simulating the change of coordinate information after the wearer clicks to enter the password and does not move his hand or retracts his hand. At this time, it is judged that the preset conditions are met; otherwise, if the preset conditions are not met, the coordinate information of the second target key point continues to be recorded through the queue, and the operation of judging whether the relative depth corresponding to the preset number of coordinate information arranged in front of the queue is greater than or equal to the first preset depth value is executed.

[0091] In the method of determining whether the preset condition is met based on relative depth, if the preset condition is determined to be met, the last coordinate information in the first preset number of coordinate information in the queue, such as the fifth coordinate information in the queue, is determined as the target coordinate information.

[0092] In some embodiments, before determining the password input by the wearer based on the password area corresponding to the target coordinate information, the method includes:

[0093] Determining whether the position corresponding to the target coordinate information is within the password area;

[0094] The determining the password input by the wearer according to the password area corresponding to the target coordinate information includes:

[0095] If the position corresponding to the target coordinate information is located within the password area, the password corresponding to the password area is determined as the password input by the wearer.

[0096] For example, to determine the target coordinate information corresponding to the position Figure 7 Which digital password is in the box area corresponding to the box? If it is in the box area corresponding to a certain digital password, it is equivalent to the wearer entering the digital password corresponding to this box area. For example, if it falls in the box area corresponding to the number 1, it is determined that the password entered by the wearer is the number 1.

[0097] In some embodiments, after determining whether the position corresponding to the target coordinate information is within the password area, the method further includes:

[0098] If the position corresponding to the target coordinate information is within the password area, clearing the queue;

[0099] If the position corresponding to the target coordinate information is outside the password area, the process returns to executing the step of using a queue to record the coordinate information of the second target key point.

[0100] When the position corresponding to the target coordinate information is within the password area, the queue is cleared, thereby avoiding repeated determination of the same password, thereby improving the accuracy of the password.

[0101] When the position corresponding to the target coordinate information is outside the password area, that is, the position corresponding to the target coordinate information does not fall within the password area corresponding to any password, at this time, continue to record the coordinate information of the second target key point through the queue, and execute the operation of judging whether the coordinate information of the second target key point recorded in the queue meets the preset conditions. Please refer to the above for details and will not repeat them here.

[0102] In the above embodiment, the payment code is scanned by the camera device of the near-eye display device. After the scanning is completed, the password input interface is displayed based on the near-eye display device. The password input interface is visible only to the wearer of the near-eye display device. The wearer performs a password input operation based on the password input interface, performs gesture recognition, determines the password entered by the wearer, and completes the scan code payment when the password is correct. Compared with the method of using a smartphone to scan code payment, it saves a series of operations such as taking out the smartphone, unlocking the smartphone, and opening the relevant payment software, saving time and being more efficient. Moreover, since the password input interface is only visible to the wearer of the near-eye display device, only the wearer can see the password he or she enters during the process, and it is invisible to others. Therefore, the risk of password leakage is reduced and the security of scan code payment is improved.

[0103] See also Figure 9 , Figure 9This is a schematic block diagram of a payment device provided in an embodiment of the present application. The payment device can be configured in a near-eye display device to execute the aforementioned payment method based on the near-eye display device.

[0104] like Figure 9 As shown, the payment device 200 may include a processor 210 and a memory 220, wherein the processor 210 and the memory 220 are connected via a bus, such as an I2C (Inter-integrated Circuit) bus.

[0105] Specifically, the processor 210 may be a micro-controller unit (MCU), a central processing unit (CPU), or a digital signal processor (DSP).

[0106] Specifically, the memory 220 may be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB flash drive, or a mobile hard disk, etc. The memory 220 stores various computer programs for execution by the processor 210 .

[0107] The processor 210 is configured to run a computer program stored in the memory and implement the following steps when executing the computer program:

[0108] Scan the payment code using the camera of the near-eye display device;

[0109] After the scanning is completed, a password input interface is displayed based on the near-eye display device;

[0110] Gesture recognition is performed on the password input operation performed by the wearer based on the password input interface to determine the password input by the wearer, so as to complete the scan code payment when the password is correct.

[0111] In some embodiments, the near-eye display device includes multiple code scanning modes. When implementing the scanning of the payment code by the camera device of the near-eye display device, the processor 210 is configured to implement:

[0112] Displaying a code scanning box on the code scanning interface of the near-eye display device according to the current code scanning mode of the near-eye display device, wherein different code scanning modes correspond to different display modes of the code scanning box;

[0113] When the code scanning frame is aligned with the payment code, the payment code is scanned by the camera device.

[0114] In some embodiments, the code scanning mode includes a first mode and a second mode. When the processor 210 displays a code scanning box on the code scanning interface of the near-eye display device according to the current code scanning mode of the near-eye display device, it is configured to implement:

[0115] If the current code scanning mode is the first mode, displaying the code scanning box on the code scanning interface according to the preset code scanning box information;

[0116] If the current scanning mode is the second mode, the scanning box information corresponding to the second mode is obtained according to the scanning box setting operation performed by the wearer based on the scanning interface, and the scanning box is displayed on the scanning interface according to the scanning box information corresponding to the second mode.

[0117] In some embodiments, the scanning frame information corresponding to the second mode includes coordinate information of vertices of the scanning frame. When the processor 210 obtains the scanning frame information corresponding to the second mode according to the scanning frame setting operation performed by the wearer based on the scanning interface, it is configured to implement:

[0118] Performing gesture recognition on the code scanning frame setting operation to determine a first target key point on the wearer's hand;

[0119] Based on the first target key point, multiple vertices of the code scanning frame are determined, and coordinate information of each vertex is obtained.

[0120] In some embodiments, when performing gesture recognition on the password input operation performed by the wearer based on the password input interface to determine the password input by the wearer, the processor 210 is configured to implement:

[0121] Performing gesture recognition on the password input operation to determine a second target key point on the wearer's hand, and recording coordinate information of the second target key point in chronological order to obtain a coordinate information sequence set;

[0122] Determining target coordinate information of the second target key point according to the coordinate information sequence set;

[0123] The password input by the wearer is determined according to the password area corresponding to the target coordinate information.

[0124] In some embodiments, when recording the coordinate information of the second target key point in chronological order to obtain a coordinate information sequence set, the processor 210 is configured to implement:

[0125] Using a queue to record the coordinate information of the second target key point, after the number of coordinate information in the queue reaches a preset threshold, recording the most recently obtained coordinate information of the second target key point at the end of the queue and deleting the coordinate information at the head of the queue;

[0126] When determining the target coordinate information of the second target key point according to the coordinate information sequence set, the processor 210 is configured to implement:

[0127] Determining whether the coordinate information of the second target key point recorded in the queue meets a preset condition;

[0128] If the preset condition is met, the target coordinate information is determined according to the coordinate information of the second target key point recorded in the queue.

[0129] In some embodiments, satisfying the preset condition includes:

[0130] The absolute depth of each coordinate information in the queue reaches a preset depth range; or

[0131] The relative depths corresponding to the first preset number of coordinate information in the queue are greater than or equal to a first preset depth value, and the relative depths corresponding to the other coordinate information in the queue are less than or equal to a second preset depth value.

[0132] In some embodiments, before determining the password input by the wearer based on the password area corresponding to the target coordinate information, the processor 210 is configured to:

[0133] Determining whether the position corresponding to the target coordinate information is within the password area;

[0134] When determining the password input by the wearer based on the password area corresponding to the target coordinate information, the processor 210 is configured to implement:

[0135] If the position corresponding to the target coordinate information is located within the password area, the password corresponding to the password area is determined as the password input by the wearer.

[0136] In some embodiments, after determining whether the position corresponding to the target coordinate information is within the password area, the processor 210 is configured to:

[0137] If the position corresponding to the target coordinate information is within the password area, clearing the queue;

[0138] If the position corresponding to the target coordinate information is outside the password area, the process returns to executing the step of using a queue to record the coordinate information of the second target key point.

[0139] The payment device 200 can execute the payment method based on the near-eye display device provided in the embodiment of the present application. Therefore, it can achieve the beneficial effects that can be achieved by the payment method based on the near-eye display device provided in the embodiment of the present application. Please refer to the previous embodiment for details and will not be repeated here.

[0140] In an embodiment of the present application, a near-eye display device is further provided. The near-eye display device includes a payment device. The payment device can be Figure 9 Therefore, the near-eye display device can achieve the beneficial effects that can be achieved by the payment method based on the near-eye display device provided in the embodiment of the present application. Please refer to the previous embodiment for details and will not be repeated here.

[0141] An embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the payment method based on the near-eye display device as described above are implemented.

[0142] The computer-readable storage medium may be an internal storage unit of the payment device or near-eye display device described in the aforementioned embodiment, such as a hard disk or memory of the payment device or near-eye display device. The computer-readable storage medium may also be an external storage device of the payment device or near-eye display device, such as a plug-in hard disk, a smart memory card (SMC), a secure digital card (SD card), a flash memory card, etc., equipped on the payment device or near-eye display device.

[0143] Since the computer program stored in the storage medium can execute any of the payment methods based on the near-eye display device provided in the embodiments of the present application, the beneficial effects that can be achieved by any of the payment methods based on the near-eye display device provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0144] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or system comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or system. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or system comprising the element.

[0145] The above description is only a specific implementation method of the present application, but the scope of protection of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the scope of protection of the present application.

Claims

1. A payment method based on a near-eye display device, characterized in that: The payment method based on the near-eye display device includes: Scan the payment code using the camera of the near-eye display device; After the scanning is completed, a password input interface is displayed based on the near-eye display device; Performing gesture recognition on the password input operation performed by the wearer based on the password input interface to determine the password input by the wearer, so as to complete the scan code payment when the password is correct; The performing gesture recognition on the password input operation performed by the wearer based on the password input interface to determine the password input by the wearer includes: Performing gesture recognition on the password input operation to determine a second target key point on the wearer's hand, and recording coordinate information of the second target key point in a queue. When the number of coordinate information in the queue reaches a preset threshold, recording the most recently obtained coordinate information of the second target key point at the end of the queue and deleting the coordinate information at the head of the queue; Determining whether the coordinate information of the second target key point recorded in the queue meets a preset condition; If the preset condition is met, determining the target coordinate information of the second target key point according to the coordinate information of the second target key point recorded in the queue; Determining the password input by the wearer according to the password area corresponding to the target coordinate information; Meeting the preset conditions includes: The absolute depth of each coordinate information in the queue reaches a preset depth range; or The relative depths corresponding to the first preset number of coordinate information in the queue are greater than or equal to a first preset depth value, and the relative depths corresponding to the other coordinate information in the queue are less than or equal to a second preset depth value.

2. The payment method based on the near-eye display device according to claim 1, characterized in that: The near-eye display device includes multiple code scanning modes, and scanning the payment code by the camera device of the near-eye display device includes: Displaying a code scanning box on the code scanning interface of the near-eye display device according to the current code scanning mode of the near-eye display device, wherein different code scanning modes correspond to different display modes of the code scanning box; When the code scanning frame is aligned with the payment code, the payment code is scanned by the camera device.

3. The payment method based on the near-eye display device according to claim 2, characterized in that: The code scanning mode includes a first mode and a second mode, and displaying a code scanning box on the code scanning interface of the near-eye display device according to the current code scanning mode of the near-eye display device includes: If the current code scanning mode is the first mode, displaying the code scanning box on the code scanning interface according to the preset code scanning box information; If the current scanning mode is the second mode, the scanning box information corresponding to the second mode is obtained according to the scanning box setting operation performed by the wearer based on the scanning interface, and the scanning box is displayed on the scanning interface according to the scanning box information corresponding to the second mode.

4. The payment method based on the near-eye display device according to claim 3, characterized in that: The scanning frame information corresponding to the second mode includes coordinate information of vertices of the scanning frame, and obtaining the scanning frame information corresponding to the second mode according to the scanning frame setting operation performed by the wearer based on the scanning interface includes: Performing gesture recognition on the code scanning frame setting operation to determine a first target key point on the wearer's hand; Based on the first target key point, multiple vertices of the code scanning frame are determined, and coordinate information of each vertex is obtained.

5. The payment method based on the near-eye display device according to claim 1, characterized in that: Before determining the password input by the wearer based on the password area corresponding to the target coordinate information, the method includes: Determining whether the position corresponding to the target coordinate information is within the password area; The determining the password input by the wearer according to the password area corresponding to the target coordinate information includes: If the position corresponding to the target coordinate information is located within the password area, the password corresponding to the password area is determined as the password input by the wearer.

6. The payment method based on the near-eye display device according to claim 5, characterized in that: After determining whether the position corresponding to the target coordinate information is within the password area, the method further includes: If the position corresponding to the target coordinate information is within the password area, clearing the queue; If the position corresponding to the target coordinate information is outside the password area, the process returns to executing the step of using a queue to record the coordinate information of the second target key point.

7. A payment device, characterized in that: The payment device includes a memory and a processor; The memory is used to store computer programs; The processor is configured to execute the computer program and implement the steps of the payment method based on a near-eye display device according to any one of claims 1 to 6 when executing the computer program.

8. A near-eye display device, characterized in that: The near-eye display device includes the payment apparatus according to claim 7.

9. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the payment method based on the near-eye display device according to any one of claims 1 to 6 are implemented.

Images