Smart glasses and image processing method thereof

Abstract

The application provides a kind of smart glasses and its image processing method, applied to smart glasses, the smart glasses include camera;It includes: obtaining first image by the camera, the first image includes two-dimensional code area image;Extract the two-dimensional code area image and the periphery area image of the two-dimensional code area image by the first image;Characteristic extraction is carried out to the periphery area image, and first feature is obtained;According to the first feature, the first application identifier corresponding to the two-dimensional code area image is identified;Start the first two-dimensional code scanning function corresponding to the first application identifier, identify the two-dimensional code area image to enter corresponding payment page;Obtain payment amount;According to the payment amount, complete payment operation in the payment page.Using the embodiment of the application can improve payment efficiency and payment convenience.

Description

Technical Field

[0001] This invention relates to the field of wearable device technology, and more particularly to smart glasses and their image processing methods. Background Technology

[0002] With the rapid development of electronic technology, electronic products have become essential in people's lives. Currently, when making payments, users often need to take out their mobile phones, scan a QR code, and enter the corresponding amount. This process is quite cumbersome, and how to solve the inconvenience caused by the cumbersome payment process is a direction worth exploring. Summary of the Invention

[0003] This invention provides smart glasses and an image processing method thereof. When payment is required, the smart glasses can identify QR codes in the environment through a camera, first locate the QR code and its surroundings, then use the surroundings to identify the corresponding application of the QR code, and finally scan the QR code to enter the payment page and complete the payment function on the payment page. The entire process does not require manual operation by the user, but the payment function is completed directly through the smart glasses, thus improving the efficiency of payment operations.

[0004] In a first aspect, the present invention provides an image processing method applied to smart glasses, the smart glasses including a camera; comprising:

[0005] A first image is acquired through the camera, and the first image includes a QR code area image;

[0006] The QR code region image and the surrounding region image of the QR code region image are extracted from the first image;

[0007] Feature extraction is performed on the surrounding area image to obtain the first feature;

[0008] Based on the first feature, identify the first application identifier corresponding to the QR code area image;

[0009] Activate the first QR code scanning function corresponding to the first application identifier, and recognize the QR code area image to enter the corresponding payment page;

[0010] Get the payment amount;

[0011] Complete the payment on the payment page according to the stated payment amount.

[0012] In a second aspect, the present invention provides smart glasses, the smart glasses including a camera; the smart glasses include:

[0013] The acquisition unit is configured to acquire a first image through the camera, the first image including a QR code area image;

[0014] An extraction unit is configured to extract the QR code region image and the surrounding region image of the QR code region image from the first image; and to perform feature extraction on the surrounding region image to obtain a first feature;

[0015] The identification unit is configured to identify the first application identifier corresponding to the QR code area image based on the first feature; activate the first QR code scanning function corresponding to the first application identifier, and identify the QR code area image to enter the corresponding payment page;

[0016] The payment unit is used to obtain the payment amount and complete the payment operation on the payment page according to the payment amount.

[0017] This invention is applied to smart glasses, which include a camera. First, the camera acquires a first image, which includes a QR code area image. The QR code area image and its surrounding area image are extracted from the first image. Features are then extracted from the surrounding area image to obtain a first feature. Based on the first feature, a first application identifier corresponding to the QR code area image is identified. Then, a first QR code scanning function corresponding to the first application identifier is activated to scan the QR code area image and access the corresponding payment page. Finally, the payment amount is obtained, and the payment operation is completed on the payment page based on the payment amount. Thus, when payment is required, the camera identifies a QR code in the environment, first locating the QR code and its surroundings, then using the surroundings to identify the corresponding application, and finally scanning the QR code to access the payment page and complete the payment. The entire process requires no manual operation from the user; the payment is completed directly through the smart glasses, improving payment efficiency. Attached Figure Description

[0018] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the following description of the embodiments will be briefly introduced. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1a This is a first system architecture diagram of an image processing system provided in an embodiment of the present invention;

[0020] Figure 1b This is a second system architecture diagram of an image processing system provided in an embodiment of the present invention;

[0021] Figure 1c This is a first structural schematic diagram of a smart glasses provided in an embodiment of the present invention;

[0022] Figure 1dThis is a schematic diagram of the second structure of a smart glasses provided in an embodiment of the present invention;

[0023] Figure 1e This is a schematic diagram of a first application scenario of an image processing method provided in an embodiment of the present invention;

[0024] Figure 2a This is a flowchart illustrating an image processing method provided in an embodiment of the present invention;

[0025] Figure 2b This is a schematic diagram of a second application scenario of an image processing method provided in an embodiment of the present invention;

[0026] Figure 2c This is a schematic diagram of a third application scenario of an image processing method provided in an embodiment of the present invention;

[0027] Figure 3 This is a block diagram of the functional units of a smart glasses provided in an embodiment of the present invention. Detailed Implementation

[0028] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0029] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this invention are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.

[0030] It should be understood that the term "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Additionally, the character " / " in this document indicates that the preceding and following related objects are in an "or" relationship. In the embodiments of this invention, "multiple" refers to two or more.

[0031] In this invention, "at least one item" or similar expressions refer to any combination of these items, including any combination of a single item or multiple items. "One or more" means one or more, while "multiple" means two or more. For example, "at least one item" of a, b, or c can represent the following seven cases: a, b, c, a and b, a and c, b and c, a, b, and c. Each of a, b, and c can be an element or a set containing one or more elements.

[0032] In the embodiments of this invention, "connection" refers to various connection methods such as direct connection or indirect connection to achieve communication between devices. The embodiments of this invention do not impose any limitations on this.

[0033] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of the invention. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0034] like Figure 1a As shown, Figure 1a This is a system architecture diagram of an image processing system provided in an embodiment of the present invention. The image processing system includes smart glasses and a server, and the smart glasses and the server are connected in communication.

[0035] During the payment process, the smart glasses can interact with the server to perform the corresponding payment functions.

[0036] Furthermore, such as Figure 1b As shown, the image processing system includes smart glasses, a server, and a merchant device, with communication connections between the smart glasses, the server, and the merchant device.

[0037] Merchant equipment may include at least one of the following: barcode scanners, payment devices (self-service checkout devices, smart cash registers), POS machines, etc., without limitation.

[0038] During the payment process, the smart glasses can interact with the server to perform corresponding payment functions. The smart glasses can also synchronize with the merchant's device to quickly obtain the corresponding payment amount and payment details.

[0039] Among them, such as Figure 1cAs shown, smart glasses may include a camera, a voice recognition module, and sensors. The camera can perform shooting functions, the voice recognition module can be used to perform voice acquisition and voice playback functions, and the sensors may include at least one of the following: temperature sensor, humidity sensor, distance sensor, ultrasonic sensor, atmospheric pressure sensor, positioning sensor, etc., without limitation.

[0040] The following is combined Figure 1d The smart glasses in the embodiments of the present invention will be described below. Figure 1d This is a structural schematic diagram of a smart glasses provided in an embodiment of the present invention, as shown below. Figure 1d As shown, the smart glasses include one or more processors, a memory, a communication interface, and one or more programs. The processor is connected to the memory and the communication interface via an internal communication bus.

[0041] The one or more programs are stored in the aforementioned memory and configured to be executed by the aforementioned processor, and the one or more programs include instructions for performing any step in the above method embodiments.

[0042] The processor can be a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute the various exemplary logic blocks, cells, and circuits described in conjunction with the disclosure of this invention. The processor can also be a combination that implements computational functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc. The communication unit can be a communication interface, transceiver, transceiver circuitry, etc., and the storage unit can be a memory.

[0043] The memory can be volatile or non-volatile, or a combination of both. Non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), used as an external cache. By way of example, but not limitation, many forms of random access memory (RAM) are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate synchronous DRAM (DDR SDRAM), enhanced synchronous DRAM (ESDRAM), synchronous linked DRAM (SLDRAM), and direct rambus RAM (DR RAM).

[0044] It is understood that smart glasses may include more or fewer structural components than those shown in the block diagram above, such as a Wi-Fi module, power module, physical buttons, speaker, Bluetooth module, and display module, etc., without limitation here. It is understood that the smart glasses may be equipped with... Figure 1a or Figure 1b The system architecture described above.

[0045] The smart glasses may also include a wireless charging module or a solar charging module, so that they can be charged using wireless charging or absorb solar energy anytime and anywhere to replenish energy and improve the battery life of the smart glasses.

[0046] Based on the aforementioned smart glasses, firstly, a first image is acquired through the camera. This first image includes a QR code area image. The QR code area image and its surrounding area image are then extracted from the first image. Feature extraction is performed on the surrounding area image to obtain a first feature. Based on the first feature, a first application identifier corresponding to the QR code area image is identified. Then, the first QR code scanning function corresponding to the first application identifier is activated to scan the QR code area image and enter the corresponding payment page. Finally, the payment amount is obtained, and the payment operation is completed on the payment page based on the payment amount. In this way, when payment is required, the camera can identify QR codes in the environment, first locate the QR code and its surroundings, first use the surroundings to identify the corresponding application of the QR code, then scan the QR code to enter the payment page, and complete the payment function on the payment page. The entire process does not require manual operation by the user; instead, the payment function is completed directly through the smart glasses, improving the efficiency of payment operations.

[0047] Please see Figure 1e , Figure 1e This is a schematic diagram of a first application scenario of an image processing method provided by an embodiment of the present invention. In this embodiment, the camera of the smart glasses can capture a QR code to obtain a first image, wherein the first image may include the image corresponding to the QR code.

[0048] Next, combined Figure 2a An image processing method according to an embodiment of the present invention will be described. Figure 2a This is a flowchart illustrating an image processing method provided by an embodiment of the present invention, applied to smart glasses, wherein the smart glasses include a camera; specifically, it includes the following steps:

[0049] S201: Acquire a first image through the camera, the first image including a QR code area image.

[0050] The QR code corresponding to the QR code area image can be a dynamic QR code or a static QR code.

[0051] In practice, the camera of the smart glasses can be used to capture the QR code to obtain the first image, for example, as shown below. Figure 2b As shown, the first image may include a QR code area image, which can be understood as an image of only the area where the QR code is located.

[0052] In a specific implementation, a preview image can be captured by a camera, and it can be identified whether the preview image contains a QR code. If the preview image contains a QR code, the distance between the smart glasses and the QR code is determined to obtain a first distance. According to the preset mapping relationship between distance and shooting parameters, the first shooting parameters corresponding to the first distance are determined. The QR code is then captured based on the first shooting parameters to obtain a first image.

[0053] Among the shooting parameters, focal length can be included, which can ensure that the QR code occupies a moderate proportion of the screen, thus helping to ensure the accuracy of subsequent image segmentation.

[0054] S202: Extract the QR code area image and the surrounding area image of the QR code area image from the first image.

[0055] The surrounding area of ​​the QR code image represents the relevant information of the QR code. This relevant information may include at least one of the following: the username corresponding to the QR code, the application identifier corresponding to the QR code, the application name corresponding to the QR code, etc., without limitation. For example, Figure 2c As shown, the first image may include a QR code area image and a surrounding area image of the QR code area image. The QR code area image can be understood as an image of only the area where the QR code is located. The surrounding area image of the QR code area image is used to represent the relevant information of the QR code, such as "WeChat" or "Alipay", or for example, color (such as green or blue).

[0056] In a specific implementation, the image of the area where the QR code is located (the area covered by the QR code) can be extracted from the first image to obtain the QR code area image. Since the surrounding area image of the QR code area image is around the QR code, the surrounding area image of the QR code area image can be locked using the QR code area image.

[0057] S203: Extract features from the surrounding area image to obtain the first feature.

[0058] The first feature may include at least one of the following: color, keyword, icon, pattern, feature point, feature vector, feature texture, etc., without limitation.

[0059] In a specific implementation, at least one feature extraction algorithm can be used to extract features from the surrounding area image to obtain the first feature. For example, the feature extraction algorithm may include at least one of the following: neural network algorithm, contour extraction algorithm, feature point extraction algorithm, image segmentation algorithm, color extraction algorithm, etc., which are not limited here.

[0060] S204: Identify the first application identifier corresponding to the QR code area image based on the first feature.

[0061] The first application identifier is used to uniquely identify a particular application.

[0062] In practice, since the first feature contains relevant information representing the application (e.g., application name, color, icon, etc.), the first application identifier corresponding to the QR code area image can be quickly located based on this relevant information.

[0063] In the specific implementation, when the first feature recognition fails, the QR code scanning function of at least one application is activated, and the QR code area image is recognized based on this QR code scanning function. If the recognition is successful by an application, the user is directed to the corresponding payment page. That is, if the surrounding feature recognition fails, the QR code scanning function of at least one application is directly activated simultaneously for QR code verification. If the verification is successful, the user is directed to the payment page. This ensures payment efficiency. The at least one application must be an application with scanning payment functionality. The at least one application can be preset or set as the system default.

[0064] S205: Activate the first QR code scanning function corresponding to the first application identifier, and recognize the QR code area image to enter the corresponding payment page.

[0065] In a specific implementation, the first QR code scanning function corresponding to the first application identifier can be activated. This first QR code scanning function can directly recognize the QR code area image, and then recognize the QR code area image to enter the corresponding payment page.

[0066] The smart glasses may include a built-in projector that can project the content to be displayed onto the lenses; for example, this method can be used to display a payment page.

[0067] In practice, after obtaining the QR code area image, there is no need to search for the QR code using the first QR code scanning function. Instead, the QR code area image can be directly used for recognition, and the user can be taken to the corresponding payment page.

[0068] S206: Obtain the payment amount and complete the payment operation on the payment page according to the payment amount.

[0069] The payment amount can be entered automatically. When a dynamic QR code is used, it will be linked to the payment amount after being recognized, allowing users to directly enter the amount. Alternatively, the payment amount can be entered by voice. For example, users can enter the payment amount by voice and then complete the payment on the payment page. This payment can be a password-free payment or a payment completed after identity verification.

[0070] The image processing method in this embodiment is applied to smart glasses, which include a camera. First, a first image is acquired through the camera. The first image includes a QR code area image. The QR code area image and its surrounding area image are extracted from the first image. Then, feature extraction is performed on the surrounding area image to obtain a first feature. Based on the first feature, a first application identifier corresponding to the QR code area image is identified. Then, the first QR code scanning function corresponding to the first application identifier is activated to identify the QR code area image and enter the corresponding payment page. Finally, the payment amount is obtained, and the payment operation is completed on the payment page based on the payment amount. In this way, when payment is required, the camera can identify QR codes in the environment, first locate the QR code and its surroundings, first use the surroundings to identify the corresponding application of the QR code, then scan the QR code to enter the payment page, and complete the payment function on the payment page. The entire process does not require manual operation by the user, but the payment function is completed directly through the smart glasses, improving the efficiency of payment operations.

[0071] In some possible implementations, the smart glasses further include a voice recognition module and may also include the following steps:

[0072] The first voice is obtained through the speech recognition module;

[0073] The first speech is converted into text to obtain the first text;

[0074] Keyword extraction is performed on the first text to obtain the first keyword;

[0075] When the first keyword includes the first preset keyword, the step of acquiring the first image through the camera is executed.

[0076] The first preset keyword can be set in advance or be the system default. The first preset keyword can include one or more keywords. The first preset keyword is used to represent payment-related keywords, such as money, yuan, payment, etc.

[0077] Specifically, the first speech can be obtained through a speech recognition module, and the first speech can be converted into text to obtain the first text. Then, the first text is extracted to obtain the first keyword. When the first keyword includes the first preset keyword, it indicates that a payment operation is required, and the payment operation process can be triggered to execute the step of obtaining the first image through the camera.

[0078] In some possible implementations, the smart glasses further include sensors and may also include the following steps:

[0079] User characteristics are collected through the aforementioned sensors;

[0080] The user characteristics are compared with preset characteristics;

[0081] When the user characteristics are successfully compared with the preset characteristics, the step of acquiring the first image through the camera is executed.

[0082] The preset features can be pre-set or system defaults. For example, preset features may include at least one of the following: action features (blinking, nodding, etc.), gesture features, physiological features, facial features, etc., without limitation.

[0083] Among them, the sensor can be used to collect features of the same type as the preset features. For example, the sensor can be a camera, an ultrasonic sensor, etc.

[0084] In practice, user features can be collected by sensors and then compared with preset features. When the user features match the preset features successfully, the step of acquiring the first image through the camera is executed, which can trigger the payment function. Conversely, when the user features fail to match the preset features, the step of acquiring the first image through the camera is not executed. In this way, the power consumption of smart glasses can be reduced and payment operations can be avoided.

[0085] In some possible implementations, when the first keyword includes multiple keywords, obtaining the payment amount includes:

[0086] When a second keyword is included among the plurality of keywords, the payment amount is determined based on the second keyword, wherein the second keyword is a keyword related to the amount.

[0087] The second keyword is a keyword related to the amount. For example, if you receive a message from a merchant such as "a total of 5 yuan", then the second keyword would be "5 yuan".

[0088] In practice, when a second keyword is included among multiple keywords, the payment amount can be determined based on the second keyword. Then, after entering the payment page, the payment amount can be quickly entered, avoiding manual input of the payment amount and improving payment efficiency and convenience.

[0089] In some possible specific embodiments, step S202 above: extracting the QR code region image and the surrounding region image of the QR code region image from the first image, can be implemented in the following manner:

[0090] The first image is used to locate the QR code, thus obtaining the QR code area;

[0091] A first image segmentation is performed based on the QR code region to obtain the QR code region image;

[0092] Extract the outline of the QR code area;

[0093] The QR code size is determined based on the outline;

[0094] The perimeter dimensions of the QR code area image are determined based on the QR code size;

[0095] The position of the outline of the surrounding area of ​​the QR code area image is determined based on the surrounding dimensions and the outline.

[0096] The first image is segmented using the contour position and the contour of the surrounding region to obtain the image of the surrounding region.

[0097] In practical implementation, since QR code markings are very obvious, during image recognition, the QR code can be located in the first image to obtain the QR code region. Then, the first image is segmented based on the QR code region to obtain the QR code region image, which only includes the area covered by the QR code. The contour of the QR code region is then extracted, and the QR code size can be determined based on the contour. The QR code size can include the length and width of the QR code. Typically, the QR code size and the surrounding dimensions of the QR code region image satisfy a certain proportional relationship. Therefore, the surrounding dimensions of the QR code region image can be determined based on this proportional relationship and the QR code size. Then, the position of the surrounding region contour of the QR code region image is determined based on the surrounding dimensions and the contour. Finally, the first image is segmented based on the position and contour of the surrounding region to obtain the surrounding region image. In this way, the first image can be accurately segmented, obtaining not only the QR code region image but also its related surrounding region images, facilitating the rapid launch of related applications and improving payment efficiency.

[0098] In some possible implementation embodiments, at least one application is pre-installed in the smart glasses, and each application corresponds to a set of peripheral features of a QR code; the step of identifying the first application identifier corresponding to the QR code region image based on the first feature includes:

[0099] The first feature is matched with the surrounding feature set of the QR code of the at least one application to obtain at least one matching value;

[0100] Select the maximum value among the at least one matching value, and use the application identifier corresponding to the application corresponding to the maximum value as the first application identifier.

[0101] The smart glasses are pre-installed with at least one application, and each application corresponds to a set of peripheral features of a QR code. Each set of peripheral features may include at least one feature, which may include at least one of the following: color, keyword, icon, pattern, feature point, feature vector, feature texture, etc., without limitation.

[0102] In a specific implementation, the first feature can be matched with the surrounding feature set of at least one application's QR code to obtain at least one matching value. Then, the maximum value among the at least one matching value is selected, and the application identifier corresponding to the application with the maximum value is taken as the first application identifier. In this way, the relevant payment application can be quickly located based on the surrounding features of the QR code, without the user having to search for the relevant application. For example, normally, when a user makes a payment, they need to see the QR code first, select the corresponding application based on the QR code, open the application's QR code scanning function, and then recognize the QR code based on the QR code scanning function. The whole process often takes a lot of time and reduces payment efficiency. However, this application enables smart glasses to quickly locate the relevant application using the surrounding features of the QR code and quickly start its related QR code scanning function.

[0103] Of course, in the process of matching the first feature with the surrounding feature set of at least one application's QR code to obtain at least one matching value, at least one thread or at least one process can be used to synchronously execute the matching of the first feature with the surrounding feature set of at least one application's QR code to obtain at least one matching value. For example, at least one thread can be used to execute the matching of the first feature with the surrounding feature set of at least one application's QR code to obtain at least one matching value, with each thread corresponding to one application and responsible for matching the first feature with the surrounding feature set of that application's QR code. Or, for another example, at least one process can be used to execute the matching of the first feature with the surrounding feature set of at least one application's QR code to obtain at least one matching value, with each process corresponding to one application and responsible for matching the first feature with the surrounding feature set of that application's QR code. In this way, matching efficiency can be guaranteed.

[0104] In some possible implementations, the smart glasses further include a positioning sensor; the step of matching the first feature with the surrounding feature set of the QR code of the at least one application to obtain at least one matching value includes:

[0105] The first position is obtained through the positioning sensor;

[0106] When the first position is a preset position, obtain the surrounding feature set of the QR code of the application corresponding to the preset position;

[0107] The first feature is compared with the surrounding feature set of the application's QR code corresponding to the preset location to obtain the at least one matching value.

[0108] In practice, smart glasses also include a positioning sensor, which can use GPS positioning technology, Beidou positioning technology, or Wi-Fi positioning technology for positioning.

[0109] The preset location can be set in advance or set by system default. The preset location can be understood as a location that the user frequently visits and has made a payment at, or a location that the user has visited before and made a payment at.

[0110] In a specific implementation, a first position can be obtained through a positioning sensor. When the first position is a preset position, the surrounding feature set of the QR code of the application corresponding to the preset position is obtained. The first feature is compared with the surrounding feature set of the QR code of the application corresponding to the preset position to obtain at least one matching value. In this way, QR code surrounding recognition can be quickly performed using historical consumption records, which helps to improve QR code matching efficiency, payment operation efficiency and payment convenience.

[0111] Conversely, if the first position is not a preset position, the first feature is matched with the surrounding feature set of the QR code of each application in at least one application to obtain at least one matching value.

[0112] In some possible implementations, step S205: recognizing the QR code area image to access the corresponding payment page, can be implemented as follows:

[0113] Obtain the reference QR code image corresponding to the first position, and determine the first threshold based on the first position;

[0114] The QR code region image is matched with the reference QR code image to obtain a first matching value;

[0115] When the first matching value is greater than the first threshold, the user is directed to the corresponding payment page based on the reference QR code image.

[0116] The first threshold can be preset or set by system default. In practice, a pre-defined mapping relationship between positions and thresholds can be stored, and the first threshold corresponding to a first position can be determined based on this mapping relationship. Specifically, different positions correspond to different numbers of payment operations. For example, the number of first payment operations corresponding to a first position can be determined, and then, according to the preset mapping relationship between positions and payment operation counts, the number of first payment operations corresponding to the first position can be determined based on this mapping relationship. The larger the number of payment operations, the smaller the first threshold; conversely, the smaller the number of payment operations, the larger the first threshold.

[0117] In specific implementation, the reference QR code image can include one or more QR code images, which can be pre-saved in the smart glasses. Then, the reference QR code image corresponding to the first location can be obtained, and a first threshold is determined based on the first location. The QR code area image is matched with the reference QR code image to obtain a first matching value. When the first matching value is greater than the first threshold, the corresponding payment page is entered based on the reference QR code image. In this way, the previously saved merchant's QR code image can be obtained based on the location, and the first threshold corresponding to the location can be determined. Then, the current QR code area image is matched with the previously saved merchant's QR code image. Since the threshold is reasonably reduced and the payment page is entered based on the previous merchant's QR code image, the efficiency of entering the payment page can be improved. Of course, if the current QR code is damaged to some extent, it will not affect the entry into the corresponding payment page, greatly improving payment efficiency and convenience.

[0118] In some possible implementations, step 206 above: obtaining the payment amount, can be implemented as follows:

[0119] Obtain the second voice;

[0120] Feature extraction is performed on the second speech to obtain the first speech features;

[0121] Authentication is performed based on the first voice feature;

[0122] Upon successful authentication, the payment amount is determined based on the second voice prompt.

[0123] In the specific implementation, after the payment page is displayed, a second voice can be obtained. The second voice can play two roles: first, identity recognition, and second, input of payment amount.

[0124] Specifically, the first speech feature may include at least one of the following: audio, timbre, keywords, strings, voiceprints, etc., without limitation.

[0125] In practice, features can be extracted from the second voice to obtain the features of the first voice. Then, identity verification can be performed based on the first voice features. If the identity verification is successful, it means that the payment is legitimate. The payment amount can then be determined based on the second voice. For example, semantic recognition can be performed on the second voice to obtain the corresponding payment amount. In this way, payment security and efficiency can be guaranteed, and the payment amount can be completed without human input. The payment operation can be completed without contact (the hands do not need to touch the smart glasses).

[0126] In some possible implementations, the following steps may also be included:

[0127] Establish a communication connection between the smart glasses and the merchant's device;

[0128] Receive a payment message sent by the merchant's device; the payment message includes the payment amount and its corresponding payment details;

[0129] Analyze whether the payment details are reasonable;

[0130] If so, perform the payment operation on the payment page according to the payment amount;

[0131] If not, a notification message will be generated to indicate that the consumption was unreasonable.

[0132] In practice, a communication connection can be established between the smart glasses and the merchant's device. This communication connection can be at least one of the following methods: Bluetooth communication connection, mobile communication connection, visible light communication connection, Wi-Fi communication connection, etc., without limitation.

[0133] The payment details include the product name, product model, product price, product barcode, etc.

[0134] Specifically, after establishing a communication connection between the smart glasses and the merchant's device, the system can receive payment messages sent by the merchant's device. These messages include the payment amount and its corresponding payment details. The system can then analyze whether the payment details are reasonable. For example, big data can be used to search for the relevant prices of the products to be paid for based on the payment details, and then the range of those relevant prices can be calculated. If the payment amount falls within that range of relevant prices, then the payment details are considered reasonable.

[0135] Next, if the transaction is successful, the payment will be completed on the payment page based on the amount paid. If not, a notification message will be generated to indicate that the purchase was unreasonable. This allows for timely reminders to users about the rationality of their spending, such as whether they overpaid, overpaid, or purchased genuine products, thus helping them save money and improve their quality of life.

[0136] Furthermore, such as Figure 3 As shown, Figure 3 This is a functional unit block diagram of a smart glasses according to an embodiment of the present invention. The smart glasses include a camera; the smart glasses 300 includes:

[0137] Acquisition unit 301 is used to acquire a first image through the camera, the first image including a QR code area image;

[0138] Extraction unit 302 is used to extract the QR code region image and the surrounding region image of the QR code region image from the first image; and to extract features from the surrounding region image to obtain a first feature;

[0139] The identification unit 303 is used to identify the first application identifier corresponding to the QR code area image based on the first feature; activate the first QR code scanning function corresponding to the first application identifier, and identify the QR code area image to enter the corresponding payment page;

[0140] Payment unit 304 is used to obtain the payment amount and complete the payment operation on the payment page according to the payment amount.

[0141] The smart glasses in this embodiment include a camera. First, the camera acquires a first image, which includes a QR code area image. The QR code area image and its surrounding area image are extracted from the first image. Features are then extracted from the surrounding area image to obtain a first feature. Based on the first feature, a first application identifier corresponding to the QR code area image is identified. Then, the first QR code scanning function corresponding to the first application identifier is activated to scan the QR code area image and enter the corresponding payment page. Finally, the payment amount is obtained, and the payment operation is completed on the payment page based on the payment amount. Thus, when payment is required, the camera identifies a QR code in the environment, first locating the QR code and its surroundings, then using the surroundings to identify the corresponding application, and finally scanning the QR code to enter the payment page and complete the payment function on that page. The entire process requires no manual operation from the user; the payment function is completed directly through the smart glasses, improving payment efficiency.

[0142] It is understood that the functions of each program module of the smart glasses in this embodiment can be specifically implemented according to the methods in the above method embodiments. The specific implementation process can be referred to the relevant descriptions in the above method embodiments, which will not be repeated here.

[0143] This invention also provides a computer-readable storage medium storing a computer program for electronic data interchange, the computer program causing a computer to perform some or all of the steps of any of the methods described in the above method embodiments, wherein the computer includes smart glasses.

[0144] This invention also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any of the methods described in the above method embodiments. The computer program product can be a software installation package, and the computer may include smart glasses.

[0145] It should be noted that, for the sake of simplicity, the above embodiments are all described as a series of actions. Those skilled in the art should understand that the present invention is not limited to the described order of actions, as some steps in the embodiments of the present invention can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions, steps, modules, or units involved are not necessarily essential to the embodiments of the present invention.

[0146] In the above embodiments, the descriptions of each embodiment of the present invention have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0147] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

[0148] The steps of the methods or algorithms described in the embodiments of this invention can be implemented in hardware or by a processor executing software instructions. The software instructions can consist of corresponding software modules, which can be stored in RAM, flash memory, ROM, EPROM, electrically erasable programmable read-only memory (EEPROM), registers, hard disk, portable hard disk, read-only optical disk (CD-ROM), or any other form of storage medium well known in the art. An exemplary storage medium is coupled to a processor, enabling the processor to read information from and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and storage medium can reside in an ASIC. Furthermore, the ASIC can reside in a terminal device or management device. Alternatively, the processor and storage medium can exist as discrete components in the terminal device or management device.

[0149] Those skilled in the art will recognize that, in one or more of the examples above, the functions described in the embodiments of the present invention can be implemented, in whole or in part, by software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. This computer program product includes one or more computer instructions. When these computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device such as a server or data center that integrates one or more available media. The available media can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., digital video discs (DVDs)), or semiconductor media (e.g., solid-state disks (SSDs)).

[0150] The modules / units included in the various devices and products described in the above embodiments can be software modules / units, hardware modules / units, or a combination of both. For example, for devices and products applied to or integrated into a chip, all modules / units can be implemented using hardware methods such as circuits, or at least some modules / units can be implemented using software programs that run on a processor integrated within the chip, while the remaining (if any) modules / units can be implemented using hardware methods such as circuits. For devices and products applied to or integrated into a chip module, all modules / units can be implemented using hardware methods such as circuits. Different modules / units can be located in the same component (e.g., chip, circuit module, etc.) or different components of the chip module, or at least some modules / units can be implemented using hardware methods such as circuits. The implementation is achieved through a software program that runs on a processor integrated within the chip module. The remaining modules / units (if any) can be implemented using hardware methods such as circuits. For various devices and products applied to or integrated into terminal equipment, each of their modules / units can be implemented using hardware methods such as circuits. Different modules / units can be located in the same component (e.g., chip, circuit module, etc.) or different components within the terminal equipment. Alternatively, at least some modules / units can be implemented using a software program that runs on a processor integrated within the terminal equipment, while the remaining modules / units (if any) can be implemented using hardware methods such as circuits.

[0151] The specific embodiments described above further illustrate the purpose, technical solution, and beneficial effects of the embodiments of the present invention. It should be understood that the above descriptions are merely specific embodiments of the present invention and are not intended to limit the scope of protection of the embodiments of the present invention. Any modifications, equivalent substitutions, improvements, etc., made on the basis of the technical solutions of the embodiments of the present invention should be included within the scope of protection of the embodiments of the present invention.

Claims

1. An image processing method, characterized in that, Applied to smart glasses, the smart glasses include a camera; including: A first image is acquired through the camera, and the first image includes a QR code area image; The QR code region image and the surrounding region image of the QR code region image are extracted from the first image; Feature extraction is performed on the surrounding area image to obtain the first feature; Based on the first feature, identify the first application identifier corresponding to the QR code area image; Activate the first QR code scanning function corresponding to the first application identifier, and recognize the QR code area image to enter the corresponding payment page; Get the payment amount; Complete the payment on the payment page according to the stated payment amount.

2. The method as described in claim 1, characterized in that, The smart glasses also include a voice recognition module, and the method further includes: The first voice is obtained through the speech recognition module; The first speech is converted into text to obtain the first text; Keyword extraction is performed on the first text to obtain the first keyword; When the first keyword includes the first preset keyword, the step of acquiring the first image through the camera is executed.

3. The method as described in claim 2, characterized in that, When the first keyword includes multiple keywords, obtaining the payment amount includes: When a second keyword is included among the plurality of keywords, the payment amount is determined based on the second keyword, wherein the second keyword is a keyword related to the amount.

4. The method according to any one of claims 1-3, characterized in that, The step of extracting the QR code region image and the surrounding region image of the QR code region image from the first image includes: The first image is used to locate the QR code, thus obtaining the QR code area; A first image segmentation is performed based on the QR code region to obtain the QR code region image; Extract the outline of the QR code area; The QR code size is determined based on the outline; The perimeter dimensions of the QR code area image are determined based on the QR code size; The position of the outline of the surrounding area of ​​the QR code area image is determined based on the surrounding dimensions and the outline. The first image is segmented using the contour position and the contour of the surrounding region to obtain the image of the surrounding region.

5. The method according to any one of claims 1-3, characterized in that, The smart glasses are pre-installed with at least one application, each application corresponding to a set of peripheral features of a QR code; the step of identifying the first application identifier corresponding to the QR code region image based on the first feature includes: The first feature is matched with the surrounding feature set of the QR code of the at least one application to obtain at least one matching value; Select the maximum value among the at least one matching value, and use the application identifier corresponding to the application corresponding to the maximum value as the first application identifier.

6. The method as described in claim 5, characterized in that, The smart glasses also include a positioning sensor; the step of matching the first feature with the surrounding feature set of the QR code of the at least one application to obtain at least one matching value includes: The first position is obtained through the positioning sensor; When the first position is a preset position, obtain the surrounding feature set of the QR code of the application corresponding to the preset position; The first feature is compared with the surrounding feature set of the application's QR code corresponding to the preset location to obtain the at least one matching value.

7. The method as described in claim 6, characterized in that, The process of recognizing the QR code area image to access the corresponding payment page includes: Obtain the reference QR code image corresponding to the first position, and determine the first threshold based on the first position; The QR code region image is matched with the reference QR code image to obtain a first matching value; When the first matching value is greater than the first threshold, the user is directed to the corresponding payment page based on the reference QR code image.

8. The method as described in claim 1 or 2, characterized in that, The process of obtaining the payment amount includes: Obtain the second voice; Feature extraction is performed on the second speech to obtain the first speech features; Authentication is performed based on the first voice feature; Upon successful authentication, the payment amount is determined based on the second voice prompt.

9. The method as described in claim 1 or 2, characterized in that, The method further includes: Establish a communication connection between the smart glasses and the merchant's device; Receive a payment message sent by the merchant's device; the payment message includes the payment amount and its corresponding payment details; Analyze whether the payment details are reasonable; If so, perform the payment operation on the payment page according to the payment amount; If not, a notification message will be generated to indicate that the consumption was unreasonable.

10. A type of smart glasses, characterized in that, The smart glasses include a camera; the smart glasses include: The acquisition unit is configured to acquire a first image through the camera, the first image including a QR code area image; An extraction unit is configured to extract the QR code region image and the surrounding region image of the QR code region image from the first image; and to perform feature extraction on the surrounding region image to obtain a first feature; The identification unit is configured to identify the first application identifier corresponding to the QR code area image based on the first feature; activate the first QR code scanning function corresponding to the first application identifier, and identify the QR code area image to enter the corresponding payment page; The payment unit is used to obtain the payment amount and complete the payment operation on the payment page according to the payment amount.

Images