Information processing method and device, storage medium and program product

By acquiring and calculating target operation posture information and biometric images, the system judges and prompts users to adjust their operation posture, solving the problems of inaccurate judgment and insufficient prompting in existing technologies, and achieving more efficient information recognition.

CN122073064APending Publication Date: 2026-05-22TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
TENCENT TECHNOLOGY (SHENZHEN) CO LTD
Filing Date
2024-11-22
Publication Date
2026-05-22

AI Technical Summary

Technical Problem

In existing technologies, adjusting the user's posture by detecting the distance between the user's operation and the biometric device cannot effectively assess the accuracy of the operation posture, and the prompting is weak, resulting in poor information recognition efficiency and accuracy.

Method used

By acquiring target operation posture information and biometric images, the system calculates object recognition results and target evaluation information. The target evaluation information is used to judge the quality of the operation posture, and the system intuitively prompts the user to adjust the operation posture through the terminal device.

Benefits of technology

It improves the accuracy of judging operating posture and the strength of prompts, allowing users to adjust their operating posture in a timely manner, thereby improving the efficiency and accuracy of information recognition.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122073064A_ABST
    Figure CN122073064A_ABST
Patent Text Reader

Abstract

The embodiment of the invention discloses an information processing method and device, a storage medium and a program product, which are used for improving the accuracy of judging an operation posture, improving the prompting strength, enabling a user to adjust the operation posture in time, and improving the recognition efficiency and accuracy. The information processing method comprises the steps that target posture information and a target image sent by a first terminal are obtained, and the target posture information is obtained by recognizing a target operation posture when the first terminal executes first operation on a target object on the first terminal; the target image is obtained by collecting biological characteristics when the first operation is executed on the target object; calculating an object recognition result based on the target image; determining target evaluation information based on the target posture information and the object recognition result, wherein the target evaluation information is used for indicating posture quality conditions of the target operation posture; and sending the object identification result and the target evaluation information to the first terminal, so that the first terminal prompts the object identification result and the target evaluation information to the target object.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of computer technology, specifically to an information processing method, apparatus, storage medium, and program product. Background Technology

[0002] Biometric technology is a technology that identifies users by recognizing their physiological or behavioral characteristics. By identifying and matching users' biometric features to complete corresponding operations, it is increasingly favored by users and businesses. For example, after registering with a biometric device, users can trigger unlocking services in access control products or payment services in payment products by recognizing their facial, palm print, or fingerprint characteristics.

[0003] In existing solutions, it's typically necessary to identify the user's posture during an operation, and then effectively trigger the corresponding service based on the accuracy and standardization of the posture. If the posture is incorrect, the user can be prompted to adjust it. However, current solutions usually determine the standardization of the user's posture by detecting the distance between the user's hand and the biometric device, and prompting the user to adjust their posture via voice and text if the distance is too far or too close. However, current solutions can only use distance information to prompt the user to adjust their posture during a single operation. This not only fails to assess the accuracy of the posture but also provides weak prompting, failing to prompt the user to adjust their posture in a timely manner, resulting in poor information recognition efficiency and accuracy. Summary of the Invention

[0004] This application provides an information processing method, device, storage medium, and program product to improve the accuracy of judging operation posture and enhance prompting, enabling users to adjust their operation posture in a timely and effective manner, thereby improving information recognition efficiency and accuracy.

[0005] In a first aspect, embodiments of this application provide an information processing method. This method is applied to an information processing device. The information processing method includes: acquiring target posture information and a target image sent by a first terminal, wherein the target posture information is obtained by the first terminal recognizing the target operation posture of a target object performing a first operation on the first terminal, and the target image is obtained by the first terminal collecting biometric features of the target object performing the first operation; calculating an object recognition result based on the target image, the object recognition result indicating whether the target object has been successfully recognized; determining target evaluation information based on the target posture information and the object recognition result, the target evaluation information indicating the quality of the target operation posture; and sending the object recognition result and the target evaluation information to the first terminal, so that the first terminal prompts the target object with the object recognition result and the target evaluation information.

[0006] Secondly, embodiments of this application provide another information processing method applicable to a first terminal. The method includes: when a target object performs a first operation on the first terminal, collecting the target object's biometric features to obtain a target image, and identifying the target operation posture during the first operation to obtain target posture information; the target image being an image including the target operation posture; sending the target posture information and the target image to an information processing device, wherein the target image is used by the information processing device to calculate an object recognition result, and the object recognition result and the target posture information are used by the information processing device to determine target evaluation information, wherein the object recognition result indicates whether the target object has been successfully recognized, and the target evaluation information indicates the quality of the target operation posture; receiving the object recognition result and the target evaluation information sent by the information processing device; and prompting the target object with the object recognition result and the target evaluation information.

[0007] Thirdly, embodiments of this application provide another information processing method applicable to a second terminal. The method includes: receiving target reward information sent by an information processing device, wherein the target reward information is obtained by the information processing device based on target evaluation information, the target evaluation information is obtained by the information processing device based on object recognition results and target posture information, the object recognition results are obtained by the information processing device processing a target image, the target posture information is obtained by a first terminal recognizing the target operation posture of a target object performing a first operation on the first terminal, the object recognition results are used to indicate whether the target object has been successfully recognized, the target evaluation information is used to indicate the quality of the target operation posture, and the target reward information is used to indicate the reward obtained by the target object when performing the first operation. The second terminal does not include the first terminal, and the target image is obtained by the first terminal collecting biometric data of the target object when performing the first operation; and prompting the target object with the target reward information.

[0008] Fourthly, embodiments of this application provide an information processing device. The information processing device includes: an acquisition unit, a calculation unit, a determination unit, and a transmission unit.

[0009] The acquisition unit is used to acquire target posture information and target image sent by the first terminal. The target posture information is obtained by the first terminal recognizing the target operation posture of the target object when performing the first operation on the first terminal. The target image is obtained by the first terminal collecting the biometric features of the target object when performing the first operation.

[0010] The calculation unit is used to calculate the object recognition result based on the target image. The object recognition result is used to indicate whether the target object has been successfully recognized.

[0011] The determining unit is used to determine target evaluation information based on target pose information and object recognition results. The target evaluation information is used to indicate the quality of the target's operating pose.

[0012] The sending unit is used to send the object recognition result and target evaluation information to the first terminal, so that the first terminal can prompt the object recognition result and target evaluation information to the target object.

[0013] In one possible design, in another implementation of the fourth aspect of the embodiments of this application, the determining unit is specifically used for:

[0014] Extract at least one of the following from the target pose information: target distance, pose tilt angle of the target operation pose, target operation pose, and target time. The target distance is the distance between the target object and the first terminal when the first operation is performed, and the target time is the time when the target image is obtained.

[0015] The target evaluation score is obtained by weighted summation of at least one of the following: target distance, target operation posture tilt angle, target operation posture, target time, and object recognition result.

[0016] Target evaluation information is obtained based on the target evaluation score.

[0017] In one possible design, in another implementation of the fourth aspect of the embodiments of this application, the computing unit is specifically used for:

[0018] Feature extraction is performed on the target image to obtain the biological characteristics of the target object;

[0019] The biometrics of the target object are compared with preset biometrics to obtain a feature matching score;

[0020] The feature matching score is compared with a first threshold, and the object recognition result is obtained based on the comparison result.

[0021] In one possible design, in another implementation of the fourth aspect of the embodiments of this application,

[0022] The determining unit is also specifically used to determine target reward information based on the target evaluation information after determining the target evaluation information based on the target pose information and the object recognition result. The target reward information is used to indicate the reward obtained by the target object when performing the first operation.

[0023] The sending unit is specifically used to send target reward information to the second terminal, so that the second terminal can notify the target object of the target reward information.

[0024] In one possible design, in another implementation of the fourth aspect of the embodiments of this application, the determining unit is specifically used for:

[0025] Based on the target evaluation score and the range of index values ​​for each evaluation level, the target posture level of the target operation posture is determined.

[0026] Based on the target posture level and the first association relationship, the target reward information is determined from multiple candidate reward information. The first association relationship is used to characterize the mapping relationship between each evaluation level and one or more candidate reward information.

[0027] In one possible design, in another implementation of the fourth aspect of the embodiments of this application, the determining unit is further specifically used for:

[0028] After determining the target evaluation information based on the target pose information and object recognition results, the target image is matched with each candidate feature image in the candidate feature image set to determine the user identifier corresponding to the target image. The user identifier is used to identify the target object.

[0029] Based on user identifiers, extract gesture information from multiple historical operation gestures of the target object;

[0030] Based on the posture information of each historical operation posture, determine the posture evaluation information of the corresponding historical operation posture.

[0031] Posture change information is determined based on posture evaluation information and target evaluation information from multiple historical operating postures. The posture change information is used to indicate the trend of posture change from historical operating posture to target operating posture.

[0032] The sending unit is used to send posture change information to the first terminal so that the first terminal can prompt the target object with the posture change information.

[0033] In one possible design, in another implementation of the fourth aspect of the embodiments of this application, the determining unit is specifically used for:

[0034] Calculate the score difference between the target evaluation score and the historical posture evaluation score. The target evaluation score is used to represent the target evaluation information, and the historical posture evaluation score is used to represent the posture evaluation information of the historical operation posture.

[0035] When the score difference is greater than the second threshold, the first change information is obtained. The first change information is used to indicate that the target operation posture has been improved relative to the historical operation posture.

[0036] or,

[0037] When the score difference is less than or equal to the second threshold, the second change information is obtained. The second change information is used to indicate that the target operating posture has not improved relative to the historical operating posture.

[0038] In one possible design, in another implementation of the fourth aspect of the embodiments of this application, the determining unit is specifically used for:

[0039] Based on the target evaluation score and multiple historical posture evaluation scores, the posture change rate is calculated. The target evaluation score is used to characterize the target evaluation information, and each historical posture evaluation score is used to characterize the posture evaluation information of the corresponding historical operation posture.

[0040] When the rate of change of posture is greater than the third threshold, the third change information is obtained. The third change information is used to indicate that the target operation posture has been improved relative to the historical operation posture.

[0041] or,

[0042] When the rate of change of posture is less than or equal to a preset threshold, a fourth change information is obtained. The fourth change information is used to indicate that the target operating posture has not improved relative to the historical operating posture.

[0043] In one possible design, in another implementation of the fourth aspect of the embodiments of this application, the second terminal includes the first terminal, or the second terminal does not include the first terminal.

[0044] Fifthly, embodiments of this application provide a first terminal. The first terminal includes an identification module, a sending module, an acquisition module, and a prompting module. Optionally, the first terminal further includes a detection module.

[0045] The identification module is used to collect the biometric features of the target object when the target object performs the first operation on the first terminal, obtain the target image, and identify the target operation posture when performing the first operation to obtain the target posture information.

[0046] The sending module is used to send target posture information and target image to the information processing device. The target image is used by the information processing device to calculate the object recognition result. The object recognition result and target posture information are used by the information processing device to determine the target evaluation information. The object recognition result is used to indicate whether the target object has been successfully recognized. The target evaluation information is used to indicate the quality of the target operation posture.

[0047] The acquisition module is used to receive object recognition results and target evaluation information sent by the information processing device;

[0048] The prompting module is used to prompt the target object with the object recognition results and target evaluation information.

[0049] In one possible design, in another implementation of the fifth aspect of the embodiments of this application, the prompting module is specifically used for:

[0050] The target object is prompted with the object recognition result and target evaluation information through at least one of the following: a visual display interface of the first terminal, a sound reminder device, and a light reminder device.

[0051] In one possible design, in another implementation of the fifth aspect of the embodiments of this application,

[0052] The acquisition module is also specifically used to receive target reward information sent by the information processing device after sending target posture information and target image to the information processing device. The target reward information is obtained by the information processing device based on the target evaluation information and is used to indicate the reward obtained by the target object when performing the first operation.

[0053] The notification module is also used to notify the target object of the target reward information.

[0054] In one possible design, in another implementation of the fifth aspect of the embodiments of this application,

[0055] The detection module is specifically used to detect whether there is an operation service associated with the target's operation posture in the first terminal before prompting the target object with the target reward information;

[0056] The prompting module is specifically used to prompt the target object with target reward information through at least one of the following: a visual display interface of the first terminal and an audio reminder device, when an operation service associated with the operation posture is detected.

[0057] Sixthly, embodiments of this application provide a second terminal. The second terminal includes a receiving unit and a prompting unit. Optionally, the second terminal further includes a detection unit.

[0058] The receiving unit is specifically used to receive target reward information sent by the information processing device. The target reward information is obtained by the information processing device based on target evaluation information. The target evaluation information is obtained by the information processing device based on object recognition results and target posture information. The object recognition results are obtained by the information processing device processing the target image. The target posture information is obtained by the first terminal recognizing the target operation posture of the target object when performing the first operation on the first terminal. The object recognition results are used to indicate whether the target object has been successfully recognized. The target evaluation information is used to indicate the quality of the target operation posture. The target reward information is used to indicate the reward obtained by the target object when performing the first operation. The second terminal does not include the first terminal. The target image is obtained by the first terminal collecting the biometrics of the target object when performing the first operation.

[0059] The prompting unit is specifically used to prompt the target object with target reward information.

[0060] In one possible design, in another implementation of the sixth aspect of the embodiments of this application,

[0061] The detection unit is specifically used to detect whether there is an operation service associated with the target operation posture in the second terminal before prompting the target reward information to the target object.

[0062] The prompting unit is specifically used to prompt the target object with target reward information based on the application client corresponding to the operation service when an operation service associated with the operation posture is detected.

[0063] A seventh aspect of this application provides a processing device, including: a memory, an input / output (I / O) interface, and a processor. The memory is used to store program instructions. The processor is used to execute the program instructions in the memory to perform the methods corresponding to the embodiments of the above aspects.

[0064] The eighth aspect of this application provides a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform methods corresponding to the embodiments of the above aspects.

[0065] The ninth aspect of this application provides a computer program product containing instructions that, when run on a computer or processor, causes the computer or processor to execute the methods corresponding to the embodiments described above for performing the various aspects described above.

[0066] As can be seen from the above technical solutions, the embodiments of this application have the following advantages:

[0067] In this embodiment, the first terminal first identifies the target operation posture of the target object when performing the first operation on the first terminal, obtaining target posture information. Furthermore, the first terminal also collects the biometric features of the target object, obtaining a target image. The first terminal then sends the target posture information and target image to the information processing device. After acquiring the target posture information and target image, the information processing device calculates the object recognition result based on the target image. This object recognition result indicates whether the target object has been successfully recognized. Further, the information processing device determines target evaluation information based on the target posture information and object recognition result. The target evaluation information indicates the quality of the target operation posture. The information processing device then sends the object recognition result and target evaluation information back to the first terminal, allowing the first terminal to provide the object recognition result and target evaluation information to the target object. In other words, compared to related solutions that use distance information to adjust the operation posture, this application considers the user's own operation posture information, using the object recognition result and the extracted target posture information to determine target evaluation information, thereby judging whether the target operation posture conforms to the specifications. Therefore, this application also uses a first terminal to intuitively prompt the object recognition result and target evaluation information to the target object, prompting the target object to adjust and correct its corresponding operating posture in real time based on the target evaluation information and object recognition result. This method not only improves the accuracy of judging operating posture but also enhances the prompting effect, effectively and promptly encouraging users to optimize their operating posture and habits, thus improving information recognition efficiency and accuracy. Attached Figure Description

[0068] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0069] Figure 1 A schematic diagram illustrating the adjustment of the operating posture is shown in the relevant solution;

[0070] Figure 2A This diagram illustrates the application of biometrics in a transportation scenario.

[0071] Figure 2B This diagram illustrates a scenario where biometrics are applied to building access control.

[0072] Figure 2C This diagram illustrates the application of biometrics in payment scenarios.

[0073] Figure 3 A schematic diagram illustrating the implementation environment of the information processing method provided in the embodiments of this application is shown;

[0074] Figure 4 A flowchart illustrating the information processing method provided in this application is shown;

[0075] Figure 5 A schematic diagram of the framework for the computational object recognition results provided in this application is shown;

[0076] Figure 6 This application provides a schematic diagram of the framework for determining target evaluation information.

[0077] Figure 7 A schematic diagram of the palm-swiping device provided in this application is shown;

[0078] Figure 8 This invention illustrates a schematic diagram of how a palm-swiping device displays target evaluation information.

[0079] Figure 9 Another flowchart illustrating the information processing method provided in this application is shown;

[0080] Figure 10 Another flowchart illustrating the information processing method provided in this application is shown;

[0081] Figure 11 This illustration shows a schematic diagram of a target reward message displayed via a first terminal, as provided in this application.

[0082] Figure 12 Another flowchart illustrating the information processing method provided in this application is shown;

[0083] Figure 13 This illustration shows a schematic diagram of a target reward message displayed via a second terminal, as provided in this application.

[0084] Figure 14 Another flowchart illustrating the information processing method provided in this application is shown;

[0085] Figure 15 A schematic diagram of optional functional modules of the information processing apparatus provided in an embodiment of this application is shown;

[0086] Figure 16 A schematic diagram of optional functional modules of the first terminal provided in an embodiment of this application is shown;

[0087] Figure 17 A schematic diagram of optional functional modules of the second terminal provided in an embodiment of this application is shown;

[0088] Figure 18A schematic diagram of an optional hardware structure of the processing device provided in an embodiment of this application is shown. Detailed Implementation

[0089] This application provides an information processing method, device, storage medium, and program product to improve the accuracy of judging operation posture and enhance prompting, enabling users to adjust their operation posture in a timely and effective manner, thereby improving information recognition efficiency and accuracy.

[0090] It is understood that in the specific embodiments of this application, data such as user information are involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0091] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0092] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a particular order or sequence. It should be understood that such data can be interchanged where appropriate so that implementations of the application described herein can be implemented, for example, in sequences other than those illustrated or described herein. Furthermore, the terms “comprising” and “having,” and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0093] With continuous technological advancements and cost reductions, an increasing number of businesses and users are using biometric identification to complete various operations and trigger different business services. For example, in payment scenarios, users no longer need to take out their wallets or payment cards; biometric technology identifies and verifies their facial or palm print features to complete the payment. Similarly, in access control scenarios, users no longer need to use traditional access cards or keys; biometric technology identifies and verifies their facial or palm print features to unlock doors. The widespread application of biometric technology in access control and payment scenarios not only simplifies procedures and improves efficiency but also reduces the risk of identity theft.

[0094] When using a user's biometrics to trigger services, the correctness of the user's gestures significantly impacts the efficiency of the operation. Typically, it's necessary to identify the user's gestures during the operation and then determine the accuracy and correctness of the gestures to effectively trigger the corresponding service. If the gestures are incorrect, the user can be prompted to adjust them. However, current solutions primarily determine the correctness of the user's gestures by detecting the distance between the user's gesture and the biometric device. If the distance is detected to be too far or too close, the user is prompted to adjust their gestures via voice and text.

[0095] For example, Figure 1 A diagram illustrating the instructions for adjusting the operating posture is shown in the relevant solution. For example... Figure 1 As shown, in the access control system of a certain building A, taking palm-swipe access as an example, the user places their palm on the recognition area of ​​the first terminal (e.g., a palm-swipe device). The palm-swipe device extracts, recognizes, and verifies the palmprint image containing the palm-swipe gesture, thereby effectively triggering the door opening service based on whether the palm-swipe gesture is accurate and standardized. Figure 1 As shown, if the palm-swiping device detects that the distance between the palm-swiping operation and the palm-swiping device is too close, it will prompt the user with text that the palm-swiping posture is not correct and needs to be adjusted.

[0096] In other words, adjusting posture according to the current method can only prompt the user to adjust their posture using distance information during a single operation. This not only fails to assess the accuracy of the posture but also provides weak prompts, making it impossible to adjust the user's posture in a timely manner.

[0097] To address the aforementioned technical problems, this application provides an information processing method. This method can be applied to various scenarios where operations are performed by recognizing biometric features. For example, the information processing scenarios of this application include, but are not limited to, access control scenarios and payment scenarios. Exemplarily, this information processing method can also be applied to various scenarios such as cloud technology, artificial intelligence, smart transportation, and assisted driving, without specific limitations in this application. Exemplarily, in the information processing method of this application, the user's own operational posture information is considered, and target evaluation information is determined using object recognition results and extracted target posture information to judge whether the target operation posture conforms to the specifications. Further, this application intuitively prompts the target object with the object recognition results and target evaluation information through a first terminal, prompting the target object to adjust and correct the corresponding operation posture in real time based on the target evaluation information and object recognition results. Compared with the method of adjusting operation posture using distance information in related solutions, this application not only improves the accuracy of judging operation posture but also enhances the prompting strength, which can promptly and effectively promote users to optimize operation posture and operating habits, and improve information recognition efficiency and accuracy.

[0098] For example, the information processing method provided in this application can be applied to one or more of the following application scenarios, as follows:

[0099] (I) Transportation Scenarios

[0100] For example, applying biometric technologies such as palm recognition and facial recognition to payment and entry / exit management in public transportation such as subways and buses is a new management method that has gradually emerged with technological advancements. Figure 2A This diagram illustrates the application of biometrics in transportation scenarios. Figure 2A As shown, when using public transportation, passengers simply need to place their palm above the recognition area of ​​the "palm-scanning" device or face the camera to complete the identity verification and payment process. By applying the information processing method provided in this application to transportation scenarios, the system can consider the user's posture information during palm-scanning or facial recognition operations, and use target evaluation information to judge whether the target operation posture conforms to the specifications. Furthermore, the object recognition results and target evaluation information can be presented to the target object in real time through the palm-scanning or facial recognition device, prompting the target object to adjust and correct their corresponding operation posture in real time. On the one hand, this not only improves the accuracy of posture judgment but also enhances the effectiveness of prompts, promptly and effectively promoting users to optimize their operation posture and habits; on the other hand, timely adjustment of operation posture can improve payment efficiency and travel efficiency, optimizing the passenger experience.

[0101] (II) Access Control Scenarios

[0102] For example, applying biometric technologies such as palm recognition and facial recognition to payment or access management in buildings, residences, shopping malls, and parking lots is an important part of smart city construction. Figure 2B This diagram illustrates a scenario where biometrics are applied to building access control. Figure 2B As shown, biometric systems, such as palm-scanning access control systems and facial recognition access control systems, are installed at the entrances and exits of office buildings and similar structures. Taking palm-scanning access control systems as an example, employees or visitors can quickly enter and exit the building by scanning their palm. Similarly, access control methods such as facial recognition and fingerprint scanning can be implemented in a similar manner. Figure 2B The illustrated palm-swiping access control method is explained below. In other words, by applying the information processing method provided in this application to access control scenarios, it is possible to consider the user's posture information during palm-swiping or facial recognition operations, and to judge whether the target's posture conforms to the specifications through target evaluation information. Furthermore, the object recognition results and target evaluation information can be intuitively and directly presented to the target object in real time through palm-swiping or facial recognition devices, prompting the target object to adjust and correct their corresponding posture in real time. On the one hand, this not only improves the accuracy of posture judgment but also enhances the effectiveness of prompts, promptly and effectively promoting users to optimize their posture and habits; on the other hand, timely adjustment of posture can improve recognition efficiency and access control false recognition rate, optimizing the entry and exit experience for employees or visitors.

[0103] (III) Payment Scenarios

[0104] For example, applying biometric technologies such as palm recognition and facial recognition to payment scenarios such as public transportation, retail and catering, offices, campuses, fitness and entertainment, cross-border payments, shopping malls, parking lots, and shared services is a new type of payment method that has gradually emerged in recent years with the development of technology and changes in consumer demand. Figure 2C This diagram illustrates the application of biometrics in payment scenarios. Figure 2CAs shown, in retail and catering establishments such as convenience stores, supermarkets, hot pot restaurants, coffee shops, and milk tea shops, customers can use palm-scanning payment at the cashier or self-checkout machine to complete the settlement of shopping or dining expenses. By applying the information processing method provided in this application to payment scenarios, it can consider the user's own palm-scanning or facial recognition posture information to judge whether the target operation posture conforms to the standard through target evaluation information. Furthermore, the object recognition results and target evaluation information can be intuitively prompted to the target object in real time through palm-scanning or facial recognition devices, prompting the target object to adjust and correct the corresponding operation posture in real time. On the one hand, it not only improves the accuracy of operation posture judgment but also enhances the prompting effect, which can promptly and effectively promote users to optimize their operation posture and habits; on the other hand, timely adjustment of operation posture can improve recognition efficiency and payment efficiency, and optimize user experience.

[0105] It should be noted that, in addition to the aforementioned scenarios such as transportation, access control, and payment, the information processing method of this application can also be applied to other scenarios in practice. For example, it can also be applied to scenarios such as urban security management, identity verification, and personalized retail services, etc., without specific limitations in this application.

[0106] For example, the method provided in this application can be applied to Figure 3 The implementation environment shown. In Figure 3 The illustrated implementation environment includes an information processing device 100 and a first terminal 200. The information processing device 100 and the first terminal 200 can be directly or indirectly connected via wired or wireless communication. This application does not impose specific limitations.

[0107] from Figure 3 As can be seen, in step S1, when the target object intends to trigger the corresponding service by performing the first operation, the user can perform the first operation on the first terminal 200. In step S2, the first terminal 200 identifies the biometric features of the target object performing the first operation to obtain a target image, and identifies the target operation posture during the first operation to obtain target posture information. It should be noted that the target image is an image containing relevant information about the biometric features of the target object. In step S3, after obtaining the target image and target posture information, the first terminal 200 sends the target image and target posture information to the information processing device 300. Therefore, the information processing device 100 can perform the following steps S4 to S7 to complete the posture adjustment and other processing, as follows:

[0108] In step S4, the information processing device 100 first acquires the target posture information and target image sent by the first terminal 200. In step S5, the information processing device 100 calculates the object recognition result based on the target image; the object recognition result indicates whether the target object has been successfully recognized. Therefore, in step S6, the information processing device 100 determines target evaluation information based on the target posture information and the object recognition result; the target evaluation information indicates the quality of the target's operational posture. Thus, in step S7, the information processing device 100 sends the object recognition result and target evaluation information to the first terminal 200.

[0109] Thus, in step S8, after the first terminal 200 receives the object recognition result and target evaluation information sent by the information processing device 100, it prompts the object recognition result and target evaluation information to the target object in different ways, so as to provide the target object with timely information on the object recognition status and the evaluation status of the target operation posture, and thus adjust the operation posture in a timely manner according to the object recognition result and target evaluation information.

[0110] Optionally, in Figure 3 In the illustrated implementation environment, a second terminal 300 may also be included. The information processing device 100 may also be directly or indirectly connected to the second terminal 300 via wired or wireless communication. In step S9, after determining the target evaluation information in step S6, the information processing device 100 may also determine target reward information based on the target evaluation information. It should be noted that this target reward information indicates the reward received by the target object when performing the first operation. Thus, in step S10, the information processing device 100 sends the target reward information to the second terminal 300. Thus, in step S11, the second terminal 300 displays the target reward information to the target object.

[0111] It should be noted that the above Figure 3 The second terminal 300 described herein may be the same as the first terminal 200. Alternatively, the second terminal 300 may be different from the first terminal 100. That is, when the second terminal 300 is the same as the first terminal 200, the object identification results, target evaluation information, and target reward information mentioned in this application can all be presented to the target object through the first terminal 200. When the second terminal 300 is different from the first terminal 200, the object identification results and target evaluation information mentioned in this application can be presented to the target object by the first terminal 200, while the target reward information can be presented to the target object by the second terminal 300.

[0112] Optionally, in Figure 3The illustrated implementation environment may also include a database 400, etc. The information processing device 100 may also be connected to the database 400 via a network. In this application, the database 400 can store target evaluation information, target posture information, etc., for subsequent evaluation of whether the target's operational posture has been improved, etc.

[0113] Optionally, the information processing device 100, the first terminal 200, the second terminal 300, etc. involved in this application can be block nodes in a blockchain network. By applying the information processing method of this application to a blockchain network scenario, the logic of various operations can be run in the smart contract in the blockchain network, enabling the first terminal 200, the second terminal 300, and the information processing device 100 to call the smart contract to participate in the business.

[0114] The second terminal 300 involved in this application includes, but is not limited to, mobile phones, tablets, laptops, desktop computers, smart voice interaction devices, smart home appliances, vehicle terminals, and aircraft. The client is deployed on the second terminal 300 and can run on the second terminal 300 via a browser or as a standalone application (APP).

[0115] The information processing device 100 involved in this application can be a processing device with data processing capabilities, such as, but not limited to, terminal devices, servers, etc. The server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence (AI) platforms.

[0116] The first terminal 200 mentioned in this application may include, but is not limited to, various forms of biometric devices. For example, the first terminal 200 may include, but is not limited to, palm-swiping devices, fingerprint-swiping devices, facial recognition devices, etc., and is not limited in this application. It should be noted that this application only uses palm-swiping devices as an example of the first terminal 200, and is not specifically limited thereto.

[0117] Based on the above description, the information processing method provided in this application will now be described in conjunction with the accompanying drawings. Figure 4 A flowchart illustrating the information processing method provided in this application is shown, using the information interaction between an information processing device and a terminal as an example. Figure 4As shown, the information processing method of this application includes at least the following steps:

[0118] 401. When the target object performs the first operation on the first terminal, the first terminal collects the biometric features of the target object to obtain the target image, and identifies the target operation posture when performing the first operation to obtain the target posture information.

[0119] In one or more embodiments, if the target object intends to complete a corresponding service through the first terminal, it can perform a first operation on the first terminal, such as a palm-swiping operation. In this way, the first terminal can collect the biometric features of the target object when performing the first operation, thereby obtaining an image containing the biometric features, i.e., a target image. For example, the target image may also include the target operation posture. For instance, the target image may include, but is not limited to, a palm print image when performing a palm-swiping operation, a facial image when performing a face-swiping operation, or a fingerprint image when performing a fingerprint-swiping operation, etc., and is not limited in this application.

[0120] As an illustrative description, when the first terminal detects a target object performing a first operation, it identifies the target object to obtain multiple candidate images. Then, after identifying multiple candidate images, it selects the target image from these candidate images.

[0121] For example, the peak signal-to-noise ratio (PSNR) of each candidate image can be calculated, and the candidate image with the highest PSNR can be selected as the target image. Alternatively, the structural similarity index (SSIM) of each candidate image can be calculated, and the candidate image with the highest SSIM can be selected as the target image. Another option is to calculate the PSNR and SSIM of each candidate image, perform a weighted sum of the PSNR and SSIM, and select the candidate image corresponding to the maximum value of the weighted sum as the target image. It should be noted that other methods are also used in practical applications to select the target image, and this application does not specifically limit these methods.

[0122] Furthermore, the first terminal also needs to identify the target operation posture when performing the first operation to obtain target posture information. The target posture information mentioned in this application includes, but is not limited to, at least one of the following: target distance, the posture tilt angle of the target operation posture, the target operation posture, and target time. Here, target distance is understood as the distance between the target object and the first terminal when performing the first operation. Additionally, target time is understood as the time when the target image is acquired.

[0123] The first terminal mentioned in this application includes, but is not limited to, palm-scanning devices, facial recognition devices, etc., and this application does not make any specific limitations.

[0124] For example, taking a first terminal including a palm-swiping device and a first operation including a palm-swiping operation as an example, the target object places its palm on the recognition area of ​​the palm-swiping device. At this time, the palm-swiping device performs palmprint recognition on the palm to obtain a palmprint image including palmprint features. Moreover, the palm-swiping device also recognizes and records the palm-swiping posture during the palm-swiping operation, obtaining relevant palm-swiping posture information. This palm-swiping posture information includes one or more of the following: the distance between the palm and the palm-swiping device during palm-swiping, the tilt angle of the palm-swiping posture, the palm-swiping posture, and the time of obtaining the palmprint image.

[0125] It should be noted that the first operation mentioned in this application includes, but is not limited to, palm scanning, facial recognition, and fingerprint scanning, etc., and this application does not make specific limitations. In addition, the target operation posture also includes, but is not limited to, the palm posture corresponding to palm scanning, the facial posture corresponding to facial recognition, and the posture corresponding to fingerprint scanning, etc., and this application does not make specific limitations.

[0126] 402. The first terminal sends the target posture information and target image to the information processing device.

[0127] In one or more embodiments, after the first terminal obtains the target posture information and the target image by performing step 401, it needs to send the target posture information and the target image to the information processing device through the network so that the information processing device can evaluate the target operation posture.

[0128] It should be noted that information processing equipment includes, but is not limited to, backend servers, etc., but is not specifically limited in this application.

[0129] 403. The information processing device calculates the object recognition result based on the target image. The object recognition result is used to indicate whether the target object has been successfully recognized.

[0130] In one or more embodiments, after obtaining a target image sent by a first terminal, the information processing device processes the target image to calculate an object recognition result. That is, the object recognition result is used to determine whether the target's operational posture has been successfully recognized.

[0131] In an optional embodiment, during the process of calculating the object recognition result by the information processing device in step 403 above, the information processing device can perform feature extraction on the target image to obtain the biometric features of the target object. After extracting the biometric features of the target object, the information processing device compares the biometric features of the target object with preset biometric features to obtain a feature matching score. Finally, the information processing device compares the feature matching score with a first threshold and obtains the object recognition result based on the comparison result.

[0132] As an illustrative example, if the feature matching score is greater than a first threshold, the object recognition result can be considered a successful identification of the target object. Conversely, if the feature matching score is less than or equal to the first threshold, the object recognition result is considered a failed identification of the target object. By using the relationship between the feature matching score and the threshold to determine whether an object has been successfully identified, unnecessary computation is reduced, improving computational efficiency. Furthermore, the possibility of false identification is reduced, improving the accuracy and robustness of the identification process. Moreover, the object recognition result ensures accurate identification, preventing subsequent evaluations of the target's operational posture from being based on incorrect objects or data, thus contributing to more accurate and personalized evaluations.

[0133] It should be noted that the first threshold in this application can be understood as a boundary value for whether an object is successfully identified, and it can be adaptively configured according to the user's identification needs. Specifically, this application does not limit the value of the first threshold.

[0134] For example, taking the palm-swiping operation as an example, regarding the process of how the information processing device calculates the object recognition result in step 403 above, it can be referred to... Figure 5 The illustrated computational framework diagram is provided for your understanding. Figure 5 As shown, the information processing device includes a palm print recognition module. After receiving a palm print image sent by the first terminal, the device can use this image as input to the palm print recognition module, along with a palm print database and a user information database. The palm print recognition module then processes the image for recognition. For example, it identifies palm print features in the image; subsequently, it compares these features with preset palm print features in the database to obtain a feature matching score, thereby determining the object recognition result. It should be noted that the described palm print database stores various preset palm print features and other information. Additionally, the user information database stores user identity information (such as user identifiers). For example, the corresponding service information bound by the user when registering for the palm print service, such as binding a WeChat Pay account when registering for the palm print payment service, or binding the user's work card information when registering for the palm print door opening service.

[0135] For example, if the first threshold is 70 and the calculated feature matching score is 85, since 85 > 70, the corresponding object recognition result is that the target object is successfully recognized. Conversely, if the calculated feature matching score for the palm-swiping gesture is 60, by comparison we know that 60 < 75, and the corresponding object recognition result is that the target object is not recognized.

[0136] It should be noted that the first threshold mentioned above is 70, and the feature matching score is 85, 60, etc. In practical applications, other values ​​can also be used, which are not limited in this application.

[0137] 404. The information processing device determines target evaluation information based on target posture information and object recognition results. The target evaluation information is used to indicate the quality of the target's operating posture.

[0138] In one or more embodiments, after the information processing device calculates the object recognition result by performing step 403, it can further determine the target evaluation information by combining the target posture information and the object recognition result. That is, the target evaluation information is used to evaluate the quality of the target's operating posture.

[0139] In some alternative embodiments, as described in step 401 above, the target posture information includes at least one of the following: target distance, the tilt angle of the target operation posture, the target operation posture, and the target time. Therefore, during the process of determining the target evaluation information in step 404, the information processing device can comprehensively consider at least one of the following: target distance, the tilt angle of the target operation posture, the target operation posture, and the target time, based on the object recognition result.

[0140] As an illustrative description, the information processing device extracts at least one of the following from the target posture information: target distance, the tilt angle of the target operation posture, the target operation posture, and the target time. Further, the information processing device performs a weighted summation of at least one of the target distance, the tilt angle of the target operation posture, the target operation posture, and the target time, along with the object recognition result, to obtain a target evaluation score. The information processing device then determines target evaluation information based on this target evaluation score. For example, the information processing device can compare the target evaluation score with the range of index values ​​for different evaluation levels, and then use the evaluation information corresponding to the matched evaluation level as the target evaluation information. For example, the target evaluation information includes, but is not limited to: good, excellent, perfect, etc., and is not specifically limited in this application.

[0141] It should be noted that the information processing device in this application performs a weighted summation of at least one of the following: target distance, target operation posture tilt angle, target operation posture, target time, and object recognition result. The methods include, but are not limited to, the following:

[0142] The target distance and object recognition results can be weighted and summed; alternatively, the target operation posture tilt angle, target distance, and object recognition results can be weighted and summed; or the target distance, target operation posture tilt angle, target operation posture, and object recognition results can be weighted and summed; or the target distance, target operation posture tilt angle, target operation posture, target time, and object recognition results can be weighted and summed, etc. Other weighted summation methods may also be included in this application, without specific limitations.

[0143] For example, taking the palm-swiping operation as an example, regarding the process of how the information processing device determines the target evaluation information in step 404 above, it can be referred to... Figure 6 The illustrated computational framework diagram is provided for your understanding. Figure 6 As shown, the information processing device also includes a palm-swishing posture evaluation module. After obtaining the object recognition result and target posture information of the palm-swishing posture, the information processing device uses the object recognition result and target posture information as input to the palm-swishing posture evaluation module to calculate the target evaluation score. Furthermore, the palm-swishing posture evaluation module also needs to compare the target evaluation score with the index value range of different evaluation levels in the user's palm-swishing evaluation database, and then use the evaluation information corresponding to the matched evaluation level as the target evaluation information for the palm-swishing posture.

[0144] Optionally, the palm-brushing posture evaluation module can also process the target evaluation information to determine the corresponding target reward information, as detailed below. Figures 9 to 13 The content shown is for your understanding; further details will not be elaborated upon here.

[0145] For example, assuming the evaluation levels for a posture include Good, Excellent, and Perfect, their respective index value ranges are [60, 75), [75, 90), and [90, 100], respectively. If the calculated target evaluation score for the palm-brushing posture is 89 points, by comparison, it can be seen that this 89 points corresponds to the evaluation level of Excellent posture. In this case, the target evaluation information for the palm-brushing posture can be determined as Excellent.

[0146] It should be noted that the evaluation levels mentioned in this application include not only good, excellent, and perfect, but in practical applications, other levels such as average, passable, unsatisfactory, and outstanding may also be included, which are not limited in this application.

[0147] By combining multiple dimensions of posture information, such as distance, tilt angle, time, and object recognition results, we can not only comprehensively evaluate all aspects of the target's operational posture, but also provide a more accurate posture evaluation by utilizing the complementary nature of information from multiple dimensions.

[0148] 405. The information processing equipment sends the object recognition result and target evaluation information to the first terminal.

[0149] In one or more embodiments, after calculating the target evaluation information, the information processing device needs to send the object recognition result and the target evaluation information to the first terminal. In this way, the first terminal displays both the object recognition result and the target evaluation information to the target object, allowing the target object to promptly view the object recognition result and the target evaluation information and adjust its operating posture accordingly.

[0150] 406. The first terminal will display the object recognition results and target evaluation information to the target object.

[0151] In one or more embodiments, after the first terminal receives the object recognition result and target evaluation information sent by the information processing device, it can prompt the target object to view it.

[0152] As an illustrative description, the first terminal can prompt the target object with the object recognition result and target evaluation information through at least one of the first terminal's visual display interface, sound reminder device, and light reminder device.

[0153] For example, taking the first terminal as an example, including a palm-swiping device, Figure 7 A schematic diagram of the palm-brushing device provided in this application is shown. Figure 7 As shown, the palm-scanning device includes at least a camera module, a feedback module, and a network communication module. The camera module acquires palmprint images and information such as palm-scanning posture and hand position of the target object. The network communication module communicates and interacts with the information processing device, transmitting target posture information and palm-scanning images to the information processing device, and also acquiring object recognition results and target evaluation information from the information processing device. The feedback module includes a visual display interface, an audio alert device, and a light alert device. The audio alert device may include, but is not limited to, a speaker. Through one or more of the visual display interface, audio alert device, and light alert device, the palm-scanning device can provide prompts to the target object regarding posture recognition structure and target evaluation information. By utilizing one or more of these alert methods, the effectiveness of the prompts can be enhanced, prompting the target object to promptly review the posture evaluation and other information.

[0154] for example, Figure 8 This illustration shows a schematic diagram of how the present application displays target evaluation information via a palm-swiping device. For example... Figure 8 As shown, assuming the determined target evaluation information for the palm-brushing posture is excellent, this target evaluation information, such as "perfect," can be displayed in the visual display interface of the palm-brushing device. Optionally, as... Figure 8 As shown, the target evaluation information can also be broadcast to the target object via a sound reminder device; or, the target evaluation information can be highlighted via a light reminder device.

[0155] It should be noted that this application only uses a palm-swiping device as an example of the first terminal. In practical applications, it may also include, but is not limited to, facial recognition devices, fingerprint recognition devices, etc. For example, when a service is completed through facial recognition, the first terminal may also be a facial recognition device; or, when a service is triggered through fingerprint recognition, the first terminal may also be a fingerprint recognition device, etc.

[0156] In this embodiment, compared to related solutions that use distance information to adjust operating posture, this application considers the user's own operating posture information. It uses object recognition results and extracted target posture information to determine target evaluation information, which is then used to judge whether the target operating posture conforms to specifications. Therefore, this application also uses a first terminal to intuitively prompt the target object with the object recognition results and target evaluation information, prompting the target object to adjust and correct its corresponding operating posture in real time based on the target evaluation information and object recognition results. This approach not only improves the accuracy of judging operating posture but also enhances the prompting effect, effectively and promptly promoting users to optimize their operating posture and habits, thus improving recognition efficiency and accuracy.

[0157] In addition, this application also uses a target evaluation information system to provide feedback on the target user's current operation posture, which not only increases the fun of the operation, but also allows the target user to enjoy the fun of gamification while enjoying convenient services such as payment, greatly enhancing the user's interest and participation.

[0158] In some alternative embodiments, the relevant solutions can also reward the target object through feedback incentives. However, in these solutions, the reward method is based on the user's operational behavior. For example, in a palm-swiping scenario, as long as the target object performs palm recognition on the palm-swiping device, the target object will be rewarded through methods such as palm-swiping red envelopes. However, the current reward method does not take into account the influence of palm-swiping posture, which fails to encourage users to enhance interactivity and experience.

[0159] To address the technical issues arising from the relevant incentive schemes, this application may also include the above-mentioned... Figure 4 Based on one or more embodiments shown, target evaluation information is used to determine target reward information. For example, Figure 9 Another flowchart illustrating the information processing method provided in this application is shown. Figure 9As shown, the information processing method of this application includes at least the following steps:

[0160] 901. When the target object performs the first operation on the first terminal, the first terminal collects the biometric features of the target object to obtain the target image, and identifies the target operation posture when performing the first operation to obtain the target posture information.

[0161] 902. The first terminal sends the target posture information and target image to the information processing device.

[0162] 903. The information processing device calculates the object recognition result based on the target image. The object recognition result is used to indicate whether the target object has been successfully recognized.

[0163] 904. The information processing equipment determines target evaluation information based on target posture information and object recognition results. The target evaluation information is used to indicate the quality of the target's operating posture.

[0164] It should be noted that the content of steps 901 to 904 above can be referred to the aforementioned... Figure 4 The content described in steps 401 to 404 is for your understanding and will not be repeated here.

[0165] 905. The information processing equipment determines the target reward information based on the target evaluation information. The target reward information is used to indicate the reward obtained by the target object when performing the first operation.

[0166] In one or more embodiments, after calculating the target evaluation information, the information processing device can also determine the target reward information using the target evaluation information. As an illustrative description, since the target evaluation score can quantify the quality of the target operating posture, i.e., characterize the target evaluation information, the information processing device can determine the target posture level of the target operating posture based on the target evaluation score and the index value range of each evaluation level after calculating the target evaluation information. After determining the corresponding target posture level, the information processing device then obtains a first correlation relationship and determines the target reward information from multiple candidate reward information based on the target posture level and the first correlation relationship. It should be noted that the first correlation relationship is used to characterize the mapping relationship between each evaluation level and one or more candidate reward information.

[0167] It should be noted that the candidate reward information mentioned in this application may include, but is not limited to, payment red envelopes, digital badges, etc., and no specific limitation is made in this application.

[0168] For example, the relationship between different evaluation levels and candidate reward information can be understood by referring to Table 1 below:

[0169] Table 1

[0170]

[0171] As shown in Table 1 above, for evaluation level 1, the indicator value range is [60, 75), and the corresponding candidate reward information includes first-order discounts for new users, one or more rewards from card collection activities, etc. For evaluation level 2, the indicator value range is [75, 90), and the corresponding candidate reward information includes, but is not limited to, payment red envelopes, red envelope subsidies, one or more rewards from points redemption, etc. For evaluation level 3, the indicator value range is [90, 100), and the corresponding candidate reward information includes, but is not limited to, digital badges, etc.

[0172] Assuming the target evaluation score is 89 points, comparison shows it falls into evaluation level 2. Therefore, one or more candidate reward information corresponding to evaluation level 2, such as payment red envelopes, red envelope subsidies, or points redemption, can be identified as the target reward.

[0173] It should be noted that the range of values ​​for each indicator and the different candidate reward information shown in Table 1 above can also be other values ​​in actual applications, which are not limited in this application.

[0174] 906. The information processing device sends target reward information to the second terminal so that the second terminal can notify the target object of the target reward information. The second terminal may include the first terminal, or the second terminal may not include the first terminal.

[0175] In one or more embodiments, after determining the target reward information, the information processing device also sends the target reward information to the second terminal so that the second terminal can prompt the target object with the target reward information.

[0176] As an illustrative description, the second terminal may include the first terminal, such as those described above. Figure 7 The mentioned devices include palm-swiping devices. In other words, when the second terminal is identical to the first terminal, after determining the target reward information, the information processing device also sends the target reward information to the target recipient through the first terminal.

[0177] Alternatively, if the second terminal does not include the first terminal, for example, if the second terminal is a smartphone, PC, etc., then after the information processing device determines the target reward information, it can also send the target reward information to the target object through the second terminal.

[0178] By using the above method, after determining the target evaluation information for the target operation posture, the corresponding target reward information can be determined using this evaluation information. This allows for the development of different incentive measures based on the operation performance of different users, such as payment red envelopes, digital badges, etc., which increases the fun of the operation and effectively improves user satisfaction and loyalty.

[0179] In some alternative embodiments, the second terminal may use different prompting methods to present the target reward information to the target object, depending on the device type. For example, if the second terminal is the first terminal, the target reward information can be directly displayed through the first terminal; details can be found in the following sections. Figure 10 The illustrated embodiments are for understanding purposes. Alternatively, if the second terminal is not the first terminal, the target reward information can be displayed through the second terminal, as detailed below. Figure 11 The illustrated embodiments are used for understanding.

[0180] Case 1: The second terminal is the first terminal

[0181] For example, in the above Figure 9 Based on one or more embodiments shown, Figure 10 Another flowchart illustrating the information processing method provided in this application is shown. Figure 10 As shown, the information processing method of this application includes at least the following steps:

[0182] 1001. When the target object performs the first operation on the first terminal, the first terminal collects the biometric features of the target object to obtain the target image, and identifies the target operation posture when performing the first operation to obtain the target posture information.

[0183] 1002. The first terminal sends the target posture information and target image to the information processing device.

[0184] 1003. The information processing device calculates the object recognition result based on the target image. The object recognition result is used to indicate whether the target object has been successfully recognized.

[0185] 1004. The information processing device determines target evaluation information based on target posture information and object recognition results. The target evaluation information is used to indicate the quality of the target's operating posture.

[0186] 1005. The information processing device determines the target reward information based on the target evaluation information. The target reward information is used to indicate the reward obtained by the target object when performing the first operation.

[0187] It should be noted that the content of steps 1001 to 1005 above can be referred to the aforementioned... Figure 9 The content described in steps 901 to 905 is for your understanding and will not be repeated here.

[0188] 1006. The information processing equipment sends the target reward information to the first terminal.

[0189] In one or more embodiments, after the information processing device determines the target reward information based on the target evaluation information, it can send the target reward information to the first terminal via a network. For example, the information processing device carries the target reward information in a message and sends the message to the first terminal via the network. Thus, upon receiving the message, the first terminal extracts the target reward information from the message.

[0190] It should be noted that the target reward information described here can be referenced from the aforementioned [reference]. Figure 9 The content described in step 905 is for your understanding and will not be elaborated here.

[0191] 1007. The first terminal prompts the target object with the target reward information.

[0192] In one or more embodiments, after the information processing device sends the target reward information to the first terminal, the first terminal can receive the target reward information. In this way, the first terminal can prompt the target object with the target reward information.

[0193] As an illustrative description, the process by which the first terminal prompts the target object with target reward information can be understood in the following way:

[0194] Before displaying the target reward information, the first terminal first checks whether there is an operation service associated with the target operation gesture on the first terminal. Then, when the first terminal detects the existence of an operation service associated with the operation gesture, it displays the target reward information to the target object through at least one of the first terminal's visual display interface and an audio notification device.

[0195] It should be noted that the described operational services may include, but are not limited to, payment services, access control services, etc. The operational services described in relation to the target operational gesture can be understood as services that can be triggered by the target operational gesture.

[0196] For example, taking a palm-swiping device as the first terminal, Figure 11 This illustration shows a diagram of a target reward message displayed via a first terminal, as provided in this application. Figure 11 As shown, C1 refers to a public transportation vehicle in a transportation scenario. C2 refers to a first terminal deployed inside the public transportation vehicle (e.g., a palm-swiping device). C3 refers to the interface of a payment application displayed on the palm-swiping device. When a user takes a public transportation vehicle and uses a palm-swiping payment service, they can swipe their palm on the device. After the swipe is successful, the user pays the fare, and the payment is displayed. Furthermore, the visual display interface of the palm-swiping device also shows target reward information, such as a "red envelope subsidy," determined when the palm-swiping gesture receives an excellent rating.

[0197] It should be noted that the above Figure 11 This example only uses payment scenarios in transportation as an illustration. In practical applications, the target reward information for other scenarios can also be referenced above. Figure 11 The content described is for your understanding and will not be elaborated upon here.

[0198] By directly instructing the target recipient on the reward information through a first terminal such as a palm-swiping device, the target recipient can view the reward status in a timely and convenient manner, improving user participation and user experience. On the other hand, since the first terminal can collect information such as the recipient's biometric characteristics, displaying the reward through this first terminal ensures that only genuine users can obtain the reward, effectively preventing fraud and improving security.

[0199] Scenario 2: The second terminal is not the first terminal

[0200] For example, in the above Figure 9 Based on one or more embodiments shown, Figure 12 Another flowchart illustrating the information processing method provided in this application is shown. Figure 12 As shown, the information processing method of this application includes at least the following steps:

[0201] 1201. When the target object performs the first operation on the first terminal, the first terminal collects the biometric features of the target object to obtain the target image, and identifies the target operation posture when performing the first operation to obtain the target posture information.

[0202] 1202. The first terminal sends the target posture information and target image to the information processing device.

[0203] 1203. The information processing device calculates the object recognition result based on the target image. The object recognition result is used to indicate whether the target object has been successfully recognized.

[0204] 1204. The information processing equipment determines target evaluation information based on target posture information and object recognition results. The target evaluation information is used to indicate the quality of the target's operating posture.

[0205] 1205. The information processing equipment determines the target reward information based on the target evaluation information. The target reward information is used to indicate the reward obtained by the target object when performing the first operation.

[0206] It should be noted that the content of steps 1201 to 1205 above can be referred to the aforementioned... Figure 9 The content described in steps 901 to 905 is for your understanding and will not be repeated here.

[0207] 1206. The information processing equipment sends the target reward information to the second terminal.

[0208] In one or more embodiments, when the device types of the first terminal and the second terminal are different, the target reward information is obtained in addition to the above-mentioned... Figure 10 In addition to the first terminal prompt described in the previous application, prompts can also be made via a second terminal. For example, the first terminal may include a palm-swiping device, and the second terminal may include a smartphone.

[0209] After the information processing device determines the target reward information based on the target evaluation information, it can send the target reward information to the second terminal via the network. For example, the information processing device can include the target reward information in a message and send the message to the second terminal via the network. Upon receiving the message, the second terminal can then extract the target reward information from it.

[0210] It should be noted that the target reward information mentioned here can be found in the aforementioned text. Figure 9 The content described in step 905 is for your understanding and will not be elaborated here.

[0211] 1207. The second terminal prompts the target object with the target reward information.

[0212] In one or more embodiments, after the information processing device sends the target reward information to the second terminal, the second terminal can receive the target reward information. In this way, the second terminal can prompt the target object with the target reward information.

[0213] As an illustrative description, the process by which the second terminal prompts the target object with target reward information can be understood in the following way:

[0214] Before displaying the target reward information to the target object, the second terminal can first detect whether there is an operation service associated with the target operation gesture on the second terminal. In this way, when the second terminal detects the existence of an operation service associated with the operation gesture, it displays the target reward information to the target object based on the application client corresponding to the operation service.

[0215] It should be noted that the described operational services may include, but are not limited to, payment services, access control services, etc. The operational services described in relation to the target operational gesture can be understood as services that can be triggered by the target operational gesture.

[0216] For example, taking a smartphone as a second terminal, Figure 13 This illustration shows a diagram of a target reward message displayed via a second terminal, as provided in this application. Figure 13As shown, D1 indicates the building in the access control scenario. D2 indicates the first terminal (e.g., a palm-swiping device) deployed at the building's entrance / exit. D3 indicates the visual display interface of the application client (e.g., WeChat) installed on the second terminal (e.g., a smartphone). When a target object enters or exits the building, if using the palm-swiping access control service, the target object can swipe their palm on the device. After successful swiping, the message "Building entrance / exit access control is open" will be displayed. Furthermore, reward information, such as "points redemption" information, determined based on an excellent evaluation level for the palm-swiping gesture, can be displayed to the target object via the WeChat client on their smartphone.

[0217] It should be noted that the above Figure 13 This example uses access control as an example. In practical applications, the target reward information for other scenarios can also be referenced above. Figure 13 The content described is for your understanding and will not be elaborated upon here.

[0218] By using the above method, the target reward information is sent to the target object through a second terminal such as a smartphone. On the one hand, the second terminal can display the rewards obtained when operating on the first terminal in real time, so that the target object can check his reward status anytime and anywhere without having to go through other channels, which is convenient and fast. On the other hand, based on the social sharing function that the application client in the second terminal usually has, users can share their reward status with others, increasing interactivity and fun, and improving users' sense of participation and satisfaction.

[0219] In some alternative embodiments, in addition to showing the target object the relevant information about the current target operation posture, the target object's historical operation postures can also be combined to comprehensively display the posture changes, so that the target object can understand the overall posture change trend in a timely and comprehensive manner. (Illustratively, in the above...) Figure 4 Based on one or more embodiments shown, Figure 14 Another flowchart illustrating the information processing method provided in this application is shown. Figure 14 As shown, the information processing method of this application includes at least the following steps:

[0220] 1401. When the target object performs the first operation on the first terminal, the first terminal collects the biometric features of the target object to obtain the target image, and identifies the target operation posture when performing the first operation to obtain the target posture information.

[0221] 1402. The first terminal sends the target posture information and target image to the information processing device.

[0222] 1403. The information processing device calculates the object recognition result based on the target image. The object recognition result is used to indicate whether the target object has been successfully recognized.

[0223] 1404. The information processing device determines target evaluation information based on target posture information and object recognition results. The target evaluation information is used to indicate the quality of the target's operating posture.

[0224] It should be noted that the content of steps 1401 to 1404 above can be referred to the aforementioned... Figure 4 The content described in steps 401 to 404 is for your understanding and will not be repeated here.

[0225] 1405. The information processing device matches the target image with each candidate feature image in the candidate feature image set to determine the user identifier corresponding to the target image. The user identifier is used to identify the target object.

[0226] In one or more embodiments, after obtaining the target image, the information processing device also needs to determine the corresponding user identifier through the target image in order to extract the historical posture information of the corresponding user. As an illustrative description, the information processing device needs to match the target image with each candidate feature image in the candidate feature image set. Then, the user identifier corresponding to the matched candidate feature image is determined as the user identifier corresponding to the target image. It should be noted that this user identifier can be used to identify the target object.

[0227] For example, taking a palmprint image as the target image, the information processing device can use the aforementioned... Figure 5 The described palmprint recognition module matches the palmprint image with each candidate feature image in the candidate feature image set stored in the palmprint database, thereby extracting the user identifier corresponding to the palmprint image from the user information database based on the matched candidate feature images.

[0228] 1406. The information processing device extracts posture information of multiple historical operation postures of the target object based on the user identifier.

[0229] In one or more embodiments, since each user's historical operation gestures and the gesture information associated with each historical operation gesture are stored in a storage medium such as a database, the information processing device, after obtaining the user identifier, can clearly determine which object's relevant gesture information needs to be extracted from the database. As an illustrative description, the information processing device needs to extract gesture information of multiple historical operation gestures of the target object based on the user identifier. It should be noted that this gesture information of multiple historical operation gestures reflects the gesture situation of the target object when performing the first operation within a past period.

[0230] 1407. The information processing equipment determines the posture evaluation information of the corresponding historical operation posture based on the posture information of each historical operation posture.

[0231] In one or more embodiments, after obtaining the posture information of each historical operation posture, the information processing device can further determine the posture evaluation information of the corresponding historical operation posture based on the posture information of each historical operation posture. It should be noted that the calculation process for obtaining the posture evaluation information of each historical operation posture can be referred to the aforementioned method. Figure 4 The content of step 404 needs to be understood, and will not be elaborated here.

[0232] 1408. The information processing device determines posture change information based on posture evaluation information and target evaluation information of multiple historical operating postures. The posture change information is used to indicate the posture change trend from the historical operating posture to the target operating posture.

[0233] In one or more embodiments, after calculating the posture evaluation information of multiple historical operating postures, the information processing device can determine the posture change information based on the posture evaluation information of these multiple historical operating postures and the target evaluation information.

[0234] For example, an information processing device can sort the posture evaluation information and target evaluation information of multiple historical operating postures according to the generation time of the operating posture, thereby obtaining an evaluation trend map. Based on this evaluation trend map, the information processing device can determine the posture change information. In other words, the posture change information reflects the trend of posture change from historical operating postures to the target operating posture.

[0235] In an optional embodiment, the target evaluation score can be used to characterize target evaluation information, and the historical posture evaluation score can be used to characterize posture evaluation information of historical operating postures. Therefore, in determining posture change information, the information processing device can first calculate the score difference between the target evaluation score and the historical posture evaluation score. Then, the information processing device determines whether the operating posture has improved based on a comparison between the score difference and a second threshold.

[0236] For example, if the information processing device calculates that the score difference is greater than a second threshold, it obtains the first change information. In other words, the first change information of this application is used to indicate that the target operating posture has improved relative to the historical operating posture.

[0237] Conversely, if the information processing device calculates that the score difference is less than or equal to the second threshold, it obtains the second change information. In this application, the second change information is used to reflect that the target operating posture has not improved relative to the historical operating posture.

[0238] By using the above method, the difference in scores can intuitively reflect the difference in operating posture before and after improvement. Therefore, this application uses the difference in scores to judge whether the posture has been improved. This not only allows us to clearly see the effect of the posture change, making the evaluation process more intuitive, but also reduces the influence of subjective judgment on the posture improvement results. This makes it easier to develop targeted improvement measures and improve the efficiency and quality of posture improvement.

[0239] In another alternative embodiment, the information processing device may first calculate the rate of change of posture based on the target evaluation score and multiple historical posture evaluation scores during the process of determining posture change information. In this way, the information processing device then determines whether the operating posture has improved based on the comparison between the score difference and a third threshold.

[0240] For example, when the information processing device calculates that the rate of change in posture is greater than a third threshold, it obtains the third change information. This third change information reflects that the target operating posture has improved compared to the historical operating posture.

[0241] Conversely, if the information processing device calculates that the rate of change in posture is less than or equal to a preset threshold, it obtains the fourth change information. In other words, the fourth change information in this application is used to indicate that the target operating posture has not improved relative to the historical operating posture.

[0242] Using the above method, the posture change rate can intuitively reflect the degree of improvement in operating posture over a period of time. Therefore, this application uses the posture change rate to judge whether posture has improved, which not only reduces the influence of subjective judgment on the posture improvement results and facilitates the formulation of targeted improvement measures, thus improving the efficiency and quality of posture improvement; but also enables continuous observation of the trend and effect of posture improvement by periodically calculating the posture change rate.

[0243] It should be noted that this application only uses the calculation of evaluation score difference and posture change rate as examples for illustration. In practical applications, other calculation methods may also be included to determine whether the operating posture has improved, and this application does not limit the description. In addition, the values ​​of the second threshold, third threshold, etc. mentioned above can be determined according to the needs, and this application does not limit the specific values.

[0244] 1409. The information processing equipment sends posture change information to the first terminal.

[0245] 1410. The first terminal sends the posture change information to the target object.

[0246] In one or more embodiments, after determining the posture change information, the information processing device can send the posture change information to a first terminal. Then, after receiving the posture change information sent by the information processing device, the first terminal displays the posture change information to the target object.

[0247] For example, the first terminal can use at least one of its visual display interface, sound reminder device, and light reminder device to notify the target object of the posture change information.

[0248] In some alternative embodiments, after determining the posture change information in step 1408, the first terminal may also generate a posture change report based on the posture change information, and then recommend posture improvement strategies to the target object based on the posture change report. In this way, after viewing the posture improvement strategy, the target object can adjust its posture in a timely manner based on the posture improvement strategy.

[0249] By using the above methods to analyze posture trends through the target user's historical operation posture scores and the current target operation posture score, we can comprehensively understand the changes in the target user's operation posture, thereby providing more accurate personalized feedback and suggestions, and thus encouraging users to maintain good operating habits in the long term.

[0250] In some alternative embodiments, the information processing methods provided in this application can be represented by JSON code. For example, the following shows an example of a data structure represented by JSON code:

[0251]

[0252]

[0253] As can be seen from the data structure above, userId and sessionId are used to uniquely identify the target object and session. Additionally, timestamp is used to record the time point for data such as target pose information. palmData records the hash of the target image, its location coordinates, and various pose scores. Feedback records target evaluation information, sound, and visual effects. Incentives describes target reward information. Furthermore, progress records the target object's current evaluation level and pose change information.

[0254] It should be noted that the purpose of using the above data structure to record the various information provided in this application is to provide the system with a comprehensive data view, support efficient data processing, and optimize user experience.

[0255] In some alternative embodiments, the information processing method provided in this application can also utilize augmented reality (AR) technology to provide virtual images or animations when the target object performs a first operation on a first terminal. For example, in a swiping scene, when the target object's swiping posture is correct, the AR device can display a virtual trophy or halo effect to increase interactive fun.

[0256] In some alternative embodiments, the information processing device in this application can accumulate points for each successful object recognition after determining that the object recognition result is successful. These points can then be used to redeem virtual goods or unlock new game levels through channels such as a points mall. This approach not only incentivizes users to maintain the correct swiping posture but also increases user engagement.

[0257] In some alternative embodiments, if the first terminal is a device that supports payment services, a payment service system, such as a palm-swipe payment system, can be integrated with a smart wearable device such as a smartwatch or bracelet. In this way, the smart wearable device can track and detect the target's posture in real time and provide timely vibration feedback based on the posture, guiding the target to adjust to a more suitable posture.

[0258] The foregoing primarily describes the solutions provided by the embodiments of this application from a methodological perspective. It is understood that to achieve the above functions, corresponding hardware structures and / or software modules are included to execute each function. Those skilled in the art should readily recognize that, based on the modules and algorithm steps described in conjunction with the embodiments disclosed in this application, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0259] This application embodiment can divide the device into functional modules according to the above method example. For example, each function can be divided into its own functional module, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware or as a software functional module. It should be noted that the module division in this application embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.

[0260] In this application embodiment, the terms "module" or "unit" refer to a computer program or part of a computer program that has a predetermined function and works with other related parts to achieve a predetermined goal, and can be implemented wholly or partially using software, hardware (such as processing circuitry or memory), or a combination thereof. Similarly, a processor (or multiple processors or memory) can be used to implement one or more modules or units. Furthermore, each module or unit can be part of an overall module or unit that includes the functionality of that module or unit.

[0261] The information processing apparatus in this application embodiment will now be described in detail from the perspective of its functional modules. Figure 15 This is an optional schematic diagram of the functional modules of the information processing device provided in the embodiments of this application. For example... Figure 15 As shown, the information processing device may include an acquisition unit 1501, a calculation unit 1502, a determination unit 1503, and a transmission unit 1504.

[0262] The acquisition unit 1501 is used to acquire target posture information and target image sent by the first terminal. The target posture information is obtained by the first terminal recognizing the target operation posture of the target object when performing the first operation on the first terminal. The target image is obtained by the first terminal collecting the biometric features of the target object when performing the first operation.

[0263] The calculation unit 1502 is used to calculate the object recognition result based on the target image. The object recognition result is used to indicate whether the target object has been successfully recognized.

[0264] The determining unit 1503 is used to determine target evaluation information based on target posture information and object recognition results. The target evaluation information is used to indicate the quality of the target's operating posture.

[0265] The sending unit 1504 is used to send the object recognition result and target evaluation information to the first terminal, so that the first terminal can prompt the object recognition result and target evaluation information to the target object.

[0266] Optionally, in the above Figure 15 Based on one described embodiment, in another embodiment of the information processing apparatus provided in this application, the determining unit 1503 is specifically used for:

[0267] Extract at least one of the following from the target pose information: target distance, pose tilt angle of the target operation pose, target operation pose, and target time. The target distance is the distance between the target object and the first terminal when the first operation is performed, and the target time is the time when the target image is obtained.

[0268] The target evaluation score is obtained by weighted summation of at least one of the following: target distance, target operation posture tilt angle, target operation posture, target time, and object recognition result.

[0269] Target evaluation information is obtained based on the target evaluation score.

[0270] Optionally, in the above Figure 15 Based on one or more of the described embodiments, in another embodiment of the information processing apparatus provided in this application, the computing unit 1502 is specifically used for:

[0271] Feature extraction is performed on the target image to obtain the biological characteristics of the target object;

[0272] The biometric features of the target object are compared with the preset biometric features to obtain a feature matching score.

[0273] The feature matching score is compared with a first threshold, and the object recognition result is obtained based on the comparison result.

[0274] Optionally, in the above Figure 15 Based on one or more of the described embodiments, in another embodiment of the information processing apparatus provided in this application,

[0275] The determining unit 1503 is also specifically used to determine target reward information based on the target evaluation information after determining the target evaluation information based on the target pose information and the object recognition result. The target reward information is used to indicate the reward obtained by the target object when performing the first operation.

[0276] The sending unit 1504 is specifically used to send target reward information to the second terminal so that the second terminal can notify the target object of the target reward information.

[0277] Optionally, in the above Figure 15 Based on one or more of the described embodiments, in another embodiment of the information processing apparatus provided in this application, the determining unit 1503 is specifically used for:

[0278] Based on the target evaluation score and the range of index values ​​for each evaluation level, the target posture level of the target operation posture is determined.

[0279] Based on the target posture level and the first association relationship, the target reward information is determined from multiple candidate reward information. The first association relationship is used to characterize the mapping relationship between each evaluation level and one or more candidate reward information.

[0280] Optionally, in the above Figure 15 Based on one or more embodiments described, in another embodiment of the information processing apparatus provided in this application, the determining unit 1503 is further specifically used for:

[0281] After determining the target evaluation information based on the target pose information and object recognition results, the target image is matched with each candidate feature image in the candidate feature image set to determine the user identifier corresponding to the target image. The user identifier is used to identify the target object.

[0282] Based on user identifiers, extract gesture information from multiple historical operation gestures of the target object;

[0283] Based on the posture information of each historical operation posture, determine the posture evaluation information of the corresponding historical operation posture.

[0284] Posture change information is determined based on posture evaluation information and target evaluation information from multiple historical operating postures. The posture change information is used to indicate the trend of posture change from historical operating posture to target operating posture.

[0285] The sending unit 1504 is used to send posture change information to the first terminal so that the first terminal can prompt the posture change information to the target object.

[0286] Optionally, in the above Figure 15 Based on one or more of the described embodiments, in another embodiment of the information processing apparatus provided in this application, the determining unit 1503 is specifically used for:

[0287] Calculate the score difference between the target evaluation score and the historical posture evaluation score. The target evaluation score is used to represent the target evaluation information, and the historical posture evaluation score is used to represent the posture evaluation information of the historical operation posture.

[0288] When the score difference is greater than the second threshold, the first change information is obtained. The first change information is used to indicate that the target operation posture has been improved relative to the historical operation posture.

[0289] or,

[0290] When the score difference is less than or equal to the second threshold, the second change information is obtained. The second change information is used to indicate that the target operating posture has not improved relative to the historical operating posture.

[0291] Optionally, in the above Figure 15 Based on one or more of the described embodiments, in another embodiment of the information processing apparatus provided in this application, the determining unit 1503 is specifically used for:

[0292] Based on the target evaluation score and multiple historical posture evaluation scores, the posture change rate is calculated. The target evaluation score is used to characterize the target evaluation information, and each historical posture evaluation score is used to characterize the posture evaluation information of the corresponding historical operation posture.

[0293] When the rate of change of posture is greater than the third threshold, the third change information is obtained. The third change information is used to indicate that the target operation posture has been improved relative to the historical operation posture.

[0294] or,

[0295] When the rate of change of posture is less than or equal to a preset threshold, a fourth change information is obtained. The fourth change information is used to indicate that the target operating posture has not improved relative to the historical operating posture.

[0296] Optionally, in the above Figure 15 Based on one or more of the described embodiments, in another embodiment of the information processing apparatus provided in this application, the second terminal includes the first terminal, or the second terminal does not include the first terminal.

[0297] The above Figure 15 The information processing device has been described mainly from the perspective of functional modules. The first terminal in the embodiments of this application will be described in detail below from the perspective of functional modules. Figure 16 This is an optional schematic diagram of the functional modules of the first terminal provided in the embodiments of this application. For example... Figure 16 As shown, the first terminal includes an identification module 1601, a sending module 1602, an acquisition module 1603, and a prompting module 1604. Optionally, the first terminal also includes a detection module 1605.

[0298] The identification module 1601 is used to collect the biometric features of the target object when the target object performs a first operation on the first terminal, obtain a target image, and identify the target operation posture when performing the first operation to obtain target posture information.

[0299] The sending module 1602 is used to send target posture information and target image to the information processing device. The target image is used by the information processing device to calculate the object recognition result. The object recognition result and target posture information are used by the information processing device to determine the target evaluation information. The object recognition result is used to indicate whether the target object has been successfully recognized. The target evaluation information is used to indicate the quality of the target operation posture.

[0300] The acquisition module 1603 is used to receive object recognition results and target evaluation information sent by the information processing device;

[0301] The prompting module 1604 is used to prompt the target object with the object recognition results and target evaluation information.

[0302] Optionally, in the above Figure 16 Based on one described embodiment, in another embodiment of the first terminal provided in this application, the prompting module 1604 is specifically used for:

[0303] The target object is prompted with the object recognition result and target evaluation information through at least one of the following: a visual display interface of the first terminal, a sound reminder device, and a light reminder device.

[0304] Optionally, in the above Figure 16 Based on the one or more embodiments described, in another embodiment of the first terminal provided in this application,

[0305] The acquisition module 1603 is also specifically used to receive target reward information sent by the information processing device after sending target posture information and target image to the information processing device. The target reward information is obtained by the information processing device based on the target evaluation information and is used to indicate the reward obtained by the target object when performing the first operation.

[0306] The prompt module 1604 is also used to prompt the target object with target reward information.

[0307] Optionally, in the above Figure 16 Based on the one or more embodiments described, in another embodiment of the first terminal provided in this application,

[0308] The detection module 1605 is specifically used to detect whether there is an operation service associated with the target operation posture in the first terminal before prompting the target reward information to the target object;

[0309] The prompting module 1604 is specifically used to prompt the target object with target reward information through at least one of the visual display interface of the first terminal and the sound reminder device when an operation service associated with the operation posture is detected.

[0310] The above Figure 15 and Figure 16 The information processing device and the first terminal were mainly described from the perspective of functional modules. The second terminal in the embodiments of this application will be described in detail below from the perspective of functional modules. Figure 17 This is an optional schematic diagram of the functional modules of the second terminal provided in the embodiments of this application. For example... Figure 17 As shown, the second terminal includes a receiving unit 1701 and a prompting unit 1702. Optionally, the second terminal further includes a detection unit 1703.

[0311] The receiving unit 1701 is specifically used to receive target reward information sent by the information processing device. The target reward information is obtained by the information processing device based on target evaluation information. The target evaluation information is obtained by the information processing device based on object recognition results and target posture information. The object recognition results are obtained by the information processing device processing the target image. The target posture information is obtained by the first terminal recognizing the target operation posture of the target object when performing the first operation on the first terminal. The object recognition results are used to indicate whether the target object has been successfully recognized. The target evaluation information is used to indicate the quality of the target operation posture. The target reward information is used to indicate the reward obtained by the target object when performing the first operation. The second terminal does not include the first terminal. The target image is obtained by the first terminal collecting the biometrics of the target object when performing the first operation.

[0312] The prompting unit 1702 is specifically used to prompt the target object with target reward information.

[0313] Optionally, in the above Figure 17 Based on one described embodiment, in another embodiment of the second terminal provided in this application,

[0314] The detection unit 1703 is specifically used to detect whether there is an operation service associated with the target operation posture in the second terminal before prompting the target reward information to the target object.

[0315] The prompting unit 1702 is specifically used to prompt the target object with target reward information based on the application client corresponding to the operation service when an operation service associated with the operation posture is detected.

[0316] The processing device in the embodiments of this application is described below from the perspective of hardware processing. Figure 18 This is a schematic diagram of the processing device provided in an embodiment of this application. The processing device can vary considerably due to differences in configuration or performance; for example, it may include the aforementioned... Figure 15 The information processing device shown in the figure Figure 16 The first terminal shown or Figure 17 The second terminal shown, etc.

[0317] like Figure 18 As shown, the processing device 400 can vary significantly due to different configurations or performance, and may include one or more central processing units (CPUs) 322 (e.g., one or more processors) and memory 332, and one or more storage media 330 (e.g., one or more mass storage devices) for storing application programs 342 or data 344. The memory 332 and storage media 330 can be temporary or persistent storage. The program stored in the storage media 330 may include one or more modules (not shown in the figure), each module including a series of instruction operations on the processing device. Furthermore, the CPU 322 may be configured to communicate with the storage media 330 and execute a series of instruction operations in the storage media 330 on the processing device 400. Exemplarily, the CPU 322 is used to execute the application program 342 stored in the storage media 330, thereby implementing the information processing method provided in the above embodiments of this application.

[0318] The processing device 400 may also include one or more power supplies 326, one or more wired or wireless network interfaces 350, one or more input / output interfaces 358, and / or one or more operating systems 341, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, etc.

[0319] For example, Figure 18 The central processing unit 322 can invoke computer execution instructions stored in memory 332 to cause the processing device to perform actions such as... Figures 4 to 14 The method in one or more method embodiments.

[0320] Specifically, Figure 15 The calculation unit 1502 and the determination unit 1503 in the middle Figure 16 The recognition module 1601, prompting module 1604, and detection module 1605 are included. Figure 17 The functions / implementation process of the prompting unit 1702 and the detection unit 1703 can be understood through... Figure 18 The central processing unit 322 in the memory calls computer execution instructions stored in the memory 332 to achieve this. Figure 15 The acquisition unit 1501 and the sending unit 1504 in the middle Figure 16 The acquisition module 1603 and the sending module 1602 in the middle Figure 17 The function / implementation process of the receiving unit 1701 can be achieved through... Figure 18 It is implemented using the input / output interface 358.

[0321] The steps performed by the processing device in the above embodiments can be based on this Figure 18 The processing equipment structure is shown.

[0322] This application also provides a computer-readable storage medium storing a computer program or instructions thereon, which, when executed by a processor, implements the steps of the methods described in the foregoing embodiments.

[0323] This application also provides a computer program product, including a computer program or instructions, which, when executed by a processor, implement the steps of the methods described in the foregoing embodiments.

[0324] In the above embodiments, the implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. Those skilled in the art will readily understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0325] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces, or indirect coupling or communication connection between apparatuses or units, and may be electrical, mechanical, or other forms.

[0326] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0327] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0328] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0329] A computer program product includes one or more computer instructions. When these computer instructions are loaded and executed on a computer, they generate, in whole or in part, the processes or functions according to embodiments of this application. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions may be transmitted from one website, computer, server, or data center to another via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a server or data center that integrates one or more available media. The available media may be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media (e.g., SSDs), etc.

[0330] The above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. An information processing method, characterized in that, Applied to an information processing device, the method includes: The first terminal sends target posture information and target image. The target posture information is obtained by the first terminal recognizing the target operation posture of the target object when performing the first operation on the first terminal. The target image is obtained by the first terminal collecting the biometric features of the target object when performing the first operation. Based on the target image, an object recognition result is calculated, and the object recognition result is used to indicate whether the target object has been successfully recognized. Target evaluation information is determined based on the target posture information and the object recognition result. The target evaluation information is used to indicate the quality of the target operation posture. The object recognition result and the target evaluation information are sent to the first terminal so that the first terminal can prompt the object recognition result and the target evaluation information to the target object.

2. The method according to claim 1, characterized in that, Determining target evaluation information based on the target pose information and the object recognition result includes: At least one of the following is extracted from the target pose information: target distance, pose tilt angle of the target operation pose, target operation pose, and target time. The target distance is the distance between the target object and the first terminal when the target object performs the first operation, and the target time is the time when the target image is obtained. A target evaluation score is obtained by weighted summation of at least one of the target distance, the tilt angle of the target operation posture, the target operation posture, the target time, and the object recognition result. Target evaluation information is obtained based on the target evaluation score.

3. The method according to any one of claims 1 to 2, characterized in that, The object recognition result is calculated based on the target image, including: Feature extraction is performed on the target image to obtain the biological characteristics of the target object; The biometrics of the target object are compared with preset biometrics to obtain a feature matching score; The feature matching score is compared with a first threshold, and the object recognition result is obtained based on the comparison result.

4. The method according to any one of claims 2 to 3, characterized in that, After determining the target evaluation information based on the target pose information and the object recognition result, the method further includes: Target reward information is determined based on the target evaluation information, and the target reward information is used to indicate the reward obtained by the target object when performing the first operation; The target reward information is sent to the second terminal so that the second terminal can present the target reward information to the target object.

5. The method according to claim 4, characterized in that, Determining target reward information based on the target evaluation information includes: Based on the target evaluation score and the range of index values ​​for each evaluation level, the target posture level of the target operation posture is determined; Based on the target posture level and the first association relationship, target reward information is determined from multiple candidate reward information, whereby the first association relationship is used to characterize the mapping relationship between each evaluation level and one or more candidate reward information.

6. The method according to claim 1, characterized in that, After determining the target evaluation information based on the target pose information and the object recognition result, the method further includes: The target image is matched with each candidate feature image in the candidate feature image set to determine the user identifier corresponding to the target image, and the user identifier is used to identify the target object; Based on the user identifier, extract gesture information of multiple historical operation gestures of the target object; Based on the posture information of each historical operation posture, determine the posture evaluation information corresponding to the historical operation posture; Posture change information is determined based on posture evaluation information of multiple historical operating postures and target evaluation information, wherein the posture change information is used to indicate the posture change trend from the historical operating posture to the target operating posture. The posture change information is sent to the first terminal so that the first terminal can prompt the target object with the posture change information.

7. The method according to claim 6, characterized in that, Based on multiple historical posture evaluation information and the target evaluation information, posture change information is determined, including: Calculate the score difference between the target evaluation score and the historical posture evaluation score, wherein the target evaluation score is used to characterize the target evaluation information and the historical posture evaluation score is used to characterize the posture evaluation information of the historical operation posture; When the score difference is greater than the second threshold, first change information is obtained, which is used to indicate that the target operation posture has been improved relative to the historical operation posture. or, When the score difference is less than or equal to the second threshold, second change information is obtained, which indicates that the target operating posture has not improved relative to the historical operating posture.

8. The method according to claim 6, characterized in that, Based on multiple historical posture evaluation information and the target evaluation information, posture change information is determined, including: Based on the target evaluation score and multiple historical posture evaluation scores, the posture change rate is calculated. The target evaluation score is used to characterize the target evaluation information, and each historical posture evaluation score is used to characterize the posture evaluation information corresponding to the historical operation posture. When the rate of change of posture is greater than a third threshold, third change information is obtained, which is used to indicate that the target operating posture has been improved relative to the historical operating posture. or, When the rate of change of posture is less than or equal to the preset threshold, a fourth change information is obtained, which is used to indicate that the target operating posture has not improved relative to the historical operating posture.

9. The method according to any one of claims 4 to 5, characterized in that, The second terminal may include the first terminal, or the second terminal may not include the first terminal.

10. A method for information processing, characterized in that, Applied to a first terminal, the method includes: When the target object performs the first operation on the first terminal, the biometric features of the target object are collected to obtain a target image, and the target operation posture during the first operation is identified to obtain target posture information. The target posture information and the target image are sent to the information processing device. The target image is used by the information processing device to calculate the object recognition result. The object recognition result and the target posture information are used by the information processing device to determine the target evaluation information. The object recognition result is used to indicate whether the target object has been successfully recognized. The target evaluation information is used to indicate the quality of the target operation posture. Receive the object identification result and the target evaluation information sent by the information processing device; The object recognition result and the target evaluation information are displayed to the target object.

11. The method according to claim 10, characterized in that, Prompting the target object to the object recognition result and the target evaluation information includes: The target object is prompted with the object recognition result and the target evaluation information through at least one of the visual display interface, sound reminder device, and light reminder device of the first terminal.

12. The method according to claim 10, characterized in that, After sending the target pose information and the target image to the information processing device, the method further includes: The system receives target reward information sent by the information processing device. The target reward information is obtained by the information processing device based on the target evaluation information. The target reward information is used to indicate the reward obtained by the target object when performing the first operation. The target object is prompted with the target reward information.

13. The method according to claim 12, characterized in that, Before prompting the target object with the target reward information, the method further includes: Detect whether there is an operation service associated with the target operation gesture in the first terminal; Prompting the target object with the target reward information includes: When an operation service associated with the operation posture is detected, the target reward information is prompted to the target object through at least one of the visual display interface of the first terminal and the sound reminder device.

14. An information processing method, characterized in that, Applied to the second terminal, including: The system receives target reward information sent by the information processing device. The target reward information is obtained by the information processing device based on the target evaluation information. The target evaluation information is obtained by the information processing device based on the object recognition result and target posture information. The object recognition result is obtained by the information processing device processing the target image. The target posture information is obtained by the first terminal recognizing the target operation posture of the target object when performing the first operation on the first terminal. The object recognition result indicates whether the target object has been successfully recognized. The target evaluation information indicates the quality of the target operation posture. The target reward information indicates the reward obtained by the target object when performing the first operation. The second terminal does not include the first terminal. The target image is obtained by the first terminal collecting biometric data of the target object when performing the first operation. The target object is prompted with the target reward information.

15. The method according to claim 14, characterized in that, Before prompting the target object with the target reward information, the method further includes: Detect whether there is an operation service associated with the target operation gesture in the second terminal; Prompting the target object with the target reward information includes: When an operation service associated with the operation gesture is detected, the target reward information is prompted to the target object based on the application client corresponding to the operation service.

16. An information processing device, characterized in that, include: The acquisition unit is used to acquire target posture information and target image sent by the first terminal. The target posture information is obtained by the first terminal recognizing the target operation posture of the target object when performing the first operation on the first terminal. The target image is obtained by the first terminal collecting the biometric features of the target object when performing the first operation. A calculation unit is used to calculate an object recognition result based on the target image, wherein the object recognition result is used to indicate whether the target object has been successfully recognized. The determining unit is configured to determine target evaluation information based on the target posture information and the object recognition result, wherein the target evaluation information is used to indicate the quality of the target operation posture; The sending unit is configured to send the object recognition result and the target evaluation information to the first terminal, so that the first terminal will prompt the object recognition result and the target evaluation information to the target object.

17. A first terminal, characterized in that, include: The identification module is used to collect the biometric features of the target object when the target object performs a first operation on the first terminal, obtain a target image, and identify the target operation posture when performing the first operation to obtain target posture information. The sending module is used to send the target posture information and the target image to the information processing device. The target image is used by the information processing device to calculate the object recognition result. The object recognition result and the target posture information are used by the information processing device to determine the target evaluation information. The object recognition result is used to indicate whether the target object has been successfully recognized. The target evaluation information is used to indicate the quality of the target operation posture. The acquisition module is used to receive the object recognition result and the target evaluation information sent by the information processing device; The prompting module is used to prompt the target object with the object recognition result and the target evaluation information.

18. An access processing device, characterized in that, include: Input / output interface, processor, and memory, wherein the memory stores program instructions; The processor is configured to execute program instructions stored in the memory to perform the method as described in any one of claims 1 to 9; or to perform the method as described in any one of claims 10 to 13; or to perform the method as described in any one of claims 14 to 15.

19. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes instructions that, when executed on a computer device, cause the computer device to perform the method as claimed in any one of claims 1 to 9; or to perform the method as claimed in any one of claims 10 to 13; or to perform the method as claimed in any one of claims 14 to 15.

20. A computer program product, characterized in that, The computer program product includes instructions that, when executed on a computer device, cause the computer device to perform the method as described in any one of claims 1 to 9; or to perform the method as described in any one of claims 10 to 13; or to perform the method as described in any one of claims 14 to 15.