Palm image recognition method, device, equipment, storage medium and program product

Abstract

The present application discloses a palm image recognition method, device, equipment, storage medium and program product, which belongs to the field of computer technology. The method includes: acquiring the palm image through the camera; performing palm detection processing on the palm image to generate a palm frame of the palm in the palm image; determining the position information of the palm relative to the palm image recognition device based on the palm frame and the palm image; displaying the palm identification corresponding to the palm on the screen based on the position information, and performing comparative identification processing on the palm image captured by the camera at the preset spatial position to obtain the object identification corresponding to the palm image. Through the above method, the palm identification can be used to assist the object to move the palm to the preset spatial position corresponding to the camera, thereby guiding the object to quickly move the palm to a suitable palm swiping position, thereby improving the recognition efficiency of palm image recognition.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer technology, and in particular to a palm image recognition method, device, equipment, storage medium and program product. Background Art

[0002] With the development of computer technology, palm recognition technology is being used more and more widely and can be applied in a variety of scenarios. For example, in payment scenarios or clocking in at work, the user's identity can be verified through palm recognition.

[0003] In the related art, when a user swipes his palm, a computer device collects a palm image, and the computer device transmits the palm image to a palm recognition server through a network. The palm recognition server recognizes the palm image, thereby completing identity recognition.

[0004] When a user swipes his palm in front of a palm image recognition device with a camera, how to ensure that the user can quickly adjust the palm to a suitable swiping position is an important issue that needs to be solved urgently. Summary of the invention

[0005] The present application provides a palm image recognition method, device, equipment, storage medium and program product, and the technical solution is as follows:

[0006] According to one aspect of the present application, a palm image recognition method is provided, the method comprising:

[0007] Acquire the palm image through the camera;

[0008] Performing palm detection processing on the palm image to generate a palm frame of the palm in the palm image;

[0009] determining, based on the palm frame and the palm image, position information of the palm relative to the palm image recognition device;

[0010] Based on the position information, a palm identifier corresponding to the palm is displayed on the screen, and the palm identifier is used to indicate that the palm moves to a preset spatial position corresponding to the camera. The palm image captured by the camera at the preset spatial position is compared and identified to obtain an object identifier corresponding to the palm image.

[0011] According to one aspect of the present application, a method for displaying a palm mark is provided, the method comprising:

[0012] Displaying an interactive interface of the palm image recognition device;

[0013] In response to a palm image recognition operation triggered in the palm image recognition device, a palm identifier and an effective recognition area identifier corresponding to the palm image are displayed, wherein the palm identifier is used to indicate a spatial position of the palm relative to the palm image recognition device, and the effective recognition area identifier is used to indicate a preset spatial position corresponding to the camera;

[0014] In response to the movement of the palm, updating a display position of the palm mark on the interactive interface, wherein the display position corresponds to a position of the palm in front of the camera;

[0015] In response to the palm mark moving to the position of the effective recognition area mark, first prompt information that the palm image is undergoing palm image recognition is displayed.

[0016] According to one aspect of the present application, a palm image recognition device is provided, the device comprising:

[0017] An acquisition module, used for acquiring the palm image through the camera;

[0018] A palm frame detection module, used for performing palm detection processing on the palm image to generate a palm frame of the palm in the palm image and parameter information of the palm frame;

[0019] a position information determination module, configured to determine position information of the palm relative to the palm image recognition device based on the palm frame and the palm image;

[0020] An identification module is used to display a palm identifier corresponding to the palm on the screen based on the position information, wherein the palm identifier is used to indicate that the palm moves to the preset spatial position corresponding to the camera, and to perform comparative identification processing on the palm image captured by the camera at the preset spatial position to obtain an object identifier corresponding to the palm image.

[0021] In a possible implementation, a palm frame detection module is used to perform the palm detection process on the palm image to determine the parameter information of the palm; determine the parameter information of the palm frame based on the parameter information of the palm; generate the palm frame of the palm in the palm image based on the parameter information of the palm frame; wherein the parameter information of the palm frame includes the width, height and center point of the palm frame

[0022] In a possible implementation, the position information includes orientation information; and the position information determination module is used to determine the orientation information of the palm relative to the camera based on the center point of the palm frame and the image center point of the palm image.

[0023] In a possible implementation, the position information includes distance information; and the position information determination module is configured to calculate the distance information of the palm relative to the palm image recognition device based on the width and / or height of the palm frame.

[0024] In a possible implementation, the position information determination module is used to calculate the area of ​​the palm frame based on the width and height of the palm frame; compare the area of ​​the palm frame with a preset area threshold to obtain the distance information of the palm relative to the camera.

[0025] In a possible implementation, the position information determination module is used to perform calculations based on the width of the palm frame and a first threshold to obtain a first distance value of the palm relative to the palm image recognition device, where the first threshold refers to a preset value of the width of the palm frame.

[0026] In a possible implementation, the position information determination module is used to perform calculations based on the height of the palm frame and a second threshold to obtain a second distance value of the palm relative to the palm image recognition device, where the second threshold refers to a preset height value of the palm frame.

[0027] In a possible implementation, the position information determination module is used to perform calculations based on the width of the palm frame and a first threshold to obtain a first distance value of the palm relative to the palm image recognition device; perform calculations based on the height of the palm frame corresponding to the palm and a second threshold to obtain a second distance value of the palm relative to the palm image recognition device; and obtain the distance information of the palm relative to the palm image recognition device based on the first distance value and the second distance value.

[0028] In a possible implementation, a palm frame detection module is used to divide the palm image into at least two grids; perform at least one palm frame prediction on each of the grids through a palm frame recognition model to obtain a confidence value corresponding to each predicted palm frame; and determine the palm frame of the palm in the palm image based on the confidence value corresponding to the predicted palm frame.

[0029] In a possible implementation, a palm frame detection module is used to obtain a sample palm image and a sample palm frame corresponding to the sample palm image; perform data processing on the sample palm image through the palm frame recognition model to obtain a predicted palm frame; and update the model parameters of the palm frame recognition model based on the difference between the predicted palm frame and the sample palm frame.

[0030] According to one aspect of the present application, a palm identification display device is provided, the device comprising:

[0031] A display module, used to display the interactive interface of the palm image recognition device;

[0032] The display module is further used to display a palm identifier and an effective recognition area identifier corresponding to the palm image in response to a palm image recognition operation triggered in the palm image recognition device, wherein the palm identifier is used to indicate a spatial position of the palm relative to the palm image recognition device, and the effective recognition area identifier is used to indicate a preset spatial position corresponding to the camera;

[0033] The display module is further configured to update a display position of the palm mark on the interactive interface in response to movement of the palm, wherein the display position corresponds to a position of the palm in front of the camera;

[0034] The display module is further configured to display first prompt information that the palm image is undergoing palm image recognition in response to the palm identifier moving to the position of the effective recognition area identifier.

[0035] In one possible implementation, the display module is used to respond to a palm image recognition operation triggered in the palm image recognition device, and display the position information of the palm relative to the palm image recognition device through the palm identifier and the effective recognition area identifier during the process of the camera capturing the palm image.

[0036] In one possible implementation, the position information includes orientation information; a display module is used to respond to a palm image recognition operation triggered in the palm image recognition device, and to represent the orientation information between the palm and the camera by displaying the relative position information between the palm identifier and the effective recognition area identifier.

[0037] In one possible implementation, the location information includes distance information; a display module is used to respond to a palm image recognition operation triggered in the palm image recognition device, and to indicate the distance information between the palm and the camera by displaying a change in the shape of the palm identifier.

[0038] In a possible implementation, the display module is used to display second prompt information in response to a palm image recognition operation triggered in the palm image recognition device, where the second prompt information is used to indicate that the palm identifier moves to the position of the effective recognition area identifier.

[0039] According to another aspect of the present application, a computer device is provided, which includes: a processor and a memory, wherein at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor to implement the palm image recognition method as described above.

[0040] According to another aspect of the present application, a computer storage medium is provided, in which at least one computer program is stored. The at least one computer program is loaded and executed by a processor to implement the palm image recognition method as described above.

[0041] According to another aspect of the present application, a computer program product is provided, which includes a computer program stored in a computer-readable storage medium; the computer program is read and executed from the computer-readable storage medium by a processor of a computer device, so that the computer device executes the palm image recognition method described above.

[0042] The beneficial effects of the technical solution provided by this application include at least:

[0043] Acquire a palm image through a camera; perform palm detection processing on the palm image to generate a palm frame of the palm in the palm image; determine the position information of the palm relative to the palm image recognition device based on the palm frame and the palm image; display a palm identifier corresponding to the palm on the screen based on the position information, the palm identifier is used to indicate that the palm moves to a preset spatial position corresponding to the camera, and perform comparative recognition processing on the palm image captured by the camera at the preset spatial position to obtain an object identifier corresponding to the palm image. The present application determines the position information of the palm relative to the palm image recognition device through a palm frame and a palm image in a palm image; and displays a palm identifier corresponding to the palm on the screen based on the position information, and can assist the object to move the palm to the preset spatial position corresponding to the camera according to the palm identifier, thereby guiding the object to quickly move the palm to a suitable palm swiping position, thereby improving the recognition efficiency of palm image recognition. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0045] Figure 1 is a schematic diagram of a palm image recognition method provided by an exemplary embodiment of the present application;

[0046] Figure 2 is a schematic diagram of the architecture of a computer system provided by an exemplary embodiment of the present application;

[0047] Figure 3 is a flow chart of a palm image recognition method provided by an exemplary embodiment of the present application;

[0048] Figure 4 is a flow chart of a palm image recognition method provided by an exemplary embodiment of the present application;

[0049] Figure 5 is a schematic diagram of a palm frame provided by an exemplary embodiment of the present application;

[0050] Figure 6 is a schematic diagram of finger gaps in a palm provided by an exemplary embodiment of the present application;

[0051] Figure 7 is a schematic diagram of a palm frame provided by an exemplary embodiment of the present application;

[0052] Figure 8 is a schematic diagram of cross-device payment based on a palm image recognition method provided by an exemplary embodiment of the present application;

[0053] Fig. 9 is a schematic diagram of a cross-device identity authentication based on a palm image recognition method provided by an exemplary embodiment of the present application;

[0054] Fig.10 is a flow chart of a method for displaying a palm mark provided by an exemplary embodiment of the present application;

[0055] Fig.11 is a flow chart of a method for displaying a palm mark provided by an exemplary embodiment of the present application;

[0056] Fig.12 is a schematic diagram of an interactive interface of a palm image recognition device provided by an exemplary embodiment of the present application;

[0057] Fig.13 is a schematic diagram of position information of a palm relative to a palm image recognition device provided by an exemplary embodiment of the present application;

[0058] Fig.14 is a schematic diagram of a palm mark relative to an effective recognition area mark provided by an exemplary embodiment of the present application;

[0059] Fig.15 is a schematic diagram of an interactive interface for performing palm image recognition provided by an exemplary embodiment of the present application;

[0060] Fig.16 is a flow chart of a palm image recognition method provided by an exemplary embodiment of the present application;

[0061] Fig.17 is a block diagram of a palm image recognition device provided by an exemplary embodiment of the present application;

[0062] Fig.18 is a block diagram of a display device for a palm identifier provided by an exemplary embodiment of the present application;

[0063] Fig.19 It is a structural diagram of a computer device provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0064] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0065] First, several terms involved in the embodiments of the present application are briefly introduced:

[0066] Artificial Intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can respond in a similar way to human intelligence. Artificial intelligence is to study the design principles and implementation methods of various intelligent machines so that machines have the functions of perception, reasoning and decision-making.

[0067] Artificial intelligence technology is a comprehensive discipline that covers a wide range of fields, including both hardware-level and software-level technologies. The basic technologies of artificial intelligence generally include sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, mechatronics and other technologies. Artificial intelligence software technology mainly includes computer vision technology, speech processing technology, natural language processing technology, and machine learning / deep learning.

[0068] Cloud technology refers to a hosting technology that unifies hardware, software, network and other resources within a wide area network or local area network to achieve data computing, storage, processing and sharing.

[0069] Cloud technology is a general term for network technology, information technology, integration technology, management platform technology, application technology, etc. based on the cloud computing business model. It can form a resource pool, which can be used on demand and is flexible and convenient. Cloud computing technology will become an important support. The backend services of the technical network system require a large amount of computing and storage resources, such as video websites, picture websites and more portal websites. With the rapid development and application of the Internet industry, in the future, each item may have its own identification mark, which needs to be transmitted to the backend system for logical processing. Data of different levels will be processed separately. All kinds of industry data need strong system backing support, which can only be achieved through cloud computing.

[0070] Cloud computing is a computing model that distributes computing tasks across a resource pool consisting of a large number of computers, enabling various application systems to obtain computing power, storage space, and information services as needed. The network that provides resources is called a "cloud". From the user's perspective, the resources in the "cloud" are infinitely scalable and can be accessed at any time, used on demand, expanded at any time, and paid for as needed.

[0071] As a provider of basic cloud computing capabilities, a cloud computing resource pool (referred to as a cloud platform, generally referred to as an IaaS (Infrastructure as a Service) platform) will be established, and various types of virtual resources will be deployed in the resource pool for external customers to choose to use. The cloud computing resource pool mainly includes: computing devices (virtualized machines, including operating systems), storage devices, and network devices.

[0072] According to the logical function division, the PaaS (Platform as a Service) layer can be deployed on the IaaS (Infrastructure as a Service) layer, and the SaaS (Software as a Service) layer can be deployed on the PaaS layer. SaaS can also be deployed directly on IaaS. PaaS is a platform for software operation, such as databases, Web (World Wide Web) containers, etc. SaaS is a variety of business software, such as web portals, SMS mass senders, etc. Generally speaking, SaaS and PaaS are upper layers relative to IaaS.

[0073] Computer vision technology (CV) is a science that studies how to make machines "see". To put it more specifically, it refers to machine vision such as using cameras and computers to replace human eyes to identify and measure targets, and further perform graphic processing so that the computer processing becomes an image that is more suitable for human eye observation or transmission to instrument detection. As a scientific discipline, computer vision studies related theories and technologies, and attempts to establish an artificial intelligence system that can obtain information from images or multi-dimensional data. Computer vision technology usually includes image processing, image recognition, image semantic understanding, image retrieval, video processing, video semantic understanding, video content / behavior recognition, three-dimensional object reconstruction, 3D technology, virtual reality, augmented reality, simultaneous positioning and map construction, and also includes common biometric recognition technology.

[0074] The present application embodiment provides a schematic diagram of a palm image recognition method, such as Figure 1 As shown, the method is applied to a palm image recognition device with a camera, and the method can be executed by a computer device, which can be a terminal or a server.

[0075] Exemplarily, the computer device displays the interactive interface 101 of the palm image recognition device; in response to the palm image recognition operation triggered in the palm image recognition device, the computer device displays the palm identifier 102 and the effective recognition area identifier 103 corresponding to the palm image; in response to the movement of the palm, the computer device updates the display position of the palm identifier 102 on the interactive interface 101, wherein the display position corresponds to the position of the palm in front of the camera; in response to the palm identifier 102 moving to the position of the effective recognition area identifier 103, the computer device displays the first prompt information 105 that the palm image is undergoing palm image recognition.

[0076] Optionally, in response to the palm identifier 102 moving to the position of the effective recognition area identifier 103 , the computer device displays the first prompt information 105 that the palm image is undergoing palm image recognition, and cancels the display of the palm identifier 102 .

[0077] The palm identifier 102 is used to indicate the spatial position of the palm relative to the palm image recognition device, that is, the corresponding identifier of the palm displayed in the interactive interface 101 during the process of the camera capturing the palm image, and the palm identifier 102 moves with the movement of the palm.

[0078] The effective recognition area mark 103 is used to indicate the preset spatial position corresponding to the camera. When the palm moves to the preset spatial position, the palm image captured by the camera has the best quality, and the palm image can be recognized quickly.

[0079] Exemplarily, in response to a palm image recognition operation triggered in the palm image recognition device, the computer device displays position information of the palm relative to the palm image recognition device during the process of the camera capturing the palm image.

[0080] Optionally, in response to the palm image recognition operation triggered in the palm image recognition device, the computer device indicates the position information between the palm and the camera by displaying the relative position information between the palm mark 102 and the effective recognition area mark 103 .

[0081] For example, Figure 1 As shown in FIG. (a), the computer device displays the position information of the palm relative to the camera in the interactive interface 101 through the position information of the palm mark 102 relative to the effective recognition area mark 103. In the interactive interface 101, the palm mark 102 is located at the lower left of the effective recognition area mark 103, which means that the palm is also located at the lower left of the camera. In the case where the palm mark 102 is not located at the position of the effective recognition area mark 103, the second prompt information 104 "Please move the palm to the target area" is displayed in the interactive interface 101.

[0082] The second prompt information 104 is used to instruct the palm mark 102 to move to the position of the effective recognition area mark 103 .

[0083] Optionally, in response to the palm image recognition operation triggered in the palm image recognition device, the computer device indicates the distance information between the palm and the camera by displaying the shape change of the palm mark 102 .

[0084] The distance information refers to the distance of the palm relative to the camera.

[0085] For example, Figure 1 As shown in Figure (b), the computer device displays the distance information between the palm and the camera by changing the shape of the palm identifier 102 in the interactive interface 101. When the palm identifier 102 is located at the position of the effective recognition area identifier 103 in the interactive interface 101 and the palm is close to the camera, the computer device indicates the distance between the palm and the camera by increasing the shape of the palm identifier 102 in the interactive interface 101, and displays a second prompt message 104 "Please move your palm backward" in the interactive interface 101.

[0086] For example, Figure 1 As shown in Figure (c), when the palm identifier 102 in the interactive interface 101 is located at the position of the effective identification area identifier 103 and the palm is far away from the camera, the computer device indicates the distance between the palm and the camera by reducing the shape of the palm identifier 102 in the interactive interface 101, and displays a second prompt message 104 "Please move your palm forward" in the interactive interface 101.

[0087] Optionally, when the palm is closer to the camera, the shape of the palm mark 102 becomes larger; when the palm is farther away from the camera, the shape of the palm mark 102 becomes smaller, but it is not limited to this and the embodiments of the present application do not make specific limitations on this.

[0088] Exemplarily, in response to the palm mark 102 moving to the position of the effective recognition area mark 103, the computer device displays the first prompt information 105 that the palm image is undergoing palm image recognition.

[0089] For example, Figure 1 As shown in FIG. 5( d ), when the palm mark 102 moves to the effective recognition area mark 103 and the palm image can be recognized, the first prompt information 105 “Palm image recognition in progress” is displayed indicating that the palm image is being recognized.

[0090] In summary, the method provided in this embodiment displays the interactive interface of the palm image recognition device; in response to the palm image recognition operation triggered in the palm image recognition device, displays the palm identifier and the effective recognition area identifier corresponding to the palm image; in response to the movement of the palm, updates the display position of the palm identifier on the interactive interface, and the display position corresponds to the position of the palm in front of the camera; in response to the palm identifier moving to the position of the effective recognition area identifier, displays the first prompt information that the palm image is undergoing palm image recognition. This application displays the palm corresponding to the object as the palm identifier in the interface, displays the preset spatial position corresponding to the camera as the effective recognition area identifier in the interactive interface, and displays the relative position information between the palm identifier and the effective recognition area identifier on the interactive interface to indicate the orientation information and distance information between the palm and the camera, thereby guiding the object to quickly move the palm to a suitable palm swiping position, thereby improving the recognition efficiency of palm image recognition.

[0091] Figure 2 The schematic diagram of the architecture of a computer system provided by an embodiment of the present application is shown. The computer system may include: a terminal 100 and a server 200.

[0092] The terminal 100 may be an electronic device such as a mobile phone, a tablet computer, a vehicle-mounted terminal (vehicle computer), a wearable device, a personal computer (PC), an intelligent voice interaction device, a smart home appliance, a vehicle-mounted terminal, an aircraft, an unmanned vending terminal, etc. The terminal 100 may be installed with a client that runs a target application, and the target application may be an application that refers to palm image recognition, or may be other applications that provide a palm image recognition function, which is not limited in this application. In addition, this application does not limit the form of the target application, including but not limited to an application (Application, App) installed in the terminal 100, a mini-program, etc., and may also be in the form of a web page.

[0093] The server 200 may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services, cloud database, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), and cloud servers for basic cloud computing services such as big data and artificial intelligence platforms. The server 200 may be a backend server of the above-mentioned target application, used to provide backend services for the client of the target application.

[0094] Among them, cloud technology refers to a hosting technology that unifies hardware, software, network and other resources in a wide area network or local area network to realize data computing, storage, processing and sharing. Cloud technology is a general term for network technology, information technology, integration technology, management platform technology, application technology, etc. based on the cloud computing business model. It can form a resource pool, which is used on demand and flexible and convenient. Cloud computing technology will become an important support. The background services of the technical network system require a large amount of computing and storage resources, such as video websites, picture websites and more portal websites. With the high development and application of the Internet industry, in the future, each item may have its own identification mark, and all need to be transmitted to the background system for logical processing. Data of different levels will be processed separately. All kinds of industry data require strong system backing support, which can only be achieved through cloud computing.

[0095] In some embodiments, the above-mentioned server can also be implemented as a node in a blockchain system. Blockchain is a new application mode of computer technologies such as distributed data storage, peer-to-peer transmission, consensus mechanism, encryption algorithm, etc. Blockchain is essentially a decentralized database, a string of data blocks generated by cryptographic methods. Each data block contains a batch of network transaction information, which is used to verify the validity of its information (anti-counterfeiting) and generate the next block. Blockchain can include the underlying blockchain platform, the platform product service layer, and the application service layer.

[0096] The terminal 100 and the server 200 may communicate with each other via a network, such as a wired or wireless network.

[0097] In the palm image recognition method provided in the embodiment of the present application, the execution subject of each step may be a computer device, which refers to an electronic device with data calculation, processing and storage capabilities. Figure 2 Taking the implementation environment of the scheme shown as an example, the palm image recognition method can be executed by the terminal 100 (such as the client of the target application installed and running in the terminal 100 executes the palm image recognition method), or the palm image recognition method can be executed by the server 200, or the terminal 100 and the server 200 can interact and cooperate to execute it, and this application does not limit this.

[0098] Figure 3 is a flowchart of a palm image recognition method provided by an exemplary embodiment of the present application. The method is applied to a palm image recognition device having a camera and a large screen. The method can be executed by a computer device, which can be Figure 2 The terminal 100 or the server 200 in the embodiment. The method comprises:

[0099] Step 302: Acquire a palm image through a camera.

[0100] The palm image is a palm image of the object whose identity is to be determined. The palm image contains a palm, which is the palm of the object whose identity is to be verified. The palm image may also contain other information, such as the object's fingers, the scene in which the camera captures the object's palm, etc.

[0101] Exemplarily, the palm image may be obtained by photographing the palm of the object to be authenticated by a camera in the computer device, or may be photographed and sent by a camera carried by other devices.

[0102] For example, the computer device is a store payment device, which captures the palm of the subject through a camera to obtain the palm image; or, the computer device is a palm image recognition server, which captures the palm image of the subject through a camera and sends the palm image to the palm image recognition server.

[0103] Step 304: Perform palm detection processing on the palm image to generate a palm frame of the palm in the palm image.

[0104] The palm detection process refers to determining the palm in the palm image and representing the palm in the palm image in the form of a palm frame.

[0105] Step 306: Determine the position information of the palm relative to the palm image recognition device based on the palm frame and the palm image.

[0106] Exemplarily, the computer device determines the position information between the palm and the palm image recognition device by comparing the palm frame in the palm image with the palm image.

[0107] Optionally, the location information includes direction information and distance information.

[0108] The orientation information refers to the orientation relationship of the palm relative to the palm image recognition device.

[0109] The distance information refers to the distance relationship between the palm and the palm image recognition device.

[0110] Step 308: Based on the position information, a palm identifier corresponding to the palm is displayed on the screen, where the palm identifier is used to indicate that the palm moves to a preset spatial position corresponding to the camera, and a palm image captured by the camera at the preset spatial position is compared and identified to obtain an object identifier corresponding to the palm image.

[0111] The palm mark is used to indicate that the palm moves to a preset spatial position corresponding to the camera.

[0112] The preset spatial position refers to the position of the palm image with the best quality that can be captured by the camera, that is, when the palm moves to the preset spatial position, the palm image captured by the camera has the best quality and can quickly realize palm image recognition.

[0113] Exemplarily, the palm comparison and identification processing refers to comparing and identifying the features of the palm area with preset palm features in the database.

[0114] The preset palm feature is a palm feature of the stored object identifier. Each preset palm feature has a corresponding object identifier, indicating that the preset palm feature belongs to the object identifier and is a palm feature of the object's palm. The object identifier can be any object identifier, such as an object identifier registered in a payment application, or an object identifier registered in an enterprise.

[0115] In an embodiment of the present application, a computer device includes a database, which includes a plurality of preset palm features and an object identifier corresponding to each preset palm feature. In the database, the preset palm features and the object identifiers may correspond one-to-one, or one object identifier may correspond to at least two preset palm features.

[0116] For example, multiple objects are registered in a payment application. By binding the preset palm features of each object with the corresponding object identifier, the palm features of multiple objects and the corresponding object identifiers are stored in a database. When the objects subsequently use the payment application, the object identifier is determined by comparing and identifying the palm image taken by the camera with the preset palm features in the database, thereby achieving identity authentication of the object.

[0117] In summary, the method provided in this embodiment obtains a palm image through a camera; performs palm detection processing on the palm image to generate a palm frame of the palm in the palm image; determines the position information of the palm relative to the palm image recognition device based on the palm frame and the palm image; displays a palm identifier corresponding to the palm on the screen based on the position information, and the palm identifier is used to indicate that the palm moves to a preset spatial position corresponding to the camera, and performs comparative identification processing on the palm image captured by the camera at the preset spatial position to obtain an object identifier corresponding to the palm image. This application determines the position information of the palm relative to the palm image recognition device through the palm frame and the palm image in the palm image; and displays the palm identifier corresponding to the palm based on the position information, and indicates that the palm moves to the preset spatial position corresponding to the camera according to the palm identifier, thereby guiding the object to quickly move the palm to a suitable palm swiping position, thereby improving the recognition efficiency of palm image recognition.

[0118] Figure 4 is a flowchart of a palm image recognition method provided by an exemplary embodiment of the present application. The method is applied to a palm image recognition device having a camera and a large screen. The method can be executed by a computer device, which can be Figure 2 The terminal 100 or the server 200 in the embodiment. The method comprises:

[0119] Step 402: Acquire a palm image through a camera.

[0120] The palm image is a palm image of the object whose identity is to be determined. The palm image contains a palm, which is the palm of the object whose identity is to be verified. The palm image may also contain other information, such as the object's fingers, the scene in which the camera captures the object's palm, etc.

[0121] Exemplarily, the computer device photographs the palm of the subject to obtain a palm image. The palm image includes the palm, which may be the left palm of the subject or the right palm of the subject. For example, the computer device is an Internet of Things device, which photographs the left palm of the subject through a camera to obtain a palm image, and the Internet of Things device may be a merchant payment terminal. For another example, when the subject is shopping in a store and conducting a transaction, the subject extends his palm to the camera of the store payment terminal, and the store payment terminal photographs the palm of the subject through the camera to obtain a palm image.

[0122] In a possible implementation, a computer device establishes a communication connection with another device, and receives a palm image sent by the other device through the communication connection. For example, the computer device is a payment application server, and the other device may be a payment terminal. The payment terminal photographs the palm of the subject, obtains the palm image, and then sends the palm image to the payment application server through the communication connection between the payment terminal and the payment application server, so that the payment application server can determine the object identification of the palm image.

[0123] Step 404: perform palm detection processing on the palm image to determine parameter information of the palm, determine parameter information of the palm frame based on the parameter information of the palm, and generate a palm frame of the palm in the palm image based on the parameter information of the palm frame.

[0124] The palm detection process refers to determining the palm in the palm image and representing the palm in the palm image in the form of a palm frame.

[0125] The parameter information of the palm includes the width, height and center point of the palm.

[0126] The parameter information of the palm frame includes the width, height and center point of the palm frame.

[0127] Exemplarily, the computer device inputs the palm image into the palm frame recognition model for image division to obtain at least two grids; the computer device predicts at least one palm frame for each grid through the palm frame recognition model to obtain a confidence value corresponding to each predicted palm frame; the computer device determines the palm frame of the palm in the palm image based on the confidence value corresponding to the predicted palm frame.

[0128] For example, the computer device divides the palm image into 7*7 grids, and predicts two predicted palm frames for each grid. Each predicted palm frame includes 5 prediction values, namely: x, y, w, h and confidence, where x and y are used to represent the position coordinates of the pixel point in the upper left corner of the predicted palm frame, w and h are used to represent the width and height of the predicted palm frame, and confidence is used to represent the confidence value of the predicted palm frame.

[0129] For each confidence value corresponding to the predicted palm frame, the computer device determines a palm frame of the palm in the palm image based on the confidence value corresponding to each predicted palm frame.

[0130] For example, Figure 5 A schematic diagram of a palm frame in a palm is shown, wherein palm frame position coordinate point 501 is the pixel position corresponding to the palm frame, and palm frame center point 502 is the center point of the palm frame. For example, the coordinates of palm frame position coordinate point 501 are (x, y), the width of the palm frame is w, and the height of the palm frame is h, then the coordinates of palm frame center point 502 can be expressed as (x+w / 2, y+h / 2).

[0131] In one possible implementation, Figure 6 The schematic diagram of the finger seam points in the palm shown, the finger seam point is the first finger seam point 601 between the index finger and the middle finger, or the finger seam point is the second finger seam point 602 between the middle finger and the ring finger, or the finger seam point is the third finger seam point 603 between the ring finger and the little finger.

[0132] Since the palm in the palm image may exist in any area of ​​the palm image, in order to determine the position of the palm in the palm image, finger gap point detection is performed on the palm image to obtain at least one finger gap point of the palm, so that the palm frame can be determined subsequently based on the at least one finger gap point.

[0133] In a possible implementation, a computer device divides a palm image into at least two grids; the computer device predicts at least one palm frame for each grid through a palm frame recognition model to obtain a confidence value corresponding to each predicted palm frame; and the computer device determines a palm frame of the palm in the palm image based on the confidence value corresponding to the predicted palm frame.

[0134] Optionally, the computer device obtains a sample palm image and a sample palm frame corresponding to the sample palm image; the computer device processes the sample palm image through a palm frame recognition model to obtain a predicted palm frame; the computer device updates the model parameters of the palm frame recognition model based on the difference between the predicted palm frame and the sample palm frame.

[0135] Step 406: Determine the orientation information of the palm relative to the camera based on the center point of the palm frame and the image center point of the palm image.

[0136] Exemplarily, the computer device determines the position information between the palm and the palm image recognition device by comparing the palm frame in the palm image with the palm image.

[0137] Optionally, the location information includes direction information and distance information.

[0138] The orientation information refers to the orientation relationship of the palm relative to the palm image recognition device.

[0139] The distance information refers to the distance relationship between the palm and the palm image recognition device.

[0140] Exemplarily, the computer device determines the orientation information of the palm relative to the camera based on the center point of the palm frame and the image center point of the palm image.

[0141] For example, Figure 7 A schematic diagram of a palm frame in a palm is shown, wherein palm frame position coordinate point 701 is the pixel position corresponding to the palm frame, palm frame center point 702 is the center point of the palm frame, and image center point 703 is the image center point of the palm image. For example, the coordinates of image center point 703 are (W / 2, H / 2), wherein W is the width of the palm image, and H is the height of the palm image. The coordinates of palm frame position coordinate point 701 are (x, y), the width of the palm frame is w, and the height of the palm frame is h. Then, the coordinates of palm frame center point 702 can be expressed as (x+w / 2, y+h / 2). Then, the offset of palm frame center point 702 relative to image center point 703 can be expressed as: dx=x+w / 2-W / 2, dy=y+h / 2-H / 2.

[0142] Step 408: Based on the width and / or height of the palm frame, calculate and obtain the distance information of the palm relative to the palm image recognition device.

[0143] Exemplarily, the computer device calculates the distance information of the palm relative to the palm image recognition device based on the width and / or height of the palm frame.

[0144] The distance information of the palm relative to the palm image recognition device can be obtained by the following four methods:

[0145] Method 1: The computer device calculates the area of ​​the palm frame based on the width and height of the palm frame; the computer device compares the area of ​​the palm frame with a preset area threshold to obtain distance information of the palm relative to the camera.

[0146] For example, the preset area threshold value preset by the computer device is K. The computer device compares the area of ​​the palm frame with the preset area threshold value K. When the calculated area of ​​the palm frame is greater than the preset area threshold value K, the distance between the palm and the palm image recognition device is closer; conversely, when the calculated area of ​​the palm frame is less than the preset area threshold value K, the distance between the palm and the palm image recognition device is farther.

[0147] Method 2: The computer device performs calculation based on the width of the palm frame and a first threshold to obtain a first distance value of the palm relative to the palm image recognition device. The first threshold refers to a preset value of the width of the palm frame.

[0148] For example, the first threshold value set by the computer device is the value of the preset width of the palm frame when the palm is 50 mm and 300 mm away from the palm image recognition device. For example, the preset width of the palm frame when the palm is 50 mm away from the palm image recognition device is w1, and the preset width of the palm frame when the palm is 300 mm away from the palm image recognition device is w2. The width of the palm frame obtained by the computer device is w.

[0149] Then, the formula for calculating the first distance value based on the width of the palm frame can be expressed as:

[0150]

[0151] In the formula, S w is the first distance value, w1 is the preset width of the palm frame when the palm is 50 mm away from the palm image recognition device, w2 is the preset width of the palm frame when the palm is 300 mm away from the palm image recognition device, and w is the width of the palm frame obtained by the computer device.

[0152] Method three: The computer device performs calculation based on the height of the palm frame and the second threshold to obtain a second distance value of the palm relative to the palm image recognition device, where the second threshold refers to a preset value of the height of the palm frame.

[0153] For example, the second threshold value set by the computer device is the value of the preset height of the palm frame when the palm is 50 mm and 300 mm away from the palm image recognition device. For example, the preset height of the palm frame when the palm is 50 mm away from the palm image recognition device is h1, and the preset height of the palm frame when the palm is 300 mm away from the palm image recognition device is h2. The height of the palm frame obtained by the computer device is h.

[0154] Then, the formula for calculating the first distance value based on the width of the palm frame can be expressed as:

[0155]

[0156] In the formula, S his the second distance value, h1 is the preset width of the palm frame when the palm is 50 mm away from the palm image recognition device, h2 is the preset width of the palm frame when the palm is 300 mm away from the palm image recognition device, and h is the height of the palm frame obtained by the computer device.

[0157] Method 4: The computer device performs calculations based on the width of the palm frame and the first threshold value to obtain a first distance value of the palm relative to the palm image recognition device; the computer device performs calculations based on the height of the palm frame corresponding to the palm and the second threshold value to obtain a second distance value of the palm relative to the palm image recognition device; the computer device obtains distance information of the palm relative to the palm image recognition device based on the first distance value and the second distance value.

[0158] The computer device considers the first distance value and the second distance value at the same time to obtain the distance information of the palm relative to the palm image recognition device. The first distance value and the second distance can be obtained by the formulas in method 2 and method 3, which will not be repeated here.

[0159] Computer equipment through min (S w , S h ) to determine whether the palm is beyond the preset maximum distance from the palm image recognition device, and by max(S w , S h ) to determine whether the palm exceeds the preset minimum distance relative to the palm image recognition device. When the distance is greater than the preset maximum distance, the palm is prompted to move closer; when the distance is less than the preset minimum distance, the palm is prompted to move away.

[0160] Step 410: Based on the position information, a palm identifier corresponding to the palm is displayed on the screen, where the palm identifier is used to indicate that the palm moves to a preset spatial position corresponding to the camera, and a palm image captured by the camera at the preset spatial position is compared and identified to obtain an object identifier corresponding to the palm image.

[0161] Exemplarily, the palm identification is used to indicate that the palm moves to a preset spatial position corresponding to the camera. When the palm moves to the preset spatial position and the computer device is able to recognize the captured palm image, the computer device performs comparative recognition processing on the palm image to obtain the object identification corresponding to the palm image.

[0162] Exemplarily, the palm comparison and identification processing refers to comparing and identifying the features of the palm area with preset palm features in the database.

[0163] The preset palm feature is a palm feature of the stored object identifier. Each preset palm feature has a corresponding object identifier, indicating that the preset palm feature belongs to the object identifier and is a palm feature of the object's palm. The object identifier can be any object identifier, such as an object identifier registered in a payment application, or an object identifier registered in an enterprise.

[0164] It should be noted that the palm, as a type of biometric feature, is biologically unique and distinguishable. Compared with facial recognition, which is currently widely used in the fields of identity verification, payment, access control, and ride-hailing, the palm will not be affected by makeup, masks, sunglasses, etc., and can improve the accuracy of object identity verification. In some scenarios, such as epidemic prevention and control scenarios, it is necessary to wear a mask to cover the mouth and nose. In this case, using palm images for identity verification can be a better choice.

[0165] Cross-device registration and recognition is a capability that is very important for the object experience. For two types of associated devices, the object can be registered in one type of device, and the object's object identifier is bound to the object's palm features. After that, the object can be authenticated on the other type of device. Since mobile phones and IoT devices differ greatly in image style and image quality, through cross-device registration and recognition, objects can be used directly on IoT devices after being registered on the mobile phone, without the need for the object to be registered on two types of devices. For example, after the object is registered through the mobile phone, it can be authenticated directly on the store's device without the need for the object to be registered on the store's device, thus avoiding information leakage of the object.

[0166] In one possible implementation, the computer device displays a palm identifier corresponding to the palm on the screen based on the position information, moves the camera based on the palm identifier, moves the preset spatial position of the camera to the location of the palm and takes a picture, performs comparison and recognition processing on the palm image taken by the camera, and obtains the object identifier corresponding to the palm image.

[0167] In summary, the method provided in this embodiment obtains a palm image through a camera; performs palm detection processing on the palm image to obtain a palm frame of the palm in the palm image; determines the orientation information and distance information of the palm relative to the palm image recognition device based on the palm frame and the palm image; displays the palm identifier corresponding to the palm based on the orientation information and the distance information, and the palm identifier is used to indicate that the palm moves to a preset spatial position corresponding to the camera, and performs comparative identification processing on the palm image captured by the camera at the preset spatial position to obtain an object identifier corresponding to the palm image. The present application determines the orientation information and distance information of the palm relative to the palm image recognition device through the palm frame and the palm image in the palm image; and displays the palm identifier corresponding to the palm based on the orientation information and the distance information, and indicates that the palm moves to the preset spatial position corresponding to the camera according to the palm identifier, thereby guiding the object to quickly move the palm to a suitable palm swiping position, thereby improving the recognition efficiency of palm image recognition.

[0168] Figure 8 801 is a schematic diagram of a cross-device payment based on a palm image recognition method provided by an exemplary embodiment of the present application. The method involves an object terminal 801, a merchant terminal 803 and a payment application server 802.

[0169] Among them, the object terminal 801 is installed with a payment application, the object terminal 801 logs in to the payment application based on the object identification, and establishes a communication connection with the payment application server 802, through which the object terminal 801 and the payment application server 802 can interact; the merchant terminal 803 is installed with a payment application, the merchant terminal 803 logs in to the payment application based on the merchant identification, and establishes a communication connection with the payment application server 802, through which the merchant terminal 803 and the payment application server 802 can interact.

[0170] The cross-device payment process includes:

[0171] 1. The subject holds the subject terminal 801 at home, and uses the subject terminal 801 to shoot the subject's own palm to obtain the subject's palm image, logs in to the payment application based on the subject identifier, and sends a palm image registration request to the payment application server 802. The palm image registration request carries the subject identifier and palm image.

[0172] 2. The payment application server 802 receives the palm image registration request sent by the object terminal 801, processes the palm image, obtains the palm features of the palm image, stores the palm features in correspondence with the object identifier, and sends a palm image binding success notification to the object terminal 801.

[0173] Among them, after the payment application server 802 stores the palm feature and the object identifier in correspondence, the palm feature is used as a preset palm feature, and the corresponding object identifier can be determined later by the stored preset palm feature.

[0174] 3. The object terminal 801 receives the palm image binding success notification, displays the palm image binding success notification, and prompts that the object palm image is bound to the object identifier.

[0175] The object completes the palm image registration through the interaction between its own object terminal 801 and the payment application server 802, and can subsequently realize automatic payment through the palm image.

[0176] 4. When the subject purchases goods in the store, the merchant terminal 803 captures the subject's palm to obtain a palm image, and sends a payment request to the payment application server 802 based on the payment application logged in with the merchant ID. The payment request carries the merchant ID, the consumption amount and the palm image.

[0177] 5. After receiving the payment request, the payment application server 802 performs palm comparison and recognition processing on the palm image, determines the object identifier of the palm image, determines the account number of the object identifier in the payment application, completes the transfer through the account number, and sends a payment completion notification to the merchant terminal 803 after the transfer is completed.

[0178] Among them, after the object uses the object terminal 801 to register the palm image, the object can directly pay with the palm at the merchant terminal 803 without the user registering the palm image on the merchant terminal 803, thereby achieving the effect of cross-device palm image recognition and improving convenience.

[0179] 6. The merchant terminal 803 receives the payment completion notification, displays the payment completion notification, and prompts the object that the payment is completed, so that the object and the merchant complete the transaction of the item, and the object can take the item away.

[0180] In addition, the above embodiment uses the object terminal 801 and the merchant terminal 803 to realize the cross-device payment process. The above merchant terminal 803 can also be replaced with a payment device on the bus. According to the above steps, a cross-device bus payment solution can be realized.

[0181] Fig. 9 1 is a schematic diagram of a cross-device identity authentication method based on a palm image provided by an exemplary embodiment of the present application. The method involves an object terminal 901, a door control device 903 and a door control server 902.

[0182] Among them, the object terminal 901 establishes a communication connection with the access control server 902, through which the object terminal 901 and the access control server 902 can interact; the access control device 903 establishes a communication connection with the access control server 902, through which the access control device 903 and the access control server 902 can interact.

[0183] The cross-device authentication process includes:

[0184] 1. The subject holds the subject terminal 901 at home, and uses the subject terminal 901 to photograph the subject's own palm to obtain the subject's palm image, and sends a palm registration request to the access control server 902. The palm registration request carries the subject's identification and palm image.

[0185] 2. The access control server 902 receives the palm registration request sent by the object terminal 901, processes the palm image, obtains the palm features of the palm image, stores the palm features in correspondence with the object identifier, and sends a palm binding success notification to the object terminal 901.

[0186] Among them, after the access control server 902 stores the palm feature and the object identifier in correspondence, the palm feature can be used as a preset palm feature, and the corresponding object identifier can be determined later through the stored preset palm feature.

[0187] 3. The object terminal 901 receives the palm binding success notification, displays the palm binding success notification, and prompts that the object palm image is bound to the object identifier.

[0188] The object completes palm image registration through the interaction between its own object terminal 901 and the access control server, and can subsequently realize automatic door opening through the palm image.

[0189] 4. When the subject goes out and returns home, the access control device 903 takes a picture of the subject's palm, obtains the subject's palm image, and sends an identity verification request to the access control server 902, the identity verification request carrying the verification palm image.

[0190] 5. The access control server 902 receives the identity authentication request sent by the access control device 903, identifies and processes the verification palm image, obtains the object identification of the palm image, determines that the object is a registered object, and sends a verification success notification to the access control device 903.

[0191] 6. The access control device 903 receives the verification pass notification sent by the access control server 902, and controls the door to open according to the verification pass notification so that the object can enter the room.

[0192] The above embodiment is a process of implementing cross-device identity authentication through the object terminal 901 and the access control device 903 .

[0193] It can be seen from the above cross-device identity authentication scenario that whether it is the palm registration stage of the interaction between the object terminal 901 and the access control server 902, or the palm image recognition stage of the interaction between other terminal devices and the server, after the object terminal 901 or other terminal devices obtain the palm image, they send the palm image to the server, and the server performs palm comparison and recognition processing. In the palm comparison and recognition processing stage, the access control server 902 compares the palm features with the preset palm features to obtain the recognition result of the current object.

[0194] Fig.10 is a flowchart of a palm identification display method provided by an exemplary embodiment of the present application. The method is applied to a palm image recognition device having a camera and a large screen. The method can be executed by a computer device, which can be Figure 2 The terminal 100 or the server 200 in the embodiment. The method comprises:

[0195] Step 1002: Displaying an interactive interface of a palm image recognition device.

[0196] A palm image recognition device refers to a device that can provide a palm image recognition function.

[0197] An interactive interface refers to an interface that can display and provide interactive functions.

[0198] Optionally, the interactive function refers to the object achieving functional control of the palm image recognition device through operations such as clicking, sliding, double-clicking, and three-level operations.

[0199] The palm image is a palm image of the object whose identity is to be determined. The palm image contains a palm, which is the palm of the object whose identity is to be verified. The palm image may also contain other information, such as the object's fingers, the scene in which the camera captures the object's palm, etc.

[0200] Exemplarily, the palm image may be obtained by photographing the palm of the object to be authenticated by a camera of a palm image recognition device in the computer device, or may be photographed and sent by a camera carried by other devices.

[0201] For example, the computer device is a store payment device, which captures the palm of the subject through a camera to obtain the palm image; or, the computer device is a palm image recognition server, which captures the palm image of the subject through a camera and sends the palm image to the palm image recognition server.

[0202] Step 1004: In response to the palm image recognition operation triggered in the palm image recognition device, a palm identifier and a valid recognition area identifier corresponding to the palm image are displayed.

[0203] The palm identifier is used to indicate the spatial position of the palm relative to the palm image recognition device.

[0204] The effective identification area identifier is used to indicate the preset spatial position corresponding to the camera.

[0205] The preset spatial position refers to the position of the palm image with the best quality that can be captured by the camera, that is, when the palm moves to the preset spatial position, the palm image captured by the camera has the best quality and can quickly realize palm image recognition.

[0206] Step 1006: In response to the movement of the palm, update the display position of the palm marker on the interactive interface.

[0207] Exemplarily, the computer device updates the display position of the palm marker on the interactive interface in response to the movement of the palm.

[0208] For example, a computer device represents the palm through a palm logo in the interactive interface. In the interactive interface, the palm logo is located at the lower left of the effective identification area logo. It can be seen that the palm is also located at the lower left of the camera. When the palm moves, the display position of the palm logo on the interactive interface also moves accordingly.

[0209] Step 1008: In response to the palm mark moving to the position of the effective recognition area mark, displaying first prompt information that the palm image is undergoing palm image recognition.

[0210] Exemplarily, in response to the palm identifier moving to the position of the effective recognition area identifier, the computer device displays a first prompt message that the palm image is undergoing palm image recognition.

[0211] Optionally, in response to the palm identifier moving to the position of the effective recognition area identifier, the computer device displays a first prompt message that the palm image is undergoing palm image recognition, and cancels display of the palm identifier.

[0212] For example, when the palm mark moves to the valid recognition area mark and the palm image can be recognized, the first prompt information that the palm image is undergoing palm image recognition is displayed, and the palm mark is canceled, for example, the first prompt information displayed is "palm image recognition is in progress".

[0213] In summary, the method provided in this embodiment displays the interactive interface of the palm image recognition device; in response to the palm image recognition operation triggered in the palm image recognition device, displays the palm identifier and the effective recognition area identifier corresponding to the palm image; in response to the movement of the palm, updates the display position of the palm identifier on the interactive interface; in response to the palm identifier moving to the position of the effective recognition area identifier, displays the first prompt information that the palm image is undergoing palm image recognition. This application displays the palm corresponding to the object as the palm identifier in the interface, displays the preset spatial position corresponding to the camera as the effective recognition area identifier in the interactive interface, and indicates the position information between the palm and the camera by displaying the relative position information between the palm identifier and the effective recognition area identifier on the interactive interface, thereby guiding the object to quickly move the palm to a suitable palm swiping position, thereby improving the recognition efficiency of palm image recognition.

[0214] Fig.11 is a flowchart of a palm identification display method provided by an exemplary embodiment of the present application. The method is applied to a palm image recognition device having a camera and a large screen. The method can be executed by a computer device, which can be Figure 2 The terminal 100 or the server 200 in the embodiment. The method comprises:

[0215] Step 1102: Displaying the interactive interface of the palm image recognition device.

[0216] A palm image recognition device refers to a device that can provide a palm image recognition function.

[0217] An interactive interface refers to an interface that can display and provide interactive functions.

[0218] The palm image is a palm image of the object whose identity is to be determined. The palm image contains a palm, which is the palm of the object whose identity is to be verified. The palm image may also contain other information, such as the object's fingers, the scene in which the camera captures the object's palm, etc.

[0219] Exemplarily, the computer device photographs the palm of the subject to obtain a palm image. The palm image includes the palm, which may be the left palm of the subject or the right palm of the subject. For example, the computer device is an Internet of Things device, which photographs the left palm of the subject through a camera to obtain a palm image, and the Internet of Things device may be a merchant payment terminal. For another example, when the subject is shopping in a store and conducting a transaction, the subject extends his palm to the camera of the store payment terminal, and the store payment terminal photographs the palm of the subject through the camera to obtain a palm image.

[0220] In a possible implementation, a computer device establishes a communication connection with another device, and receives a palm image sent by the other device through the communication connection. For example, the computer device is a payment application server, and the other device may be a payment terminal. The payment terminal photographs the palm of the subject, obtains the palm image, and then sends the palm image to the payment application server through the communication connection between the payment terminal and the payment application server, so that the payment application server can determine the object identification of the palm image.

[0221] For example, Fig.12 The schematic diagram of the interactive interface of the palm image recognition device shown is as follows: Fig.12 As shown in Figure (a) in the figure, taking smart payment as an example, the interactive interface 1201 of the palm image recognition device displays a functional button palm payment button 1202 and a face payment button 1203. When the object triggers the palm payment button 1203, the interactive interface 1201 of the palm image recognition device displays a guiding schematic diagram of palm image recognition, such as Fig.12 As shown in FIG. 1( b ), the guiding schematic diagram of palm image recognition includes a palm image recognition device diagram 1204, a palm diagram 1205, and guiding information 1206. The guiding schematic diagram of palm image recognition intuitively shows how the palm faces the palm image recognition device and the optimal position of the palm relative to the palm image recognition device during palm image recognition. At the same time, the guiding information 1206 shows the optimal position of the palm relative to the palm image recognition device during palm image recognition.

[0222] In a possible implementation manner, the computer device displays the second prompt information in response to the palm image recognition operation triggered in the palm image recognition device.

[0223] The second prompt information is used to instruct the palm mark to move to the position of the effective recognition area mark.

[0224] Step 1104: In response to the palm image recognition operation triggered in the palm image recognition device, during the process of the camera capturing the palm image, the position information of the palm relative to the palm image recognition device is displayed through the palm identifier and the effective recognition area identifier.

[0225] The palm identification includes the position information of the palm relative to the palm image recognition device.

[0226] The effective identification area identifier is used to indicate the preset spatial position corresponding to the camera.

[0227] The preset spatial position refers to the position of the palm image with the best quality that can be captured by the camera, that is, when the palm moves to the preset spatial position, the palm image captured by the camera has the best quality and can quickly realize palm image recognition.

[0228] Exemplarily, in response to a palm image recognition operation triggered in the palm image recognition device, the computer device displays the position information of the palm relative to the palm image recognition device through a palm identifier and an effective recognition area identifier during the process of the camera capturing the palm image.

[0229] Optionally, the position information includes orientation information; the computer device responds to the palm image recognition operation triggered in the palm image recognition device, and indicates the orientation information between the palm and the camera by displaying the relative position information between the palm identifier and the effective recognition area identifier.

[0230] Optionally, the location information includes distance information, and the computer device responds to the palm image recognition operation triggered in the palm image recognition device to indicate the distance information between the palm and the camera by displaying a change in the shape of the palm marker.

[0231] For example, Fig.13 The schematic diagram of the position information of the palm relative to the palm image recognition device is shown as Fig.13 As shown in FIG. 1 (a), the computer device displays the position information of the palm relative to the camera through the position information of the palm mark 1302 relative to the effective recognition area mark 1303 in the interactive interface 1301. Fig.13 In Figure (a), the palm mark 1302 in the interactive interface 1301 is located in the middle of the effective recognition area mark 1303, which means that the palm is also located in front of the camera.

[0232] The computer device displays the distance information between the palm and the camera by changing the shape of the palm identifier 1302 in the interactive interface 1301. When the palm identifier 1302 is located at the position of the effective identification area identifier 1303 in the interactive interface 1301 and the palm is close to the camera, the computer device indicates the distance between the palm and the camera by increasing the shape of the palm identifier 1302 in the interactive interface 1301, and displays a second prompt message 1304 "Please move your palm backwards" in the interactive interface 1301.

[0233] like Fig.13 As shown in Figure (b), when the palm identifier 1302 in the interactive interface 1301 is located at the position of the effective identification area identifier 1303 and the palm is far away from the camera, the computer device indicates the distance between the palm and the camera by reducing the shape of the palm identifier 1302 in the interactive interface 1301, and displays a second prompt message 1304 "Please move your palm forward" in the interactive interface 1301.

[0234] Step 1106: In response to the movement of the palm, update the display position of the palm marker on the interactive interface.

[0235] Exemplarily, the computer device updates the display position of the palm marker on the interactive interface in response to the movement of the palm.

[0236] For example, a computer device represents the palm through a palm logo in the interactive interface. In the interactive interface, the palm logo is located at the lower left of the effective identification area logo. It can be seen that the palm is also located at the lower left of the camera. When the palm moves, the display position of the palm logo on the interactive interface also moves accordingly.

[0237] For example, Fig.14 The schematic diagram of the palm mark relative to the effective recognition area mark is shown in FIG. Fig.14 As shown, the computer device displays the position information of the palm relative to the camera through the position information of the palm mark 1402 relative to the effective identification area mark 1403 in the interactive interface 1401. In the interactive interface 1401, the palm mark 1402 is located at the lower left of the effective identification area mark 1403, so it can be known that the palm is also located at the lower left of the camera. In the case that the palm mark 1402 is not located at the position of the effective identification area mark 1403, the second prompt information 1404 "Please move the palm to the target area" is displayed in the interactive interface 1401.

[0238] Step 1108: In response to the palm mark moving to the position of the effective recognition area mark, displaying first prompt information that the palm image is undergoing palm image recognition.

[0239] Exemplarily, in response to the palm identifier moving to the position of the effective recognition area identifier, the computer device displays a first prompt message that the palm image is undergoing palm image recognition.

[0240] Optionally, in response to the palm identifier moving to the position of the effective recognition area identifier, the computer device displays a first prompt message that the palm image is undergoing palm image recognition, and cancels display of the palm identifier.

[0241] For example, when the palm mark moves to the valid recognition area mark and the palm image can be recognized, the first prompt information that the palm image is undergoing palm image recognition is displayed, and the palm mark is canceled, for example, the first prompt information displayed is "palm image recognition is in progress".

[0242] For example, Fig.15 The schematic diagram of the interactive interface in which palm image recognition is in progress is shown. When the palm identifier moves to the effective recognition area identifier 1502 and the palm image can be recognized, the first prompt information 1503 "Palm image recognition in progress" that the palm image is undergoing palm image recognition is displayed on the interactive interface 1501, and the palm identifier is cancelled.

[0243] In summary, the method provided in this embodiment displays the interactive interface of the palm image recognition device; in response to the palm image recognition operation triggered in the palm image recognition device, in the process of the camera shooting the palm image, the position information of the palm relative to the palm image recognition device is displayed through the palm identifier and the effective recognition area identifier; in response to the movement of the palm, the display position of the palm identifier on the interactive interface is updated; in response to the palm identifier moving to the position of the effective recognition area identifier, the first prompt information that the palm image is undergoing palm image recognition is displayed. This application displays the palm corresponding to the object as the palm identifier in the interface, displays the preset spatial position corresponding to the camera as the effective recognition area identifier in the interactive interface, and indicates the position information between the palm and the camera by displaying the relative position information between the palm identifier and the effective recognition area identifier on the interactive interface, thereby guiding the object to quickly move the palm to a suitable palm swiping position, thereby improving the recognition efficiency of palm image recognition.

[0244] Fig.16 is a flowchart of a palm image recognition method provided by an exemplary embodiment of the present application. The method can be executed by a computer device, which can be Figure 2 The terminal 100 or the server 200 in the embodiment. The method comprises:

[0245] Step 1601: Start.

[0246] Step 1602: Obtain a palm frame.

[0247] Exemplarily, the computer device acquires a palm image through a camera, performs palm detection on the palm image to determine parameter information of the palm, and determines parameter information of a palm frame based on the parameter information of the palm; the computer device generates a palm frame of the palm in the palm image based on the parameter information of the palm frame.

[0248] The parameter information of the palm frame includes the width, height and center point of the palm frame.

[0249] Step 1603: Determine the palm frame center point of the palm frame.

[0250] The parameter information of the palm includes the width, height and center point of the palm, and the parameter information of the palm frame corresponds to the parameter information of the palm.

[0251] The computer device determines the center point of the palm frame based on the parameter information of the palm.

[0252] Exemplarily, the palm frame position coordinate point is the pixel position corresponding to the palm frame, and the palm frame center point is the center point of the palm frame. For example, the coordinates of the palm frame position coordinate point are (x, y), the width of the palm frame is w, and the height of the palm frame is h, then the coordinates of the palm frame center point can be expressed as (x+w / 2, y+h / 2).

[0253] Step 1604: Determine the displacement of the palm in the x and y directions.

[0254] Exemplarily, the computer device determines the offset of the palm in the x and y directions based on the center point of the palm frame and the image center point of the palm image, that is, determines the orientation information of the palm relative to the camera.

[0255] Step 1605: Determine the distance information of the palm relative to the palm image recognition device based on the size of the palm frame.

[0256] Exemplarily, the computer device calculates the distance information of the palm relative to the palm image recognition device based on the width and / or height of the palm frame.

[0257] Optionally, the computer device calculates the area of ​​the palm frame based on the width and height of the palm frame; the computer device compares the area of ​​the palm frame with a preset area threshold to obtain distance information of the palm relative to the camera.

[0258] Step 1606: Displaying a palm identifier corresponding to the palm based on the position information to provide interactive guidance.

[0259] Exemplarily, the computer device displays a palm identifier corresponding to the palm on the screen based on the orientation information and distance information of the palm relative to the camera, and provides interactive guidance to the object according to the palm identifier.

[0260] Step 1607: End.

[0261] In summary, the method provided in this embodiment obtains the palm frame of the palm in the palm image; based on the palm frame and the palm image, determines the offset of the palm relative to the palm in the palm image in the x, y direction and determines the distance information of the palm relative to the palm image recognition device based on the size of the palm frame; based on the orientation information and distance information, displays the palm identification corresponding to the palm and performs interactive guidance. This application determines the orientation information and distance information of the palm relative to the palm image recognition device through the palm frame and the palm image in the palm image; and displays the palm identification corresponding to the palm based on the orientation information and distance information, and instructs the palm to move to the preset spatial position corresponding to the camera according to the palm identification, thereby guiding the object to quickly move the palm to the appropriate palm swiping position, thereby improving the recognition efficiency of palm image recognition.

[0262] Illustratively, the application scenarios of the palm image recognition method provided in the embodiments of the present application include but are not limited to the following scenarios:

[0263] For example, in the smart payment scenario:

[0264] The merchant's computer device obtains a palm image of the object by photographing the palm of the object, and uses the palm image recognition method provided in the embodiment of the present application to determine the object identification of the palm image, and transfers part of the resources in the resource account corresponding to the object identification to the merchant's resource account, thereby realizing automatic payment through the palm.

[0265] For example, in the cross-device payment scenario:

[0266] The subject can complete identity registration using a personal mobile phone at home or other private spaces, bind the subject's account to the subject's palm image, and then use the in-store device to identify the subject's palm image, determine the subject's account, and pay directly through the account.

[0267] For example, in the clock-in scenario:

[0268] The computer device obtains a palm image of the object by photographing the palm of the object, and uses the palm image recognition method provided in the embodiment of the present application to determine the object identifier of the palm image, establish a clock-in mark for the object identifier, and determine that the object identifier has completed clocking in at the current time.

[0269] Of course, in addition to being applied to the above-mentioned scenarios, the method provided in the embodiments of the present application can also be applied to other scenarios that require palm image recognition, and the embodiments of the present application are not limited to specific application scenarios.

[0270] Fig.17 The following is a schematic diagram of the structure of a palm image recognition device provided by an exemplary embodiment of the present application. The device can be implemented as all or part of a computer device through software, hardware, or a combination of both. The device includes:

[0271] An acquisition module 1701 is used to acquire the palm image through the camera;

[0272] A palm frame detection module 1702 is used to perform palm detection processing on the palm image to generate a palm frame of the palm in the palm image and parameter information of the palm frame;

[0273] A position information determination module 1703, configured to determine position information of the palm relative to the palm image recognition device based on the palm frame and the palm image;

[0274] The identification module 1704 is used to display a palm identifier corresponding to the palm on the screen based on the position information, wherein the palm identifier is used to indicate that the palm moves to the preset spatial position corresponding to the camera, and to perform comparative identification processing on the palm image captured by the camera at the preset spatial position to obtain an object identifier corresponding to the palm image.

[0275] In a possible implementation, the palm frame detection module 1702 is used to perform the palm detection process on the palm image to determine parameter information of the palm; determine parameter information of the palm frame based on the parameter information of the palm; and generate the palm frame of the palm in the palm image based on the parameter information of the palm frame; wherein the parameter information of the palm frame includes the width, height and center point of the palm frame.

[0276] In a possible implementation, the position information includes orientation information; the position information determination module 1703 is used to determine the orientation information of the palm relative to the camera based on the center point of the palm frame and the image center point of the palm image.

[0277] In a possible implementation, the position information includes distance information; the position information determination module 1703 is used to calculate the distance information of the palm relative to the palm image recognition device based on the width and / or height of the palm frame.

[0278] In a possible implementation, the position information determination module 1703 is used to calculate the area of ​​the palm frame based on the width and height of the palm frame; compare the area of ​​the palm frame with a preset area threshold to obtain the distance information of the palm relative to the camera.

[0279] In a possible implementation, the position information determination module 1703 is used to perform calculations based on the width of the palm frame and a first threshold to obtain a first distance value of the palm relative to the palm image recognition device, where the first threshold refers to a preset value of the width of the palm frame.

[0280] In a possible implementation, the position information determination module 1703 is used to perform calculations based on the height of the palm frame and a second threshold to obtain a second distance value of the palm relative to the palm image recognition device, where the second threshold refers to a preset value of the height of the palm frame.

[0281] In a possible implementation, the position information determination module 1703 is used to perform calculations based on the width of the palm frame and a first threshold to obtain a first distance value of the palm relative to the palm image recognition device; perform calculations based on the height of the palm frame corresponding to the palm and a second threshold to obtain a second distance value of the palm relative to the palm image recognition device; and obtain the distance information of the palm relative to the palm image recognition device based on the first distance value and the second distance value.

[0282] In one possible implementation, the palm frame detection module 1702 is used to divide the palm image into at least two grids; perform at least one palm frame prediction on each of the grids through a palm frame recognition model to obtain a confidence value corresponding to each predicted palm frame; and determine the palm frame of the palm in the palm image based on the confidence value corresponding to the predicted palm frame.

[0283] In a possible implementation, the palm frame detection module 1702 is used to obtain a sample palm image and a sample palm frame corresponding to the sample palm image; perform data processing on the sample palm image through the palm frame recognition model to obtain a predicted palm frame; and update the model parameters of the palm frame recognition model based on the difference between the predicted palm frame and the sample palm frame.

[0284] Fig.18 A schematic diagram of the structure of a palm identification display device provided by an exemplary embodiment of the present application is shown. The device can be implemented as all or part of a computer device through software, hardware, or a combination of both. The device includes:

[0285] Display module 1801, used to display the interactive interface of the palm image recognition device;

[0286] The display module 1801 is further used to display a palm identifier and an effective recognition area identifier corresponding to the palm image in response to a palm image recognition operation triggered in the palm image recognition device, wherein the palm identifier is used to indicate a spatial position of the palm relative to the palm image recognition device, and the effective recognition area identifier is used to indicate a preset spatial position corresponding to the camera;

[0287] The display module 1801 is further configured to update a display position of the palm mark on the interactive interface in response to the movement of the palm, wherein the display position corresponds to a position of the palm in front of the camera;

[0288] The display module 1801 is further configured to display a first prompt message that the palm image is undergoing palm image recognition in response to the palm identifier moving to the position of the effective recognition area identifier.

[0289] In one possible implementation, the display module 1801 is used to respond to a palm image recognition operation triggered in the palm image recognition device, and display the position information of the palm relative to the palm image recognition device through the palm identifier and the effective recognition area identifier during the process of the camera capturing the palm image.

[0290] In one possible implementation, the position information includes orientation information; the display module 1801 is used to respond to the palm image recognition operation triggered in the palm image recognition device, and to represent the orientation information between the palm and the camera by displaying the relative position information between the palm identifier and the effective recognition area identifier.

[0291] In one possible implementation, the location information includes distance information; the display module 1801 is used to respond to the palm image recognition operation triggered in the palm image recognition device, and to indicate the distance information between the palm and the camera by displaying the shape change of the palm identifier.

[0292] In a possible implementation, the display module 1801 is used to display second prompt information in response to a palm image recognition operation triggered in the palm image recognition device, where the second prompt information is used to indicate that the palm identifier moves to the position of the effective recognition area identifier.

[0293] Fig.19 The structural block diagram of a computer device 1900 shown in an exemplary embodiment of the present application is shown. The computer device can be implemented as the server in the above-mentioned solution of the present application. The image computer device 1900 includes a central processing unit (CPU) 1901, a system memory 1904 including a random access memory (RAM) 1902 and a read-only memory (ROM) 1903, and a system bus 1905 connecting the system memory 1904 and the central processing unit 1901. The image computer device 1900 also includes a large-capacity storage device 1906 for storing an operating system 1909, an application program 1910 and other program modules 1911.

[0294] The mass storage device 1906 is connected to the central processing unit 1901 through a mass storage controller (not shown) connected to the system bus 1905. The mass storage device 1906 and its associated computer readable medium provide non-volatile storage for the image computer device 1900. That is, the mass storage device 1906 may include a computer readable medium (not shown) such as a hard disk or a compact disc read-only memory (CD-ROM) drive.

[0295] Without loss of generality, the computer-readable medium may include computer storage media and communication media. Computer storage media include volatile and non-volatile, removable and non-removable media implemented by any method or technology for storing information such as computer-readable instructions, data structures, program modules or other data. Computer storage media include RAM, Erasable Programmable Read Only Memory (EPROM), Electronically-Erasable Programmable Read-Only Memory (EEPROM) flash memory or other solid-state storage technology, CD-ROM, Digital Versatile Disc (DVD) or other optical storage, cassettes, tapes, disk storage or other magnetic storage devices. Of course, those skilled in the art will appreciate that the computer storage media is not limited to the above. The above-mentioned system memory 1904 and mass storage device 1906 can be collectively referred to as memory.

[0296] According to various embodiments of the present disclosure, the image computer device 1900 can also be connected to a remote computer on a network such as the Internet for operation. That is, the image computer device 1900 can be connected to a network 1908 via a network interface unit 1907 connected to the system bus 1905, or the network interface unit 1907 can be used to connect to other types of networks or remote computer systems (not shown).

[0297] The memory also includes at least one computer program, which is stored in the memory. The central processing unit 1901 implements all or part of the steps in the palm image recognition method or palm identification display method shown in the above-mentioned embodiments by executing the at least one program.

[0298] An embodiment of the present application also provides a computer device, which includes a processor and a memory, wherein the memory stores at least one program, and the at least one program is loaded and executed by the processor to implement the palm image recognition method or palm identification display method provided in the above-mentioned method embodiments.

[0299] An embodiment of the present application also provides a computer-readable storage medium, in which at least one computer program is stored. The at least one computer program is loaded and executed by a processor to implement the palm image recognition method or palm identification display method provided in the above-mentioned method embodiments.

[0300] An embodiment of the present application also provides a computer program product, which includes a computer program, and the computer program is stored in a computer-readable storage medium; the computer program is read and executed from the computer-readable storage medium by a processor of a computer device, so that the computer device executes to implement the palm image recognition method or palm identification display method provided in the above-mentioned method embodiments.

[0301] It will be understood that in the specific implementation of the present application, the data involved, historical data, and data related to user data processing such as portraits related to user identity or characteristics, when the above embodiments of the present application are applied to specific products or technologies, need to obtain user permission or consent, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0302] It should be understood that the "plurality" mentioned in this article refers to two or more. "And / or" describes the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects are in an "or" relationship.

[0303] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0304] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent switching, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A palm image recognition method, characterized in that: The method is applied to a palm image recognition device having a camera and a screen, and the method comprises: Acquire the palm image through the camera; Performing palm detection processing on the palm image to generate a palm frame of the palm in the palm image; determining, based on the palm frame and the palm image, position information of the palm relative to the palm image recognition device; Based on the position information, a palm identifier corresponding to the palm is displayed on the screen, where the palm identifier is used to indicate that the palm moves to a preset spatial position corresponding to the camera, and a palm image captured by the camera at the preset spatial position is compared and identified to obtain an object identifier corresponding to the palm image; The position information includes distance information, and determining the position information of the palm relative to the palm image recognition device based on the palm frame and the palm image includes: calculating the distance information of the palm relative to the palm image recognition device based on the width and / or height of the palm frame; The calculating, based on the width and height of the palm frame, distance information of the palm relative to the palm image recognition device includes: Performing calculation based on the width of the palm frame and a first threshold to obtain a first distance value of the palm relative to the palm image recognition device, wherein the first threshold refers to a preset value of the width of the palm frame; Performing calculation based on the height of the palm frame and a second threshold to obtain a second distance value of the palm relative to the palm image recognition device, wherein the second threshold refers to a preset value of the height of the palm frame; The distance information of the palm relative to the palm image recognition device is obtained based on the first distance value and the second distance value.

2. The method according to claim 1, characterized in that The step of performing palm detection processing on the palm image to generate a palm frame of the palm in the palm image includes: Performing palm detection processing on the palm image to determine parameter information of the palm; determining parameter information of the palm frame based on the parameter information of the palm; generating the palm frame of the palm in the palm image based on the parameter information of the palm frame; The parameter information of the palm frame includes the width, height and center point of the palm frame.

3. The method according to claim 2, characterized in that The location information includes position information; The determining, based on the palm frame and the palm image, the position information of the palm relative to the palm image recognition device comprises: The position information of the palm relative to the camera is determined based on the center point of the palm frame and the image center point of the palm image.

4. The method according to claim 1, characterized in that: The calculating, based on the width and / or height of the palm frame, the distance information of the palm relative to the palm image recognition device comprises: Calculating the area of ​​the palm frame based on the width and height of the palm frame; The area of ​​the palm frame is compared with a preset area threshold to obtain the distance information of the palm relative to the camera.

5. The method according to claim 1, characterized in that The calculating, based on the width of the palm frame, the distance information of the palm relative to the palm image recognition device comprises: Performing calculation based on the width of the palm frame and a first threshold to obtain a first distance value of the palm relative to the palm image recognition device; The first threshold refers to a preset width of the palm frame.

6. The method according to claim 1, characterized in that The calculating, based on the height of the palm frame, the distance information of the palm relative to the palm image recognition device comprises: Performing calculation based on the height of the palm frame and the second threshold to obtain a second distance value of the palm relative to the palm image recognition device; The second threshold refers to a preset height value of the palm frame.

7. The method according to any one of claims 1 to 6, characterized in that: The method further comprises: Dividing the palm image into at least two grids; Predicting at least one palm frame for each of the grids using a palm frame recognition model to obtain a confidence value corresponding to each predicted palm frame; The palm frame of the palm in the palm image is determined based on the confidence value corresponding to the predicted palm frame.

8. The method according to claim 7, characterized in that The method further comprises: Acquire a sample palm image and a sample palm frame corresponding to the sample palm image; Performing data processing on the sample palm image by using the palm frame recognition model to obtain a predicted palm frame; Based on the difference between the predicted palm frame and the sample palm frame, the model parameters of the palm frame recognition model are updated.

9. A method for displaying a palm mark, characterized in that: The method is applied to a palm image recognition device having a camera and a screen, and the method comprises: Displaying an interactive interface of the palm image recognition device; In response to a palm image recognition operation triggered in the palm image recognition device, during the process of the camera taking the palm image, the position information of the palm relative to the palm image recognition device is displayed through a palm identifier and an effective recognition area identifier, wherein the palm identifier is used to indicate the spatial position of the palm relative to the palm image recognition device, and the effective recognition area identifier is used to indicate a preset spatial position corresponding to the camera; In response to the movement of the palm, updating a display position of the palm mark on the interactive interface, wherein the display position corresponds to a position of the palm in front of the camera; In response to the palm mark moving to the position of the effective recognition area mark, displaying first prompt information that the palm image is undergoing palm image recognition; The position information includes distance information, and the distance information is obtained based on a first distance value and a second distance value. The first distance value is calculated based on the width of the palm frame and a first threshold, and the second distance value is calculated based on the height of the palm frame and a second threshold. The first threshold refers to a preset value of the width of the palm frame, and the second threshold refers to a preset value of the height of the palm frame.

10. The method according to claim 9, characterized in that The location information includes position information; In response to the palm image recognition operation triggered in the palm image recognition device, during the process of the camera capturing the palm image, displaying the position information of the palm relative to the palm image recognition device through the palm identifier and the effective recognition area identifier, includes: In response to a palm image recognition operation triggered in the palm image recognition device, the position information between the palm and the camera is represented by displaying relative position information between the palm identifier and the effective recognition area identifier.

11. The method according to claim 9, characterized in that The location information includes distance information; In response to the palm image recognition operation triggered in the palm image recognition device, during the process of the camera capturing the palm image, displaying the position information of the palm relative to the palm image recognition device through the palm identifier and the effective recognition area identifier, includes: In response to a palm image recognition operation triggered in the palm image recognition device, the distance information between the palm and the camera is represented by displaying a change in the shape of the palm mark.

12. The method according to any one of claims 9 to 11, characterized in that: The method further comprises: In response to a palm image recognition operation triggered in the palm image recognition device, second prompt information is displayed, where the second prompt information is used to indicate that the palm identifier is moved to a position of the effective recognition area identifier.

13. A palm image recognition device, characterized in that: The device comprises: An acquisition module, used for acquiring the palm image through a camera; A palm frame detection module, used for performing palm detection processing on the palm image to generate a palm frame of the palm in the palm image and parameter information of the palm frame; a position information determination module, configured to determine position information of the palm relative to the palm image recognition device based on the palm frame and the palm image; an identification module, configured to display a palm identifier corresponding to the palm on a screen based on the position information, wherein the palm identifier is used to indicate that the palm moves to a preset spatial position corresponding to the camera, and to perform comparative identification processing on a palm image captured by the camera at the preset spatial position to obtain an object identifier corresponding to the palm image; The position information includes distance information, and determining the position information of the palm relative to the palm image recognition device based on the palm frame and the palm image includes: calculating the distance information of the palm relative to the palm image recognition device based on the width and / or height of the palm frame; The calculating, based on the width and height of the palm frame, distance information of the palm relative to the palm image recognition device includes: Performing calculation based on the width of the palm frame and a first threshold to obtain a first distance value of the palm relative to the palm image recognition device, wherein the first threshold refers to a preset value of the width of the palm frame; Performing calculation based on the height of the palm frame and a second threshold to obtain a second distance value of the palm relative to the palm image recognition device, wherein the second threshold refers to a preset value of the height of the palm frame; The distance information of the palm relative to the palm image recognition device is obtained based on the first distance value and the second distance value.

14. A palm mark display device, characterized in that: The device comprises: A display module, used to display the interactive interface of the palm image recognition device; The display module is further used to respond to the palm image recognition operation triggered in the palm image recognition device, and display the position information of the palm relative to the palm image recognition device through the palm identifier and the effective recognition area identifier during the process of the camera shooting the palm image, wherein the palm identifier is used to indicate the spatial position of the palm relative to the palm image recognition device, and the effective recognition area identifier is used to indicate the preset spatial position corresponding to the camera; The display module is further configured to update a display position of the palm mark on the interactive interface in response to movement of the palm, wherein the display position corresponds to a position of the palm in front of the camera; The display module is further configured to display a first prompt message indicating that the palm image is undergoing palm image recognition in response to the palm identifier moving to the position of the effective recognition area identifier; The position information includes distance information, and the distance information is obtained based on a first distance value and a second distance value. The first distance value is calculated based on the width of the palm frame and a first threshold, and the second distance value is calculated based on the height of the palm frame and a second threshold. The first threshold refers to a preset value of the width of the palm frame, and the second threshold refers to a preset value of the height of the palm frame.

15. A computer device, characterized in that: The computer device includes: a processor and a memory, wherein at least one computer program is stored in the memory, and at least one computer program is loaded and executed by the processor to implement the palm image recognition method according to any one of claims 1 to 8, or the palm identification display method according to any one of claims 9 to 12.

16. A computer storage medium, characterized in that: The computer storage medium stores at least one computer program, which is loaded and executed by the processor to implement the palm image recognition method according to any one of claims 1 to 8, or the palm identification display method according to any one of claims 9 to 12.

17. A computer program product, characterized in that The computer program product includes a computer program, which is stored in a computer-readable storage medium; the computer program is read and executed from the computer-readable storage medium by a processor of a computer device, so that the computer device executes the palm image recognition method according to any one of claims 1 to 8, or the palm identification display method according to any one of claims 9 to 12.

Images