Synchronous acquisition method for contact type finger image and finger state truth value

Abstract

The invention provides a synchronous acquisition method for a contact-type finger image and a finger state truth value, and relates to the technical field of biological feature recognition and man-machine interaction, and the method comprises the steps: collecting the contact-type finger image through a first device with a fingerprint or touch sensor, synchronously acquiring a non-contact image sequence of the finger based on a mirror reflection principle or an additional second device with a shooting function; a plurality of visual algorithms are used, and according to the finger image sequence collected in a non-contact mode, true value data of the finger state are obtained through calculation; according to the true value data of the finger state, the contact type finger state measurement technology is optimized. According to the invention, when a fingerprint or touch sensor of consumer electronic equipment such as a mobile phone is used for collecting the contact finger image, the image sequence of the finger and the adjacent hand area is conveniently collected at low cost, so that the truth value data of the finger state is obtained; the finger state data associated with the contact type finger image can be conveniently acquired.

Description

Technical Field

[0001] The present application relates to the technical field of biometric feature recognition and human-computer interaction, and in particular to a method for synchronously collecting contact finger images and finger state true values. Background Art

[0002] At present, fingerprint recognition technology, as a mature biometric recognition technology, has been widely used in the field of identity recognition. However, the information contained in the fingerprint image includes not only individual identity information, but also information such as the three-dimensional posture and force of the finger. This information extracted from the fingerprint image can be applied to the field of human-computer interaction to develop a variety of interaction methods; it can also be used in identity authentication applications to achieve richer operations. Touch interaction technology also has similar characteristics. In addition to the contact and positioning information that is widely extracted and used, the touch image also contains a variety of information such as the three-dimensional posture and force of the finger, which can be used to develop more practical applications.

[0003] Many finger state measurement technologies based on contact sensors such as fingerprints or touch sensors use deep network-based methods and therefore rely on collecting a large number of finger samples and state truth values. However, the current mainstream technologies for collecting finger state truth values, such as optical tracking technology, are very complex and require expensive equipment and cumbersome operation processes. This technology is difficult to use to collect the current user's finger state truth data, and therefore difficult to use for personalized fine-tuning of pre-trained deep networks. In practical applications, how to use mobile phones with fingerprint or touch sensors to conveniently and simultaneously collect contact finger images and finger state truth data, thereby providing rich data for the design and optimization of algorithms used in applications, has become a problem worth studying. Summary of the invention

[0004] The present application aims to solve one of the technical problems in the related art at least to some extent.

[0005] To this end, the purpose of the present application is to propose a method, device, electronic device and readable medium for synchronously collecting contact finger images and finger state true values, which can synchronously collect non-contact image sequences of fingers while using mobile phone sensors to collect contact finger images, and obtain true value data of finger states based on this, thereby optimizing finger state measurement technology based on contact images.

[0006] To achieve the above-mentioned purpose, the first embodiment of the present application proposes a method for synchronously collecting a contact finger image and a finger state true value, comprising:

[0007] Capturing contact finger images through a first device having a fingerprint or touch sensor, and synchronously capturing non-contact finger image sequences based on the mirror reflection principle or an additional second device having a photographing function;

[0008] Using a variety of visual algorithms, the true value data of the finger state is calculated based on the finger image sequence collected by non-contact;

[0009] According to the true value data of the finger state, the contact finger state measurement technology is optimized.

[0010] Optionally, the collecting of the contact finger image by the first device having a fingerprint or touch sensor and the synchronous collection of the non-contact image sequence of the finger based on the mirror reflection principle include:

[0011] Place the first device face up on a table, or fix the position in other ways;

[0012] Fixing a reflective mirror in the upper area of ​​the front side of the first device, wherein the mirror surface of the reflective mirror faces the screen of the first device;

[0013] When the user places a finger on the fingerprint or touch sensor of the first device to collect a contact finger image, the front camera of the first device is used to synchronously collect a non-contact image sequence of the finger through reflection of the mirror.

[0014] Optionally, the collecting of contact finger images by a device having a fingerprint or touch sensor, and synchronously collecting a non-contact image sequence of the finger based on an additional second device having a photographing function, includes:

[0015] Place the first device face up on a table, or fix the position in other ways;

[0016] Fixing the second device to the upper area of ​​the front side of the first device;

[0017] When the user places a finger on the fingerprint or touch sensor of the first device to collect a contact finger image, the second device is used to synchronously collect a non-contact image sequence of the finger.

[0018] Optionally, also include:

[0019] When collecting non-contact image sequences of fingers, a supplementary light source is used for auxiliary lighting according to actual conditions.

[0020] Optionally, the true value data of the finger state includes the finger position, three-dimensional posture, force and other data associated with the information contained in the contact finger image, wherein the three-dimensional posture of the finger refers to the three-dimensional posture of the first finger segment of the finger.

[0021] Optionally, the method uses a plurality of visual algorithms to calculate the true value data of the finger state according to the finger image sequence collected non-contactly, including:

[0022] Use deep learning methods to build a visual recognition model to identify the finger positions;

[0023] According to the spatial position relationship and the parameters of the camera, the three-dimensional posture of the finger is obtained by solving the problem.

[0024] Using deep learning methods, the finger force is estimated based on the morphological changes of the finger nail.

[0025] Optionally, the contact finger state measurement technology includes:

[0026] The three-dimensional posture, force and position of the finger are measured from the contact finger image through deep learning methods.

[0027] To achieve the above-mentioned purpose, the second embodiment of the present application proposes a device for synchronously collecting contact finger images and finger state true values, comprising:

[0028] A collection module, used to collect contact finger images through a first device with a fingerprint or touch sensor, and synchronously collect non-contact finger image sequences based on the mirror reflection principle or an additional second device with a shooting function;

[0029] A calculation module, used to calculate the true value data of the finger state according to the finger image sequence collected by non-contact method using a variety of visual algorithms;

[0030] The optimization module is used to optimize the contact finger state measurement technology according to the true value data of the finger state.

[0031] To achieve the above-mentioned purpose, the third aspect of the present application provides an electronic device, including: a processor, and a memory communicatively connected to the processor;

[0032] The memory stores computer-executable instructions;

[0033] The processor executes the computer-executable instructions stored in the memory to implement the method as described in any one of the first aspects above.

[0034] To achieve the above-mentioned purpose, the fourth aspect embodiment of the present application proposes a computer-readable storage medium, in which computer execution instructions are stored. When the computer execution instructions are executed by a processor, they are used to implement the method as described in any one of the above-mentioned first aspects.

[0035] The technical solution provided by the embodiments of the present application brings at least the following beneficial effects:

[0036] By proposing two types of acquisition schemes, namely, through the principle of mirror reflection or additional devices with shooting function, it is possible to achieve synchronous non-contact acquisition of finger (which may include adjacent hand areas) image sequences when users use contact sensors (including fingerprint sensors and touch sensors) of consumer electronic devices such as mobile phones, tablets, computers, smart watches, etc. to collect contact finger images. Through visual algorithms, multiple true value data of finger states can be further calculated from non-contact images, and the true value data can be used to optimize the contact finger state measurement technology.

[0037] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0039] Figure 1 is a flow chart of a method for synchronously collecting a contact finger image and a finger state true value according to an embodiment of the present application;

[0040] Figure 2 is a schematic diagram of collecting finger data using mirror reflection according to an embodiment of the present application;

[0041] Figure 3 is a schematic diagram of using an additional photographing device to collect finger data according to an embodiment of the present application;

[0042] Figure 4 is a flow chart of collecting finger data using mirror reflection according to an embodiment of the present application;

[0043] Figure 5 is a flow chart of collecting finger data using an additional photographing device according to an embodiment of the present application;

[0044] Figure 6 It is a block diagram of a device for synchronously collecting contact finger images and finger state true values ​​according to an embodiment of the present application. DETAILED DESCRIPTION

[0045] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.

[0046] The following describes a method and device for synchronously collecting a contact finger image and a finger state true value according to an embodiment of the present application with reference to the accompanying drawings.

[0047] Figure 1 FIG. 1 is a flow chart of a method for synchronously collecting a contact finger image and a finger state true value according to an embodiment of the present application. Figure 1 As shown, the method comprises the following steps:

[0048] Step 101: A contact finger image is collected by a first device having a fingerprint or touch sensor, and a non-contact finger image sequence is collected synchronously based on the mirror reflection principle or by a second device having an additional shooting function.

[0049] The existing technology has the following technical problems: the current mainstream technology for collecting the true value of finger state, such as optical tracking technology, is very complex, requiring expensive equipment and cumbersome operation procedures. This technology is difficult to use to collect the true value data of the finger state of the current user, and therefore difficult to use for personalized fine-tuning of the pre-trained deep network.

[0050] Therefore, in response to the above problems, this application proposes two types of acquisition solutions, namely, collecting non-contact image sequences of fingers based on the principle of mirror reflection or additional devices with shooting functions, and then calculating the true value data of the finger status by using multiple visual algorithms.

[0051] In an embodiment of the present application, the first device may be a consumer electronic device such as a mobile phone, tablet computer, computer, smart watch, etc. that includes a fingerprint sensor or a touch sensor, and the second device may be a mobile phone, camera, smart glasses and other wearable devices with a shooting function, etc., which are not limited in the present application.

[0052] In a possible embodiment, a schematic diagram of collecting finger data using mirror reflection is shown in FIG. Figure 2 As shown in the figure, the schematic diagram of using an additional camera to collect finger data is as follows Figure 3 In this embodiment, the first device is a mobile phone with a fingerprint sensor or a touch sensor, and the second device is a mobile phone with a camera function or other camera devices.

[0053] Figure 4 This is a flow chart of collecting finger data using mirror reflection according to an embodiment of the present application, including:

[0054] Step 201: Place the first device face up on a desktop, or fix the position of the first device in other ways.

[0055] If the first device is a mobile phone with a fingerprint sensor or a touch sensor, such as Figure 2 As shown, place the mobile phone face up on the table, or fix the position in other ways.

[0056] It is understandable that there are many ways to fix the position of a mobile phone, and this application does not limit this.

[0057] Step 202: fix a reflector on the upper area of ​​the front side of the first device, with the mirror surface of the reflector facing the screen of the first device.

[0058] like Figure 2 As shown, the reflector is fixed to the upper area of ​​the front of the mobile phone, with the mirror surface facing the mobile phone screen.

[0059] It is understandable that there are many ways to fix the position of the reflector, and this application does not limit this.

[0060] In a possible embodiment, a special bracket can be used to fix the reflector to the upper area of ​​the front of the mobile phone.

[0061] Step 203: When the user places a finger on the fingerprint or touch sensor of the first device to collect a contact finger image, the front camera of the first device is used to synchronously collect a non-contact image sequence of the finger through reflection of the mirror.

[0062] like Figure 2 As shown, when a user places a finger on the fingerprint or touch sensor of a mobile phone to collect a contact finger image, the front camera of the same mobile phone can be used to synchronously collect a non-contact image sequence of the finger through reflection of the mirror.

[0063] That is, while the contact finger image is collected using the mobile phone sensor, the non-contact image sequence of the finger is synchronously collected using the front camera of the same mobile phone.

[0064] Figure 5 This is a flow chart of using an additional camera to collect finger data according to an embodiment of the present application, including:

[0065] Step 301: Place the first device on a desktop with its front side facing upward, or fix its position in other ways.

[0066] Similar to the above process, place the mobile phone face up on the table, or fix the position in other ways.

[0067] It is understandable that there are many ways to fix the position of a mobile phone, and this application does not limit this.

[0068] Step 302: Fix the second device in the upper area of ​​the front side of the first device.

[0069] It is understandable that there are many ways to fix the position of a device with a shooting function, and this application does not limit this.

[0070] In a possible embodiment, a special bracket is used to fix another mobile phone with a camera function or other camera equipment on the upper area of ​​the front of the mobile phone.

[0071] Step 303: When the user places a finger on the fingerprint or touch sensor of the first device to collect a contact finger image, the second device is used to synchronously collect a non-contact image sequence of the finger.

[0072] like Figure 3 As shown, when a user places a finger on the fingerprint or touch sensor of a mobile phone to collect a contact finger image, a front camera of another mobile phone or other shooting device can be used to synchronously collect a non-contact image sequence of the finger.

[0073] That is, while the contact finger image is collected using the mobile phone sensor, the non-contact image sequence of the finger is synchronously collected using the front camera of another mobile phone or other shooting device.

[0074] In addition, for Figure 4 and Figure 5 In order to achieve better image shooting quality, the method shown may also use a supplementary light source for auxiliary lighting when collecting the non-contact image sequence of the finger according to actual conditions.

[0075] Step 102: Use a variety of visual algorithms to calculate the true value data of the finger state based on the finger image sequence collected in a non-contact manner.

[0076] In an embodiment of the present application, the true value data of the finger state includes the finger position (for example, the index finger of the right hand), three-dimensional posture, force (normal force and shear force) and other data related to the information contained in the contact finger image, wherein the three-dimensional posture of the finger refers to the three-dimensional posture of the first segment of the finger.

[0077] It is understandable that by using a reasonable visual algorithm, the true value data of the finger state (or data very close to the true value) can be obtained from the finger image sequence. In this application, no specific restriction is made on the visual algorithm used, that is, any visual algorithm that can realize the calculation and acquisition of the true value data of the finger state can be used.

[0078] The following are some algorithm solutions that can be used as references, but they are not intended to limit this application. They are as follows:

[0079] (1) Use deep learning methods to build a visual recognition model to identify the finger positions. Alternatively, when collecting fingerprints, the fingerprints can be distinguished by specifying the collected finger positions.

[0080] As a possible implementation, the position and identity of fingers (such as the right index finger) can be automatically recognized by training a deep learning model. This can be achieved through convolutional neural networks (CNN) or other deep learning architectures.

[0081] Alternatively, when collecting fingerprints, the distinction is achieved by specifying the finger position collected. For example, the user can pre-specify which finger is placed on the sensor to achieve the distinction.

[0082] (2) Based on the spatial position relationship and camera parameters, the three-dimensional posture of the finger is obtained.

[0083] As a possible implementation method, the gesture of the finger in three-dimensional space is calculated by multi-view geometric reconstruction technology using spatial geometric relationships and camera parameters (such as focal length, pixel size, etc.). This can be achieved through structured light, stereo vision or multi-view geometry methods.

[0084] (3) Use deep learning methods to estimate the finger force based on the morphological changes of the finger nail.

[0085] As a possible implementation method, the morphological changes of the fingernail can be analyzed through a deep learning model to estimate the force (including normal force and shear force) applied to the finger. This method can be based on a convolutional neural network or other deep learning models and can be trained to identify changes in force.

[0086] In the embodiment of the present application, for the collected contact finger image and finger state true value data, interpolation and other methods can also be used to further achieve more accurate data synchronization. According to actual needs, a reasonable data storage and representation format is designed to store the contact finger image and finger state true value data, so as to facilitate the subsequent use of the data.

[0087] In addition, in order to improve the accuracy and convenience of acquisition, an intuitive user interface and interactive process can be designed to guide users to correctly place their fingers and other operations. The acquisition system can be designed to calculate the true value of the finger state in real time, thereby providing real-time feedback, such as acquisition status prompts, image acquisition quality prompts, etc., to help users understand the status of the current operation.

[0088] Step 103: Optimize the contact finger state measurement technology according to the true value data of the finger state.

[0089] Finally, the finger state true value data obtained through the above steps is used to optimize the contact finger state measurement technology.

[0090] It should be noted that the contact finger state measurement technology involved here includes but is not limited to: measuring the three-dimensional posture, force and finger position of the finger from the fingerprint or touch image through deep learning methods.

[0091] In order to implement the above-mentioned embodiment, the present application also proposes a device for synchronously collecting contact finger images and finger state true values.

[0092] Figure 6 1 is a block diagram of a synchronous acquisition device 10 for contact finger images and finger state true values ​​according to an embodiment of the present application, comprising:

[0093] The acquisition module 100 is used to acquire contact finger images through a first device having a fingerprint or touch sensor, and synchronously acquire a non-contact image sequence of the finger based on the mirror reflection principle or an additional second device having a shooting function;

[0094] The calculation module 200 is used to calculate the true value data of the finger state according to the finger image sequence collected in a non-contact manner using a plurality of visual algorithms;

[0095] The optimization module 300 is used to optimize the contact finger state measurement technology according to the true value data of the finger state.

[0096] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0097] In order to implement the above embodiments, the present application also proposes an electronic device, comprising: a processor, and a memory communicatively connected to the processor; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory to implement the method provided by the above embodiments.

[0098] In order to implement the above embodiments, the present application also proposes a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, they are used to implement the methods provided by the above embodiments.

[0099] In the description of the aforementioned embodiments, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0100] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0101] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0102] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0103] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0104] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0105] In addition, each functional unit in each embodiment of the present application may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0106] The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present application. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present application.

[0107] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this application can be executed in parallel, sequentially or in different orders, as long as the expected results of the technical solution of this application can be achieved, and this document is not limited here.

[0108] The above specific implementations do not constitute a limitation on the protection scope of this application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of this application should be included in the protection scope of this application.

Claims

1. A method for synchronously collecting contact finger images and finger state true values, characterized in that: include: Capturing contact finger images through a first device having a fingerprint or touch sensor, and synchronously capturing non-contact finger image sequences based on the mirror reflection principle or an additional second device having a photographing function; Using a variety of visual algorithms, the true value data of the finger state is calculated based on the finger image sequence collected by non-contact; According to the true value data of the finger state, the contact finger state measurement technology is optimized.

2. The method according to claim 1, characterized in that The method of collecting a contact finger image by a first device having a fingerprint or touch sensor and synchronously collecting a non-contact image sequence of the finger based on the mirror reflection principle includes: Place the first device face up on a table, or fix the position in other ways; Fixing a reflector at an upper area of ​​the front surface of the first device, wherein a mirror surface of the reflector faces a screen of the first device; When the user places a finger on the fingerprint or touch sensor of the first device to collect a contact finger image, the front camera of the first device is used to synchronously collect a non-contact image sequence of the finger through reflection of the mirror.

3. The method according to claim 1, characterized in that The method of collecting contact finger images by a device having a fingerprint or touch sensor and synchronously collecting a non-contact image sequence of the finger based on an additional second device having a shooting function includes: Place the first device face up on a table, or fix the position in other ways; Fixing the second device to the upper area of ​​the front side of the first device; When the user places a finger on the fingerprint or touch sensor of the first device to collect a contact finger image, the second device is used to synchronously collect a non-contact image sequence of the finger.

4. The method according to claim 2 or 3, characterized in that: Also includes: When collecting non-contact image sequences of fingers, a supplementary light source is used for auxiliary lighting according to actual conditions.

5. The method according to claim 1, characterized in that The true value data of the finger state includes the finger position, three-dimensional posture, force and other data associated with the information contained in the contact finger image, wherein the three-dimensional posture of the finger refers to the three-dimensional posture of the first finger segment of the finger.

6. The method according to claim 5, characterized in that The method uses a plurality of visual algorithms to calculate the true value data of the finger state according to the finger image sequence collected by non-contact, including: Use deep learning methods to build a visual recognition model to identify the finger positions; According to the spatial position relationship and the parameters of the camera, the three-dimensional posture of the finger is obtained by solving the problem. Using deep learning methods, the finger force is estimated based on the morphological changes of the finger nail.

7. The method according to claim 1, characterized in that The contact-type finger state measurement technology comprises: The three-dimensional posture, force and finger position of the finger are measured from the contact finger image through deep learning method.

8. A synchronous acquisition device for contact finger images and finger state true values, characterized in that: include: A collection module, used to collect contact finger images through a first device with a fingerprint or touch sensor, and synchronously collect non-contact finger image sequences based on the mirror reflection principle or an additional second device with a shooting function; A calculation module, used to calculate the true value data of the finger state according to the finger image sequence collected by non-contact method using a variety of visual algorithms; The optimization module is used to optimize the contact finger state measurement technology according to the true value data of the finger state.

9. An electronic device, characterized in that: include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 7 when executed by a processor.

Images