Information Processing Apparatus, Information Processing Method, and Computer Program

Abstract

This information processing device 1 comprises: an acquisition unit 11 for acquiring three-dimensional information 3DI on the skin; a detection unit 12 for, upon extracting a pattern from the three-dimensional information 3DI, detecting a unique region in said pattern; an extraction unit 13 for extracting a unique region pattern in the unique region; and a generation unit 14 for generating a joined pattern image by joining the pattern and the unique region pattern together on the basis of the pattern extracted from the three-dimensional information 3DI by the detection unit 12 and the unique region pattern extracted by the extraction unit 13.

Description

Technical Field

[0001] This disclosure relates to the technical fields of information processing apparatuses, information processing methods, and recording media.

Background Art

[0002] When a transducer that transmits and receives ultrasonic waves moves horizontally below a window on which a fingertip is placed to scan different surfaces of the fingertip and a plurality of ultrasonic tomographic images are obtained, and the plurality of ultrasonic tomographic images are combined to generate a three-dimensional image including the fingerprint of the fingertip, the three-dimensional image of the fingertip obtained during the identification operation is compared with the three-dimensional image of the fingertip pre-registered in the recording device to determine whether the person to be identified is a specific person. A technique for identification is described in Patent Document 1. A wrinkle and scratch extraction means for extracting wrinkles and scratches on a finger from a fingerprint image and outputting them as information on feature points related to the wrinkles and scratches, and fingerprint data storage means for storing the information on feature points related to the wrinkles and scratches from the wrinkle and scratch extraction means together with the information on the feature points of the fingerprint ridge lines as fingerprint data, and fingerprint data stored in the fingerprint data storage means, and collation means for performing fingerprint collation based on the information on the feature points of the fingerprint ridge lines and the information on the feature points related to the wrinkles and scratches input during collation are provided, and a technique for accurately collating even low-quality fingerprints with rough surfaces or many scratches on the finger is described in Patent Document 2. A biological pattern information processing apparatus including a biological pattern information acquisition unit that acquires biological pattern information indicating a biological pattern and a specific region detection unit that detects a specific region including damage from the biological pattern indicated by the acquired biological pattern information is described in Patent Document 3.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Patent Document 3

Summary of the Invention

Problems to be Solved by the Invention

[0004] This disclosure aims to provide an information processing apparatus, an information processing method, and a recording medium for improving the technologies described in prior art documents.

Means for Solving the Problems

[0005] One aspect of the information processing apparatus includes an acquisition means for acquiring three-dimensional information of the skin, a detection means for extracting a pattern from the three-dimensional information and detecting a specific region of the pattern, an extraction means for extracting a specific region pattern of the specific region, and a generation means for generating a combined pattern image by combining the pattern extracted by the detection means from the three-dimensional information and the specific region pattern extracted by the extraction means.

[0006] One aspect of the information processing method is to acquire three-dimensional information of the skin, extract a pattern from the three-dimensional information, detect a specific region of the pattern, extract a specific region pattern of the specific region, and generate a combined pattern image by combining the pattern extracted from the three-dimensional information and the specific region pattern extracted from the specific region.

[0007] One aspect of the recording medium stores a computer program for causing a computer to execute an information processing method of acquiring three-dimensional information of the skin, extracting a pattern from the three-dimensional information, detecting a specific region of the pattern, extracting a specific region pattern of the specific region, and generating a combined pattern image by combining the pattern extracted from the three-dimensional information and the specific region pattern extracted from the specific region.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

[0009] Hereinafter, embodiments of an information processing apparatus, an information processing method, and a recording medium will be described with reference to the drawings. [1: First Embodiment]

[0010] The first embodiment of an information processing apparatus, an information processing method, and a recording medium will be described. Hereinafter, the first embodiment of an information processing apparatus, an information processing method, and a recording medium will be described using the information processing apparatus 1 to which the first embodiment of an information processing apparatus, an information processing method, and a recording medium is applied. [1-1: Configuration of Information Processing Apparatus 1]

[0011] With reference to FIG. 1, the configuration of the information processing apparatus 1 in the first embodiment will be described. FIG. 1 is a block diagram showing the configuration of the information processing apparatus 1 in the first embodiment.

[0012] As shown in FIG. 1, the information processing apparatus 1 includes an acquisition unit 11, a detection unit 12, an extraction unit 13, and a generation unit 14. The acquisition unit 11 acquires three-dimensional information 3DI of the skin. The detection unit 12 extracts a pattern from the three-dimensional information 3DI and detects a specific region of the pattern. The extraction unit 13 extracts a specific region pattern of the specific region. The generation unit 14 generates a combined pattern image in which the pattern extracted by the detection unit 12 from the three-dimensional information 3DI and the specific region pattern extracted by the extraction unit 13 are combined. [1-2: Technical Effects of Information Processing Apparatus 1]

[0013] Since the information processing apparatus 1 in the first embodiment generates a combined pattern image in which a pattern and a specific region pattern are combined, compared with the case where the pattern and the specific region pattern are not combined, the information amount of the pattern is large and a pattern image with high accuracy can be obtained. [2: Second Embodiment]

[0014] The second embodiment of an information processing apparatus, an information processing method, and a recording medium will be described. Hereinafter, the second embodiment of an information processing apparatus, an information processing method, and a recording medium will be described using the information processing apparatus 2 to which the second embodiment of an information processing apparatus, an information processing method, and a recording medium is applied. [2-1: Configuration of Information Processing Apparatus 2]

[0015] With reference to FIG. 2, the configuration of the information processing apparatus 2 in the second embodiment will be described. FIG. 2 is a block diagram showing the configuration of the information processing apparatus 2 in the second embodiment.

[0016] As shown in FIG. 2, the information processing apparatus 2 includes an arithmetic unit 21 and a storage device 22. Further, the information processing apparatus 2 may include a communication device 23, an input device 24, and an output device 25. However, the information processing apparatus 2 may not include at least one of the communication device 23, the input device 24, and the output device 25. The arithmetic unit 21, the storage device 22, the communication device 23, the input device 24, and the output device 25 may be connected via a data bus 26.

[0017] The arithmetic unit 21 includes, for example, at least one of a CPU (Central Processing Unit), a GPU (Graphics Proecssing Unit), and an FPGA (Field Programmable Gate Array). The arithmetic unit 21 reads a computer program. For example, the arithmetic unit 21 may read a computer program stored in the storage device 22. For example, the arithmetic unit 21 may read a computer program stored in a computer-readable and non-temporary recording medium using a recording medium reading device (for example, the input device 24 described later) provided in the information processing apparatus 2. The arithmetic unit 21 may obtain a computer program from a device (not shown) disposed outside the information processing apparatus 2 via the communication device 23 (or another communication device) (that is, it may be downloaded or read). The arithmetic unit 21 executes the read computer program. As a result, logical functional blocks for executing the operations to be performed by the information processing apparatus 2 are realized in the arithmetic unit 21. That is, the arithmetic unit 21 can function as a controller for realizing logical functional blocks for executing the operations (in other words, processes) to be performed by the information processing apparatus 2.

[0018] FIG. 2 shows an example of logical function blocks realized in the arithmetic unit 21 to execute information processing operations. As shown in FIG. 2, in the arithmetic unit 21, an acquisition unit 211 which is a specific example of "acquisition means", a detection unit 212 which is a specific example of "detection means", an extraction unit 213 which is a specific example of "extraction means", and a generation unit 214 which is a specific example of "generation means" are realized. Operations of each of the acquisition unit 211, the detection unit 212, the extraction unit 213, and the generation unit 214 will be described later.

[0019] The storage device 22 can store desired data. For example, the storage device 22 may temporarily store a computer program executed by the arithmetic unit 21. The storage device 22 may temporarily store data that the arithmetic unit 21 temporarily uses when the arithmetic unit 21 is executing a computer program. The storage device 22 may store data that the information processing apparatus 2 stores long-term. Note that the storage device 22 may include at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device. That is, the storage device 22 may include a non-temporary recording medium.

[0020] The communication device 23 can communicate with a device outside the information processing apparatus 2 via a communication network (not shown). The communication device 23 may acquire three-dimensional information 3DI used for information processing operations from a three-dimensional information generation apparatus 100, which will be described later, via the communication network.

[0021] The input device 24 is a device that receives input of information to the information processing apparatus 2 from the outside of the information processing apparatus 2. For example, the input device 24 may include an operating device (for example, at least one of a keyboard, a mouse, and a touch panel) that can be operated by an operator of the information processing apparatus 2. For example, the input device 24 may include a reading device that can read information recorded as data on an externally attachable recording medium with respect to the information processing apparatus 2.

[0022] The output device 25 is a device that outputs information to the outside of the information processing device 2. For example, the output device 25 may output the information as an image. That is, the output device 25 may include a display device (so-called, display) capable of displaying an image indicating the information to be output. For example, the output device 25 may output the information as voice. That is, the output device 25 may include a voice device (so-called, speaker) capable of outputting voice. For example, the output device 25 may output the information on paper. That is, the output device 25 may include a printing device (so-called, printer) capable of printing desired information on paper. [2-2: Three-dimensional information generation device 100]

[0023] The three-dimensional information generation device 100 may include, for example, a projection device, an imaging device, and an image processing device that processes an image acquired by the imaging device. The projection device may project a first light pattern whose luminance changes in a first period and a second light pattern whose luminance changes in a second period longer than the first period onto the object to be measured. The imaging device may acquire an image of the object to be measured onto which the first or second light pattern is projected. The image processing device calculates a relative phase value at each part of the object to be measured based on the luminance value of the image of the object to be measured onto which the first light pattern is projected, and calculates an absolute phase value at each part of the object to be measured based on the luminance value and the relative phase value of the image of the object to be measured onto which the second light pattern is projected, and may calculate three-dimensional coordinates at each part of the object to be measured based on the absolute phase value.

[0024] The three-dimensional information generation device 100 may output the three-dimensional coordinates at each part of the object to be measured as three-dimensional information 3DI. Note that the configuration of the three-dimensional information generation device 100 described above is merely an example. For example, the three-dimensional information generation device 100 may be an optical coherence tomography device that generates three-dimensional luminance data of the object to be measured generated by performing optical coherence tomography while irradiating the object to be measured with a light beam by two-dimensional scanning, and may output the three-dimensional luminance data as three-dimensional information 3DI. [2-3: Information processing operations performed by the information processing device 2]

[0025] Referring to FIG. 3, the flow of the information processing operation performed by the information processing apparatus 2 in the second embodiment will be described. FIG. 3 is a flowchart showing the flow of the information processing operation performed by the information processing apparatus 2 in the second embodiment. FIG. 4 is a conceptual diagram of the flow of the information processing operation performed by the information processing apparatus 2 in the second embodiment.

[0026] As shown in FIG. 3, the acquisition unit 211 acquires three-dimensional information 3DI of the skin (step S20). In the second embodiment, the skin may be the skin of a finger.

[0027] The detection unit 212 extracts a pattern from the three-dimensional information 3DI (step S21). In the second embodiment, the pattern may be a fingerprint. The detection unit 212 may extract convex portions in contact with a predetermined surface. The predetermined surface may be a curved surface along the approximate shape of the finger. The convex portion may be a ridge line. That is, in step S21, the detection unit 212 may collect information such as information indicating a shape formed on the surface where the seal is pressed when, for example, a seal is pressed.

[0028] The detection unit 212 detects a specific region of the extracted pattern (step S22). The specific region is a region that is recessed compared to the surroundings and may include a wrinkle region. The specific region may be an abnormal region of the pattern where the pattern is discontinuous. A region where the pattern cannot be extracted by the detection unit 212 may be a noise region in pattern extraction.

[0029] The detection unit 212 may detect a region not in contact with the predetermined surface as a specific region. The specific region may be a cut region with nothing in the image, such as those marked with reference numerals SA1, SA2, and SA3 in FIG. 4(a). The detection unit 212 may detect, for example, a region where a pattern pattern at a predetermined pitch cannot be extracted as a specific region. The detection unit 212 may extract a region where the pattern pattern is abnormal from the three-dimensional information 3DI.

[0030] The extraction unit 213 extracts the specific region pattern of the specific region (step S23). The extraction unit 213 may estimate the approximate three-dimensional shape of the corresponding specific region based on the width of the corresponding specific region and the depth information of the deepest part, and extract the shape of the convex part in contact with the approximate three-dimensional shape. For example, as illustrated in FIG. 4(b), the extraction unit 213 may extract the specific region patterns of the specific regions SA1, SA2, and SA3 respectively.

[0031] Based on the pattern extracted by the detection unit 212 from the three-dimensional information 3DI and the specific region pattern extracted by the extraction unit 213, the generation unit 214 generates a combined pattern image in which the pattern and the specific region pattern are combined (step S24). Based on the pattern extracted by the detection unit 212 from the three-dimensional information 3DI and the specific region pattern extracted by the extraction unit 213, a combined pattern image in which the pattern is complemented by the specific region pattern may be generated. For example, the generation unit 214 may generate a combined fingerprint image as illustrated in FIG. 4(c).

[0032] Furthermore, for example, as illustrated in FIG. 4(c), the output device 25 outputs a combined pattern image complemented by the specific region pattern, and the specific region part is displayed in a different color so as to be easily visible.

[0033] The pattern of the epidermis is formed by the pattern of the dermis. On the other hand, depressions such as wrinkles are changes in the epidermis. Therefore, even when wrinkles or the like are formed and depressions are present in the epidermis, the epidermis has a pattern. In other words, even in the gaps between the valleys of the epidermis, there are ridge patterns. In the specific region, the pattern does not appear on the surface at the same height as the region where no wrinkles are formed, but the pattern exists. In the second embodiment, the patterns existing on the surfaces with different heights are also adopted to generate a pattern image. [2-4: Technical Effects of the Information Processing Apparatus 2]

[0034] Due to aging, dry skin conditions, etc., the patterns on the surface of the epidermis may be in a state different from the original patterns. For example, this applies when wrinkles or the like are formed on the skin and there are areas where the epidermis is sunken compared to the surrounding area. This corresponds to the case where the surface state of the epidermis is different from the state of the dermis. In this case, the ridge lines of the pattern may be interrupted. As a result, it may be difficult to extract accurate feature points of the pattern. For example, when collating patterns, it may lead to a decrease in collation accuracy. For example, when collecting fingerprints with a two-dimensional scanner, if there are wrinkles on the finger, the ridge lines will be interrupted by the wrinkles. Also, fingerprints collected by applying ink or fingerprints obtained by a live scanner, etc., can only collect the patterns of the parts in contact with the plane. That is, since the wrinkled areas of the skin do not contact the plane, it may not be possible to collect the fingerprints of the wrinkled areas. In the second embodiment, the information processing apparatus 2 combines and complements the pattern on the surface of the epidermis and the pattern of the sunken area compared to the surrounding area including the wrinkled area, so that a highly accurate pattern image can be obtained. That is, the information processing apparatus 2 can reproduce the state of the dermis. [3: Third Embodiment]

[0035] The third embodiment of the information processing apparatus, the information processing method, and the recording medium will be described. Hereinafter, the third embodiment of the information processing apparatus, the information processing method, and the recording medium will be described using the information processing apparatus 3 to which the third embodiment of the information processing apparatus, the information processing method, and the recording medium is applied.

[0036] The information processing apparatus 3 in the third embodiment has a different generation operation performed by the generation unit 214 compared to the information processing apparatus 2 in the second embodiment. Other features of the information processing apparatus 3 may be the same as other features of the information processing apparatus 2. [3-1: Information Processing Operations Performed by the Information Processing Apparatus 3]

[0037] Referring to FIG. 5, the flow of the information processing operations performed by the information processing apparatus 3 in the third embodiment will be described. FIG. 5 is a flowchart showing the flow of the information operations performed by the information processing apparatus 3 in the third embodiment.

[0038] The acquisition unit 211 acquires three-dimensional information 3DI of the skin (step S20). The detection unit 212 extracts a pattern from the three-dimensional information 3DI (step S21). The detection unit 212 detects a specific region of the pattern (step S22). The extraction unit 213 extracts a specific region pattern of the specific region (step S23).

[0039] The generation unit 214 determines, for each of the specific regions, whether the specific region pattern of the specific region can be connected to the pattern of the region adjacent to the specific region (step S30). The generation unit 214 may determine whether the specific region pattern of the specific region can be connected to the pattern of the region adjacent to the specific region when the pattern and the specific region pattern are joined together. When the specific region pattern of the specific region cannot be connected to the pattern of the region adjacent to the specific region, the generation unit 214 may correct the shape of the joining portion of the corresponding specific region pattern so as to be connectable to the pattern of the adjacent region. For example, the generation unit 214 may correct the line direction of the specific region pattern in the joining portion according to the width and depth of the specific region.

[0040] The generation unit 214 generates a joined pattern image in which the pattern and the specific region pattern are joined together based on the specific region patterns of the specific regions that can be connected to the patterns of the regions adjacent to the specific regions (step S31). [3-2: Technical Effect of Information Processing Apparatus 3]

[0041] In the third embodiment, the information processing apparatus 3 wants to obtain a pattern similar to the state of the dermis by complementing the interrupted patterns. Therefore, if the connection between the patterns is not possible and it is not useful for complementing the interrupted information, the specific region pattern is excluded from the objects to be joined. When a pattern different from the original pattern is generated, there may be a situation where the reliability of the generated pattern image is reduced. On the contrary, the information processing apparatus 3 in the third embodiment can prevent the reduction in the reliability of the generated pattern image. [4: Fourth Embodiment]

[0042] A fourth embodiment of an information processing apparatus, an information processing method, and a recording medium will be described. Hereinafter, the fourth embodiment of the information processing apparatus, the information processing method, and the recording medium will be described using the information processing apparatus 4 to which the fourth embodiment of the information processing apparatus, the information processing method, and the recording medium is applied. [4-1: Configuration of Information Processing Apparatus 4]

[0043] With reference to FIG. 6, the configuration of the information processing apparatus 4 in the fourth embodiment will be described. FIG. 6 is a block diagram showing the configuration of the information processing apparatus 4 in the fourth embodiment.

[0044] As shown in FIG. 6, the information processing apparatus 4 in the fourth embodiment is different from the information processing apparatus 2 in the second embodiment and the information processing apparatus 3 in the third embodiment in that the arithmetic unit 21 includes a reliability imparting unit 415 and a collation unit 416, and the storage device 22 stores a fingerprint database DB in which registered pattern images are pre-registered. Other features of the information processing apparatus 4 may be the same as other features of at least one of the information processing apparatus 2 and the information processing apparatus 3. [4-2: Information Processing Operations Performed by Information Processing Apparatus 4]

[0045] With reference to FIG. 7, the flow of information processing operations performed by the information processing apparatus 4 in the fourth embodiment will be described. FIG. 7 is a flowchart showing the flow of information operations performed by the information processing apparatus 4 in the fourth embodiment.

[0046] The acquisition unit 211 acquires the three-dimensional information 3DI of the skin (step S20). The detection unit 212 extracts a pattern from the three-dimensional information 3DI (step S21). The detection unit 212 detects a specific region of the pattern (step S22). The extraction unit 213 extracts the specific region pattern of the specific region (step S23). The generation unit 214 generates a combined pattern image in which the pattern extracted by the detection unit 212 from the three-dimensional information 3DI and the specific region pattern extracted by the extraction unit 213 are combined (step S24).

[0047] The reliability assigning unit 415 assigns a higher reliability to the unique region when the depression is shallower compared to the surrounding area (step S40). When the depression in the unique region is deep, the slope of the skin is greater, and the reliability of the included pattern is often lower compared to an area without a depression. For example, even if the stitching is successful, there is a possibility that matching with the registered image will fail. Therefore, the reliability assigning unit 415 may assign a higher reliability to the unique region when the depression is shallower compared to the surrounding area.

[0048] The matching unit 416 changes the weighting of the minutiae included in the concatenated fingerprint image according to the reliability (step S41). The minutiae may include "end points" where the pattern is interrupted, and "branch points" where the pattern branches.

[0049] The matching unit 416 matches the joined fingerprint image with a registered pattern image that has been registered in advance (step S42). The generation unit 214 may further generate a ridge image by extracting ridges from the joined pattern image. The generation unit 214 may further generate a two-dimensional image in which only ridges remain from the joined pattern image. The matching unit 416 may match the ridge image with a registered pattern image that has been registered in advance.

[0050] Furthermore, the output device 25 may output information such as the width and depth of the unique region, and information related to the unique points of the pattern contained in the unique region. [4-3: Technical Effects of Information Processing Device 4]

[0051] The smaller the deformation of the surface shape, the easier it is to reproduce the state when the surface shape has not deformed. Conversely, the larger the deformation of the surface shape, the more difficult it is to reproduce the state when the surface shape has not deformed. That is, the smaller the deformation of the surface shape, the more reliable the reproduced pattern can be. Conversely, the larger the deformation of the surface shape, the more likely the reproduced pattern cannot be trusted. The information processing apparatus 4 in the fourth embodiment can effectively utilize the generated pattern image by attaching a reliability level to the reproduced pattern. Particularly in collation, information that can determine whether the collation result can be trusted is useful. In addition, since the information processing apparatus 4 further generates a ridge line image obtained by extracting ridge lines from the joined pattern image, an image suitable for collation can be obtained. [5: Fifth Embodiment]

[0052] The fifth embodiment of the information processing apparatus, the information processing method, and the recording medium will be described. Hereinafter, the fifth embodiment of the information processing apparatus, the information processing method, and the recording medium will be described using the information processing apparatus 5 to which the fifth embodiment of the information processing apparatus, the information processing method, and the recording medium is applied. [5-1: Configuration of Information Processing Apparatus 5]

[0053] With reference to FIG. 8, the configuration of the information processing apparatus 5 in the fifth embodiment will be described. FIG. 8 is a block diagram showing the configuration of the information processing apparatus 5 in the fifth embodiment.

[0054] As shown in FIG. 8, the information processing apparatus 5 in the fifth embodiment is different from the information processing apparatus 2 in the second embodiment and the information processing apparatus 4 in the fourth embodiment in that the arithmetic unit 21 includes a collation unit 416 and a correspondence unit 517, and the storage device 22 stores a fingerprint database DB in which registered pattern images are registered in advance. Other features of the information processing apparatus 5 may be the same as at least one other feature of the information processing apparatus 2 to the information processing apparatus 4. [5-2: Information Processing Operations Performed by Information Processing Apparatus 5]

[0055] The flow of information processing operations performed by the information processing device 5 in the fifth embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart showing the flow of information processing operations performed by the information processing device 5 in the fifth embodiment.

[0056] The acquisition unit 211 acquires three-dimensional information 3DI of the skin (step S20). The detection unit 212 extracts a pattern from the three-dimensional information 3DI (step S21). The detection unit 212 detects a unique region of the pattern (step S22). The extraction unit 213 extracts a unique region pattern of the unique region (step S23). The generation unit 214 generates a joined pattern image by joining the pattern and the unique region pattern based on the pattern extracted from the three-dimensional information 3DI by the detection unit 212 and the unique region pattern extracted by the extraction unit 213 (step S24).

[0057] If a feature point included in the concatenated fingerprint image exists in an area based on the pattern of a unique area, the associating unit 517 associates the feature point with unique area information indicating that the feature point is based on the pattern of the unique area (step S50).

[0058] The association unit 517 reduces the weighting of the feature points associated with the unique region information (step S51).

[0059] The association unit 517 compares the joined fingerprint image with a registered pattern image that has been registered in advance (step S52). Note that the generation unit 214 may further generate a ridge image by extracting ridges from the joined fingerprint image. The association unit 517 may compare the ridge image with a registered pattern image that has been registered in advance. [5-3: Technical Effects of Information Processing Device 5]

[0060] A feature point of a pattern image may be a position that can accurately capture the features of the pattern image. For example, it may be a position used to compare two pattern images when matching them. Therefore, it is often preferable to adopt a more reliable location as a position that can accurately capture the features of a pattern image. It is often preferable to be able to distinguish from which region a position extracted as a feature point originates, i.e., whether it originates from a region other than the peculiar region or the peculiar region. The information processing device 5 in the fifth embodiment can distinguish whether it originates from a region other than the peculiar region or the peculiar region. The information processing device 5 associates peculiar region information indicating that the feature point is based on the pattern of the peculiar region with the feature point, and can therefore determine whether or not to use the corresponding position as a feature point for processing depending on the application. In particular, when matching pattern images, information that can determine whether or not it can be used for matching is useful. [6: Sixth embodiment]

[0061] An information processing device, an information processing method, and a recording medium according to a sixth embodiment will be described below. The sixth embodiment of the information processing device, the information processing method, and a recording medium will be described below using an information processing device 6 to which the sixth embodiment of the information processing device, the information processing method, and a recording medium is applied. [6-1: Configuration of information processing device 6]

[0062] The configuration of the information processing device 6 in the sixth embodiment will be described with reference to Fig. 10. Fig. 10 is a block diagram showing the configuration of the information processing device 6 in the sixth embodiment.

[0063] 10, the information processing device 6 of the sixth embodiment differs from the information processing device 2 of the second embodiment to the information processing device 5 of the fifth embodiment in that the calculation device 21 includes a matching unit 416 and a learning unit 618, and the storage device 22 stores a fingerprint database DB in which registered pattern images are registered in advance. Other features of the information processing device 6 may be the same as at least one other feature of the information processing device 2 to the information processing device 5. [6-2: Information processing operation performed by information processing device 6]

[0064] The flow of information processing operations performed by the information processing device 6 in the sixth embodiment will be described with reference to Fig. 11. Fig. 11 is a flowchart showing the flow of information processing operations performed by the information processing device 6 in the sixth embodiment.

[0065] The acquisition unit 211 acquires three-dimensional information 3DI of the skin (step S20). The detection unit 212 extracts a pattern from the three-dimensional information 3DI (step S21). The detection unit 212 detects a unique region of the pattern (step S22). The extraction unit 213 extracts a unique region pattern of the unique region (step S23). The generation unit 214 generates a joined pattern image by joining the pattern and the unique region pattern based on the pattern extracted from the three-dimensional information 3DI by the detection unit 212 and the unique region pattern extracted by the extraction unit 213 (step S24).

[0066] The matching unit 416 calculates a matched matching score between the matched pattern image and a pre-registered registered fingerprint image, and an unmatched matching score between the pattern image based on the pattern extracted from the three-dimensional information 3DI and a pre-registered registered fingerprint image (step S60).

[0067] The learning unit 618 compares the joined matching score with the unjoined matching score (step S61).

[0068] When the difference between the joined matching score and the unjoined matching score becomes smaller than a predetermined value, the learning unit 618 causes the generation unit 214 to learn a method for generating a joined pattern image so as to omit joining the pattern and the unique area pattern (step S62).

[0069] In other words, the generation unit 214 may learn a method for generating a joined pattern image by joining a pattern and a unique area pattern when joining the pattern and the unique area pattern can produce advantageous effects, such as improving the accuracy of the pattern image.

[0070] Furthermore, the learning unit 618 may construct an image generation model that can combine a pattern and a specific region pattern when an advantageous effect can be obtained. The generation unit 214 may generate a combined pattern image in which the pattern and the specific region pattern are combined using the image generation model. By using the learned image generation model, the generation unit 214 can reduce the processing load for generating the combined pattern image even when the information processing apparatus acquires three-dimensional information of unknown skin.

[0071] Note that parameters defining the operation of the image generation model may be stored in the storage device 22. The parameters defining the operation of the image generation model may be parameters updated by a learning operation, and may be, for example, weights and biases of a neural network. [6-3: Technical effects of the information processing apparatus 6]

[0072] In the sixth embodiment, when the information processing apparatus 6 cannot obtain an advantageous effect even if a pattern and a specific region pattern are combined, the processing load can be reduced by omitting the processing. When there is no need for complementation, the information processing apparatus 6 can omit the processing, and thus can perform an efficient pattern image generation operation. [7: Seventh embodiment]

[0073] A seventh embodiment of an information processing apparatus, an information processing method, and a recording medium will be described. Below, a seventh embodiment of an information processing apparatus, an information processing method, and a recording medium will be described using an information processing system 70 to which the seventh embodiment of the information processing apparatus, the information processing method, and the recording medium is applied. [7-1: Configuration of the information processing system 70]

[0074] With reference to FIG. 12, the configuration of the information processing system 70 in the seventh embodiment will be described. FIG. 12 is a block diagram showing the configuration of the information processing system 70 in the seventh embodiment.

[0075] As shown in FIG. 12, the information processing system 70 in the seventh embodiment may include an information processing apparatus 7 and a three-dimensional information generation apparatus 700.

[0076] The information processing apparatus 7 in the seventh embodiment may be the same as at least one of the information processing apparatuses 2 to 6 in the second to sixth embodiments. The information processing apparatus 7 and the three-dimensional information generation apparatus 700 may exchange information via a communication network. Alternatively, the information processing apparatus 7 and the three-dimensional information generation apparatus 700 may be integrally configured. For example, the information processing apparatus 7 may include the three-dimensional information generation apparatus 700. Alternatively, the three-dimensional information generation apparatus 700 may include the information processing apparatus 7. [7-2: Three-dimensional information generation apparatus 700]

[0077] The three-dimensional information generation apparatus 700 will be described with reference to FIG. 13. FIG. 13 is an external view showing the appearance of the three-dimensional information generation apparatus 700. The three-dimensional information generation apparatus 700 may include a scanner unit 710. As shown in FIG. 13, the three-dimensional information generation apparatus 700 may be configured such that the palm is turned downward and the fingers of the hand are held over the scanner unit 710.

[0078] The scanner unit 710 may be a non-contact fingerprint scanner. The scanner unit 710 may capture a three-dimensional fingerprint image as the three-dimensional information 3DI of the skin.

[0079] The three-dimensional information generation apparatus 700 may capture a three-dimensional fingerprint image a plurality of times and generate a composite image by combining the captured three-dimensional fingerprint images. The three-dimensional information generation apparatus 700 may output the generated composite image as the three-dimensional information 3DI of the skin. [8: Supplementary Note]

[0080] Regarding the embodiments described above, the following supplementary notes are further disclosed. [Supplementary Note 1] Acquisition means for acquiring three-dimensional information of the skin, Detection means for extracting a pattern from the three-dimensional information and detecting a specific region of the pattern, an extraction means for extracting a unique area pattern of the unique area; a generating means for generating a joined pattern image by joining the pattern extracted from the three-dimensional information by the detecting means and the unique region pattern extracted by the extracting means, based on the pattern extracted from the three-dimensional information by the detecting means and the unique region pattern extracted by the extracting means; An information processing device comprising: [Appendix 2] The specific area is a region that is depressed compared to its surroundings, and includes a wrinkled area. 2. The information processing device according to claim 1. [Appendix 3] The generating means generates a joined pattern image by joining together the unique region patterns and the unique region patterns, based on the unique region patterns that can be connected to patterns in areas adjacent to the unique region. 3. The information processing device according to claim 1 or 2. [Appendix 4] The generating means further generates a ridge image by extracting ridges from the connected pattern image. 4. The information processing device according to any one of claims 1 to 3. [Appendix 5] The apparatus further includes a reliability assigning means for assigning a higher reliability to the unique region as the depression is shallower compared to the surrounding area. 5. The information processing device according to any one of appendices 1 to 4. [Appendix 6] The image processing device further includes a correlation unit that, when a feature point included in the joined pattern image exists in a region based on the unique region pattern, correlates the feature point with unique region information indicating that the feature point is based on the unique region pattern. 6. The information processing device according to any one of appendices 1 to 5. [Appendix 7] The apparatus further comprises a matching means for matching the joined pattern image with a registered pattern image that has been registered in advance, The matching means changes the weighting of the feature points included in the connected pattern image in accordance with the reliability. 6. The information processing device according to claim 5. [Appendix 8] The apparatus further comprises a matching means for matching the joined pattern image with a registered pattern image that has been registered in advance, The matching means reduces the weighting of the feature points associated with the specific region information. The information processing apparatus according to Supplementary Note 6. [Supplementary Note 9] Calculate the combined matching score between the combined pattern image and a pre-registered registered pattern image, and the non-combined matching score between the pattern image based on the pattern extracted from the three-dimensional information and a pre-registered registered pattern image. When the difference between the combined matching score and the non-combined matching score is smaller than a predetermined value, further include a learning means for causing the generation means to learn the generation method of the combined pattern image so as to omit combining the pattern and the specific region pattern. The information processing apparatus according to any one of Supplementary Notes 1 to 8. [Supplementary Note 10] Obtain three-dimensional information of the skin, Extract a pattern from the three-dimensional information, detect a specific region of the pattern, Extract the specific region pattern of the specific region, Generate a combined pattern image in which the pattern and the specific region pattern are combined based on the pattern extracted from the three-dimensional information and the specific region pattern extracted from the specific region. Information processing method. [Supplementary Note 11] Cause a computer to, Obtain three-dimensional information of the skin, Extract a pattern from the three-dimensional information, detect a specific region of the pattern, Extract the specific region pattern of the specific region, Generate a combined pattern image in which the pattern and the specific region pattern are combined based on the pattern extracted from the three-dimensional information and the specific region pattern extracted from the specific region. Information processing method. A recording medium on which a computer program for executing the information processing method is recorded.

[0081] At least a part of the constituent elements of each of the above-described embodiments can be appropriately combined with at least another part of the constituent elements of each of the above-described embodiments. A part of the constituent elements of each of the above-described embodiments may not be used. Also, to the extent permitted by law, the disclosures of all the documents (for example, published gazettes) cited in this disclosure above are incorporated by reference and made part of the description of this disclosure.

[0082] This disclosure can be appropriately changed within a range not contrary to the technical idea that can be read from the claims and the entire specification. An information processing apparatus, an information processing method, and a recording medium involving such changes are also included in the technical idea of this disclosure.

Explanation of Reference Numerals

[0083] 1, 2, 3, 4, 5, 6, 7 Information processing apparatus 11, 211 Acquisition unit 12, 212 Detection unit 13, 213 Extraction unit 14, 214 Generation unit 415 Reliability assignment unit 416 Verification unit 517 Association unit 618 Learning unit 100, 700 Three-dimensional information generation apparatus 710 Scanner unit 70 Information processing system

Claims

1. An acquisition means for acquiring three-dimensional information of the skin, A detection means for extracting a pattern from the three-dimensional information and detecting a specific region of the pattern, An extraction means for extracting a specific region pattern of the specific region, A generation means for generating a combined pattern image in which the pattern and the specific region pattern are combined based on the pattern extracted by the detection means from the three-dimensional information and the specific region pattern extracted by the extraction means An information processing apparatus comprising the above.

2. The specific region is a region that is recessed compared to the surroundings and includes a wrinkle region The information processing apparatus according to claim 1.

3. The generation means generates a combined pattern image in which the pattern and the specific region pattern are combined based on a specific region pattern that can be connected to the pattern of a region adjacent to the specific region among the specific region patterns The information processing apparatus according to claim 1 or 2.

4. The generation means further generates a ridge line image by extracting ridge lines from the combined pattern image The information processing apparatus according to claim 1 or 2.

5. Further comprising a reliability assignment means for assigning a higher reliability as the degree of depression compared to the surroundings of the specific region is shallower The information processing apparatus according to claim 1 or 2.

6. Further comprising an association means for associating specific region information indicating that it is based on the specific region pattern with a corresponding feature point when the feature point included in the combined pattern image exists in a region based on the specific region pattern The information processing apparatus according to claim 1 or 2.

7. Further comprising a collation means for collating the combined pattern image with a registered pattern image registered in advance, The collation means changes the weighting of the feature points included in the combined pattern image according to the reliability The information processing apparatus according to claim 5.

8. Calculating a combined collation score between the combined pattern image and a registered pattern image registered in advance, and an uncombined collation score between a pattern image based on the pattern extracted from the three-dimensional information and a registered pattern image registered in advance, When the difference between the combined collation score and the uncombined collation score is smaller than a predetermined value, the generation means is further caused to learn the method of generating the combined pattern image so as to omit combining the pattern and the specific region pattern The information processing apparatus according to claim 1 or 2.

9. Acquire three-dimensional information of the skin, Extract a pattern from the three-dimensional information, detect a specific region of the pattern, Extract a specific region pattern of the specific region, Extract a specific region pattern of the specific region, Generate a combined pattern image by combining the pattern extracted from the three-dimensional information and the specific area pattern extracted from the specific area An information processing method executed by a computer

10. Cause a computer to Acquire three-dimensional information of the skin Extract a pattern from the three-dimensional information, detect a specific area of the pattern Extract the specific area pattern of the specific area Generate a combined pattern image by combining the pattern extracted from the three-dimensional information and the specific area pattern extracted from the specific area Information processing method A computer program for executing the information processing method

Images