Information processing device, information processing method, and recording medium

Abstract

This information processing device comprises: an acquisition means for acquiring a first biological image including a living body; an inclination changing means for generating a second biological image that is obtained by changing an inclination of the first biological image; an output means for outputting information for displaying the second biological image on a display means; a reception means for receiving a drawing input from a user to the second biological image in a state in which the second biological image is displayed; and a drawing reflection means for generating a third biological image in which the drawing input is reflected in the first biological image on the basis of the drawing input and inclination information indicating an inclination of the second biological image.

Description

Information processing device, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing method, and a recording medium.

[0002] When using a biometric image, input of feature points and the like may be required. For example, when using a fingerprint image or palm print image for matching processing, ridges in the image may be traced in advance. As a technique related to such processing, Patent Document 1 discloses a technique for tracing a core line (ridge) existing between two feature points extracted from a core line image and extracting feature amounts to be used in matching processing.

[0003] JP 2003-030154 A

[0004] An object of this disclosure is to provide an information processing device, an information processing method, and a recording medium that aim to improve upon the techniques disclosed in prior art documents.

[0005] One aspect of the information processing device disclosed herein includes an acquisition means for acquiring a first biometric image including a living body, an inclination change means for generating a second biometric image that is an image obtained by changing the inclination of the first biometric image, an output means for outputting information for displaying the second biometric image on a display means, a reception means for receiving drawing input from a user onto the second biometric image while the second biometric image is displayed, and a drawing reflection means for generating a third biometric image in which the drawing input is reflected on the first biometric image based on the drawing input and inclination information indicating the inclination of the second biometric image.

[0006] In one aspect of the information processing method disclosed herein, at least one computer acquires a first biometric image including a living body, generates a second biometric image that is an image in which the tilt of the first biometric image is changed, outputs information for displaying the second biometric image on a display means, accepts drawing input on the second biometric image from a user while the second biometric image is displayed, and generates a third biometric image in which the drawing input is reflected in the first biometric image based on the drawing input and tilt information that indicates the tilt of the second biometric image.

[0007] One aspect of the recording medium of this disclosure is a recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method, which includes acquiring a first biometric image including a living body, generating a second biometric image that is an image in which the tilt of the first biometric image is changed, outputting information for displaying the second biometric image on a display means, accepting drawing input on the second biometric image from a user while the second biometric image is displayed, and generating a third biometric image in which the drawing input is reflected in the first biometric image based on the drawing input and tilt information that indicates the tilt of the second biometric image.

[0008] 1 is a block diagram showing the hardware configuration of a first information processing device. 2 is a block diagram showing the functional configuration of the first information processing device. 3 is a flowchart showing the flow of operation of the first information processing device. 4 is a schematic diagram showing a specific example of operation of the first information processing device. 5 is a block diagram showing the functional configuration of a second information processing device. 6 is a flowchart showing the flow of operation of the second information processing device. 7 is a schematic diagram showing a display example in the second information processing device. 8 is a flowchart showing the flow of operation of a third information processing device. 9 is a schematic diagram showing a specific example of operation of the third information processing device. 10 is a block diagram showing the functional configuration of a fourth information processing device. 11 is a flowchart showing the flow of storage operation in the fourth information processing device. 12 is a flowchart showing the flow of tilt determination operation in the fourth information processing device.

[0009] Hereinafter, embodiments of an information processing device, an information processing method, and a recording medium will be described with reference to the drawings.

[0010] First Embodiment A first information processing apparatus will be described with reference to FIGS. 1 to 4. FIG.

[0011] (Hardware Configuration) First, the hardware configuration of the first information processing apparatus will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the first information processing apparatus.

[0012] 1, the first information processing device 1 includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, a storage device 14, an input device 15, and an output device 16. The processor 11, RAM 12, ROM 13, storage device 14, input device 15, and output device 16 are connected to each other via a data bus 17. The data bus 17 may be an interface other than a data bus (for example, a LAN, a USB, etc.).

[0013] The processor 11 loads a computer program. For example, the processor 11 is configured to load a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may load a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The processor 11 may acquire (i.e., load) the computer program from a device (not shown) located outside the first information processing device 1 via a network interface. The processor 11 executes the loaded computer program to perform various processes. When the processor 11 executes the loaded computer program, functional blocks related to the processes performed by the first information processing device 1 are realized within the processor 11. In other words, the processor 11 may function as a controller that executes each control in the first information processing device 1.

[0014] The processor 11 may be configured as, for example, a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), or a quantum processor. The processor 11 may be configured as one of these, or may be configured to use multiple processors in parallel.

[0015] The RAM 12 temporarily stores computer programs executed by the processor 11. The RAM 12 temporarily stores data that the processor 11 temporarily uses while it is executing the computer programs. The RAM 12 may be, for example, a dynamic random access memory (D-RAM) or a static random access memory (SRAM). Alternatively, other types of volatile memory may be used instead of the RAM 12.

[0016] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store fixed data. The ROM 13 may be, for example, a programmable read-only memory (PROM) or an erasable read-only memory (EPROM). Alternatively, other types of non-volatile memory may be used instead of the ROM 13.

[0017] The storage device 14 stores data that is to be saved long-term by the first information processing device 1. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device 14 may store computer programs executed by the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0018] The input device 15 is a device that receives input instructions from a user of the first information processing device 1. The input device 15 may include, for example, at least one of a keyboard, a mouse, a touch panel, and a touch pen. The input device 15 may also be, for example, a device that includes a microphone and is capable of voice input.

[0019] The output device 16 is a device that outputs information related to the first information processing device 1 to the outside. For example, the output device 16 may be a display device (e.g., a display or a monitor) that can display information related to the first information processing device 1. The output device 16 may also be a speaker or the like that can output information related to the information processing device 1 as audio.

[0020] The first information processing device 1 may be configured to include some of the components described in Fig. 1. For example, the first information processing device 1 may be configured to include only the processor 11, RAM 12, and ROM 13 among the above-mentioned components. In this case, the storage device 14, input device 15, and output device 16 may each be provided as a device external to the first information processing device 1. Furthermore, some of the calculation functions of the first information processing device 1 may be realized by an external server, a cloud, or the like.

[0021] (Functional Configuration) Next, the functional configuration of the first information processing device 1 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the first information processing device.

[0022] 2, the first information processing device 1 is configured as a device that performs drawing input on a biometric image including a living body. The first information processing device 1 is configured to include, as components for realizing its functions, an image acquisition unit 110, an inclination change unit 120, an image output unit 130, an input acceptance unit 140, and a drawing reflection unit 150. Note that each of the image acquisition unit 110, the inclination change unit 120, the image output unit 130, the input acceptance unit 140, and the drawing reflection unit 150 may be a processing block realized by the above-mentioned processor 11 (see FIG. 1).

[0023] The image acquisition unit 110 is configured to be able to acquire a first biometric image including a biometric feature. The first biometric image may be an image that can be used for biometric authentication. For example, the first biometric image may be an image including a fingerprint, palm print, or the like of a subject. The image acquisition unit 110 may acquire the first biometric image by, for example, photographing a biometric feature with a camera. Alternatively, the image acquisition unit 110 may acquire the first biometric image from a database or the like. The first biometric image acquired by the image acquisition unit 110 is configured to be output to each of the tilt change unit 120 and the drawing reflection unit 150.

[0024] The tilt changer 120 is configured to generate a second biometric image by changing the tilt of the first biometric image acquired by the image acquisition unit 110. The tilt changer 120 may change the tilt in only one direction or in multiple directions. For example, the tilt changer 120 may generate a second biometric image by rotating the first biometric image around multiple rotation axes. More specifically, the tilt changer 120 may generate a second biometric image by rotating the first biometric image in three-dimensional coordinates in the X-axis direction (roll direction), the Y-axis direction (pitch direction), and the Z-axis direction (yaw direction). Note that the tilt used when generating the second biometric image may be input by the user. For example, if the user inputs a numerical value (angle) indicating the tilt, the tilt changer 120 may change the tilt of the first biometric image in accordance with the input numerical value. Alternatively, the tilt of the first biometric image may be changed in accordance with a stick-type UI operation or a mouse drag operation. Furthermore, the tilt may be changed in conjunction with a tablet device or the like having a gyro function, depending on the angle at which the device is tilted or rotated. This allows the user to change the tilt of the first biometric image at an angle desired by the user. Alternatively, the tilt change unit 120 may change the tilt of the first biometric image at a preset angle. Furthermore, the tilt change unit 120 may automatically determine the tilt based on features extracted from the first biometric image. The second biometric image generated by the tilt change unit 120 is configured to be output to the image output unit 130. Furthermore, the tilt change unit 120 is configured to output information regarding the tilt when the second biometric image was generated (hereinafter referred to as "tilt information") to the drawing reflection unit 150.

[0025] The image output unit 130 is configured to be able to output information for displaying the second biometric image (i.e., an image obtained by changing the tilt of the first biometric image) generated by the tilt change unit 120. The information output by the image output unit 130 may be output to, for example, a display included in the above-mentioned output device 16 (see FIG. 1 ). In this case, the second biometric image is displayed on the display. Note that the image output unit 130 may output information for displaying the first biometric image (i.e., the image before the tilt change) in addition to the second biometric image. Furthermore, the image output unit 130 may output information for displaying a third biometric image (described in detail below) in addition to the second biometric image.

[0026] After the image output unit 130 outputs information for displaying the second biometric image, the input accepting unit 140 accepts drawing input for the displayed second biometric image. The drawing input may be, for example, drawing input input using the input device 15 (see FIG. 1 ). For example, the input accepting unit 140 may accept an operation of tracing the second biometric image displayed on the display with a touch pen as the drawing input. The drawing input information may be, for example, information indicating the characteristics of the biometric image (e.g., information used for biometric authentication). More specifically, the drawing input may be information indicating ridges or minutiae (e.g., dots, bifurcations, etc.) in a fingerprint image or palm print image. In this way, even if the fingerprint image or palm print image has wrinkles, faint marks, or chips, making it difficult to automatically extract fingerprint or palm print features, it is possible to appropriately acquire fingerprint or palm print features based on the drawing input information. The fingerprint image or palm print image may be an impression image or a latent image. The information relating to the drawing input received by the input receiving unit 140 is configured to be output to the drawing reflecting unit 150 .

[0027] The drawing reflecting unit 150 is configured to be able to generate a third biometric image by reflecting the drawing input received by the input receiving unit 140 on the first biometric image. Specifically, the drawing reflecting unit 150 generates the third biometric image based on the drawing input for the second biometric image received by the input receiving unit 140 and tilt information used when generating the second biometric image. For example, the drawing reflecting unit 150 converts the drawing input for the second biometric image into drawing input for the first biometric image based on the tilt information. Then, the drawing reflecting unit 150 generates the third biometric image by reflecting the converted drawing input on the first biometric image. The drawing reflecting unit 150 may have a function of outputting the generated third biometric image. For example, the drawing reflecting unit 150 may be configured to output information that causes the image output unit 130 to display the third biometric image.

[0028] (Flow of Operation) Next, the flow of operation of the first information processing device 1 will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the flow of operation of the first information processing device.

[0029] 3 , when the operation of the first information processing device 1 starts, the image acquisition unit 110 first acquires a first biometric image (step S101). Then, the tilt change unit 120 changes the tilt of the first biometric image acquired by the image acquisition unit 110 to generate a second biometric image (step S102).

[0030] Next, the image output unit 130 outputs information about the second biometric image generated by the inclination change unit 120 to display the second biometric image (step S103). Then, the input accepting unit 140 accepts drawing input for the displayed second biometric image (step S104).

[0031] Next, the drawing reflecting unit 150 reflects the drawing input received by the input receiving unit 140 on the first biometric image to generate a third biometric image (step S105). This makes it possible to obtain an image in which the drawing input for the second biometric image (i.e., the image after the tilt has been changed) is reflected on the first biometric image (i.e., the image before the tilt has been changed). (Operation Example) Next, a specific operation example of the first information processing device 1 will be described with reference to FIG. 4. FIG. 4 is a schematic diagram showing a specific operation example of the first information processing device.

[0032] 4, the image acquisition unit 110 acquires a fingerprint image as the first biometric image. The tilt change unit 120 changes the tilt of this fingerprint image to generate a second biometric image. Note that, although the second biometric image is generated by tilting the entire first biometric image here, the second biometric image may also be generated by cutting out a portion of the first biometric image and changing the tilt of that portion.

[0033] When the second biometric image is displayed, the input accepting unit 140 accepts drawing input for the second biometric image. Here, an operation of tracing a part of the ridges of the fingerprint image is accepted as drawing input. Note that when accepting drawing input, the second biometric image may be made enlarged or reduced. In this case, the user performing drawing input may perform the drawing input operation while enlarging or reducing the displayed second biometric image to an appropriate size.

[0034] When the drawing input is accepted, the drawing input for the second biometric image is reflected in the first biometric image, thereby generating a third biometric image reflecting the drawing input. By taking into account the tilt information, the drawing input in the third biometric image is reflected at a position corresponding to the ridge on which the user has made the drawing input.

[0035] (Technical Effects) Next, technical effects obtained by the first information processing device 1 will be described.

[0036] As described with reference to FIGS. 1 to 4 , in the first information processing device 1, drawing input to the second biometric image is reflected in the first biometric image to generate a third biometric image. In this way, drawing input to the biometric image after tilting can be reflected in the biometric image before tilting. Therefore, drawing input operations can be performed at an angle that is easy to perform drawing input. For example, tilting the image (i.e., viewing it from an angle) can sometimes make the connection status of ridges in a fingerprint image or palm print image easier to see. For this reason, it has been necessary to print a fingerprint image on paper and view the paper from an angle to check the connection status of the ridges. However, with the first information processing device 1, drawing input can be performed on the fingerprint image at an angle that is easy to view, and the drawing input can be reflected in the original image. This can also reduce the effort and cost required for drawing input.

[0037] Second Embodiment A second information processing device 1 will be described with reference to Figures 5 to 7. The second information processing device 1 differs in some configurations and operations from the first information processing device 1 described above, but other parts may be similar to the first information processing device 1. Therefore, the following will describe in detail the parts that differ from the first embodiment, and will omit explanations of other overlapping parts as appropriate.

[0038] (Functional Configuration) First, the functional configuration of the second information processing device 1 will be described with reference to Fig. 5. Fig. 5 is a block diagram showing the functional configuration of the second information processing device. Note that in Fig. 5, the same elements as those described in Fig. 2 are denoted by the same reference numerals.

[0039] 5, the second information processing device 1 is configured to include, as components for realizing its functions, an image acquisition unit 110, an inclination change unit 120, an image output unit 130, an input acceptance unit 140, and a drawing reflection unit 150. In particular, the second information processing device 1 is configured so that the third biometric image generated by the drawing reflection unit 150 is output by the image output unit 130.

[0040] The image output unit 130 in the second information processing device 1 outputs information for displaying the second biometric image when the third biometric image has not yet been generated. On the other hand, when the third biometric image has already been generated, the image output unit 130 outputs information for displaying the third biometric image in addition to the second biometric image. In this case, the image output unit 130 may output information for displaying the second biometric image and the third biometric image side by side on the same screen.

[0041] The drawing reflecting unit 150 in the second information processing device 1 updates the third biometric image every time new drawing input is received. That is, the drawing reflecting unit 150 reflects the new drawing input on the already generated third biometric image to generate a new third biometric image. The third biometric image updated in this manner may be output by the image output unit 130 every time. That is, the image output unit 130 may output information for displaying the new third biometric image every time the third biometric image is updated.

[0042] (Operation Flow) Next, the operation flow of the second information processing device 1 will be described with reference to Fig. 6. Fig. 6 is a flowchart showing the operation flow of the second information processing device. Note that in Fig. 6, the same processes as those described in Fig. 3 are denoted by the same reference numerals.

[0043] 6 , when the operation of the second information processing device 1 starts, the image acquisition unit 110 first acquires a first biometric image (step S101). Then, the tilt change unit 120 changes the tilt of the first biometric image acquired by the image acquisition unit 110 to generate a second biometric image (step S102).

[0044] Next, the image output unit 130 outputs information about the second biometric image generated by the inclination change unit 120 to display the second biometric image (step S103). Then, the input accepting unit 140 accepts drawing input for the displayed second biometric image (step S104).

[0045] Next, the drawing reflecting unit 150 reflects the drawing input received by the input receiving unit 140 in the first biometric image to generate a third biometric image (step S105). Then, the image output unit 130 outputs information about the third biometric image generated by the drawing reflecting unit 150 in addition to information about the second biometric image, and displays the second biometric image and the third biometric image side by side (step S201).

[0046] Thereafter, the second information-processing device 1 determines whether the drawing input has been completed (step S202). The second information-processing device 1 may determine that the drawing input has been completed when, for example, the user performs an operation to notify the completion of the drawing input or when a predetermined time has elapsed since the last drawing input.

[0047] If it is determined that the drawing input has been completed (step S202: YES), the series of operations ends. On the other hand, if it is determined that the drawing input has not been completed (step S202: NO), the process resumes from step S104. In this way, by repeating the process from step S104 onwards, the third biometric image is updated every time a drawing input is received.

[0048] (Display Example) Next, a display example on the second information processing device 1 will be described with reference to Fig. 7. Fig. 7 is a schematic diagram showing a display example on the second information processing device.

[0049] As shown in FIG. 7 , the second information processing device 1 displays the second biometric image and the third biometric image side by side on the same screen. Here, the second biometric image is displayed on the right side and the third biometric image is displayed on the left side, but the display positions are not limited to this example. Furthermore, the second biometric image and the third biometric image may be displayed in different sizes. For example, the second biometric image may be displayed larger than the third biometric image. Alternatively, the second biometric image may be displayed smaller than the third biometric image.

[0050] The second biometric image and the third biometric image change each time a drawing is input. That is, the images are updated each time a drawing is input. In the example shown in FIG. 7 , as ridges are drawn and input into the second biometric image, the number of ridges reflected in the third biometric image also increases. The drawing may be reflected in the third biometric image in real time. That is, when a user draws and inputs into the second biometric image, the drawing may be reflected in the third biometric image almost simultaneously.

[0051] (Technical Effects) Next, technical effects obtained by the second information processing device 1 will be described.

[0052] 5 to 7, the second information processing device 1 displays the second biometric image and the third biometric image side by side. In this way, it is possible to perform drawing input on the second biometric image while checking the third biometric image in which the drawing input is reflected. Furthermore, the second information processing device 1 updates the third biometric image every time drawing input is received. In this way, it is possible to perform drawing input little by little while checking how the drawing input is reflected.

[0053] <Third embodiment> A third information processing device 1 will be described with reference to Figures 8 and 9. The third information processing device 1 differs in some configurations and operations from the first and second information processing devices 1 described above, but other parts may be similar to the first and second information processing devices 1. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.

[0054] (Operational Flow) First, the operational flow of the third information processing device 1 will be described with reference to Fig. 8. Fig. 8 is a flowchart showing the operational flow of the third information processing device. Note that in Fig. 8, the same processes as those shown in Fig. 6 are denoted by the same reference numerals.

[0055] 8 , when the operation of the third information processing device 1 starts, the image acquisition unit 110 first acquires a first biometric image (step S101). Then, the tilt change unit 120 changes the tilt of the first biometric image acquired by the image acquisition unit 110 to generate a second biometric image (step S102).

[0056] Next, the image output unit 130 outputs information about the second biometric image generated by the inclination change unit 120 to display the second biometric image (step S103). Then, the input accepting unit 140 accepts drawing input for the displayed second biometric image (step S104).

[0057] Next, the drawing reflecting unit 150 reflects the drawing input received by the input receiving unit 140 onto the first biometric image to generate a third biometric image (step S301). At this time, the drawing reflecting unit 150 reflects the drawing input according to the tilt information when the second biometric image was generated. Specifically, the drawing reflecting unit 150 reflects the drawing input for each of the second biometric images having different tilts onto the first biometric image so that the second biometric images have different display modes.

[0058] Next, the image output unit 130 outputs information about the second biometric image and information about the third biometric image generated by the drawing reflecting unit 150, and displays the second biometric image and the third biometric image side by side (step S201). Then, the third information processing device 1 determines whether to change the tilt of the second biometric image (step S302). The third information processing device 1 may determine to change the tilt when, for example, the user performs an operation to change the tilt.

[0059] If it is determined that the tilt of the second biometric image is to be changed (step S302: YES), the process is executed again from step S102. That is, a new second biometric image is generated. Note that the tilt when the new second biometric image is generated is a different value from the tilt when the previous second biometric image was generated. Therefore, the newly generated second biometric image has a different tilt from the previous second biometric image. In this way, in the third information processing device 1, multiple second biometric images are generated by changing the first biometric image with different tilts.

[0060] If it is determined that the tilt of the second biometric image is to be changed (step S302: YES), the third information processing device 1 determines whether the drawing input is completed (step S202). If it is determined that the drawing input is completed (step S202: YES), the series of operations ends. On the other hand, if it is determined that the drawing input is not completed (step S202: NO), the processing resumes from step S104. In this way, by repeating the processing from step S104 onwards, the third biometric image is updated every time drawing input is received.

[0061] (Operation Example) Next, a specific operation example of the third information processing device 1 (particularly, an operation example when generating a third biometric image by reflecting drawing input) will be described with reference to Fig. 9. Fig. 9 is a schematic diagram showing a specific operation example of the third information processing device.

[0062] 9 , first, the input accepting unit 140 accepts drawing input for the first second biometric image. Then, the drawing reflecting unit 150 reflects the drawing input accepted by the input accepting unit 140 in the first biometric image. As a result, a third biometric image is generated that reflects the drawing input for the first second biometric image.

[0063] Thereafter, the tilt changing unit 120 changes the tilt to generate a second second biometric image. Then, the input accepting unit 140 accepts drawing input for the second second biometric image. Then, the drawing reflecting unit 150 reflects the drawing input accepted by the input accepting unit 140 in the already generated third biometric image. As a result, a third biometric image reflecting the drawing inputs for the first and second second biometric images is generated. Note that if the drawing input for the first second biometric image and the drawing input for the second second biometric image are inputs to a common area, they may be displayed so as to overlap in the third biometric image.

[0064] In the third biometric image generated in this manner, the drawing input is reflected so as to be displayed in different ways depending on the tilt information (in other words, depending on which second biometric image the drawing input was input to). Specifically, the drawing input for the first second biometric image and the drawing input for the second second biometric image may be displayed in different colors. For example, the drawing input for the first second biometric image may be displayed in red, and the drawing input for the second second biometric image may be displayed in blue. Alternatively, the drawing input for the first second biometric image and the drawing input for the second second biometric image may be displayed in different line thicknesses or types.

[0065] Furthermore, the drawing input for the first second biometric image and the drawing input for the second second biometric image may be switchable between display and non-display on the third biometric image. For example, the display may be switchable among a first display mode in which both the drawing input for the first second biometric image and the drawing input for the second second biometric image are displayed, a second display mode in which only the drawing input for the first second biometric image is displayed and the drawing input for the second second biometric image is not displayed, and a third display mode in which only the drawing input for the first second biometric image is not displayed and only the drawing input for the second second biometric image is displayed.

[0066] In the above example, multiple second biometric images with different inclinations are sequentially generated and drawing input is performed on each of them sequentially. However, multiple second biometric images may be generated simultaneously. For example, multiple second biometric images with different inclinations may be generated simultaneously and displayed side-by-side, allowing drawing input to be performed on each of the multiple second biometric images simultaneously. In this case, the drawing input corresponding to each of the multiple second biometric images may be reflected in one third biometric image.

[0067] (Technical Effects) Next, technical effects obtained by the third information processing device 1 will be described.

[0068] As described in Figures 8 and 9, the third information processing device 1 generates multiple second biometric images with different inclinations. In this way, drawing input can be performed after observing the biometric images from different angles. Furthermore, the third information processing device 1 reflects drawing input for second biometric images with different inclinations so that each drawing input is displayed in a different manner. In this way, even when multiple second biometric images are generated, it is possible to visually understand which second biometric image the drawing input was performed for.

[0069] <Fourth embodiment> A fourth information processing device 1 will be described with reference to Figures 10 to 12. The fourth information processing device 1 differs in some configurations and operations from the first to third information processing devices 1 described above, but other parts may be similar to the first to third information processing devices 1. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.

[0070] (Functional Configuration) First, the functional configuration of the fourth information processing device 1 will be described with reference to Fig. 10. Fig. 10 is a block diagram showing the functional configuration of the fourth information processing device. Note that in Fig. 10, the same elements as those shown in Fig. 5 are denoted by the same reference numerals.

[0071] 10, the fourth information processing device 1 is configured to include, as components for realizing its functions, an image acquisition unit 110, an inclination change unit 120, an image output unit 130, an input acceptance unit 140, a drawing reflection unit 150, and a storage unit 160. That is, the fourth information processing device 1 further includes the storage unit 160 in addition to the configuration of the second embodiment (see FIG. 5).

[0072] The storage unit 160 is configured to be able to store the characteristics of the drawing input for the second biometric image in association with tilt information when the second biometric image was generated. That is, the storage unit 160 stores a pair of the tilt of the second biometric image and the characteristics of the drawing input for the second biometric image. Examples of the characteristics of the drawing input include the direction, number, and density of ridges. The information stored in the storage unit 160 is configured to be able to be read out as needed by the tilt changing unit 120.

[0073] When generating a second biometric image from a first biometric image, the tilt changing unit 120 in the fourth information processing device 1 reads information stored in the storage unit 160 and determines the tilt to be changed. For example, the tilt determining unit 120 searches whether or not features similar to those of ridges included in the first biometric image are stored in the storage unit 160. If features similar to those of ridges included in the first biometric image are stored in the storage unit 160, the tilt information stored in association with those features is used as the tilt information when generating the second biometric image.

[0074] The functions of the storage unit 160 and the tilt change unit 120 described above may be realized by a machine-learned model (for example, a neural network trained by deep learning). In this case, a model that determines tilt information may be trained using the information stored in the storage unit 160 as training data. Specifically, a pair of drawing input features for the second biometric image and tilt information used to generate the second biometric image may be used as training data to train a model that, when a first biometric image is input, outputs tilt information corresponding to the image.

[0075] (Storage Operation) Next, the storage operation in the fourth information processing device 1 (i.e., the operation when storing information in the storage unit 160) will be described with reference to Fig. 11. Fig. 11 is a flowchart showing the flow of the storage operation in the fourth information processing device.

[0076] 11 , when the storage operation in the fourth information processing device 1 is started, first, the storage unit 160 acquires the features of the drawing input (hereinafter, appropriately referred to as "drawing features") accepted by the input accepting unit 140 (step S401). The drawing features may be extracted by the input accepting unit 140 or by the storage unit 160.

[0077] Next, the storage unit 160 acquires tilt information from the tilt change unit 120 when the current second biometric image is generated (step S402). Note that step S402 may be executed before step S401. Alternatively, steps S401 and S402 may be executed simultaneously in parallel.

[0078] Next, the storage unit 160 associates the acquired drawing feature with the tilt information and stores them (step S403). The storage unit 160 stores a plurality of pairs of drawing feature and tilt information. That is, the storage unit 160 performs the above-described series of operations and accumulates a plurality of pieces of information each time a second biometric image is generated and a drawing input is performed.

[0079] (Tilt Determination Operation) Next, the tilt determination operation (i.e., the operation for determining the tilt when generating the second biometric image) in the fourth information processing device 1 will be described with reference to Fig. 12. Fig. 12 is a flowchart showing the flow of the tilt determination operation in the third information processing device.

[0080] 12 , when the inclination determination operation by the fourth information processing device 1 is started, first, the inclination modification unit 120 extracts ridge-related features (hereinafter referred to as "ridge features") from the first biometric image acquired by the image acquisition unit 110 (step S451). The inclination modification unit 120 may extract ridge features from the entire first biometric image. Alternatively, the inclination modification unit 120 may extract ridge features from a portion of the first biometric image. For example, the inclination modification unit 120 may extract ridge features from an area designated by a user by circling it.

[0081] Next, the inclination changing unit 120 searches for drawing features similar to the ridge feature extracted from the first biometric image from among the drawing features stored in the storage unit 160 (step S452). If a drawing feature similar to the ridge feature extracted from the first biometric image is found (step S453: YES), the inclination changing unit 120 determines the inclination information associated with the similar drawing feature and stored as the inclination when generating the second biometric image (step S454).

[0082] If no drawing feature similar to the ridge feature extracted from the first biometric image is found (step S453: NO), the process of step S454 is omitted. That is, the tilt when generating the second biometric image is not determined from the information stored in the storage unit 160. In this case, the tilt changing unit 120 may determine the tilt when generating the second biometric image based on another method (e.g., input from the user).

[0083] (Technical Effects) Next, technical effects obtained by the fourth information processing device 1 will be described.

[0084] 10 to 12 , in the fourth information processing device 1, the characteristics of the drawing input for the second biometric image and the tilt information used when the second biometric image was generated are associated and stored. Then, when a new second biometric image is generated, the tilt of the first biometric image (i.e., how to change the tilt of the first biometric information) is determined based on the stored information. In this way, it is possible to determine the tilt appropriate for the first biometric image based on the previously stored information, and to appropriately generate the second biometric image.

[0085] The scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described program is recorded, but also the program itself.

[0086] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. Furthermore, the scope of each embodiment is not limited to programs that execute processes by themselves, but also includes programs that execute processes by operating on an OS in conjunction with other software or expansion board functions. Furthermore, the program itself may be stored on a server, and part or all of the program may be downloadable from the server to a user terminal. The program may be provided to the user in, for example, a SaaS (Software as a Service) format.

[0087] <Supplementary Notes> The above-described embodiment may be further described as in the following supplementary notes, but is not limited to the following.

[0088] (Supplementary Note 1) The information processing device described in Supplementary Note 1 is an information processing device that includes an acquisition means for acquiring a first biometric image including a living body, an inclination change means for generating a second biometric image that is an image obtained by changing the inclination of the first biometric image, an output means for outputting information for displaying the second biometric image on a display means, a reception means for receiving drawing input from a user onto the second biometric image while the second biometric image is displayed, and a drawing reflection means for generating a third biometric image in which the drawing input is reflected on the first biometric image based on the drawing input and inclination information indicating the inclination of the second biometric image.

[0089] (Appendix 2) The information processing device described in Appendix 2 is the information processing device described in Appendix 1, in which the output means outputs information to display the second biometric image and the third biometric image side by side on the display means when the third biometric image is generated.

[0090] (Supplementary Note 3) The information processing device described in Supplementary Note 3 is the information processing device described in Supplementary Note 1 or 2, in which the drawing reflecting means updates the third biometric image by reflecting the received drawing input each time the receiving means receives the drawing input.

[0091] (Appendix 4) The information processing device described in Appendix 4 is the information processing device described in Appendix 3, wherein the tilt changing means changes the first biometric image with different tilts to generate multiple second biometric images, and the drawing reflecting means reflects the drawing input for each of the multiple second biometric images in the first biometric image each time, thereby updating the third biometric image.

[0092] (Appendix 5) The information processing device described in Appendix 5 is the information processing device described in any one of Appendix 4, wherein the drawing reflection means reflects the drawing input for each of the plurality of second biometric images on the first biometric image so that the display modes are different from each other, thereby generating the third biometric image.

[0093] (Appendix 6) The information processing device described in Appendix 6 is the information processing device described in any one of Appendices 1 to 5, further comprising a storage means for linking and storing the characteristics of the drawing input for the second biometric image and the tilt information when the second biometric image is generated, and the tilt change means determines the tilt to be changed when the second biometric image is generated based on the information stored in the storage means.

[0094] (Supplementary Note 7) The information processing device described in Supplementary Note 7 is the information processing device described in any one of Supplements 1 to 6, in which the first biometric image is a fingerprint image or a palm print image, and the drawing input is input as information indicating at least one of ridges and minutiae.

[0095] (Supplementary Note 8) The information processing device according to Supplementary Note 8 is the information processing device according to any one of Supplementary Notes 1 to 7, wherein the tilt changing means changes the tilt of the first biometric image based on information indicating tilt input by the user.

[0096] (Appendix 9) The information processing method described in Appendix 9 is an information processing method in which at least one computer acquires a first biometric image including a living body, generates a second biometric image that is an image in which the tilt of the first biometric image is changed, outputs information for displaying the second biometric image on a display means, accepts drawing input on the second biometric image from a user while the second biometric image is displayed, and generates a third biometric image in which the drawing input is reflected in the first biometric image based on the drawing input and tilt information that indicates the tilt of the second biometric image.

[0097] (Appendix 10) The recording medium described in Appendix 10 is a recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method of acquiring a first biometric image including a living body, generating a second biometric image which is an image in which the tilt of the first biometric image is changed, outputting information for displaying the second biometric image on a display means, accepting drawing input on the second biometric image from a user while the second biometric image is displayed, and generating a third biometric image in which the drawing input is reflected on the first biometric image based on the drawing input and tilt information which indicates the tilt of the second biometric image.

[0098] (Appendix 11) The computer program described in Appendix 11 is a computer program that causes at least one computer to execute an information processing method of acquiring a first biometric image including a living body, generating a second biometric image that is an image in which the tilt of the first biometric image is changed, outputting information for displaying the second biometric image on a display means, accepting drawing input on the second biometric image from a user while the second biometric image is displayed, and generating a third biometric image in which the drawing input is reflected in the first biometric image based on the drawing input and tilt information that indicates the tilt of the second biometric image.

[0099] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0100] REFERENCE SIGNS LIST 1 Information processing device 11 Processor 12 RAM 13 ROM 14 Storage device 15 Input device 16 Output device 17 Data bus 110 Image acquisition unit 120 Inclination change unit 130 Image output unit 140 Input reception unit 150 Drawing reflection unit 160 Storage unit

Claims

1. An information processing device comprising: an acquisition means for acquiring a first biometric image including a living body; an inclination change means for generating a second biometric image which is an image obtained by changing the inclination of the first biometric image; an output means for outputting information for displaying the second biometric image on a display means; an acceptance means for accepting drawing input from a user onto the second biometric image while the second biometric image is displayed; and a drawing reflection means for generating a third biometric image in which the drawing input is reflected on the first biometric image based on the drawing input and inclination information indicating the inclination of the second biometric image.

2. The information processing device according to claim 1, wherein the output means outputs information for displaying the second biometric image and the third biometric image side by side on the display means when the third biometric image has been generated.

3. The information processing device according to claim 2, wherein the drawing reflecting means updates the third biometric image by reflecting the drawing input each time the receiving means receives the drawing input.

4. The information processing device according to claim 3, wherein the tilt changing means changes the first biometric image at different tilts to generate a plurality of the second biometric images, and the drawing reflecting means reflects the drawing input for each of the plurality of second biometric images in the first biometric image each time, thereby updating the third biometric image.

5. The information processing device according to any one of claims 4, wherein the drawing reflection means reflects the drawing input for each of the plurality of second biometric images in the first biometric image so that the drawing inputs have different display modes from each other to generate the third biometric image.

6. An information processing device according to any one of claims 1 to 5, further comprising a storage means for storing the characteristics of the drawing input for the second biometric image and the tilt information when the second biometric image is generated in association with each other, wherein the tilt changing means determines the tilt to be changed when the second biometric image is generated based on the information stored in the storage means.

7. An information processing device according to any one of claims 1 to 5, wherein the first biometric image is a fingerprint image or a palm print image, and the drawing input is input as information indicating at least one of ridges and minutiae.

8. The information processing device according to any one of claims 1 to 5, wherein the tilt changing means changes the tilt of the first biometric image based on information indicating the tilt input by the user.

9. An information processing method in which at least one computer acquires a first biometric image including a living body, generates a second biometric image which is an image obtained by changing the tilt of the first biometric image, outputs information for displaying the second biometric image on a display means, accepts drawing input on the second biometric image from a user while the second biometric image is displayed, and generates a third biometric image in which the drawing input is reflected in the first biometric image based on the drawing input and tilt information indicating the tilt of the second biometric image.

10. A recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method, which comprises acquiring a first biometric image including a living body, generating a second biometric image which is an image obtained by changing the tilt of the first biometric image, outputting information for displaying the second biometric image on a display means, accepting drawing input on the second biometric image from a user while the second biometric image is displayed, and generating a third biometric image in which the drawing input is reflected on the first biometric image based on the drawing input and tilt information indicating the tilt of the second biometric image.

Images