Information processing device, information processing method, and recording medium

Abstract

An information processing device 1 comprises a detection unit 11 that detects an object-to-object distance between an object to be photographed and a light emission unit that emits light for scanning the object to be photographed, and a control unit 12 that starts emission of light by the light emission unit if the object-to-object distance is equal to an intended distance.

Description

[Technical Field]

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing method, and a recording medium. [Background technology]

[0002] Patent Document 1 describes a non-contact guide that projects a pattern indicating the position of the sensor using visible light onto a body part containing biometric information, allowing the user to position their body appropriately relative to the sensor without touching the sensor guide. Patent Document 2 describes a technology in which light emitted from a light source is split into at least one and another, one of the split lights is irradiated toward a measurement object from a light input / output unit, and the reflected light from the measurement object is captured by an optical coherence tomography head from the light input / output unit as measurement light, and the optical input / output unit of the optical coherence tomography head is supported so as to be rotatable around the measurement object, thereby acquiring an accurate tomographic image. Patent Document 3 describes a technology in which, when a change occurs in the inner diameter of a tubular body, the distance between the imaging unit and the laser light emitting unit is adjusted each time to follow the change in the inner diameter of the tubular body, thereby reliably capturing annular laser light. Patent Literature 4 describes a technology for dividing a tomographic image of a fundus captured by an optical coherence tomography unit into small sections, calculating a representative value for each section, calculating a selected representative value from the calculated representative values ​​as an image quality parameter indicating the quality of the tomographic image, and displaying the calculated image quality parameter of the tomographic image on a display. Patent Literature 5 describes an information processing device that includes a branching / converging device that branches light emitted from a wavelength swept laser light source into object light and reference light, a balanced light receiver that generates information regarding changes in the intensity ratio of interference light between the object light and the reference light that is transmitted through a transparent substrate having a structure with a varying thickness formed on its surface and irradiated onto a measurement object and scattered from the measurement object, and a control unit that acquires depth-wise structural data of the measurement object based on the information regarding changes in the intensity ratio of the interference light, wherein the control unit connects multiple depth-wise structural data acquired while moving the irradiation position of the object light based on the position of the structure on the transparent substrate. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-251837 [Patent Document 2] Japanese Patent Application Laid-Open No. 2014-178164 [Patent Document 3] Japanese Patent Application Publication No. 2019-060722 [Patent Document 4] International Publication No. 2015 / 098912 [Patent Document 5] International Publication No. 2020 / 100626 Summary of the Invention [Problem to be solved by the invention]

[0004] An object of this disclosure is to provide an information processing device, an information processing method, and a recording medium that aim to improve upon the techniques described in prior art documents. [Means for solving the problem]

[0005] One aspect of the information processing device includes a detection means for detecting the distance between an object to be imaged and a light irradiation unit that irradiates light to scan the object to be imaged, and a scanning control means for starting irradiation of the light by the light irradiation unit when the object to be imaged is a desired distance.

[0006] One aspect of the information processing method detects the distance between an object to be imaged and a light irradiation unit that irradiates light to scan the object to be imaged, and if the distance between the objects is a desired distance, starts irradiating the light by the light irradiation unit.

[0007] One aspect of the recording medium has recorded thereon a computer program for causing a computer to execute an information processing method for detecting an inter-object distance between an image capture target and a light irradiation unit that irradiates light to scan the image capture target, and, if the inter-object distance is a desired distance, starting irradiation of the light by the light irradiation unit. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram showing the configuration of an information processing device according to the first embodiment. [Figure 2] FIG. 2 is a block diagram showing the configuration of an information processing device according to the second embodiment. [Figure 3] FIG. 3 is a diagram showing the configuration of an optical coherence tomographic imaging apparatus according to the second embodiment. [Figure 4] FIG. 4 is a flowchart showing the flow of information processing operations performed by the information processing device in the second embodiment. [Figure 5] FIG. 5 is a block diagram showing the configuration of an information processing device according to the third embodiment. [Figure 6] FIG. 6 is a flowchart showing the flow of information processing operations performed by the information processing device in the third embodiment. [Figure 7] FIG. 7 is a conceptual diagram of the information processing operation performed by the information processing device in the third embodiment. [Figure 8] FIG. 8 is a conceptual diagram of the information processing operation performed by the information processing device in the fourth embodiment. [Figure 9] FIG. 9 is a conceptual diagram of the information processing operation performed by the information processing device in the fourth embodiment. [Figure 10] FIG. 10 is a block diagram showing the configuration of an information processing device according to the fifth embodiment. [Figure 11] FIG. 11 is a flowchart showing the flow of information processing operations performed by the information processing device in the fifth embodiment. [Figure 12] FIG. 12 is a conceptual diagram of the information processing operation performed by the information processing device in the fifth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of an information processing device, an information processing method, and a recording medium will be described with reference to the drawings. [1: First embodiment]

[0010] An information processing device, an information processing method, and a recording medium according to a first embodiment will be described below. The information processing device, the information processing method, and the recording medium according to the first embodiment will be described below using an information processing device 1 to which the information processing device, the information processing method, and the recording medium according to the first embodiment are applied. [1-1: Configuration of information processing device 1]

[0011] The configuration of an information processing device 1 in the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the configuration of the information processing device 1 in the first embodiment.

[0012] 1, the information processing device 1 includes a detection unit 11 and a control unit 12. The detection unit 11 detects the distance between an object to be imaged and a light irradiation unit that irradiates the object with light to scan the object. When the object distance is a desired distance, the control unit 12 starts irradiating light by the light irradiation unit. [1-2: Technical Effects of Information Processing Device 1]

[0013] The information processing device 1 in the first embodiment can perform high-precision optical coherence tomographic imaging because the light irradiation unit starts irradiating light when the inter-object distance is the desired distance, i.e., when the imaging object and the light irradiation unit are in an appropriate positional relationship. [2: Second embodiment]

[0014] A second embodiment of an information processing device, an information processing method, and a recording medium will be described below. Hereinafter, the second embodiment of the information processing device, the information processing method, and the recording medium will be described using an information processing device 2 to which the second embodiment of the information processing device, the information processing method, and the recording medium is applied. [2-1: Configuration of information processing device 2]

[0015] The configuration of the information processing device 2 in the second embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the configuration of the information processing device 2 in the second embodiment.

[0016] 2, the information processing device 2 includes a calculation device 21 and a storage device 22. The information processing device 2 may further include an optical coherence tomography imaging device 100, a communication device 23, an input device 24, and an output device 25. However, the information processing device 2 does not have to include at least one of the optical coherence tomography imaging device 100, the communication device 23, the input device 24, and the output device 25. When the information processing device 2 does not include the optical coherence tomography imaging device 100, the information processing device 2 may transmit and receive information to and from the optical coherence tomography imaging device 100 via the communication device 23. The calculation device 21, the storage device 22, the optical coherence tomography imaging device 100, the communication device 23, the input device 24, and the output device 25 may be connected via a data bus 26.

[0017] The arithmetic device 21 includes, for example, at least one of a central processing unit (CPU), a graphics processing unit (GPU), and a field programmable gate array (FPGA). The arithmetic device 21 reads a computer program. For example, the arithmetic device 21 may read a computer program stored in the storage device 22. For example, the arithmetic device 21 may read a computer program stored in a computer-readable, non-transitory recording medium using a recording medium reading device (e.g., an input device 24 described later) not shown in the drawings that is provided in the information processing device 2. The arithmetic device 21 may acquire (i.e., download or read) the computer program from a device (not shown) located outside the information processing device 2 via the communication device 23 (or another communication device). The arithmetic device 21 executes the read computer program. As a result, logical functional blocks for executing operations to be performed by the information processing device 2 are realized within the arithmetic device 21. That is, the arithmetic device 21 can function as a controller for realizing logical functional blocks for executing the operations (in other words, processing) that the information processing device 2 should perform.

[0018] 2 shows an example of logical functional blocks realized in the arithmetic device 21 to execute information processing operations. As shown in FIG. 2, a detection unit 211, which is a specific example of "detection means," a detection unit 212, which is a specific example of "control means," and a movement unit 213, which is a specific example of "movement means," are realized in the arithmetic device 21. However, the arithmetic device 21 does not necessarily have to include the movement unit 213. The operations of the detection unit 211, the control unit 212, and the movement unit 213 will be described later with reference to FIG. 4.

[0019] The storage device 22 can store desired data. For example, the storage device 22 may temporarily store a computer program executed by the arithmetic device 21. The storage device 22 may temporarily store data that the arithmetic device 21 temporarily uses when the arithmetic device 21 is executing a computer program. The storage device 22 may store data that the information processing device 2 stores long-term. The storage device 22 may include at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device. In other words, the storage device 22 may include a non-temporary recording medium.

[0020] The communication device 23 is capable of communicating with devices external to the information processing device 2 via a communication network (not shown). The communication device 23 may be a communication interface based on standards such as Ethernet (registered trademark), Wi-Fi (registered trademark), and Bluetooth (registered trademark).

[0021] The input device 24 is a device that accepts information input to the information processing device 2 from outside the information processing device 2. For example, the input device 24 may include an operation device that can be operated by an operator of the information processing device 2 (for example, at least one of a keyboard, a mouse trackball, a touch panel, a pointing device such as a pen tablet, a button, etc.). For example, the input device 24 may include a reading device that can read information recorded as data on a recording medium that can be externally attached to the information processing device 2.

[0022] The output device 25 is a device that outputs information to the outside of the information processing device 2. For example, the output device 25 may output information as an image. That is, the output device 25 may include a display device (a so-called display) that can display an image showing the information to be output. Examples of the display device include a liquid crystal display and an OLED (Organic Light Emitting Diode) display. For example, the output device 25 may output information as sound. That is, the output device 25 may include an audio device (a so-called speaker) that can output sound. For example, the output device 25 may output information on paper. That is, the output device 25 may include a printing device (a so-called printer) that can print desired information on paper. Furthermore, the input device 24 and the output device 25 may be integrally formed as a touch panel.

[0023] Note that the hardware configuration shown in FIG. 2 is an example, and devices other than those shown in FIG. 2 may be added, or some devices may not be provided. Also, some devices may be replaced with other devices having similar functions. Also, some functions of the second embodiment may be provided by other devices via a network. The functions of the second embodiment may be distributed and realized among multiple devices. In this way, the hardware configuration shown in FIG. 2 can be modified as appropriate. [2-2: Optical coherence tomography imaging device 100]

[0024] The optical coherence tomography imaging apparatus 100 performs optical coherence tomography imaging by irradiating a target with a light beam while scanning it two-dimensionally, and generates three-dimensional brightness data of the target.

[0025] Optical coherence tomography (OCT) is a technology that utilizes interference between object light and reference light to identify the position of the scattering point of the object light in the optical axis direction, i.e., the depth direction of the object, and obtain spatially resolved structural data within the object in the depth direction. Optical coherence tomography techniques include time domain (TD-OCT) and Fourier domain (FD-OCT) methods. The second embodiment employs FD-OCT. In FD-OCT, interference between object light and reference light is measured over a wide wavelength range, and structural data in the depth direction is obtained by Fourier transforming this spectrum. Methods for obtaining interference light spectra include spectral domain (SD-OCT), which uses a spectroscope, and swept source (SS-OCT), which uses a wavelength-swept light source. The optical coherence tomography imaging device 100 employed in the second embodiment performs optical coherence tomography using SS-OCT.

[0026] The optical coherence tomographic imaging device 100 scans the irradiation position of the object light in an in-plane direction perpendicular to the depth direction (also referred to as the "Z direction") of the imaging target O, thereby obtaining tomographic structure data that is spatially resolved in the in-plane direction and spatially resolved in the depth direction, i.e., three-dimensional tomographic structure data of the imaging target O.

[0027] Fig. 3 is a diagram showing a schematic configuration of an optical coherence tomography imaging device 100 employed in the second embodiment. The optical coherence tomography imaging device 100 may capture an image of an imaging target O, such as a subject's finger, based on a three-dimensional measurement technique of optical coherence tomography imaging, and generate three-dimensional brightness data including the inside of the skin. Note that the configuration diagram shown in Fig. 3 merely shows one example of an apparatus using optical coherence tomography imaging technology, and an apparatus with a configuration other than that shown in Fig. 3 may also be used.

[0028] 3 , the optical coherence tomography imaging device 100 may include a light source unit 110, a branching and merging unit 120, a light irradiating unit 130, a mirror unit 140, a light receiving unit 150, and a signal processing unit 160. The light irradiating unit 130 may include a scanning mirror and a lens. The optical coherence tomography imaging operation of the optical coherence tomography imaging device 100 may be controlled by a calculation device 21.

[0029] The light source unit 110 may be a laser that emits light while sweeping its wavelength. The light source unit 110 may generate and output wavelength-swept light pulses. For example, the light source unit 110 may generate light pulses with a wavelength that sweeps from 1250 nm to 1350 nm over a duration of 5 μs.

[0030] The branching and merging unit 120 may branch the light emitted from the light source unit 110 into object light and reference light. The object light may be irradiated onto the imaging target O via the light irradiation unit 130. The object light scattered by the imaging target O may return to the branching and merging unit 120. On the other hand, the reference light may be irradiated onto and reflected by the mirror unit 140. The reference light reflected by the mirror unit 140 may return to the branching and merging unit 120. The object light scattered by the imaging target O and the reference light reflected by the mirror unit 140 may interfere with each other at the branching and merging unit 120, generating two interference lights. That is, the intensity ratio between the two interference lights may be determined by the phase difference between the object light and the reference light.

[0031] The light receiving unit 150 may receive two interference lights and output a voltage corresponding to the difference in intensity between the two interference lights. The voltage output by the light receiving unit 150 may be input to the signal processing unit 160. [A-scan]

[0032] The signal processing unit 160 may generate interference light spectrum data based on information on a change in wavelength of the light emitted by the light source unit 110 and information on a change in the intensity ratio of the two interference lights. The signal processing unit 160 may perform a Fourier transform on the generated interference light spectrum data to acquire data indicating the intensity of the backscattered light (object light) at different depth positions in the depth direction (Z direction).

[0033] Hereinafter, the operation of acquiring data indicating the intensity of backscattered light (object light) in the depth direction (Z direction) of the irradiation position of the object light in the imaging target O will be referred to as an "A-scan." The signal processing unit 160 may receive an A-scan trigger signal from the light source unit 110 and generate an A-scan waveform at predetermined intervals. The signal processing unit 160 may generate, as the A-scan waveform, a waveform indicating the intensity of backscattered object light at Nz locations. [B-scan]

[0034] The signal processing unit 160 may control the light irradiation unit 130 in response to an A-scan trigger signal supplied from the light source unit 110. The light irradiation unit 130 may scan the irradiation position of the object light on the imaging target O. The light irradiation unit 130 may move the irradiation position of the object light in the scanning line direction (also referred to as the "scanning fast axis direction" and the "X direction").

[0035] The signal processing unit 160 may repeatedly perform an A-scan operation for each irradiation position of the object light and connect the A-scan waveforms for each irradiation position of the object light. This allows the signal processing unit 160 to acquire a two-dimensional map of the intensity of backscattered light (object light) in the scanning line direction (X direction) and the depth direction (Z direction) as a tomographic image. Hereinafter, the operation of repeatedly performing A-scan operations while moving in the scanning line direction (the fast axis direction of scanning, X direction) and connecting the measurement results is referred to as a "B scan." If the irradiation positions of the object light for each B scan are Nx locations, the tomographic image obtained by the B scan is two-dimensional brightness data indicating the backscattered intensity of the object light at Nz × Nx points. [C-scan]

[0036] The light irradiation unit 130 may move the irradiation position of the object light not only in the scanning line direction (X direction) but also in a direction perpendicular to the scanning line (also called the "slow axis direction of scanning" or "Y direction"). The signal processing unit 160 may repeatedly perform B-scan operations and connect the B-scan measurement results. This allows the signal processing unit 160 to acquire three-dimensional tomographic structure data. Hereinafter, the operation of repeatedly performing B-scan operations while moving in the direction perpendicular to the scanning line (Y direction) and connecting the measurement results is referred to as a "C-scan." If the number of B-scans performed per C-scan is Ny, the tomographic structure data obtained by the C-scan is three-dimensional brightness data indicating the backscattering intensity of the object light at Nz × Nx × Ny points.

[0037] The signal processing unit 160 sends the data after the digitalization process to the arithmetic unit 21. Note that the operation of the signal processing unit 160 may be performed by the arithmetic unit 21. [Effects of optical coherence tomography imaging]

[0038] Optical coherence tomography imaging allows for the acquisition of epidermal fingerprint images without contact. This means that the fingertip does not have to come into contact with a glass plate or the like, making it hygienic. Furthermore, unlike epidermal fingerprint imaging, in which a fingerprint image is acquired by bringing the fingertip into contact with a glass plate or the like, optical coherence tomography imaging is not affected by deformation that occurs during contact. Optical coherence tomography imaging also allows for the acquisition of dermal fingerprint images. In other words, since fingerprint images can be acquired without being affected by the state of the epidermis, fingerprint images can be acquired even when it is difficult to read epidermal fingerprints. Furthermore, when an epidermal fingerprint has been altered, this method is suitable for detecting the alteration. [2-3: Information processing operation performed by information processing device 2]

[0039] The flow of the information processing operation performed by the information processing device 2 in the second embodiment will be described with reference to Fig. 4. Fig. 4 is a flowchart showing the flow of the information processing operation performed by the information processing device 2 in the second embodiment.

[0040] As shown in FIG. 4, the detection unit 211 detects the inter-object distance between the imaging target O and the light irradiation unit 130, which emits light to scan the imaging target O (step S20). The detection unit 211 may detect the distance d between the imaging target O and the light irradiation unit 130, as illustrated in FIG. 3. The detection unit 211 may detect the inter-object distance based on the results of a B-scan performed by the optical coherence tomography imaging device 100. The inter-object distance may be the distance in the Z direction. The detection unit 211 may perform a B-scan of the imaging target O located at a desired position on the XY plane and detect the inter-object distance by analyzing a two-dimensional cross-sectional image obtained by the B-scan. When the inter-object distance is detected based on the results of the B-scan performed by the optical coherence tomography imaging device 100, the detection unit 211 can detect the inter-object distance without adding a new device to the information processing device 2. Furthermore, the detection unit 211 can detect the inter-object distance while continuously monitoring the imaging target O.

[0041] The moving unit 213 moves the light irradiating unit 130 to a position suitable for scanning the imaging target O based on the inter-target distance (step S21). The light irradiating unit 130 may be placed on a vertically movable stage, for example, and configured to be movable up and down. The vertical direction may be the Z direction described above. The moving unit 213 may move the light irradiating unit 130 up and down so that the distance between the imaging target O and the light irradiating unit 130 becomes the optimal distance.

[0042] If the inter-object distance is the desired distance, the control unit 212 starts irradiating light by the light irradiating unit 130 (step S22). The light irradiating unit 130 may irradiate a light beam in the Z direction. [2-4: Technical Effects of Information Processing Device 2]

[0043] The information processing device 2 in the second embodiment moves the light irradiation unit 130 to a position suitable for scanning the imaging target O. Therefore, even if the imaging target O itself cannot be moved to the appropriate position, the light irradiation unit 130 can start irradiating light when the imaging target O and the light irradiation unit 130 are in an appropriate positional relationship, thereby enabling high-precision optical coherence tomographic imaging. [3: Third embodiment]

[0044] An information processing device, an information processing method, and a recording medium according to a third embodiment will be described below. The third embodiment of the information processing device, the information processing method, and the recording medium will be described below using an information processing device 3 to which the third embodiment of the information processing device, the information processing method, and the recording medium is applied. [3-1: Configuration of information processing device 3]

[0045] The configuration of the information processing device 3 in the third embodiment will be described with reference to Fig. 5. Fig. 5 is a block diagram showing the configuration of the information processing device 3 in the third embodiment.

[0046] 5, the information processing device 3 in the third embodiment includes a calculation device 21 and a storage device 22, similar to the information processing device 2 in the second embodiment. Furthermore, the information processing device 3 may include an optical coherence tomography imaging device 100, a communication device 23, an input device 24, and an output device 25, similar to the information processing device 2 in the second embodiment. However, the information processing device 3 does not necessarily include at least one of the optical coherence tomography imaging device 100, the communication device 23, the input device 24, and the output device 25. The information processing device 3 in the third embodiment differs from the information processing device 2 in the second embodiment in that the calculation device 21 includes an output control unit 314. Other features of the information processing device 3 may be the same as other features of the information processing device 2 in the second embodiment. [3-2: Information processing operation performed by information processing device 3]

[0047] The flow of information processing operations performed by the information processing device 3 in the third embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart showing the flow of information processing operations performed by the information processing device 3 in the third embodiment.

[0048] As shown in FIG. 6, the output control unit 314 outputs guide information for guiding the imaging target O to a desired position (step S30). The guide information may include at least one of visual information, auditory information, and tactile information. The output control unit 314 may control the output device 25 to output the guide information. In the third embodiment, the guide information includes at least visual information, and the visual information may be an image visibly displayed at a desired position. The output control unit 314 may display an air button B as guide information for guiding the imaging target O to a desired position. [3-3: Air Button B]

[0049] Fig. 7 is a conceptual diagram of an air button B. As shown in Fig. 7, the information processing device 3 in the third embodiment may be provided with an air button display display 3141 and a retroreflector 3142 near the information processing device 3 in order to realize the air button B. The air button display display 3141 may be a liquid crystal display, an OLED (Organic Light Emitting Diode) display, or the like. The retroreflector 3142 may be a member capable of retroreflection.

[0050] The air button B may be an image formed in the air by retroreflecting an image displayed on the air button display 3141 by the retroreflector 3142. The information processing device 3 employs the air button display 3141 and the retroreflector 3142, thereby enabling the image to be formed in the air.

[0051] The aerial button display 3141 and the retroreflector 3142 may be provided according to their positional relationship with the light irradiation unit 130. By appropriately providing the aerial button display 3141 and the retroreflector 3142, it is possible to form an image at a desired position. The output control unit 314 may display an aerial button B in the air at an optimal position for capturing an image of the imaging target O. The output control unit 314 may form the aerial button B above the light irradiation unit 130. The aerial button B can be used to follow a finger and guide the finger to a desired position. The output control unit 314 may form a button-shaped image as the aerial button B.

[0052] The detection unit 211 detects the inter-object distance between the imaging target O and the light irradiation unit 130. The output control unit 314 may change at least one of the color and shape of the air button B according to the detection result by the detection unit 211. At this time, the color may change as the target position is approached. For example, the output control unit 314 may color the air button B blue when the imaging target O is not present, color the air button B reddish-blue when the imaging target O is not in a position suitable for imaging, and color the air button B green when the imaging target O is in a position suitable for imaging. Furthermore, the output control unit 314 may change the color of the air button B in a gradation according to the inter-object distance rather than changing the color in stages.

[0053] The air button B may be a three-dimensional image. The output control unit 314 may deform the air button B according to the detection result, i.e., the position of the imaging target O. The output control unit 314 may deform the shape of the air button B so that the button is depressed and concave, according to the vertical movement of the imaging target O detected by the detection unit 211. The output control unit 314 may deform the air button B so that the location over which the imaging target O is held becomes concave. The output control unit 314 may deform the air button B when the position in the in-plane direction (XY direction) is correct, to guide the imaging target O to a more appropriate position. The output control unit 314 may guide the imaging target O to an accurate position by having the subject press the button. The output control unit 314 may also change the shape of the air button B discontinuously or continuously.

[0054] The output control unit 314 may further output at least one of auditory information and tactile information as guide information leading to the desired position. The output control unit 314 may output, as the auditory information, for example, a sound whose pitch changes depending on the inter-object distance, or a sound whose volume changes depending on the inter-object distance. The output control unit 314 may also output a predetermined sound effect when the correct position is reached. The output control unit 314 may output, as the auditory information, for example, a sound that specifically instructs left, right, up, down, etc. The output control unit 314 may output, as the tactile information, for example, wind whose direction changes depending on the inter-object distance, or wind whose strength changes depending on the inter-object distance. The output control unit 314 may output, as the tactile information, for example, ultrasound whose wavelength changes depending on the inter-object distance.

[0055] 6, the detection unit 211 determines whether or not the imaging target O is present within the desired position range (step S31). If the imaging target O is not present within the desired position range (step S31: No), the process proceeds to step S31.

[0056] If the imaging target O is present within the desired positional range (step S31: Yes), the detection unit 211 detects the inter-object distance between the imaging target O and the light irradiation unit 130 that irradiates the imaging target O with light to scan the imaging target O (step S20). The movement unit 213 moves the light irradiation unit 130 to a position suitable for scanning the imaging target based on the inter-object distance (step S21). If the inter-object distance is the desired distance, the control unit 212 starts irradiating light by the light irradiation unit 130 (step S22).

[0057] In optical coherence tomography imaging, it is preferable that the positional relationship between the imaging target O and the light irradiation unit 130 is appropriate. That is, in optical coherence tomography imaging, it is preferable that the imaging target O and the light irradiation unit 130 can move relative to each other appropriately. The information processing device 3 may move the imaging target O according to guide information, or may move the light irradiation unit 130 based on the inter-target distance. The information processing device 3 may adjust the positional relationship between the imaging target O and the light irradiation unit 130 to be appropriate by performing at least one of an output operation of the output control unit 314 and a movement operation by the movement unit 213.

[0058] Optical coherence tomographic imaging can be performed with high accuracy by having the light irradiating unit 130 irradiate the imaging target O with light perpendicularly. That is, it is preferable that the imaging target O and the light irradiating unit 130 are positioned at the same position in a plane perpendicular to the direction in which the light irradiating unit 130 irradiates light. The output operation of the output control unit 314 can lead to a positional relationship in which light is irradiated perpendicularly to the imaging target O.

[0059] Furthermore, the accuracy of human vision (or perceptual distance, sensory distance) in the distance direction (Z direction) is often lower than that in the in-plane directions (X and Y directions). Therefore, the information processing device 3 may move the imaging target O, particularly in the X and Y directions, guided by the guide information. Furthermore, the information processing device 3 may move the light irradiation unit 130 based on the inter-target distance, particularly in the Z direction. [3-4: Technical Effects of Information Processing Device 3]

[0060] There are many situations where people feel uncomfortable directly touching objects that are touched by an unspecified number of people. Furthermore, there is also the social issue of fingerprints left on contact points due to touch operations being stolen. To address these hygiene concerns and reduce security risks, contactless operation is required for various input devices. However, compared to touch operations, contactless operation is more difficult to control to ensure proper positional relationships.

[0061] In contrast, the information processing device 3 in the third embodiment displays a visibly recognizable image in a space where no physical object exists, so that the imaging target O can be guided to a desired position in a completely non-contact state. Furthermore, the information processing device 3 changes at least one of the color and shape of the image according to the distance between the objects, so that it can help the imaging target O to move more easily to an appropriate position.

[0062] The information processing device 3 in the third embodiment guides the imaging target O in the in-plane direction and the distance direction, and furthermore, adjusts the distance direction mechanically, so that an appropriate positional relationship can be obtained with high precision. [4: Fourth embodiment]

[0063] An information processing device, an information processing method, and a recording medium according to a fourth embodiment will be described below. The information processing device, the information processing method, and the recording medium according to the fourth embodiment will be described below using an information processing device 4 to which the information processing device, the information processing method, and the recording medium according to the fourth embodiment are applied.

[0064] The information processing device 4 in the fourth embodiment is different from the information processing device 3 in the third embodiment in the output operation by the output control unit 314. Other features of the information processing device 4 may be the same as other features of the information processing device 3. [4-1: Optical coherence tomography imaging of the target O from above]

[0065] 8A and 8B are conceptual diagrams illustrating a case where the light irradiating unit 130 performs optical coherence tomography imaging of the imaging target O from above. As illustrated in Fig. 8A, the light irradiating unit 130 may be configured to irradiate the imaging target O, which is located below the light irradiating unit 130, with light from above.

[0066] 8(b), the output control unit 314 may output one guide light beam from the side to a desired position P as guide information leading to the desired position. The subject may move his / her finger so that the guide light hits the center of the finger pad.

[0067] As illustrated in FIGS. 8(c) and 8(e), the output control unit 314 may output two guide light beams to a desired position P as guide information leading to the desired position. The output control unit 314 may specify a single desired position P using the two guide light beams. FIGS. 8(d) and 8(f) illustrate an example of how the imaging target O appears when observed from above. As illustrated in FIGS. 8(c) and 8(d), when the imaging target O is located at a desired height, the light beams form a single point denoted by P. In contrast, as illustrated in FIGS. 8(c) and 8(d), when the imaging target O is located vertically shifted from the desired height, the light beams form two points denoted by P1 and P2. The subject may move their finger so that a single guide light beam hits the center of the finger pad. The output control unit 314 may guide the imaging target O to a position where the two points are exactly aligned. [4-2: Optical coherence tomography imaging of the target O from below] 9A and 9B are conceptual diagrams illustrating a case where the light irradiating unit 130 performs optical coherence tomography imaging of the imaging target O from below. As illustrated in Fig. 9A, the light irradiating unit 130 may be configured to irradiate the imaging target O, which is located above the light irradiating unit 130, with a light beam from below.

[0068] 9(b), the output control unit 314 may output one guide light beam from the side to a desired position P as guide information leading to the desired position. The subject may move his / her finger so that the guide light hits the center of the finger pad.

[0069] As illustrated in FIGS. 9(c) and 9(e), the output control unit 314 may output two guide light beams to a desired position P as guide information leading to the desired position. The output control unit 314 may specify a single desired position P using the two guide light beams. FIGS. 9(d) and 9(f) illustrate an example of how the imaging target O appears when observed from below. As illustrated in FIGS. 9(c) and 9(d), when the imaging target O is located at a desired height, the light beams form a single point denoted by P. In contrast, as illustrated in FIGS. 9(c) and 9(d), when the imaging target O is located vertically shifted from the desired height, the light beams form two points denoted by P1 and P2. The subject may move their finger so that a single guide light beam hits the center of the finger pad. The output control unit 314 may guide the finger to a position where the two points are exactly aligned.

[0070] 9(a), the information processing device 4 may capture an image of the imaging target O from below using a camera (not shown), and display the image captured by the camera on a display D that is installed with its display surface facing upward. The image captured may be an optical coherence tomographic image. The display D may display a finger pad facing downward and a beam. The display D may display the inter-object distance between the imaging target O and the light irradiation unit 130. The camera may be a stereo camera, and the image displayed on the display D may be a stereo image.

[0071] The output control unit 314 may further output at least one of auditory information and tactile information as guide information leading to the desired position. The output control unit 314 may output, for example, as auditory information, a sound whose pitch changes depending on the inter-object distance, or a sound whose volume changes depending on the inter-object distance. The output control unit 314 may output, for example, as auditory information, a sound that specifically instructs left, right, up, down, etc. Furthermore, the output control unit 314 may output a predetermined sound effect when the correct position is reached. The output control unit 314 may output, for example, as tactile information, wind whose direction changes depending on the inter-object distance, wind whose strength changes depending on the inter-object distance, etc. The output control unit 314 may output, for example, as tactile information, ultrasound whose wavelength changes depending on the inter-object distance, etc.

[0072] In the third and fourth embodiments, the output control unit 314 outputs visual information as guide information to guide the user to a desired location. However, the output control unit 314 may output at least one of auditory information and tactile information instead of visual information as guide information. [4-3: Technical Effects of Information Processing Device 4]

[0073] The information processing device 4 in the fourth embodiment guides the imaging target to a desired position using at least one of visual information, auditory information, and tactile information, and therefore can perform coherence tomographic imaging with the imaging target O and the light irradiation unit 130 in an appropriate positional relationship. [5: Fifth embodiment]

[0074] A fifth embodiment of an information processing device, an information processing method, and a recording medium will be described below. Hereinafter, the fifth embodiment of an information processing device, an information processing method, and a recording medium will be described using an information processing device 5 to which the fifth embodiment of the information processing device, the information processing method, and the recording medium is applied. [5-1: Configuration of information processing device 5]

[0075] The configuration of the information processing device 5 in the fifth embodiment will be described with reference to Fig. 10. Fig. 10 is a block diagram showing the configuration of the information processing device 5 in the fifth embodiment.

[0076] As shown in FIG. 10 , the information processing device 5 of the fifth embodiment includes a calculation device 21 and a storage device 22, similar to the information processing device 3 of the third embodiment and the information processing device 4 of the fourth embodiment. Furthermore, similar to the information processing device 3 of the third embodiment and the information processing device 4 of the fourth embodiment, the information processing device 5 may include an optical coherence tomography imaging device 100, a communication device 23, an input device 24, and an output device 25. However, the information processing device 5 does not necessarily include at least one of the optical coherence tomography imaging device 100, the communication device 23, the input device 24, and the output device 25. The information processing device 5 of the fifth embodiment differs from the information processing device 3 of the third embodiment and the information processing device 4 of the fourth embodiment in that the output control unit 314 of the calculation device 21 includes a first output control unit 5141 and a second output control unit 5142. Other features of the information processing device 5 may be the same as other features of at least one of the information processing device 3 of the third embodiment and the information processing device 4 of the fourth embodiment. [5-2: Information Processing Operation Performed by Information Processing Device 5]

[0077] The flow of information processing operations performed by the information processing device 5 in the fifth embodiment will be described with reference to Fig. 11 and Fig. 12. Fig. 11 is a flowchart showing the flow of information processing operations performed by the information processing device 5 in the fifth embodiment. Fig. 12 is a conceptual diagram showing the flow of information processing operations performed by the information processing device 5 in the fifth embodiment.

[0078] 11, the first output control unit 5141 outputs first guide information for guiding the imaging target O to a desired position range (step S50). As exemplified in FIG. 12(a), the first output control unit 5141 may output a first guide image 5141I as first guide information for directing the measurement subject's attention to move the imaging target O to a desired location. The first guide information may be information indicating a range in which the light irradiation unit 130 can capture images. The first guide information may be information indicating a movable range of the light irradiation unit 130 in the XY plane.

[0079] The detection unit 211 determines whether or not the imaging target O is present within the desired position range (step S51). If the imaging target O is not present within the desired position range (step S51: No), the process proceeds to step S51.

[0080] As illustrated in FIG. 12(b), if the imaging target O is present within the desired position range (step S51: Yes), the second output control unit 5142 outputs second guide information for guiding the imaging target O to the desired position (step S52). As illustrated in FIG. 12(c), the second output control unit 5142 may output a second guide image 5142I as second guide information for precisely aligning the imaging target O to the desired position. The second guide information may be U-shaped (or U-shaped or concave) to guide not only the finger position but also the finger orientation. In the fifth embodiment, the output control unit 314 may operate the first output control unit 5141 at the start of operation, and switch the operation of the first output control unit 5141 to the operation of the second output control unit 5142 when the imaging target enters the desired position range.

[0081] The detection unit 211 detects the inter-subject distance between the imaging target and the light irradiation unit 130 that irradiates the imaging target with light to scan the imaging target (step S20). The movement unit 213 moves the light irradiation unit 130 to a position suitable for scanning the imaging target based on the inter-subject distance (step S21). When the inter-subject distance is the desired distance, the control unit 212 starts irradiating light by the light irradiation unit 130 (step S22).

[0082] 12(d), if the imaging target O is present within a desired position range (step S51: Yes), in step S52, the second output control unit 5142 may output the second guide information to a position corresponding to the position of the imaging target O, and the movement unit 213 may move the light irradiation unit 130 to a position corresponding to the position of the imaging target O. In other words, the second guide information may be information indicating a range in which the light irradiation unit 130 can capture images after movement in the X and Y directions. [5-3: Technical Effects of Information Processing Device 5]

[0083] The information processing device 5 in the fifth embodiment outputs guide information divided into stages, thereby making it possible for the subject to make rough movements and fine movements. [6: Sixth embodiment]

[0084] An information processing device, an information processing method, and a recording medium according to a sixth embodiment will be described below. The sixth embodiment of the information processing device, the information processing method, and a recording medium will be described below using an information processing device 6 to which the sixth embodiment of the information processing device, the information processing method, and a recording medium is applied.

[0085] The information processing device 6 in the sixth embodiment is different from the information processing device 2 in the second embodiment to the information processing device 5 in the fifth embodiment in the initial position of the light irradiation unit 130. Other features of the information processing device 6 may be the same as at least one other feature of the information processing device 2 to the information processing device 5.

[0086] In the sixth embodiment, the initial position of the light irradiator 130 is determined based on statistical information on the positions where the image capture target O was located when the detection unit 211 started operating in the past. For example, the location where the image capture target O is likely to be located may be biased due to the posture that the subject is likely to assume. The moving unit 213 may store, in the storage device 22, the positions where multiple subjects first hold their fingers over the light irradiator 130 and the position of the light irradiator 130 when the light irradiator 130 starts irradiating light. The moving unit 213 may move the light irradiator 130 in advance to a position where the subject is statistically likely to first hold their finger over the light irradiator 130 before starting the information processing operation. The moving unit 213 may determine the initial position of the light irradiator 130 based on history information on the positions where the subjects first hold their fingers over the light irradiator 130.

[0087] Furthermore, the movement unit 213 may link the initial position of the light irradiation unit 130 to a time period or a day of the week. The movement unit 213 may determine the initial position according to the day of the week, time period, etc. Locations where an imaging target is likely to be present often vary depending on the day of the week and time period. In other words, the method for setting the initial position may be arbitrarily changed depending on the environment in which it is used.

[0088] The information processing device 6 in the sixth embodiment determines the initial position of the light irradiation unit 130 based on statistical information on the position where the imaging target O was located at the start of a past detection operation, thereby reducing the amount of movement of the light irradiation unit 130 and suppressing the operational load. [7: Note]

[0089] The following additional notes are provided regarding the above-described embodiment. [Appendix 1] a detection means for detecting a distance between an imaging target and a light irradiation unit that irradiates the imaging target with light that scans the imaging target; a scanning control means for starting the irradiation of light by the light irradiation unit when the inter-object distance is a desired distance; An information processing device comprising: [Appendix 2] The imaging device further includes a moving unit that moves the light irradiating unit to a position suitable for scanning the imaging target based on the target distance. 10. The information processing device according to claim 1. [Appendix 3] further comprising an output means for outputting guide information for guiding the imaging target to a desired position; The guide information includes at least one of visual information, auditory information, and tactile information. 3. The information processing device according to claim 1 or 2. [Appendix 4] The visual information is an image visibly displayed at the desired location. 4. The information processing device according to claim 3. [Appendix 5] The output means changes at least one of the color and the shape of the image according to the inter-object distance. 5. The information processing device according to claim 4. [Appendix 6] The output means a first output means for outputting first guide information for guiding the imaging target to a desired position range; a second output means for outputting second guide information for guiding the imaging target to the desired position, When the operation starts, the first output means operates, When the imaging target enters the desired position range, the operation of the first output means is switched to the operation of the second output means. 6. The information processing device according to any one of appendices 3 to 5. [Appendix 7] The initial position of the light emitting unit is determined based on statistical information of the positions where the imaging target was located when the detection unit started its operation in the past. 7. The information processing device according to any one of appendices 1 to 6. [Appendix 8] Detecting a distance between an imaging target and a light irradiation unit that irradiates the imaging target with light that scans the imaging target; When the object distance is a desired distance, the light irradiation unit starts irradiating the light. Information processing methods. [Appendix 9] On the computer, Detecting a distance between an imaging target and a light irradiation unit that irradiates the imaging target with light that scans the imaging target; When the object distance is a desired distance, the light irradiation unit starts irradiating the light. A recording medium on which a computer program for executing an information processing method is recorded.

[0090] At least some of the constituent elements of each of the above-described embodiments can be appropriately combined with at least some of the other constituent elements of each of the above-described embodiments. Some of the constituent elements of each of the above-described embodiments may not be used. Furthermore, to the extent permitted by law, the disclosures of all documents (e.g., published patent applications) cited in this disclosure are incorporated by reference as part of the description of this disclosure.

[0091] This disclosure may be modified as appropriate within the scope of the claims and the technical idea that can be read from the entire specification. Information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure. [Explanation of symbols]

[0092] 1,2,3,4,5,6 Information processing equipment 11,211 Detector 12,212 Control unit 213 Mobile Department 314 Output control section 5141 1st output control section 5142 Second output control section 100 Optical coherence tomography imaging device 110 Light source section 120 Junction 130 Light irradiation unit 140 Mirror section 150 Light receiving part 160 Signal Processing Unit O Imaging target B Air button 3141 Air button display 3142 Retroreflector P Desired position

Claims

1. a detection means for detecting a distance between an imaging target and a light irradiation unit that irradiates the imaging target with light that scans the imaging target; a scanning control means for starting the irradiation of light by the light irradiation unit when the inter-object distance is a desired distance; an output means for outputting guide information to a desired position in the air so as to guide the imaging target to the desired position in the air; An information processing device comprising:

2. The imaging device further includes a moving unit that moves the light irradiating unit to a position suitable for scanning the imaging target based on the target distance. The information processing device according to claim 1 .

3. further comprising an output means for outputting guide information for guiding the imaging target to a desired position; The guide information includes at least one of visual information, auditory information, and tactile information.

3. The information processing device according to claim 1 or 2.

4. The visual information is an image visibly displayed at the desired location. The information processing device according to claim 3 .

5. The output means changes at least one of the color and the shape of the image according to the inter-object distance. The information processing device according to claim 4 .

6. The output means a first output means for outputting first guide information for guiding the imaging target to a desired position range; a second output means for outputting second guide information for guiding the imaging target to the desired position, At the start of operation, the first output means operates, When the imaging target enters the desired position range, the operation of the first output means is switched to the operation of the second output means. The information processing device according to claim 3 .

7. The initial position of the light emitting unit is determined based on statistical information of the positions where the imaging target was located when the detection unit started its operation in the past.

3. The information processing device according to claim 1 or 2.

8. The output means retroreflects the image displayed by the display onto a retroreflector so as to guide the imaging target to a desired position in the air, and outputs the image formed at the desired position.

3. The information processing device according to claim 1 or 2.

9. The output means outputs two guide light beams to the desired position so that when the imaging target is located at a desired position in the air, one point is formed by the guide light beams, and when the imaging target is located at a position shifted from the desired position, two points are formed by the guide light beams.

3. The information processing device according to claim 1 or 2.

10. An information processing method executed by a computer, Detecting a distance between an imaging target and a light irradiation unit that irradiates the imaging target with light that scans the imaging target; When the inter-object distance is a desired distance, the light irradiation unit starts irradiating the light. Outputting guide information to a desired position in the air so as to guide the imaging target to the desired position in the air. Information processing methods.

11. On the computer, Detecting a distance between an imaging target and a light irradiation unit that irradiates the imaging target with light that scans the imaging target; When the inter-object distance is a desired distance, the light irradiation unit starts irradiating the light. Outputting guide information to a desired position in the air so as to guide the imaging target to the desired position in the air. A computer program for executing an information processing method.

Images