Information processing device, information processing method, and program

Abstract

An information processing device for acquiring biological information on a subject on the basis of at least one moving image obtained by imaging the subject using a plurality of imaging devices having different imaging regions, the information processing device comprising: a first acquisition unit 11 that acquires the at least one moving image; a second acquisition unit 13 that acquires information related to a change in an imaging environment; a selection unit 12 with which an imaging device used to acquire the biological information is selected from the plurality of imaging devices on the basis of said information; and a third acquisition unit 16 that acquires the biological information on the subject on the basis of the moving image obtained by using the selected imaging device.

Description

Information processing device, information processing method, and program

[0001] The present invention relates to an information processing device, an information processing method, and a program for acquiring biological information of a subject.

[0002] In order to acquire biometric information of a subject without contacting the subject, a technique for detecting a biometric signal of the subject based on a moving image obtained by imaging the subject is known. For example, when measuring a pulse rate as biometric information, a pulse waveform is detected as the biometric signal. The pulse rate can then be calculated from the number of peaks in the pulse waveform within a certain period of time. By acquiring the biometric information of the subject without contacting the subject, stress on the subject can be reduced.

[0003] Patent Document 1 discloses a method for acquiring biological information based on a moving image obtained by capturing an image of a subject using an imaging device.

[0004] Japanese Patent Application Laid-Open No. 2005-218507

[0005] However, when acquiring biometric information of a subject using the method disclosed in Patent Document 1, if the subject falls within the blind spot of the imaging device, the biometric information of the subject cannot be acquired. For example, when acquiring biometric information of a subject without contact in an examination room or treatment room in a hospital, there is a risk that the subject may fall within the blind spot of the imaging device due to an object other than the subject, such as an examination device or a medical professional (doctor, nurse, or technician). As a result, the biometric information of the subject cannot be acquired accurately. On the other hand, a method of acquiring multiple pieces of biometric information of the subject based on multiple moving images obtained by imaging the subject using multiple imaging devices with different imaging areas is also conceivable, but this is not preferable because the processing becomes complicated.

[0006] SUMMARY OF THE INVENTION It is therefore an object of the present invention to provide an information processing device capable of acquiring biological information of a subject with high accuracy.

[0007] An information processing device that acquires biometric information of a subject based on at least one moving image obtained by imaging the subject using multiple imaging devices with different imaging areas, characterized by comprising: a first acquisition unit that acquires at least one moving image; a second acquisition unit that acquires information regarding changes in the imaging environment; a selection unit that selects an imaging device to be used to acquire the biometric information from the multiple imaging devices based on the information; and a third acquisition unit that acquires the biometric information of the subject based on the moving image obtained using the selected imaging device.

[0008] According to the present invention, it is possible to provide an information processing apparatus capable of acquiring biological information of a subject with high accuracy.

[0009] FIG. 1 is a block diagram of an information processing device in Example 1. FIG. 1 is a diagram showing the relationship between an imaging device, a subject, and an inspection device. FIG. 2 is a diagram showing an example of an image obtained by the imaging device in FIG. 2. FIG. 2 is a diagram showing an example of an image obtained by the imaging device in FIG. 2. FIG. 2 is a diagram showing the relationship between an imaging device, a subject, and an inspection device during inspection. FIG. 4 is a diagram showing an example of an image obtained by the imaging device in FIG. 4. FIG. 4 is a diagram showing an example of an image obtained by the imaging device in FIG. 4. A flowchart showing processing operations of an information processing device in Example 1. FIG. 1 is a block diagram of an information processing device in Example 2. FIG. 1 is a diagram showing the relationship between an imaging device, a subject, and a subject other than the subject. FIG. 8 is a diagram showing an example of an image obtained by the imaging device in FIG. 8. FIG. 8 is a diagram showing an example of an image obtained by the imaging device in FIG. 8. A flowchart showing processing operations of an information processing device in Example 2.

[0010] Preferred embodiments of the present invention will be described below with reference to the drawings. For convenience, the drawings may be drawn at a scale different from the actual scale. As shown in the drawings, identical components are designated by the same reference numerals, and redundant descriptions will be omitted. The following embodiments do not limit the scope of the claimed invention. While the embodiments describe multiple features, not all of these features are necessarily essential to the invention, and multiple features may be combined in any desired manner.

[0011] There is a technology that detects time-series data of reflected light from the skin surface of a subject as a biosignal to obtain bioinformation of the subject without contacting the subject. The blood flow rate in the blood vessels of a living subject periodically increases and decreases in response to pulse and breathing. This is due to the light absorption characteristics of hemoglobin contained in blood.

[0012] Hemoglobin in blood has a high absorptivity for light in the 495 to 570 nm (green wavelength) and 800 to 1000 nm (infrared wavelength) ranges. Therefore, by acquiring the change over time in the amount of light (particularly green wavelength or infrared wavelength) reflected from a portion of the skin surface containing the subject's blood vessels, it is possible to detect the subject's biological signals. In this embodiment, one of pulse rate, blood pressure, respiratory rate, heart rate, and oxygen saturation is acquired as the subject's biological information.

[0013] A known technique can be used to determine the subject's biological information based on the acquired biological signals. The signal processing and other processing of the biological signals corresponding to the target biological information among pulse rate, blood pressure, respiratory rate, heart rate, and oxygen saturation are not limited to those in this embodiment.

[0014] For example, the biological signal (waveform) may be calculated by a moving average of a waveform based on a photoplethysmogram (PPG) calculated from brightness values ​​in a moving image. The biological signal may include wavelengths in the green or infrared range in a moving image and may be information based on the state of the subject, such as blood flow.

[0015] The pulse rate can be determined by detecting peak positions in the biosignal (waveform) and calculating the interval between peaks or the number of peaks within a certain time range. Alternatively, the pulse rate can be determined from the peak frequency in the frequency characteristics obtained by Fourier transforming the biosignal. Furthermore, peaks in the biosignal may be detected using a threshold value for the peak height or peak width of the biosignal.

[0016] The respiratory rate can be determined from the frequency characteristics obtained by Fourier transforming a biosignal (waveform) based on PPG. Alternatively, it can be determined by calculating the interval between peaks in a waveform obtained by extracting a frequency band signal caused by respiration from the biosignal (waveform) or the number of peaks within a certain time range. The frequency band of the biosignal caused by respiration is lower in frequency than the frequency band of the biosignal caused by the pulse.

[0017] Note that feature quantities of the biosignals may be calculated to acquire each piece of bioinformation. For example, if the bioinformation is blood pressure, the feature quantity may be the shape of the waveform, such as multiple peaks in one waveform of the biosignal or a notch point just before the second peak. Alternatively, blood pressure may be acquired using pulse transit time (PTT) or pulse wave velocity (PWV). Furthermore, if the bioinformation is heart rate variability, a stress index (LF / HF) may be calculated based on the high-frequency (HF) and low-frequency (LF) components of a heart rate variability spectrum obtained by frequency-converting the fluctuation in the interval between peaks of the biosignal.

[0018] Furthermore, biometric information may be acquired using a machine learning model. It is estimated using machine learning from the above features and biometric signals. Methods for generating machine learning models include decision tree learning, support vector machines, and deep learning.

[0019] First Embodiment First, a first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram of an information acquisition system 1 according to the first embodiment.

[0020] The information acquisition system 1 according to this embodiment includes an information processing device 10, a plurality of imaging devices 100 (100a, 100b, and 100c) with different imaging areas, an inspection device 101, and a display device 102. The information processing device 10 can communicate with each of the plurality of imaging devices 100, the inspection device 101, and the display device 102 via a wired connection or a network.

[0021] The information processing device 10 in this embodiment includes an information acquisition unit (first acquisition unit) 11, a selection unit 12, a moving image acquisition unit (second acquisition unit) 13, a region setting unit 14, a processing unit 15, and a biometric information acquisition unit (third acquisition unit) 16. The information processing device 10 is a device that measures biometric information based on a moving image made up of captured images (hereinafter referred to as frame images) obtained by sequentially capturing images of a subject from which biometric information is to be acquired using an imaging device 100. The function of acquiring the biometric information of the subject by the information processing device 10 can be implemented by one or more processors (processing means) such as CPUs.

[0022] Each of the multiple imaging devices 100 has an optical system and an imaging element. The optical system focuses light incident on the imaging element from the subject space. The imaging element receives an optical image of the subject formed through the optical system to acquire a moving image. The imaging element is a CCD (Charge Coupled Device) sensor, a CMOS (Complementary Metal-Oxide Semiconductor) sensor, or the like.

[0023] The inspection device 101 is a device that inspects a subject 103. For example, the inspection device 101 is an inspection device that inspects a subject, such as a CT (Computed Tomography) device or an X-ray TV device. Note that a plurality of inspection devices may be set.

[0024] The inspection device 101 in this embodiment includes an inspection unit for performing an inspection on a subject other than biological information, an imaging unit having an image sensor for imaging the subject, and a communication unit (transmission unit) for communicating with the information processing device 10. When the inspection device 101 includes an imaging unit, the inspection device 101 may be one of the multiple imaging devices 100. This configuration is preferable because it allows the subject to be clearly imaged even during an inspection.

[0025] Note that either the information processing device 10 or the imaging device 100 may be configured as an integrated device, or an imaging unit having an imaging element and an optical system may be mounted on the information processing device 10. For example, this may be a smartphone or a personal computer.

[0026] Alternatively, either the inspection device 101 or the imaging device 100 may be configured as an integrated device. For example, an imaging unit having an imaging element and an optical system may be mounted on the inspection device 101. Preferably, the multiple imaging devices 100 include an imaging device equipped with an imaging element capable of detecting not only light in the R (red), G (green), and B (blue) wavelength ranges, but also the IR (infrared) wavelength range. This configuration allows biometric information of the subject 103 to be acquired even in a dark illumination environment. Furthermore, since IR penetrates deeply into the body, information on blood flow deep within the body can be acquired.

[0027] The display device 102 is, for example, a liquid crystal display or a projector, and displays moving images captured by the imaging device 100 and measured biological information of the subject.

[0028] An information acquisition system 1 according to this embodiment will be described with reference to FIGS.

[0029] 2 and 4 are conceptual diagrams of an object 103, an inspection device 101, and multiple imaging devices 100 in this embodiment. In FIG. 2, the object 103 is before (or after) inspection using the inspection device 101. In contrast, in FIG. 4, the object 103 is undergoing inspection using the inspection device 101. The multiple imaging devices 100 include 100a, 100b, and 100c, and are arranged to image the object 103 from diagonally above. Also, FIGS. 3A to 3C and 5A to 5C are diagrams showing examples of imaging regions of multiple imaging devices 100 with different imaging regions. A to C in each figure correspond to the imaging devices 100a, 100b, and 100c, respectively.

[0030] As shown in Fig. 3B, before the examination, the subject 103 is in the blind spot of the imaging device 100b when the examination device 101 is used. On the other hand, as shown in Fig. 3A and Fig. 3C, the subject 103 can be imaged using the imaging device 100a and the imaging device 100c. Therefore, in the state shown in Fig. 2, it is preferable to acquire biological information of the subject based on moving images acquired by the imaging device 100a or 100c.

[0031] Fig. 4 shows a state in which the bed in the inspection device 101 has moved and the subject 103 has entered the gantry of the inspection device 101. Therefore, as shown in Fig. 5B, the subject 103 enters the blind spot of the imaging devices 100a and 100c by the inspection device 101. On the other hand, as shown in Fig. 5B, the subject 103 can be imaged using the imaging device 100b. Therefore, in the state shown in Fig. 4, it is preferable to acquire biological information of the subject based on moving images acquired by the imaging device 100b.

[0032] As described above, by capturing an image of the subject 103 using the imaging device 100 with a different imaging region, it is possible to acquire biological information of the subject 103 depending on the situation.

[0033] The information processing device 10 in this embodiment acquires information about changes in the imaging environment from the inspection device 101. At this time, the inspection device 101 has a transmission unit, and in this embodiment, the inspection device 101 transmits information about operation in accordance with the operation of the device to the information processing device 10 as information about changes in the imaging environment. As information about the operation of the inspection device 101, control instruction signals such as movement of the bed and start and end of the inspection are transmitted.

[0034] By acquiring information about the operation of the inspection device 101 as information about a change in the imaging environment, it is possible to acquire biological information by selecting an imaging device capable of imaging the subject 103 after the change in the imaging environment from among a plurality of imaging devices each having a different imaging area. With this configuration, even if the subject 103 is in the blind spot of one imaging device, it is possible to image the subject 103 using another imaging device.

[0035] Furthermore, as information regarding a change in the imaging environment in this embodiment, for example, a control signal for the inspection device (external device) 101 may be acquired as information regarding a change in the imaging environment. In this case, a control unit (or control device) (not shown) that controls the inspection device 101 transmits a signal (control signal) for controlling the inspection device 101, and the inspection device 101 operates in accordance with the control signal. The control unit may be included in the information processing device 10, or the inspection device 101 may be controlled using the control unit in the information processing device 10. When a CT device is used as the inspection device 101, control instruction signals such as movement of the bed and start and end of the examination can be acquired as control signals to the CT device as information regarding a change in the imaging environment.

[0036] Note that the information regarding changes in the imaging environment is not limited to the above. The information processing device 10 may acquire information regarding lighting as information regarding changes in the imaging environment. In this case, the information regarding changes in the imaging environment may be acquired based on the brightness value of a moving image from the imaging device, such as a change in lighting or whether the environment is bright or dark. Alternatively, as in the case of the inspection device 101, the information regarding changes in the imaging environment may be acquired based on a control signal for a lighting device (lighting device) for illuminating the subject, or the state of the lighting device, such as whether it is on or off.

[0037] Furthermore, when acquiring information about lighting as information about a change in the imaging environment, if the change is that the illumination on the subject 103 becomes darker, the selector 12 selects an imaging device equipped with an imaging element capable of photoelectrically converting light in the IR (infrared) wavelength range. With this configuration, even if a biosignal cannot be accurately acquired using visible light alone, it is possible to accurately acquire bioinformation about the subject 103. Note that a change in the illumination on the subject 103 becoming darker is, for example, a change in the amount of illumination light irradiated on the subject 103 decreasing.

[0038] Next, an example of the operation of the information acquisition system 1 according to the first embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart illustrating a method for acquiring biometric information in the biometric information processing apparatus according to the first embodiment.

[0039] In step S10, the information acquisition unit 11 acquires information about changes in the imaging environment. In this embodiment, the information about changes in the imaging environment is information about the operation of the inspection device 101.

[0040] In step S11, the selection unit 12 selects at least one imaging device that images the subject to acquire biological information from the multiple imaging devices based on information about changes in the imaging environment. When the selection unit 12 selects multiple imaging devices, for example, from three imaging devices, the selection unit 12 selects two imaging devices that image the subject when selecting imaging devices based on information about changes in the imaging environment. Furthermore, the selection unit 12 may select one imaging device based on moving images acquired by the two imaging devices.

[0041] In this embodiment, the information regarding the change in the imaging environment will be described as information regarding the change in the subject resulting from the transition from the state in FIG. 2 to the state in FIG. 4. When the state in FIG. 4 is reached, the information acquisition unit 11 in this embodiment acquires information regarding the operation of the inspection device 101 as information regarding the change in the imaging environment. Due to the operation of the inspection device 101, the subject 103 enters the blind spot of the imaging device 100a. At this time, the imaging device 100a cannot acquire biological information about the subject 103. Therefore, the selection unit 12 in this embodiment selects at least one of the imaging devices 100a and 100c that can image the subject 103.

[0042] Furthermore, multiple moving images obtained using multiple image capturing devices selected based on information about changes in the imaging environment may be acquired. In this case, the selector 12 may select a moving image (first moving image) to be used to acquire biometric information, or an image capturing device corresponding to the first moving image, based on the number of pixels corresponding to the skin region of the subject 103 in the moving image. The skin region of the subject 103 may be the face, hands, feet, etc. of the subject 103. By acquiring biometric information based on a moving image with a larger number of pixels in the skin region, the accuracy of the acquired biometric information can be improved.

[0043] Furthermore, the selection unit 12 may select an imaging device according to a preset priority. For example, the priority may be determined in advance, such as face > hands > feet, and after multiple imaging devices have been selected, the selection unit 12 may select an imaging device that captures a body region with a high priority.

[0044] In step S12, the video acquisition unit 13 acquires a video obtained by capturing an image using the selected imaging device. Note that if multiple imaging devices (or multiple videos) are selected, the selection unit 12 may select one of the multiple imaging devices after this process.

[0045] In step S13, the region setting unit 14 detects a region of interest of the subject 103 to be used for acquiring biometric information based on the video. In this embodiment, the region of interest is the subject's face, and is information determined as a face region through face detection. Here, the face region is not limited to the entire face defined based on feature points of facial regions such as the eyes, nose, mouth, and facial contours, but may also be a specific part such as the cheeks or forehead. By selecting a region of interest, such as a skin region containing blood vessels of the subject 103, from the video, the accuracy of estimating biometric information can be improved. Note that if multiple imaging devices (or multiple videos) are selected, the selection unit 12 may select one of the multiple imaging devices after this process.

[0046] In step S14, the processing unit 15 extracts signal information (brightness values) within the region of interest of each frame image in the moving image to obtain time-series data, which is a biosignal. The processing unit 15 may also obtain a signal obtained by performing a moving average process on the time-series data obtained based on the moving image. This configuration reduces noise components contained in the time-series data.

[0047] In step S15, the biological information acquiring unit 16 acquires biological information from the acquired biological signal. At this time, the biological information acquiring unit 16 performs processing according to the target biological information. For example, when obtaining a heart rate or a respiratory rate as biological information, peaks (maximum values ​​or minimum values) in the biological signal are detected, and the heart rate or respiratory rate is calculated based on the number of peaks within a certain period of time.

[0048] Next, Example 2 will be described with reference to Fig. 7. Fig. 7 is a block diagram of an information acquisition system 2 according to Example 2. Unlike Example 1, the information acquisition system 2 according to this example is configured such that the information processing device 10 and the inspection device 101 are not communicatively connected.

[0049] Furthermore, the information acquisition unit 11 in this embodiment acquires information about changes in the imaging environment based on moving images from the imaging device. The information about changes in the imaging environment in this embodiment is information about the movement of the subject 103 and subjects 104 other than the subject, such that the subject 103 enters a blind spot of the imaging device. Subjects other than the subject include, for example, the inspection device 101 and medical professionals (doctors, nurses, and laboratory technicians). Therefore, it is preferable that the imaging device that images the subject 103 be installed in a position where it can image all of the subject, the inspection device, and non-subjects such as doctors.

[0050] In this embodiment, the information acquisition unit 11 can acquire information about changes in the imaging environment based on the moving images by detecting the movements and movements of subjects, including the subject 103, in the moving images using block matching or the like of specific regions of the subjects. Furthermore, movements of subjects other than the subject, such as movements of subjects other than the subject, performed on the subject, such as movements of subjects other than the subject, may be acquired as information about changes in the imaging environment. In this case, when a subject other than the subject is included in the video, the information may be acquired as information about changes in the imaging environment such as movements of subjects other than the subject, or the movement of subjects other than the subject may be detected and acquired as information about changes in the imaging environment such as movements of subjects other than the subject. Alternatively, specific movements of subjects other than the subject making specific movements may be detected and acquired as information about changes in the imaging environment such as movements of subjects other than the subject.

[0051] The information acquiring unit 11 may acquire a change in brightness value over time from the moving image as information related to a change in the imaging environment. If the brightness value in the moving image drops significantly, it is assumed that the amount of illumination light irradiating the subject 103 has decreased. When the information related to a change in the imaging environment as described above has been acquired, it is preferable to cause the selecting unit 12 to select an imaging device equipped with an imaging element capable of detecting light with wavelengths in the infrared range.

[0052] Furthermore, in addition to being acquired based on the moving images, audio data may be acquired as information regarding changes in the imaging environment. For example, a preset keyword such as "treatment begins" may be detected and used as information regarding changes in the imaging environment. In this case, it is preferable that the audio data be acquired together with the moving images by the moving image acquisition unit 13.

[0053] Next, an information acquisition system 2 according to this embodiment will be described with reference to Figures 2, 3, 8 and 9. Figures 2 and 3 are the same as those in the first embodiment.

[0054] Fig. 8 is an image diagram of a subject 103, a subject 104, an inspection device 101, and multiple image capture devices 100 in this embodiment. Also, Figs. 9A to 9C are diagrams showing examples of imaging areas of multiple image capture devices 100 with different imaging areas. A to C in each figure correspond to image capture devices 100a, 100b, and 100c, respectively. Note that the subject 104 in this embodiment is a subject other than the subject 103, such as a medical professional (doctor, nurse, or laboratory technician).

[0055] Fig. 8 shows a state in which the subject 104 has moved close to the subject 103. At this time, as shown in Fig. 9A, the subject 103 enters the blind spot of the imaging device 100a due to the subject 104. Also, as shown in Fig. 9B, the subject 103 enters the blind spot of the imaging device 100b due to the inspection device 101. On the other hand, as shown in Fig. 9C, the subject 103 can be imaged using the imaging device 100c. Therefore, in the state shown in Fig. 8, it is preferable to acquire biological information of the subject based on moving images acquired by the imaging device 100c.

[0056] Next, an operation example of the information acquisition system 2 according to the second embodiment will be described with reference to Fig. 10 . Fig. 10 is a flowchart illustrating a method for acquiring biometric information in the information processing device 10 according to the second embodiment. The information processing device 10 acquires moving images from at least one of the multiple image capturing devices 100 before step S20, which will be described later. As an example, the information processing device 10 according to the second embodiment acquires moving images ( Fig. 3A ) obtained by capturing images using the image capturing device 100a in Fig. 2 .

[0057] In step S20, the information acquisition unit 11 acquires information about a change in the imaging environment (a change in the subject). The information acquisition unit 11 in this embodiment acquires information about a change in the imaging environment based on a moving image obtained by the imaging device 100a.

[0058] In step S21, the information acquisition unit 11 determines whether or not information regarding a change in the imaging environment has been acquired, or whether or not the information regarding the change in the imaging environment has changed. If the information acquisition unit 11 acquires information regarding a change in the imaging environment or the information regarding the change in the imaging environment has changed, the process proceeds to step S22. If the information regarding the change in the imaging environment cannot be acquired or the information regarding the change in the imaging environment has not changed, there is no need to change the imaging device that acquires moving images for acquiring biometric information, so step S22 is skipped and the process proceeds to step S23.

[0059] In step S22, the selector 12 selects at least one imaging device from the multiple imaging devices 100 that can image the skin area of ​​the subject 103 based on information about the change in the imaging environment. Hereinafter, the information about the change in the imaging environment in this embodiment will be described as related to the change in the subject caused by the state of FIG. 2 changing from the state of FIG. 8. When the state of FIG. 8 is reached, the subject 103 enters the blind spot of the imaging device 100a due to the subject 104. At this time, the imaging device 100a cannot acquire biological information about the subject 103. Therefore, the selector 22 in this embodiment selects the imaging device 100c that can image the subject 103.

[0060] In addition, when a plurality of moving images have been acquired, the selection unit 12 may select a moving image (first moving image) to be used for acquiring biometric information from the plurality of moving images acquired using different imaging devices. Steps S23 to S25 are the same as those in the first embodiment.

[0061] In step S26, the processing unit 15 determines whether time-series data for the specified time has been acquired. If the specified time has not been reached, the processing unit 15 executes the processes of each step again, starting from step S20, to satisfy the specified time. Here, the specified time is the time required to acquire biometric information. For example, when acquiring biometric information by Fourier transforming a biometric signal, a moving image of several seconds to several tens of seconds is required, so the specified time is appropriately set depending on the number of samples required for the conversion. If time-series data for the specified time has been acquired, the process proceeds to step S27.

[0062] In step S27, the biological information acquiring unit 16 acquires biological information of the subject 103 based on the obtained biological signal.

[0063] The information processing device 10 may repeatedly perform steps S20 to S27 to acquire biological information of the subject continuously over time.

[0064] This embodiment can also be realized by a process in which a program that realizes one or more of the functions of the above-described embodiment is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that realizes one or more of the functions.

[0065] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention.

[0066] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention.

[0067] The embodiments of the present invention include the following configurations, methods, and programs.

[0068] [Configuration 1] An information processing device that acquires biometric information of a subject based on at least one moving image obtained by imaging the subject using multiple imaging devices with different imaging areas, characterized in that it comprises: a first acquisition unit that acquires the at least one moving image; a second acquisition unit that acquires information regarding changes in the imaging environment; a selection unit that selects an imaging device to be used to acquire the biometric information from the multiple imaging devices based on the information; and a third acquisition unit that acquires the biometric information of the subject based on the moving image obtained using the selected imaging device.

[0069] [Configuration 2] The information processing device according to Configuration 1, wherein the second acquisition unit acquires, as the information, a control signal for controlling an inspection device for inspecting the object or an illumination device for illuminating the object.

[0070] [Configuration 3] The information processing device according to Configuration 1, wherein the second acquisition unit acquires, as the information, information relating to an operation of an inspection device for inspecting the subject from the inspection device.

[0071] [Configuration 4] The information processing apparatus according to Configuration 1, wherein the second acquisition unit acquires, as the information, information relating to the operation of an illumination device for illuminating the subject from the illumination device.

[0072] [Configuration 5] The information processing device according to Configuration 4, wherein the plurality of imaging devices include an imaging device equipped with an imaging element capable of detecting light with a wavelength in the infrared range, and the selection unit selects an imaging device equipped with an imaging element capable of detecting light with a wavelength in the infrared range when the amount of illumination light irradiated to the subject is reduced due to operation of the illumination device.

[0073] [Configuration 6] The information processing device according to Configuration 1, wherein the second acquisition unit acquires the information based on the moving image.

[0074] [Configuration 7] The information processing device according to Configuration 6, wherein the second acquisition unit detects, as the information, a movement of the subject based on the moving image.

[0075] [Configuration 8] The information processing device according to configuration 6 or 7, wherein the second acquisition unit detects, as the information, a change in luminance value over time in the moving image.

[0076] [Configuration 9] The information processing device according to any one of configurations 1 to 8, further comprising a setting unit that sets a region including the subject in the moving image as a region of interest, and the third acquisition unit acquires biological information of the subject based on the region of interest in the moving image.

[0077] [Configuration 10] The information processing device according to Configuration 2, wherein the selection unit selects a plurality of imaging devices that image a skin region of the subject based on the information about the subject, and selects an imaging device that acquires biological information based on a region of the subject in a plurality of moving images acquired by the plurality of imaging devices.

[0078] [Configuration 11] The information processing device according to Configuration 10, wherein the selection unit selects an imaging device having a large number of pixels in a skin region of the subject in a plurality of moving images acquired by the plurality of imaging devices.

[0079] [Configuration 12] The information processing device according to Configuration 10 or 11, wherein the selection unit selects an imaging device capable of imaging a body region of the subject having a predetermined high priority.

[0080] [Configuration 13] The information processing device according to any one of configurations 1 to 12, wherein the biological information includes at least one of the subject's pulse rate, blood pressure, respiratory rate, heart rate, and oxygen saturation.

[0081] [Configuration 14] An imaging apparatus comprising: the information processing apparatus according to any one of configurations 1 to 13; and an imaging element for imaging the subject.

[0082] [Configuration 15] An information acquisition system having the information processing device according to any one of configurations 1 to 13 and an inspection device capable of communicating with the information processing device, wherein the inspection device has a transmitting unit that transmits the information to the information processing device in accordance with the operation of the inspection device.

[0083] [Configuration 16] An information acquisition system having the information processing device described in any one of configurations 1 to 13 and the plurality of imaging devices capable of communicating with the information processing device, wherein each of the plurality of imaging devices has a transmission unit that transmits moving images to the information processing device.

[0084] [Method 1] An information processing method for acquiring biometric information of a subject based on at least one moving image obtained by imaging the subject using multiple imaging devices with different imaging areas, comprising: a step of acquiring the at least one moving image; a step of acquiring information regarding changes in the imaging environment; a step of selecting an imaging device to be used to acquire the biometric information from the multiple imaging devices based on the information; and a step of acquiring the biometric information of the subject based on the moving image obtained using the selected imaging device.

[0085] [Program 1] A program for causing a computer to execute the information processing method described in Method 1.

[0086] [Configuration 17] An inspection device communicably connected to the information processing device according to any one of configurations 1 to 13, the inspection device comprising: an inspection unit for inspecting the subject; an imaging unit having an imaging element for imaging the subject; and a transmission unit for transmitting information relating to changes in the imaging environment to the information processing device.

[0087] The present invention is not limited to the above-described embodiments, and various modifications and variations can be made without departing from the spirit and scope of the present invention. Therefore, the following claims are appended to apprise the public of the scope of the present invention.

[0088] This application claims priority based on Japanese Patent Application No. 2023-107673, filed on June 30, 2023, the entire contents of which are incorporated herein by reference.

[0089] 10 Information processing device 11 First acquisition unit 12 Selection unit 13 Second acquisition unit 16 Third acquisition unit

Claims

1. An information processing device that acquires biometric information of a subject based on at least one moving image obtained by imaging the subject using a plurality of imaging devices with different imaging areas, comprising: a first acquisition unit that acquires the at least one moving image; a second acquisition unit that acquires information regarding changes in the imaging environment; a selection unit that selects an imaging device to be used to acquire the biometric information from the plurality of imaging devices based on the information; and a third acquisition unit that acquires the biometric information of the subject based on the moving image obtained using the selected imaging device.

2. The information processing device according to claim 1, characterized in that the second acquisition unit acquires as the information a control signal for controlling an inspection device for inspecting the specimen or an illumination device for illuminating the specimen.

3. The information processing device according to claim 1, characterized in that the second acquisition unit acquires information relating to the operation of an inspection device for inspecting the specimen from the inspection device as the information.

4. The information processing apparatus according to claim 1, wherein the second acquisition unit acquires information relating to the operation of an illumination device for illuminating the subject from the illumination device as the information.

5. The information processing device according to claim 4, characterized in that the plurality of imaging devices include an imaging device equipped with an imaging element capable of detecting light having a wavelength in the infrared range, and the selection unit selects an imaging device equipped with an imaging element capable of detecting light having a wavelength in the infrared range when the amount of illumination light irradiated to the subject decreases due to operation of the illumination device.

6. The information processing device according to claim 1, wherein the second acquisition unit acquires the information based on the moving image.

7. The information processing device according to claim 6, wherein the second acquisition unit detects the motion of the subject as the information based on the moving image.

8. The information processing device according to claim 6, wherein the second acquisition section detects a change in luminance value over time in the moving image as the information.

9. An information processing device as described in any one of claims 1 to 8, characterized in that it has a setting unit that sets an area in the moving image that includes the subject as a region of interest, and the third acquisition unit acquires biological information of the subject based on the region of interest in the moving image.

10. The information processing device according to claim 2, characterized in that the selection unit selects a plurality of imaging devices for imaging the skin area of ​​the subject based on the information on the subject, and selects an imaging device for acquiring biometric information based on the area of ​​the subject in a plurality of moving images acquired by the plurality of imaging devices.

11. The information processing device according to claim 10, characterized in that the selection unit selects an imaging device having a large number of pixels in the skin area of ​​the subject in a plurality of moving images acquired by the plurality of imaging devices.

12. The information processing apparatus according to claim 10, wherein the selection unit selects an imaging device capable of imaging a body region of the subject having a predetermined high priority.

13. An information processing device according to any one of claims 1 to 8, characterized in that the biological information includes at least one of the subject's pulse rate, blood pressure, respiratory rate, heart rate, and oxygen saturation.

14. An imaging device comprising: an information processing device according to any one of claims 1 to 8; and an imaging element for imaging the subject.

15. An information acquisition system having an information processing device according to any one of claims 1 to 8 and an inspection device capable of communicating with the information processing device, characterized in that the inspection device has a transmitting unit that transmits the information to the information processing device in accordance with the operation of the inspection device.

16. An information acquisition system having an information processing device as described in any one of claims 1 to 8 and a plurality of imaging devices capable of communicating with the information processing device, wherein each of the plurality of imaging devices has a transmission unit for transmitting moving images to the information processing device.

17. An information processing method for acquiring biometric information of a subject based on at least one moving image obtained by imaging the subject using a plurality of imaging devices with different imaging areas, comprising the steps of: acquiring the at least one moving image; acquiring information regarding changes in the imaging environment; selecting an imaging device to be used to acquire the biometric information from the plurality of imaging devices based on the information; and acquiring the biometric information of the subject based on the moving image obtained using the selected imaging device.

18. A program for causing a computer to execute the information processing method according to claim 17.

19. An inspection device communicatively connected to an information processing device according to any one of claims 1 to 8, characterized in that the inspection device comprises an inspection unit for inspecting the specimen, an imaging unit having an imaging element for imaging the specimen, and a transmission unit for transmitting information regarding changes in the imaging environment to the information processing device.

Images