Information processing device, information processing method, and program

Abstract

To provide an information processing device capable of acquiring biological information of a subject with high accuracy.SOLUTION: An information processing device for acquiring biological information of a subject on the basis of at least one moving image acquired by imaging the subject using a plurality of imaging devices with different imaging areas includes a first acquisition unit 11 for acquiring at least one moving image, a second acquisition unit 13 for acquiring information regarding changes in an imaging environment, a selection unit 12 for selecting an imaging device to be used to acquire biological information from a plurality of imaging devices on the basis of the information, and a third acquisition unit 16 for acquiring the biological information of the subject on the basis of the moving image acquired using the selected imaging device.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program for acquiring biological information of a subject. [Background technology]

[0002] In order to obtain bio-information of a subject without contacting the subject, a technique is known for detecting a bio-signal of the subject based on a moving image obtained by imaging the subject. For example, when measuring a pulse rate as bio-information, a pulse waveform is detected as a bio-signal. Then, the pulse rate can be obtained from the number of peaks in the pulse waveform within a certain period of time. By obtaining the bio-information of the subject without contacting the subject, the stress on the subject can be reduced.

[0003] Patent Document 1 discloses a method for acquiring biological information based on a moving image obtained by imaging a subject using an imaging device. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2005-218507 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, when the method disclosed in Patent Document 1 is used to acquire biometric information of a subject, if the subject falls within the blind spot of the imaging device, the biometric information of the subject cannot be acquired. For example, when acquiring biometric information of a subject in a non-contact manner in an examination room or treatment room in a hospital, the subject may fall within the blind spot of the imaging device due to subjects other than the subject, such as an examination device or a medical professional (doctor, nurse, or technician). As a result, the biometric information of the subject cannot be acquired with high accuracy. On the other hand, a method of performing a process of acquiring multiple pieces of biometric information of the subject based on each of multiple moving images obtained by imaging the subject using multiple imaging devices with different imaging areas may be considered, but this is not preferable because the process becomes complicated.

[0006] SUMMARY OF THE PRESENT EMBODIMENTS Accordingly, an object of the present invention is to provide an information processing apparatus capable of acquiring biological information of a subject with high accuracy. [Means for solving the problem]

[0007] The present invention provides an information processing device that acquires biometric information of a subject based on at least one moving image obtained by imaging the subject using a plurality of imaging devices with different imaging areas, and is characterized in that it comprises a first acquisition unit that acquires the at least one moving image, a second acquisition unit that acquires information regarding changes in the imaging environment, a selection unit that selects an imaging device to be used to acquire the biometric information from the plurality of imaging devices based on the information, and a third acquisition unit that acquires the biometric information of the subject based on the moving image obtained using the selected imaging device. Effect of the Invention

[0008] According to the present invention, it is possible to provide an information processing apparatus capable of acquiring biological information of a subject with high accuracy. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram of an information processing device according to a first embodiment. [Diagram 2] FIG. 2 is a diagram showing the relationship between an imaging device, a test object, and an inspection device. [Diagram 3] 3 is a diagram showing an example of an image obtained by the imaging device in FIG. 2. [Figure 4] FIG. 2 is a diagram showing the relationship between an imaging device, a test object, and an inspection device during inspection. [Diagram 5] 5 is a diagram showing an example of an image obtained by the imaging device in FIG. 4. [Figure 6] 4 is a flowchart showing a processing operation of the information processing device according to the first embodiment. [Figure 7] FIG. 11 is a block diagram of an information processing device according to a second embodiment. [Figure 8] FIG. 2 is a diagram showing the relationship between an imaging apparatus, a subject, and a subject other than the subject. [Figure 9] 9 is a diagram showing an example of an image obtained by the imaging device in FIG. 8. [Figure 10] 11 is a flowchart showing a processing operation of an information processing device in the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. Note that each drawing may be drawn at a scale different from the actual scale for convenience. Also, as shown in each drawing, the same reference numerals are given to the same components, and duplicated descriptions are omitted. Note that the following embodiments do not limit the invention according to the claims. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined in any manner.

[0011] There is a technology that detects time series data of reflected light from the skin surface of a subject as a biosignal in order to obtain bioinformation of the subject without contacting the subject. The blood flow rate of the blood vessels of a living subject periodically increases and decreases according to the pulse and breathing. This is due to the characteristics of the light absorption rate of hemoglobin contained in blood.

[0012] Hemoglobin in blood has high absorptivity for light of 495 to 570 nm (green wavelength) and 800 to 1000 nm (infrared wavelength). Therefore, by acquiring the change over time in the amount of light (especially green wavelength or infrared wavelength) reflected from a part of the skin surface including the blood vessels of the subject, it is possible to detect the subject's biosignal. In this embodiment, any one of pulse rate, blood pressure, respiratory rate, heart rate, and oxygen saturation is acquired as the subject's bioinformation.

[0013] A known technique can be used to obtain the subject's bioinformation based on the obtained biosignal of the subject. Signal processing of the biosignal according to the target bioinformation among pulse rate, blood pressure, respiratory rate, heart rate, and oxygen saturation and other processing are not limited to those in this embodiment.

[0014] For example, the biosignal (waveform) may be calculated by a moving average of a waveform based on a photoplethysmogram (PPG) calculated from the luminance value in the moving image. The biosignal may include a green wavelength or an infrared wavelength in the moving image and may be information based on the state of the subject, such as blood flow.

[0015] The pulse rate can be obtained by detecting peak positions from the biosignal (waveform) and calculating the interval between peaks or the number of peaks within a certain time range. Alternatively, the pulse rate can be obtained from the peak frequency in the frequency characteristic obtained by Fourier transforming the biosignal. Furthermore, the peaks in the biosignal may be detected by a threshold value for the peak height or peak width in the biosignal.

[0016] The respiration rate can be obtained from the frequency characteristics obtained by performing a Fourier transform on the biosignal (waveform) based on the PPG. Alternatively, it can be obtained by calculating the interval between peaks of the waveform obtained by extracting the frequency band signal caused by breathing from the biosignal (waveform) or the number of peaks within a certain time range. The frequency band of the biosignal caused by breathing is lower than the frequency band of the biosignal caused by the pulse rate.

[0017] Note that the feature amount of the biosignal may be obtained to acquire each piece of bioinformation. For example, if the bioinformation is blood pressure, the feature amount may be a waveform shape such as multiple peaks of one waveform of the biosignal or a notch point just before the second peak. Alternatively, the blood pressure may be acquired using the pulse transit time (PTT) or pulse wave velocity (PWV). If the bioinformation is heart rate variability, the stress index (LF / HF) may be calculated based on the high frequency component (HF) and low frequency component (LF) of the heart rate variability spectrum obtained by frequency converting the variation in the interval between the peaks of the biosignal.

[0018] Furthermore, biometric information may be acquired using a machine learning model. It is estimated from the above-mentioned features and biometric signals using machine learning. As a method for generating the machine learning model, decision tree learning, support vector machine, deep learning, etc. can be used.

[0019] [Example 1] First, a first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram of an information acquisition system 1 according to the first embodiment.

[0020] The information acquisition system 1 according to this embodiment includes an information processing device 10, a plurality of imaging devices 100 (100a, 100b, and 100c) having different imaging areas, an inspection device 101, and a display device 102. The information processing device 10 can communicate with each of the plurality of imaging devices 100, the inspection device 101, and the display device 102 via a wire or a network.

[0021] The information processing device 10 in this embodiment includes an information acquiring section (first acquiring section) 11, a selecting section 12, a moving image acquiring section (second acquiring section) 13, a region setting section 14, a processing section 15, and a biometric information acquiring section (third acquiring section) 16. The information processing device 10 is a device that measures biometric information based on a moving image made up of captured images (hereinafter, frame images) obtained by capturing images of a subject from which biometric information is to be acquired using an imaging device 100 in a time-series manner. The function of acquiring the biometric information of the subject by the information processing device 10 can be implemented by one or more processors (processing means) such as CPUs.

[0022] Each of the imaging devices 100 has an optical system and an imaging element. The optical system collects light incident on the imaging element from the subject space. The imaging element receives an optical image of the subject formed via the optical system to obtain a moving image. The imaging element is a CCD (Charge Coupled Device) sensor, a CMOS (Complementary Metal-Oxide Semiconductor) sensor, or the like.

[0023] The inspection device 101 is a device that performs an inspection on a subject 103. For example, the inspection device 101 is an inspection device that performs an inspection on a subject, such as a CT (Computed Tomography) device and an X-ray TV device. Note that a plurality of inspection devices may be set.

[0024] The inspection device 101 in this embodiment includes an inspection unit for performing an inspection on a subject other than biological information, an imaging unit having an image sensor for imaging the subject, and a communication unit (transmission unit) for communicating with the information processing device 10. When the inspection device 101 includes an imaging unit, the inspection device 101 may be one of the imaging devices 100. This configuration is preferable because it allows the subject to be clearly imaged even during an inspection.

[0025] Note that either the information processing device 10 or the imaging device 100 may be configured as an integrated device, or an imaging unit having an imaging element and an optical system may be mounted on the information processing device 10. For example, the information processing device 10 may be a smartphone or a personal computer.

[0026] Also, either the inspection device 101 or the imaging device 100 may be configured as an integrated device, for example, an imaging unit having an imaging element and an optical system may be mounted on the inspection device 101. Also, it is preferable that the multiple imaging devices 100 have an imaging device equipped with an imaging element capable of detecting not only light in the R (red), G (green), and B (blue) wavelength ranges, but also the IR (infrared) wavelength range. With such a configuration, it is possible to obtain biological information of the subject 103 even in an environment with dark illumination light. Also, since IR has a deep penetration depth into the interior of a living body, it is possible to obtain information on blood flow deep inside the body.

[0027] The display device 102 is, for example, a liquid crystal display or a projector, and displays moving images captured by the imaging device 100 and measured biological information of a subject.

[0028] An information acquisition system 1 according to the present embodiment will be described with reference to FIGS.

[0029] 2 and 4 are conceptual diagrams of an object 103, an inspection device 101, and a plurality of imaging devices 100 in this embodiment. In FIG. 2, the object 103 is before (or after) inspection using the inspection device 101. On the other hand, in FIG. 4, the object 103 is undergoing inspection using the inspection device 101. The plurality of imaging devices 100 include 100a, 100b, and 100c, and are arranged to image the object 103 from diagonally above. In addition, FIGS. 3 and 5 are diagrams showing an example of imaging regions of the plurality of imaging devices 100 having different imaging regions. (a) to (c) in each figure correspond to the imaging devices 100a, 100b, and 100c, respectively.

[0030] As shown in Fig. 3(b), before the inspection, the subject 103 is in the blind spot of the imaging device 100b by the inspection device 101. On the other hand, as shown in Fig. 3(a) and Fig. 3(c), the subject 103 can be imaged using the imaging device 100a and the imaging device 100c. Therefore, in the state of Fig. 2, it is preferable to acquire biological information of the subject based on a moving image acquired by the imaging device 100a or 100c.

[0031] Fig. 4 shows a state where the bed in the inspection device 101 has moved and the subject 103 has entered the gantry in the inspection device 101. Therefore, as shown in Fig. 5(b), the subject 103 enters the blind spot of the imaging devices 100a and 100c by the inspection device 101. On the other hand, as shown in Fig. 5(b), the subject 103 can be imaged using the imaging device 100b. Therefore, in the state shown in Fig. 4, it is preferable to acquire biological information of the subject based on a moving image acquired by the imaging device 100b.

[0032] As described above, by capturing an image of the subject 103 using the imaging device 100 having a different imaging region, it is possible to acquire biological information of the subject 103 according to the situation.

[0033] The information processing device 10 in this embodiment acquires information on changes in the imaging environment from the inspection device 101. At this time, the inspection device 101 has a transmission unit, and in this embodiment, the inspection device 101 transmits information on the operation as information on changes in the imaging environment to the information processing device 10 in accordance with the operation of the device. As information on the operation of the inspection device 101, signals of control instructions such as movement of the bed and start and end of the examination are transmitted.

[0034] By acquiring information on the operation of the inspection device 101 as information on the change in the imaging environment, it is possible to acquire biological information by selecting an imaging device capable of imaging the subject 103 after the change in the imaging environment from among a plurality of imaging devices each having a different imaging area. With this configuration, even if the subject 103 is in the blind spot of one imaging device, it is possible to image the subject 103 using the other imaging device.

[0035] Furthermore, as information regarding a change in the imaging environment in this embodiment, for example, a control signal for the examination device (external device) 101 may be acquired as information regarding a change in the imaging environment. In this case, a control unit (or control device) (not shown) that controls the examination device 101 transmits a signal (control signal) for controlling the examination device 101, and the examination device 101 operates in response to the control signal. The control unit may be included in the information processing device 10, or the examination device 101 may be controlled using the control unit in the information processing device 10. When a CT device is used as the examination device 101, a control signal for the CT device, such as a signal of control instructions for moving the bed and starting and ending an examination, can be acquired as information regarding a change in the imaging environment.

[0036] The information on the change in the imaging environment is not limited to the above. The information processing device 10 may acquire information on the illumination as the information on the change in the imaging environment. In this case, the information on the change in the imaging environment may be acquired based on the luminance value of the moving image from the imaging device, such as the change in the illumination or whether it is bright or dark. Alternatively, similar to the case of the inspection device 101, the information on the change in the imaging environment may be acquired as the information on the change in the imaging environment, such as a control signal for an illumination device (illumination device) for illuminating the subject, or the state of the illumination device, such as ON or OFF.

[0037] Furthermore, when acquiring information about illumination as information about a change in the imaging environment, if the illumination on the subject 103 becomes darker, the selection unit 12 selects an imaging device equipped with an imaging element capable of photoelectrically converting light in the IR (infrared) wavelength range. With this configuration, even if a biosignal cannot be acquired accurately with visible light alone, it is possible to acquire bioinformation of the subject 103 with high accuracy. Note that a change in illumination on the subject 103 becoming darker is, for example, a change in the amount of illumination light irradiated on the subject 103 decreasing.

[0038] Next, an operation example of the information acquiring system 1 according to the first embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart of a method for acquiring biometric information in the biometric information processing device according to the first embodiment.

[0039] In step S10, the information acquiring unit 11 acquires information regarding a change in the imaging environment. The information regarding the change in the imaging environment in this embodiment is information regarding the operation of the inspection device 101.

[0040] In step S11, the selection unit 12 selects at least one imaging device that images the subject to acquire biological information from the multiple imaging devices based on information about changes in the imaging environment. When the selection unit 12 selects multiple imaging devices, for example, from three imaging devices, it selects two imaging devices that image the subject when selecting the imaging devices based on information about changes in the imaging environment. Furthermore, the selection unit 12 may select one imaging device based on moving images acquired by the two imaging devices.

[0041] The information regarding the change in the imaging environment in this embodiment will be described as being related to the change in the subject caused by changing from the state in FIG. 2 to the state in FIG. 4. When the state in FIG. 4 is reached, the information acquiring unit 11 in this embodiment acquires information regarding the operation of the inspection device 101 as information regarding the change in the imaging environment. Due to the operation of the inspection device 101, the subject 103 enters the blind spot of the imaging device 100a. At this time, the imaging device 100a cannot acquire biological information of the subject 103. Therefore, the selecting unit 12 in this embodiment selects at least one of the imaging devices 100a and 100c that can image the subject 103.

[0042] Also, a plurality of moving images obtained by using a plurality of image capturing devices selected based on information on changes in the imaging environment may be acquired. In this case, the selection unit 12 may select a moving image (first moving image) used to acquire biometric information, or an image capturing device corresponding to the first moving image, based on the number of pixels corresponding to the skin region of the subject 103 in the moving image. The skin region of the subject 103 is the face, hands, feet, etc. of the subject 103. By acquiring biometric information based on a moving image with a larger number of pixels in the skin region, the accuracy of the acquired biometric information can be improved.

[0043] Furthermore, the selection unit 12 may select an imaging device according to a preset priority. For example, a priority may be determined in advance, such as face>hands>feet, and after a plurality of imaging devices are selected, an imaging device capturing an image of a body region with a high priority may be selected.

[0044] In step S12, the video acquisition unit 13 acquires a video obtained by imaging using the selected imaging device. If multiple imaging devices (or multiple videos) are selected, the selection unit 12 may select one of the multiple imaging devices after this process.

[0045] In step S13, the region setting unit 14 detects a region of interest of the subject 103 used to acquire biometric information based on the video. The region of interest in this embodiment is the subject's face region, and is information determined to be a face region by performing face detection. Here, the face region is not limited to the entire face range defined based on feature points of types of face regions such as the eyes, nose, mouth, and face contour, but may be a specific part such as the cheek or forehead. By setting a region including blood vessels of the subject 103 from the video as the region of interest, the estimation accuracy of the biometric information can be improved. Note that if multiple imaging devices (or multiple videos) are selected, the selection unit 12 may select one of the multiple imaging devices after this process.

[0046] In step S14, the processing unit 15 extracts signal information (luminance value) within the region of interest of each frame image in the moving image to obtain time-series data. The processing unit 15 may obtain, as a biosignal, a signal obtained by performing moving average processing on the time-series data obtained based on the moving image. With this configuration, it is possible to reduce noise components contained in the time-series data.

[0047] In step S15, the bio-information acquiring unit 16 acquires bio-information from the acquired bio-signal. At this time, the bio-information acquiring unit 16 performs processing according to the target bio-information. For example, when obtaining a heart rate or a respiratory rate as the bio-information, peaks (maximum or minimum values) in the bio-signal are detected, and the heart rate or the respiratory rate is obtained based on the number of peaks within a certain period of time.

[0048] [Example 2] Next, a second embodiment will be described with reference to Fig. 7. Fig. 7 is a block diagram of an information acquisition system 2 according to the second embodiment. In the information acquisition system 2 according to the second embodiment, unlike the first embodiment, an information processing device 10 and an inspection device 101 are not communicatively connected.

[0049] Moreover, the information acquiring unit 11 in this embodiment acquires information about changes in the imaging environment based on moving images from the imaging device. The information about changes in the imaging environment in this embodiment is information about the movement of the subject 103 and subjects 104 other than the subject, such as the subject 103 entering a blind spot of the imaging device. Subjects other than the subject include, for example, the examination device 101 and medical personnel (doctors, nurses, and laboratory technicians). Therefore, it is preferable that the imaging device that images the subject 103 is installed in a position where it can image all of the examination device, non-subjects such as doctors, and subjects.

[0050] In this embodiment, the information acquiring unit 11 can acquire information on the change in the imaging environment based on the moving image by detecting the motion or movement of the subject including the subject 103 in the moving image by block matching or the like of a specific region of the subject. In addition, the information acquiring unit 11 may acquire the motion of the subject other than the subject performed on the subject, such as a motion of a treatment or the like by the subject other than the subject, as information on the change in the imaging environment. In this case, when a subject other than the subject is included in the video, the information may be acquired as information on the change in the imaging environment, such as a treatment, or the motion of the subject other than the subject may be detected and acquired as information on the change in the imaging environment, such as a treatment. Alternatively, the information acquiring unit 11 may detect a specific motion of a subject other than the subject making a specific motion and acquire it as information on the change in the imaging environment, such as a treatment.

[0051] The information acquiring unit 11 may acquire a change in luminance value over time from the moving image as information on the change in the imaging environment. If the luminance value in the moving image drops significantly, it is assumed that the amount of illumination light irradiated to the subject 103 is decreasing. When acquiring information on the change in the imaging environment as described above, it is preferable to have the selecting unit 12 select an imaging device equipped with an imaging element capable of detecting light with a wavelength in the infrared range.

[0052] Furthermore, in addition to being acquired based on the moving image, audio data may be acquired as information regarding a change in the imaging environment. For example, a preset keyword such as "Treatment will begin" may be detected and used as information regarding a change in the imaging environment. In this case, it is preferable that the audio data is acquired together with the moving image by the moving image acquisition unit 13.

[0053] Next, an information acquisition system 2 according to this embodiment will be described with reference to Figures 2, 3, 8 and 9. Figures 2 and 3 are the same as those of the first embodiment.

[0054] Fig. 8 is an image diagram of a subject 103, a subject 104, an inspection device 101, and a plurality of imaging devices 100 in this embodiment. Fig. 9 is a diagram showing an example of imaging regions of a plurality of imaging devices 100 having different imaging regions. (a) to (c) in each figure correspond to imaging devices 100a, 100b, and 100c, respectively. Note that the subject 104 in this embodiment is a subject other than the subject 103, such as a medical professional (doctor, nurse, or technician).

[0055] Fig. 8 shows a state where the subject 104 has moved close to the subject 103. At this time, as shown in Fig. 8(a), the subject 104 causes the subject 103 to enter the blind spot of the imaging device 100a. Also, as shown in Fig. 8(b), the subject 103 causes the inspection device 101 to enter the blind spot of the imaging device 100b. On the other hand, as shown in Fig. 8(c), the subject 103 can be imaged using the imaging device 100c. Therefore, in the state shown in Fig. 8, it is preferable to acquire biological information of the subject based on a moving image acquired by the imaging device 100c.

[0056] Next, an operation example of the information acquisition system 2 according to the second embodiment will be described with reference to Fig. 10. Fig. 10 is a flowchart of a method for acquiring biometric information in the information processing device 10 according to the second embodiment. The information processing device 10 acquires a moving image from at least one of the multiple imaging devices 100 before step S20 described later. As an example, the information processing device 10 in this embodiment acquires a moving image (Fig. 3(a)) obtained by capturing an image using the imaging device 100a in Fig. 2.

[0057] In step S20, the information acquisition unit 11 acquires information about a change in the imaging environment. The information acquisition unit 11 in this embodiment acquires information about a change in the imaging environment based on a moving image captured by the imaging device 100a.

[0058] In step S21, the information acquisition unit 11 determines whether or not information regarding the change in the imaging environment has been acquired, or whether or not the information regarding the change in the imaging environment has changed. If the information acquisition unit 11 acquires information regarding the change in the imaging environment or the information regarding the change in the imaging environment has changed, the process proceeds to step S22. If the information regarding the change in the imaging environment cannot be acquired or the information regarding the change in the imaging environment has not changed, there is no need to change the imaging device that acquires the moving images for acquiring biometric information, so step S22 is skipped and the process proceeds to step S23.

[0059] In step S22, the selection unit 12 selects at least one imaging device capable of imaging the skin area of ​​the subject 103 from the multiple imaging devices 100 based on information about the change in the imaging environment. Hereinafter, the information about the change in the imaging environment in this embodiment will be described as information about the change in the subject caused by the state of FIG. 2 changing to the state of FIG. 8. As a result of the state of FIG. 8, the subject 103 enters the blind spot of the imaging device 100a due to the subject 104. At this time, the imaging device 100a cannot acquire biological information of the subject 103. Therefore, the selection unit 22 in this embodiment selects the imaging device 100c that can image the subject 103.

[0060] In addition, when a plurality of moving images are acquired, the selection unit 12 may select a moving image (first moving image) to be used for acquiring biometric information from the plurality of moving images acquired by using different imaging devices. Steps S23 to S25 are the same as those in the first embodiment.

[0061] In step S26, the processing unit 15 judges whether time series data for the specified time has been acquired, and if the specified time has not been reached, the processing of each step is executed again from step S20 to satisfy the specified time. Here, the specified time is the time required to acquire bioinformation. For example, when acquiring bioinformation by Fourier transforming a biosignal, a moving image of several seconds to several tens of seconds is required, so the specified time is appropriately set according to the number of samples required for the conversion. If time series data for the specified time has been acquired, the process proceeds to step S27.

[0062] In step S27, the biological information acquiring unit 16 acquires biological information of the subject 103 based on the obtained biological signal.

[0063] The information processing device 10 may repeatedly perform steps S20 to S27 to acquire biological information of the subject continuously in time.

[0064] (Other Examples) This embodiment can also be realized by a process in which a program for realizing one or more functions of the above-mentioned embodiment is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) for realizing one or more functions.

[0065] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention.

[0066] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention.

[0067] The embodiments of the present invention include the following configurations, methods, and programs.

[0068] [Configuration 1] An information processing device for acquiring biological information of a subject based on at least one moving image obtained by imaging the subject using a plurality of imaging devices with different imaging areas, A first acquisition unit that acquires the at least one video image; A second acquisition unit that acquires information regarding a change in the imaging environment; a selection unit that selects an imaging device to be used for acquiring the biometric information from the plurality of imaging devices based on the information; and a third acquisition unit that acquires biological information of the subject based on a moving image obtained by using a selected imaging device.

[0069] [Configuration 2] 2. The information processing device according to configuration 1, wherein the second acquisition unit acquires, as the information, a control signal for controlling an inspection device for inspecting the object or an illumination device for illuminating the object.

[0070] [Configuration 3] 2. The information processing apparatus according to configuration 1, wherein the second acquisition unit acquires information relating to an operation of an inspection apparatus for inspecting the subject from the inspection apparatus as the information.

[0071] [Configuration 4] 2. The information processing device according to configuration 1, wherein the second acquisition unit acquires, as the information, information relating to an operation of an illumination device for illuminating the subject from the illumination device.

[0072] [Configuration 5] the plurality of imaging devices include an imaging device having an imaging element capable of detecting light having a wavelength in the infrared range, The information processing device according to configuration 4, wherein the selection unit selects an imaging device having an imaging element capable of detecting light with wavelengths in the infrared range when an amount of illumination light irradiated to the subject is reduced by operation of the illumination device.

[0073] [Configuration 6] 2. The information processing device according to configuration 1, wherein the second acquisition unit acquires the information based on the moving image.

[0074] [Configuration 7] 7. The information processing device according to configuration 6, wherein the second acquisition unit acquires the information based on the moving image.

[0075] [Configuration 8] 8. The information processing device according to configuration 6 or 7, wherein the second acquisition unit detects a change in luminance value over time in the moving image as the information.

[0076] [Configuration 9] a setting unit that sets a region including the subject in the moving image as a region of interest, 9. The information processing apparatus according to any one of configurations 1 to 8, wherein the third acquisition unit acquires biological information of the subject based on the region of interest in the moving image.

[0077] [Configuration 10] The information processing device according to configuration 2, wherein the selection unit selects a plurality of imaging devices for imaging a skin region of the subject based on the information on the subject, and selects an imaging device for acquiring biological information based on a region of the subject in a plurality of moving images acquired by the plurality of imaging devices.

[0078] [Configuration 11] 11. The information processing device according to configuration 10, wherein the selection unit selects an imaging device having a large number of pixels in a skin region of the subject in a plurality of moving images acquired by the plurality of imaging devices.

[0079] [Configuration 12] 12. The information processing device according to configuration 10 or 11, wherein the selection unit selects an imaging device capable of imaging a body region of the subject having a high predetermined priority.

[0080] [Configuration 13] 13. The information processing device according to any one of configurations 1 to 12, wherein the biological information includes at least one of a pulse rate, a blood pressure, a respiratory rate, a heart rate, and an oxygen saturation level of the subject.

[0081] [Configuration 14] 14. An imaging apparatus comprising: the information processing apparatus according to any one of configurations 1 to 13; and an imaging element for imaging the subject.

[0082] [Configuration 15] An information acquisition system having the information processing device according to any one of configurations 1 to 13 and an inspection device capable of communicating with the information processing device, The information acquisition system according to the present invention is characterized in that the inspection device has a transmission unit that transmits the information to the information processing device in response to an operation of the inspection device.

[0083] [Configuration 16] An information acquisition system including the information processing device according to any one of configurations 1 to 13 and the plurality of imaging devices capable of communicating with the information processing device, 2. An information acquisition system, comprising: a plurality of imaging devices each having a transmission unit for transmitting a moving image to the information processing device.

[0084] [Method 1] 1. An information processing method for acquiring biological information of a subject based on at least one moving image obtained by imaging the subject using a plurality of imaging devices with different imaging areas, comprising: acquiring said at least one motion picture; acquiring information regarding a change in an imaging environment; selecting an imaging device to be used for acquiring the biometric information from the plurality of imaging devices based on the information; and acquiring biological information of the subject based on a moving image obtained using a selected imaging device.

[0085] [Program 1] A program for causing a computer to execute the information processing method according to method 1.

[0086] [Configuration 17] An inspection device communicably connected to the information processing device according to any one of configurations 1 to 13, The inspection device includes: An inspection unit for inspecting the subject; an imaging unit having an imaging element for imaging the subject; and a transmitting unit configured to transmit information regarding a change in the imaging environment to the information processing device. [Explanation of symbols]

[0087] 10. Information processing device 11 First acquisition part 12 Selection section 13 Second acquisition part 16 Third acquisition part

Claims

1. An information processing device that acquires biological information of a subject based on at least one moving image obtained by imaging the subject using a plurality of imaging devices with different imaging areas, A first acquisition unit that acquires the at least one moving image; A second acquisition unit that acquires information regarding a change in the imaging environment; a selection unit that selects an imaging device to be used for acquiring the biometric information from the plurality of imaging devices based on the information; and a third acquisition unit that acquires biological information of the subject based on a moving image obtained by using a selected imaging device.

2. The information processing apparatus according to claim 1 , wherein the second acquisition unit acquires, as the information, a control signal for controlling an inspection device for inspecting the object or an illumination device for illuminating the object.

3. The information processing apparatus according to claim 1 , wherein the second acquisition unit acquires information relating to an operation of an inspection apparatus for inspecting the subject from the inspection apparatus as the information.

4. The information processing apparatus according to claim 1 , wherein the second acquisition unit acquires, as the information, information relating to an operation of an illumination device for illuminating the subject from the illumination device.

5. the plurality of imaging devices include an imaging device having an imaging element capable of detecting light having a wavelength in the infrared range, 5. The information processing device according to claim 4, wherein the selection unit selects an imaging device having an imaging element capable of detecting light with wavelengths in the infrared range when an amount of illumination light irradiated to the subject is reduced by operation of the illumination device.

6. The information processing apparatus according to claim 1 , wherein the second acquisition unit acquires the information based on the moving image.

7. The information processing apparatus according to claim 6 , wherein the second acquisition unit acquires the information based on the moving image.

8. The information processing apparatus according to claim 6 , wherein the second acquisition unit detects a change in luminance value over time in the moving image as the information.

9. a setting unit that sets a region including the subject in the moving image as a region of interest, The information processing apparatus according to claim 1 , wherein the third acquisition unit acquires biological information of the subject based on the region of interest in the moving image.

10. The information processing device according to claim 2, characterized in that the selection unit selects a plurality of imaging devices that image a skin area of ​​the subject based on the information on the subject, and selects an imaging device that acquires biological information based on a region of the subject in a plurality of moving images acquired by the plurality of imaging devices.

11. The information processing apparatus according to claim 10 , wherein the selection unit selects an imaging device having a large number of pixels in a skin region of the subject in a plurality of moving images acquired by the plurality of imaging devices.

12. The information processing apparatus according to claim 10 , wherein the selection unit selects an imaging device capable of imaging a body region of the subject having a predetermined high priority.

13. 9. The information processing apparatus according to claim 1, wherein the biological information includes at least one of a pulse rate, a blood pressure, a respiratory rate, a heart rate, and an oxygen saturation level of the subject.

14. 9. An imaging apparatus comprising: the information processing apparatus according to claim 1; and an imaging element for imaging the subject.

15. 9. An information acquisition system comprising: an information processing device according to claim 1; and an inspection device capable of communicating with the information processing device, The information acquisition system according to the present invention is characterized in that the inspection device has a transmission unit that transmits the information to the information processing device in response to an operation of the inspection device.

16. 9. An information acquisition system comprising: the information processing device according to claim 1; and the plurality of imaging devices capable of communicating with the information processing device, 2. An information acquisition system, comprising: a plurality of imaging devices each having a transmission unit for transmitting a moving image to the information processing device.

17. 1. An information processing method for acquiring biological information of a subject based on at least one moving image obtained by imaging the subject using a plurality of imaging devices with different imaging areas, comprising: acquiring said at least one motion picture; acquiring information regarding a change in an imaging environment; selecting an imaging device to be used for acquiring the biometric information from the plurality of imaging devices based on the information; and acquiring biological information of the subject based on a moving image obtained using a selected imaging device.

18. A program for causing a computer to execute the information processing method according to claim 17.

19. An inspection device communicably connected to the information processing device according to any one of claims 1 to 8, The inspection device includes: An inspection unit for inspecting the subject; an imaging unit having an imaging element for imaging the subject; and a transmitting unit configured to transmit information regarding a change in the imaging environment to the information processing device.

Images