Image analysis device, pulse wave detection device, and image analysis method

Abstract

To improve detection accuracy of a pulse wave by a method different from conventional methods.SOLUTION: In an image analysis apparatus (10), a region of interest detection unit (11) detects a region of interest of a living body (900) from an image including the living body (900) based on a predetermined algorithm. A pulse wave detection unit (12) reduces an influence of a specific high-luminance pixel with a pixel value equal to or larger than a pixel value threshold in a plurality of pixels included in the region of interest and thereafter detects the pulse wave of the living body (900) based on the time change of the pixel values of the pixels.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The following disclosure relates to an image analyzing device that detects a pulse wave of a living body by analyzing an image showing the living body. [Background technology]

[0002] As an example of a device for detecting a pulse wave of a living body, a pulse wave detection device that detects a pulse wave based on an output value (pixel value) of an imaging element (light receiving element) is known. However, it is known that in such a pulse wave detection device, the detection accuracy of the pulse wave can be reduced due to saturation of the pixel value. Therefore, Patent Document 1 proposes a technology aimed at improving the detection accuracy of the pulse wave. Specifically, Patent Document 1 discloses a method of controlling a liquid crystal filter so as to suppress the amount of light received by the imaging element below a saturation level. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2008-301934 A Summary of the Invention [Problem to be solved by the invention]

[0004] Recently, a technology has been proposed in which an image of a living body is captured by an imaging device and the captured image is analyzed to detect a pulse wave. However, as described below, Patent Document 1 does not take into consideration any specific method for improving the accuracy of detecting a pulse wave based on such image analysis. An object of one aspect of the present disclosure is to improve the accuracy of detecting a pulse wave by a method different from the conventional one. [Means for solving the problem]

[0005] In order to solve the above problems, a video analysis device according to one embodiment of the present disclosure includes a region of interest detection unit that detects a region of interest of a living body from a video image showing the living body based on a predetermined algorithm, and a pulse wave detection unit that detects pulse waves of the living body based on changes in pixel values ​​of the plurality of pixels included in the region of interest based on time, after reducing the influence of specific high-luminance pixels having pixel values ​​equal to or greater than a pixel value threshold among the plurality of pixels included in the region of interest.

[0006] Moreover, a video analysis method according to one aspect of the present disclosure includes a region of interest detection step of detecting a region of interest of a living body from a video image showing the living body based on a predetermined algorithm, and a pulse wave detection step of detecting a pulse wave of the living body based on a change over time in pixel values ​​of a plurality of pixels included in the region of interest after reducing an influence of a specific high-luminance pixel having a pixel value equal to or greater than a pixel value threshold. Effect of the Invention

[0007] According to one aspect of the present disclosure, it is possible to improve the accuracy of detecting pulse waves by using a method different from the conventional method. [Brief description of the drawings]

[0008] [Figure 1] 1 is a block diagram showing a configuration of a main part of a pulse wave detecting device according to a first embodiment. [Diagram 2] 4A and 4B are diagrams illustrating an example of the arrangement of red, green, and blue color filters in a color filter portion. [Diagram 3] 4 is a diagram showing an example of a region of interest detected by a region of interest detection unit; FIG. [Figure 4] 11A and 11B are diagrams illustrating an example of an interpolation process for missing pixel values ​​in each color channel image. [Diagram 5] FIG. 13 is a diagram showing an example of a synthesis process of each color channel image after interpolation. [Figure 6] FIG. 13 is a diagram illustrating an example of how a pixel value changes over time in a full-color region-of-interest image. [Figure 7]FIG. 2 shows an example of classification of each pixel in a full-color region-of-interest image at a given time. [Figure 8] FIG. 13 shows another example of classification of each pixel in a full-color region-of-interest image at a given time. [Figure 9] FIG. 13 is a diagram for explaining a pixel value threshold value in a modified example of the first embodiment. [Figure 10] FIG. 11 is a block diagram showing the configuration of the main parts of a pulse wave detecting device according to a second embodiment. [Figure 11] 11A and 11B are diagrams illustrating an example of a process for setting each pixel value in each color low resolution channel image. [Figure 12] FIG. 13 is a diagram showing an example of a synthesis process of low-resolution channel images of each color. [Figure 13] FIG. 11 is a block diagram showing the configuration of a main part of a pulse wave detecting device according to a third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] [Embodiment 1] A pulse wave detection device 1 according to the first embodiment will be described below. For convenience of explanation, the same reference numerals will be given to components having the same functions as those described in the first embodiment in the following embodiments, and the explanations thereof will not be repeated. For simplicity, the explanations of matters similar to those in the known art will also be omitted as appropriate.

[0010] Please note that each configuration and each numerical value described in this specification is merely an example unless otherwise specified. Therefore, unless otherwise specified, the positional relationship of each member is not limited to the example of each figure. Also, please note that each drawing is for explaining the shape, structure, and positional relationship of each member in a schematic manner, and is not necessarily drawn as it actually is. In this specification, the description "A to B" regarding two numbers A and B means "greater than or equal to A and less than or equal to B" unless otherwise specified.

[0011] (Overview of Pulse Wave Detection Device 1) FIG. 1 is a block diagram showing the configuration of the main parts of a pulse wave detection device 1. The pulse wave detection device 1 detects the pulse wave of a living organism 900 (e.g., a human). The pulse wave detection device 1 is an example of a non-contact type pulse wave detection device. Hereinafter, the pulse wave of the living organism H will be simply referred to as the pulse wave. The pulse wave detection device 1 includes a video analysis device 10 and an imaging device 50 (e.g., a camera). The video analysis device 10 and the imaging device 50 are connected so as to be able to communicate with each other.

[0012] The imaging device 50 captures a video (moving image) showing the living body H. Specifically, the imaging device 50 captures images (still images) that constitute the video for each frame period. In the first embodiment, the imaging device 50 is an RGB (Red, Green, Blue) camera. Therefore, the video in the first embodiment is an RGB color video. The imaging device 50 includes a color filter unit 51 and an imaging unit 52.

[0013] The color filter unit 51 includes a red color filter 511R, a green color filter 511G, and a blue color filter 511B. The imaging unit 52 includes a plurality of imaging elements 520 arranged in an array. The imaging elements 520 are known image sensors. The imaging elements 520 receive light (e.g., external light) that arrives from the living body 900 and passes through the color filter unit 51.

[0014] The imaging element 520 is also referred to as a pixel of the imaging device 50. For this reason, in this specification, the imaging element 520 is also referred to as an imaging pixel. W×H imaging pixels are arranged in the imaging section 52. W represents the number of imaging pixels in the horizontal direction (imaging pixels per row), and H represents the number of imaging pixels in the vertical direction (imaging pixels per column). The imaging pixels output, as pixel values ​​(gradation values), signal values ​​(e.g., current values) of electric signals indicating the intensity (e.g., luminance) of light received by the imaging pixels themselves. More specifically, the imaging pixels output pixel values ​​as analog values.

[0015] In the imaging device 50, an AD converter (not shown) converts the pixel values ​​as analog values ​​into digital values. Then, the imaging device 50 outputs a digital image (an image having digital pixel values). As an example, the pixel values ​​in the first embodiment are sampled as 8-bit digital values. Therefore, the pixel values ​​in the first embodiment are in the range of 0 to 255.

[0016] 2 is a diagram showing an example of the arrangement of red color filters 511R, green color filters 511G, and blue color filters 511B in the color filter section 51. In the imaging device 50, the red color filters 511R, green color filters 511G, and blue color filters 511B are arranged in one-to-one correspondence with the imaging elements 520. One red color filter 511R is arranged so as to cover one imaging element 520. One green color filter 511G is arranged so as to cover another imaging element 520. One blue color filter 511B is arranged so as to cover yet another imaging element 520.

[0017] 2, in the first embodiment, a red color filter 511R, a green color filter 511G, and a blue color filter 511B are arranged in a Bayer array. In the color filter section 51 in the example of FIG. 2, color filter units 510 corresponding to four (two in the horizontal direction × two in the vertical direction) imaging pixels are defined.

[0018] One color filter unit 510 includes (i) one red color filter 511R, (ii) two green color filters 511G (green color filters 511G1 and 511G2), and (iii) one green color filter 511B. In the color filter section 51, the multiple color filter units 510 are repeatedly arranged in the horizontal and vertical directions. In this manner, in the color filter section 51, the red color filter 511R, the green color filter 511G, and the blue color filter 511B are arranged in a mosaic pattern (more specifically, in a checkered pattern) with a number ratio of 1:2:1.

[0019] In this specification, an imaging pixel corresponding to the red color filter 511R is referred to as a red imaging pixel. One red imaging pixel receives light (red light) that has passed through the red color filter 511R, and outputs a red pixel value (R pixel value) that indicates the intensity of the red light. Also, an imaging pixel corresponding to the green color filter 511G is referred to as a green imaging pixel. One green imaging pixel receives light (green light) that has passed through the green color filter 511G, and outputs a green pixel value (G pixel value) that indicates the intensity of the green light. Also, an imaging pixel corresponding to the blue color filter 511B is referred to as a blue imaging pixel. One blue imaging pixel receives light (blue light) that has passed through the blue color filter 511B, and outputs a blue pixel value (B pixel value) that indicates the intensity of the blue light.

[0020] The imaging unit 52 generates (i) an R channel image IMGR (an image showing the distribution of R pixel values ​​output by a plurality of red imaging pixels), (ii) a G channel image IMGRG (an image showing the distribution of G pixel values ​​output by a plurality of green imaging pixels), and (iii) a B channel image IMGB (an image showing the distribution of B pixel values ​​output by a plurality of blue imaging pixels) for each video frame period. IMGR, IMGG, and IMGB all have a resolution W×H. Then, the imaging unit 52 generates an image IMG as a mosaic-like RGB color image by combining IMGR, IMGG, and IMGB. In other words, the imaging unit 52 generates IMG as a RAW image.

[0021] As described above, the imaging unit 52 generates IMG as a RAW image for each frame constituting the video. The imaging unit 52 then generates a video (RAW video) by arranging each generated frame in the order of frame number. The imaging unit 52 supplies the generated video to the video analysis device 10.

[0022] Video analysis device 10 includes region of interest detection section 11 and pulse wave detection section 12. Video analysis device 10 detects pulse waves by analyzing video acquired from imaging device 50. More specifically, video analysis device 10 detects pulse waves by analyzing each frame of the video (each of a plurality of IMGs).

[0023] Region of interest detection unit 11 detects a region of interest (ROI) from IMG based on a predetermined algorithm (e.g., using a known algorithm). A region of interest is a partial region of IMG in which a predetermined part of a living body 900 is shown. FIG. 3 is a diagram showing an example of a region of interest detected by region of interest detection unit 11. In the following description, the region of interest in the example of FIG. 3 is referred to as region of interest 910.

[0024] The IMG in the example of Fig. 3 is an image showing the entire face of the living body 900. In the example of Fig. 3, one cheek of the face is set in advance as a predetermined part. First, region of interest detection unit 11 detects a face region (a region showing the face of the living body 900) from the IMG. Then, region of interest detection unit 11 detects a region within the face region showing one cheek as region of interest 910. Region of interest 910 in the example of Fig. 3 is a rectangular region.

[0025] However, as will be apparent to those skilled in the art, the predetermined portion does not need to be limited to the cheek, but may be any portion from which information regarding blood vessels of the living body 900 can be extracted. Other examples of the predetermined portion include the forehead, the root of the nose, the neck, the fingertips, and the palm. The region of interest may be any image region that expresses a change in color of the skin of the living body over time. The number of regions of interest is not necessarily limited to one. Thus, the IMG is not limited to the example of FIG. 3.

[0026] Pulse wave detection unit 12 detects a pulse wave based on changes over time in pixel values ​​of multiple pixels included in region of interest 910. As an example, pulse wave detection unit 12 calculates, for each frame, (i) an average value Rave of R pixel values ​​included in region of interest 910, (ii) an average value Gave of G pixel values ​​included in region of interest 910, and (iii) an average value Bave of B pixel values ​​included in region of interest 910. In other words, pulse wave detection unit 12 derives time series data for each of Rave, Gave, and Bave.

[0027] The pulse wave detection unit 12 may then detect (derive) the pulse wave by analyzing the time series data using a known algorithm. As an example, the pulse wave detection unit 12 may detect the pulse wave using the method disclosed in International Publication WO2020 / 090348.

[0028] However, when pixel values ​​are saturated within the region of interest 910, the accuracy of pulse wave detection by pulse wave detection unit 12 may decrease. Such pixel value saturation may occur, for example, when the brightness of external light is high. Therefore, in the first embodiment, as described below, pulse wave detection unit 12 detects a pulse wave after reducing the influence of pixels in which pixel values ​​are saturated (hereinafter referred to as saturated pixels) among the pixels included in region of interest 910.

[0029] In this specification, "saturation of pixel values" means that the pixel value is a predetermined maximum value that can be set in an image (more precisely, digital image data). As described above, in the first embodiment, the pixel value is sampled as an 8-bit digital value. Therefore, in the first embodiment, "saturation of pixel values" means that the pixel value is 255. In contrast, in the first embodiment, "non-saturation of pixel values" means that the pixel value is 0 to 254. For the above reasons, a saturated pixel in the first embodiment is a pixel having a pixel value of 255. Therefore, in the first embodiment, the pixel value of 255 is also referred to as a saturated pixel value. Note that the pixel value in the above description refers to any one of the R pixel value, the G pixel value, and the B pixel value.

[0030] (Example of Processing of Pulse Wave Detection Unit 12 in Embodiment 1) Fig. 4 and Fig. 5 are diagrams for explaining an example of processing by the pulse wave detection unit 12. As described below, Fig. 4 shows an example of an interpolation process for missing pixel values ​​in each color channel image. Fig. 5 shows an example of a synthesis process for each color channel image after interpolation.

[0031] The pulse wave detection unit 12 decomposes the image of the region of interest 910 as a RAW image (hereinafter referred to as a region of interest RAW image) into a region of interest R channel image IMGR1, a region of interest G channel image IMGG1, and a region of interest B channel image IMGB1. FIG. 4 shows examples of IMGR1, IMGG1, and IMGB1. In the following, for example, the pixel in the i-th row and j-th column in IMGR1 is represented as IMGR1(i,j). The pixel value of the pixel is also represented as IMGR1(i,j).

[0032] As shown in Fig. 4, IMGR1 has pixels with missing pixel values. Hereinafter, pixels with missing pixel values ​​are referred to as missing pixels. The missing pixels in IMGR1 are (i) pixels at positions corresponding to green imaging pixels, and (ii) pixels at positions corresponding to blue imaging pixels. On the other hand, pixels with no missing pixel values ​​are referred to as non-missing pixels. The non-missing pixels in IMGR1 are pixels at positions corresponding to red imaging pixels.

[0033] Pulse wave detection unit 12 generates an interpolated R channel image of the region of interest IMGR2 by interpolating missing pixel values ​​(pixel values ​​of missing pixels) in IMGR1 using non-missing pixel values ​​(pixel values ​​of non-missing pixels) in IMGR1. That is, pulse wave detection unit 12 generates IMGR2 by demosaicing IMGR1 (more specifically, color demosaicing).

[0034] As an example, consider IMGR1(2,2) as a pixel of interest in IMGR1. In the example of Fig. 4, IMGR1(2,2) is a missing pixel. Pulse wave detection unit 12 may interpolate the pixel value of a missing pixel (e.g., IMGR1(2,2)) using non-missing pixel values ​​in a 3x3 rectangular area centered on the missing pixel. In other words, pulse wave detection unit 12 may use the non-missing pixel values ​​to set the pixel value of IMGR2 at the position corresponding to the missing pixel.

[0035] In the example of Fig. 4, IMGR1(1,1), IMGR1(1,3), IMGR1(3,1), and IMGR1(3,3) are non-missing pixel values ​​in the rectangular region. Therefore, pulse wave detection unit 12 sets IMGR2(2,2) using these four non-missing pixel values. As an example, pulse wave detection unit 12 may set IMGR2(2,2) by linear interpolation using the four non-missing pixel values.

[0036] In the example of FIG. 4, the pulse wave detection unit 12 sets IMGR2(2,2) as the average value of the four non-defective pixel values. That is, the pulse wave detection unit 12 IMGR2(2,2) ={IMGR2(1,1)+IMGR2(1,3) +IMGR2(3,1)+IMGR2(3,3)} / 4 …(1) IMGR2(2,2) is set as follows. Other non-missing pixel values ​​may be interpolated in the same manner as in the above example. For the interpolation when the pixel of interest is a non-missing pixel, see the example of IMGB1 described later.

[0037] Similarly, the pulse wave detection unit 12 generates an interpolated region of interest G channel image IMGG2 by demosaicing IMGG1. As an example, consider IMGG1(2,2) as a pixel of interest in IMGG1. IMGG1(2,2) in the example of FIG. 4 is also a missing pixel, like IMGR1(2,2).

[0038] Pulse wave detection unit 12 sets IMGR2(2,2) using non-missing pixel values ​​in a 3×3 rectangular region centered on IMGG1(2,2). In the example of FIG. 4, IMGG1(1,2), IMGG1(2,1), IMGG1(2,3), and IMGG1(3,2) are the non-missing pixel values ​​in the rectangular region. In the example of FIG. 4, pulse wave detection unit 12 IMGG2(2,2) ={IMGG1(1,2)+IMGG1(2,1) +IMGG1(2,3)+IMGG1(3,2)} / 4 …(2) Set IMGG2(2,2) as the image.

[0039] Similarly, the pulse wave detection unit 12 generates an interpolated region of interest B channel image IMGB2 by demosaicing IMGB1. As an example, consider IMGB1(2,2) as a pixel of interest in IMGB1. IMGB1(2,2) in the example of FIG. 4 is a non-defective pixel, unlike IMGR1(2,2) and IMGG1(2,2).

[0040] If the pixel of interest is a non-defective pixel, the pulse wave detection unit 12 sets the pixel value of the non-defective pixel as the pixel value of the IMGB2 at the position corresponding to the non-defective pixel. IMGB2(2,2) = IMGB1(2,2) …(3) Then, set IMGB2(2,2).

[0041] As described above, pulse wave detection unit 12 generates IMGR2, IMGG2, and IMGB2 that do not have non-defective pixels by demosaicing IMGR1, IMGG1, and IMGB1, respectively. IMGR2, IMGG2, and IMGB2 generated as described above each have a resolution of W×H.

[0042] Next, the pulse wave detection unit 12 generates a full-color image IMG2 of the region of interest having a resolution of W×H by combining IMGR2, IMGG2, and IMGB2. An example of IMG2 is shown in Fig. 5. As shown in Fig. 5, IMG2 is a full-color RGB image. A full-color RGB image is an image in which all pixels in the image have three pixel values, an R pixel value, a G pixel value, and a B pixel value. Hereinafter, the three pixel values ​​are collectively referred to as RGB pixel values.

[0043] Specifically, the pulse wave detection unit 12 IMG2(i,j) ={IMGR2(i,j),IMGG2(i,j),IMGB2(i,j)}…(4) The R pixel value, G pixel value, and B pixel value of IMG2(i,j) are set as follows. In the example of Fig. 5, IMGR2(2,2) = 80, IMGG2(2,2) = 130, and IMGB2(2,2) = 200. Therefore, the pulse wave detection unit 12 sets IMG2(2,2) as IMG2(2,2) = (80, 130, 200).

[0044] IMG2 is a full-color RGB image, and therefore contains more color information than the region of interest RAW image. In other words, IMG2 contains more information about the blood vessels of the living body 900. Therefore, by detecting a pulse wave based on IMG2, it is possible to improve the accuracy of detecting the pulse wave.

[0045] Therefore, in the first embodiment, it is preferable that the pulse wave detection unit 12 calculates Rave, Gave, and Bave for each frame using the pixel values ​​(RGB pixel values) of each pixel included in IMG 2. In this way, it is preferable that the pulse wave detection unit 12 derives time series data of Rave, Gave, and Bave based on IMG 2. Then, the pulse wave detection unit 12 detects the pulse wave by analyzing the time series data.

[0046] Additionally, in the first embodiment, the pulse wave detection unit 12 detects a pulse wave after reducing the influence of saturated pixels included in IMG2. Saturated pixels are an example of specific high luminance pixels (described later) according to one aspect of the present disclosure. As an example, the pulse wave detection unit 12 determines (identifies) pixels in IMG2 that have a pixel value equal to or greater than a pixel value threshold Lth as specific high luminance pixels.

[0047] In the first embodiment, Lth is set as a value indicating saturation of pixel values. That is, Lth is set as a value equal to a saturated pixel value. Specifically, Lth is set as 255. For this reason, Lth in the first embodiment may be referred to as a saturation threshold. Hereinafter, Lth as the saturation threshold will be represented as Lth1. In the first embodiment, the pulse wave detection unit 12 determines, among the pixels in IMG2, pixels having a pixel value equal to Lth1 (i.e., pixels having a pixel value of 255) as saturated pixels.

[0048] FIG. 6 is a graph illustrating the change over time in pixel value L of a pixel in IMG2 (e.g., IMG2(2,2)). L is any one of the R pixel value, G pixel value, and B pixel value. In the example of FIG. 6, L is the B pixel value. The horizontal axis in the graph of FIG. 6 is time t. The horizontal axis may be interpreted as frame number.

[0049] 6, L=Lth1 from t1 to t2 (first time range) and from t3 to t4 (second time range). Therefore, pulse wave detection unit 12 determines that IMG2(2,2) is a saturated pixel in the first time range and the second time range. In this case, as an example, pulse wave detection unit 12 calculates Rave, Gave, and Bave without using the R pixel value, G pixel value, and B pixel value of IMG2(2,2) in the first time range and the second time range, respectively.

[0050] However, even if the B pixel value of IMG2(2,2) is saturated, the R pixel value and the G pixel value of IMG2(2,2) may be unsaturated. Therefore, when the B pixel value is saturated and the R pixel value and the G pixel value are unsaturated in IMG2(2,2), the pulse wave detection unit 12 may calculate Rave and Gave using the R pixel value and the G pixel value of IMG2(2,2) in the first time range and the second time range, respectively. It is sufficient for the pulse wave detection unit 12 to calculate the time series data by excluding the pixel value where saturation occurs.

[0051] 7 is a diagram showing an example of classification of each pixel in IMG2 at a certain time (e.g., t1). As described above, the pulse wave detection section 12 identifies saturated pixels 610 based on Lth1. In this case, the pulse wave detection section 12 may further identify pixels in IMG2 excluding the saturated pixels 610 as normal pixels 620. The pulse wave detection section 12 may then detect a pulse wave based on the change in pixel value of the normal pixels 620 over time.

[0052] (effect) As described above, in the technology of Patent Document 1 (an example of a conventional technology), a liquid crystal filter is controlled so as to suppress the amount of light received by an imaging element below a saturation level. However, the technology of Patent Document 1 is premised on a wristwatch-type pulse wave detection device (a contact-type pulse wave detection device). Therefore, in the technology of Patent Document 1, the direction in which light (e.g., external light) is incident on the region of interest is somewhat limited. For this reason, Patent Document 1 proposes a method for controlling a liquid crystal filter based on the premise that the direction of external light is specified in advance.

[0053] However, in a pulse wave detection device that detects pulse waves by analyzing an image captured by an imaging device (for convenience, referred to as an "image analysis-based pulse wave detection device"), external light is generally incident on the region of interest from many different directions. Therefore, in an image analysis-based pulse wave detection device, unlike the technology of Patent Document 1, it is difficult to specify in advance the direction in which external light will be incident on the region of interest.

[0054] Therefore, even if the technology of Patent Document 1 is adopted in a pulse wave detection device based on image analysis, it is not possible to appropriately control the amount of light received by the image sensor. In other words, even if the technology of Patent Document 1 is adopted in a pulse wave detection device based on image analysis, it is not possible to suppress the occurrence of saturated pixels in the region of interest. As described above, in the past, no consideration was given to a method for improving the detection accuracy of pulse waves in a pulse wave detection device based on image analysis.

[0055] On the other hand, as described above, pulse wave detection device 1 (more specifically, video analysis device 10) can detect pulse waves after reducing the influence of saturated pixels in the region of interest. Therefore, even if saturated pixels exist in the region of interest, it is possible to prevent a decrease in pulse wave detection accuracy. Therefore, unlike the technology of Patent Document 1, it is possible to improve pulse wave detection accuracy even if the direction of external light is not specified in advance. As described above, pulse wave detection device 1 can improve pulse wave detection accuracy by a method different from conventional methods.

[0056] [Modifications] (1) Fig. 8 is a diagram showing another example of classification of pixels in IMG2 at a certain time (e.g., t1). In the example of Fig. 8, similarly to the above-mentioned Fig. 6, a saturated pixel 610 is specified by the pulse wave detection section 12. The pulse wave detection section 12 may further specify pixels located around the saturated pixel 610 as surrounding pixels 615.

[0057] As an example, the pulse wave detection unit 12 may identify pixels within IMG2 that are within a predetermined distance range from the saturated pixel 610 as the surrounding pixels 615. In the example of Fig. 8, the pulse wave detection unit 12 identifies pixels adjacent to the saturated pixel 610 (pixels spaced one pixel apart) as the surrounding pixels 615. In the example of Fig. 8, the distance between pixels is defined as an 8-neighborhood distance (chessboard distance). However, it goes without saying that in one embodiment of the present disclosure, the definition of the distance between pixels is not limited to the example of Fig. 8.

[0058] 8, the pulse wave detection section 12 further specifies, from each pixel of IMG2, pixels excluding the saturated pixels 610 and the surrounding pixels 615, as normal pixels 620A. The pulse wave detection section 12 may then detect a pulse wave based on the change over time in the pixel value of the normal pixels 620A.

[0059] In many cases, the local distribution of pixel values ​​in an image has a certain degree of continuity. Therefore, even if the peripheral pixels 615 are not saturated pixels at a certain time, they are expected to be pixels that are highly likely (possible) to change to saturated pixels as time progresses. Therefore, as shown in FIG. 8, the pulse wave detection unit 12 may exclude not only the saturated pixels 610 but also the peripheral pixels 615 to specify the normal pixels 620A. This makes it possible to detect the pulse wave after reducing the influence of not only the saturated pixels 610 but also the peripheral pixels 615. As a result, it becomes possible to further improve the detection accuracy of the pulse wave.

[0060] (2) As described above, in one aspect of the present disclosure, the pulse wave detection unit 12 may detect a pulse wave based on a change in pixel value of a normal pixel over time. However, if the number of normal pixels is too small, there is a concern that the pulse wave may be detected with insufficient (low) accuracy.

[0061] Therefore, the pulse wave detection unit 12 may stop detecting the pulse wave when the number of normal pixels is less than the pixel number threshold. In other words, the pulse wave detection unit 12 may detect the pulse wave only when the number of normal pixels is equal to or greater than the pixel number threshold. Note that the pulse wave detection unit 12 may output notification information indicating that the detection of the pulse wave will be stopped when the number of normal pixels is less than the pixel number threshold. As an example, when the number of normal pixels is less than the pixel number threshold, the pulse wave detection unit 12 may output an error message indicating that "the detection of the pulse wave will be stopped because there is a concern that the pulse wave may not be detected with sufficient accuracy" to a display unit (not shown) of the pulse wave detection device 1.

[0062] According to the above configuration, when the number of normal pixels is less than the pixel number threshold, it is possible to prevent the pulse wave from being detected with insufficient accuracy. The pixel number threshold is not particularly limited, but may be set based on the number of normal pixels that is expected to enable detection of a pulse wave with a relatively high degree of accuracy. As an example, the pixel number threshold may be set to 100.

[0063] (3) As is clear from the above explanations, Lth (pixel value threshold) is not limited to the saturation threshold (Lth1). As an example, Lth may be set as a value indicating a high probability of pixel value saturation. Thus, in this specification, pixels whose pixel values ​​are equal to or greater than Lth are referred to as specific high luminance pixels. Note that in this specification, saturated pixels are also included in the "pixels whose pixel values ​​are highly likely to saturate."

[0064] Hereinafter, Lth in this modified example will be referred to as Lth2. As an example, Lth2 may be set to 230. However, Lth2 is not limited to the above example. Lth2 may be set to a value that is 90% or more and 100% or less of the saturated pixel value. Therefore, when the pixel value is sampled as an 8-bit digital value (when the saturated pixel value is 255), Lth2 may be set to 230 or more and 255 or less.

[0065] Although the specific high luminance pixels are not as significant as saturated pixels, they are considered to contribute to a decrease in the accuracy of pulse wave detection. For this reason, as an example, the pulse wave detection unit 12 may determine pixels whose pixel values ​​are equal to or greater than Lth2 as specific high luminance pixels. Then, the pulse wave detection unit 12 may detect the pulse wave after reducing the influence of the specific high luminance pixels. In this case, the accuracy of pulse wave detection can be further improved. As can be understood from the above explanation, the peripheral pixels in the example of FIG. 8 described above can be said to be another example of specific high luminance pixels.

[0066] Fig. 9 is a diagram for explaining Lth2. Fig. 9 also illustrates the time change of pixel value L of one pixel (e.g., IMG2(2,2)) in IMG2, as in Fig. 6. L in the example of Fig. 9 is also a B pixel value, as in the example of Fig. 6.

[0067] 9, L≧Lth2 holds in (i) tm1 to tm2 (first time range), (ii) tm3 to tm4 (second time range), and (iii) tm5 to tm6 (third time range). Therefore, pulse wave detection unit 12 determines that IMG2(2,2) is a specific high luminance pixel in the first time range, the second time range, and the third time range.

[0068] Therefore, as an example, pulse wave detection unit 12 calculates Rave, Gave, and Bave in the first time range, the second time range, and the third time range, respectively, without using the R pixel value, the G pixel value, and the B pixel value of IMG2(2,2). This allows pulse wave detection unit 12 to detect a pulse wave while reducing the influence of IMG2(2,2), which is a specific high luminance pixel.

[0069] However, even if the B pixel value of IMG2(2,2) is equal to or greater than Lth2, the R pixel value and the G pixel value of IMG2(2,2) may be less than Lth2. Therefore, when the B pixel value of IMG2(2,2) is equal to or greater than Lth2 and the R pixel value and the G pixel value are less than Lth2, the pulse wave detection unit 12 may calculate Rave and Gave using the R pixel value and the G pixel value of IMG2(2,2) in the first time range, the second time range, and the third time range, respectively. In this case, the pulse wave detection unit 12 can detect the pulse wave after reducing the influence of IMG2(2,2), which is a specific high luminance pixel. As described above, the pulse wave detection unit 12 only needs to be able to calculate the time series data by excluding pixel values ​​equal to or greater than Lth2.

[0070] (4) The method of detecting a pulse wave by reducing the influence of specific high-luminance pixels (e.g., saturated pixels) is not limited to the above examples. For example, a pulse wave can be detected without necessarily eliminating the pixel values ​​of saturated pixels.

[0071] As an example, consider a case where the pixels in IMG2 are classified into saturated pixels and normal pixels as shown in FIG. 7 above. In this case, pulse wave detection unit 12 may set different weighting coefficients for saturated pixel values ​​and normal pixel values ​​(hereinafter referred to as normal pixel values). In the following description, the weighting coefficient for saturated pixel values ​​is represented as w1, and the weighting coefficient for normal pixel values ​​is represented as w2. Specifically, pulse wave detection unit 12 sets w1 to a value smaller than w2. w1 and w2 may be referred to as the saturated weighting coefficient and the normal weighting coefficient, respectively.

[0072] Then, the pulse wave detection unit 12 may derive the pulse wave by substituting (i) a weighted saturated pixel value obtained by multiplying the saturated pixel value by w1, and (ii) a weighted normal pixel value obtained by multiplying the normal pixel value by w2, into a predetermined arithmetic expression for deriving the pulse wave. The arithmetic expression is set so that the smaller the weighting coefficient for a pixel value, the smaller the effect of the pixel value on the arithmetic result (pulse wave). As described above, the pulse wave detection unit 12 may detect the pulse wave according to the arithmetic expression using the weighted saturated pixel value and the weighted normal pixel value. This makes it possible to detect the pulse wave while reducing the effect of the saturated pixel value on the pulse wave and taking into account the presence of the saturated pixel value.

[0073] As another example, consider a case where the pulse wave detection unit 12 classifies each pixel in IMG2 into a specific high luminance pixel and a normal pixel based on Lth2. In this case, similar to the above example for saturated pixels, the pulse wave detection unit 12 may set different weighting coefficients for the pixel values ​​of the specific high luminance pixels (hereinafter referred to as specific high luminance pixel values) and the normal pixel values. In the following description, the weighting coefficient for the specific high luminance pixel values ​​is represented as w1a. The pulse wave detection unit 12 sets w1a to a value smaller than w2. w1a may be set to a value equal to w1 or to a value larger than w1. w1a may be referred to as a specific weighting coefficient.

[0074] Then, the pulse wave detection unit 12 may derive the pulse wave by substituting (i) the weighted specific high luminance pixel value, which is the specific high luminance pixel value multiplied by w1a, and (ii) the weighted normal pixel value into the above arithmetic expression. As described above, the pulse wave detection unit 12 may detect the pulse wave according to the above arithmetic expression using the weighted specific high luminance pixel value and the weighted normal pixel value. This makes it possible to detect the pulse wave while reducing the influence of the specific high luminance pixel value on the pulse wave and taking into account the presence of the specific high luminance pixel value.

[0075] As yet another example, consider a case in which the pixels in IMG2 are classified into saturated pixels, peripheral pixels, and normal pixels as shown in FIG. 8 above. In this case, the pulse wave detection unit 12 may set different weighting coefficients for the saturated pixel values, the pixel values ​​of the peripheral pixels (hereinafter referred to as peripheral pixel values), and the normal pixel values. In the following description, the weighting coefficient for the peripheral pixel values ​​is represented as wm. The pulse wave detection unit 12 sets wm to a value smaller than w2 and larger than w1. wm may be referred to as a peripheral weighting coefficient.

[0076] Then, the pulse wave detection unit 12 may derive the pulse wave by substituting (i) the weighted saturated pixel value, (ii) the weighted surrounding pixel value obtained by multiplying the surrounding pixel value by wm, and (iii) the weighted normal pixel value into the above arithmetic expression. As described above, the pulse wave detection unit 12 may detect the pulse wave according to the above arithmetic expression using the weighted saturated pixel value, the weighted surrounding pixel value, and the weighted normal pixel value. This allows the pulse wave to be detected while taking into consideration the difference in the influence that the saturated pixel value and the surrounding pixel value have on the pulse wave.

[0077] [Embodiment 2] 10 is a block diagram showing the configuration of the main parts of pulse wave detection device 2 of embodiment 2. The video analysis device of pulse wave detection device 2 is referred to as video analysis device 10A. Also, the pulse wave detection section of video analysis device 10A is referred to as pulse wave detection section 12A. Pulse wave detection section 12A generates a full-color image of the region of interest by a method different from that of pulse wave detection section 12.

[0078] Fig. 11 and Fig. 12 are diagrams for explaining an example of the processing of the pulse wave detection unit 12A. As described below, Fig. 11 shows an example of the processing for setting each pixel value in each color low resolution channel image. Fig. 11 shows IMGR1, IMGG1, and IMGB1 similar to those in Fig. 4 described above. Fig. 12 shows an example of the processing for synthesizing each color low resolution channel image.

[0079] The pulse wave detection unit 12A generates a low-resolution R channel image IMGR3, a low-resolution G channel image IMGG3, and a low-resolution B channel image IMGB3 by down-converting IMGR1, IMGG1, and IMGB1, respectively. In the example of Fig. 10, the pulse wave detection unit 12A generates IMGR3, IMGG3, and IMGB3 having a resolution of W / 2 x H / 2. That is, the pulse wave detection unit 12A performs down-conversion on each of IMGR1, IMGG1, and IMGB1 to reduce the horizontal resolution and vertical resolution by half.

[0080] As an example, pulse wave detection unit 12A sets one pixel value in IMGR3 using pixel values ​​of each pixel included in a 2×2 rectangular area (hereinafter referred to as a red pixel unit) in IMGR1. One pixel unit corresponds to one color filter unit 510 in FIG. 2 described above. Hereinafter, a pixel unit including four pixels IMGR1(i,j), IMGR1(i,j+1), IMGR1(i+1,j), and IMGR1(i+1,j+1) will be referred to as a red pixel unit Runit(i,j). Pixel units of other colors will be denoted in the same manner.

[0081] According to the arrangement of the color filters in FIG. 2, one Runit in IMGR1 contains only one non-defective pixel. For example, Runit(1,1) contains only IMGR1(1,1) as a non-defective pixel. Therefore, the pulse wave detection unit 12A may set a single non-defective pixel value in one Runit as the pixel value of IMGR3 corresponding to that one Runit. As an example, the pulse wave detection unit 12A may IMGR3(1,1)=IMGR1(1,1) …(5) 10, IMGR1(1,1)=80. Therefore, pulse wave detection unit 12A sets the pixel value of the pixel corresponding to Runit(1,1) as IMGR3(1,1)=80.

[0082] As described above, by setting the pixel value of IMGR3(i,j) so that it corresponds one-to-one with the single non-missing pixel value contained in Runit(i,j), an R channel image IMGR3 having a resolution of W / 2 × H / 2 is generated.

[0083] According to the arrangement of the color filters of each color in FIG. 3, one blue pixel unit Bunit in IMGB1 includes only one non-defective pixel. Therefore, IMGB3 may be generated based on IMGB1, similar to the above example for IMGR3. For example, Bunit(1,1) includes only IMGB1(2,2) as a non-defective pixel. Therefore, the pulse wave detection unit 12A: IMGB3(1,1)=IMGB1(2,2) …(6) Then, IMGB3(1,1) may be set.

[0084] In the example of Fig. 11, IMGB1(2,2) = 180. Therefore, the pulse wave detection unit 12A sets the pixel value of the pixel corresponding to Bunit(1,1) as IMGB3(1,1) = 180. In this manner, by setting the pixel value of IMGB3(i,j) so as to correspond one-to-one with the single non-missing pixel value included in Bunit(i,j), IMGR3, which is a B channel image having a resolution of W / 2 × H / 2, is generated.

[0085] According to the arrangement of the color filters in Fig. 3, one green pixel unit Gunit in IMGG1 includes two non-missing pixels. For example, Gunit(1,1) includes two non-missing pixels IMGG1(1,2) and IMGG1(2,1).

[0086] Therefore, the pulse wave detector 12A may set the average value of the two non-defective pixel values ​​in one Bunit as the pixel value of the IMGB3 corresponding to that pixel unit. IMGG3(1,1)={IMGG1(1,2)+IMGG1(2,1)} / 2 …(7) 11, IMGG1(1,2)=140 and IMGG1(2,1)=150. Therefore, pulse wave detection unit 12A sets the pixel value of the pixel corresponding to Gunit(1,1) as IMGG3(1,1)=145.

[0087] In this way, by setting the pixel value of IMGG3(i,j) so that it corresponds one-to-one with the average value of the two non-missing pixel values ​​contained in Gunit(i,j), a G channel image IMGG3 having a resolution W / 2 × H / 2 is generated.

[0088] As described above, the pulse wave detection unit 12A may set the pixel value of a pixel corresponding to a pixel unit in a low-resolution channel image of a certain color based on a statistical value (e.g., average value) of pixel values ​​of one or more non-missing pixels included in one pixel unit in a channel image of the certain color. This makes it possible to generate a low-resolution channel image of each color without interpolating the non-missing pixel values.

[0089] Next, the pulse wave detection unit 12A generates a low-resolution region of interest full-color image IMG3 having a resolution of W / 2×H / 2 by combining IMGR3, IMGG3, and IMGB3. An example of IMG3 is shown in Fig. 12. IMG3 is a full-color RGB image, similar to the above-mentioned IMG2.

[0090] Specifically, the pulse wave detection unit 12A includes: IMG3(i,j) ={IMGR3(i,j),IMGG3(i,j),IMGB3(i,j)}…(8) The R pixel value, G pixel value, and B pixel value of IMG3(i,j) are set as follows. As described above, IMGR3(1,1) = 80, IMGG2(1,1) = 145, and IMGB3(1,1) = 180. Therefore, pulse wave detection unit 12A sets IMG3(1,1) as IMG3(1,1) = (80, 145, 180).

[0091] Pulse wave detection unit 12A calculates Rave, Gave, and Bave for each frame using the pixel values ​​(RGB pixel values) of each pixel included in IMG 3. In this manner, pulse wave detection unit 12A derives time series data of Rave, Gave, and Bave based on IMG 3. Pulse wave detection unit 12 then detects a pulse wave by analyzing the time series data, similar to embodiment 1.

[0092] As described above, pulse wave detection device 2 can detect a pulse wave based on a full-color image (e.g., IMG3) of a region of interest that is generated without interpolating non-missing pixel values. This makes it possible to detect a pulse wave while eliminating the effects of errors caused by interpolation of non-missing pixel values. Therefore, pulse wave detection device 2 can further improve the accuracy of pulse wave detection.

[0093] [Embodiment 3] 13 is a block diagram showing the configuration of the main parts of pulse wave detection device 3 of embodiment 3. The video analysis device of pulse wave detection device 3 is referred to as video analysis device 10B. Unlike video analysis device 10, video analysis device 10B further includes video storage unit 13. In addition, the pulse wave detection unit of pulse wave detection device 3 is referred to as pulse wave detection unit 12B. Pulse wave detection unit 12B detects pulse waves by a method different from that of pulse wave detection unit 12.

[0094] The video storage unit 13 stores the video generated by the imaging device 50 (more specifically, the imaging unit 52). As an example, the video storage unit 13 stores the RAW video generated by the imaging unit 52. Note that the video storage unit 13 may record only the pixel values ​​of pixels included in the region of interest 910 detected by the region of interest detection unit 11 from the video generated by the imaging unit 52.

[0095] The number of frames of the video stored in the video storage unit 13 may be a predetermined number of frames that has been set in advance. In other words, the time length of the video stored in the video storage unit 13 may be set in advance. As an example, consider a case where the predetermined number of frames is set to 300. In this case, the video storage unit 13 stores each frame of the video generated by the imaging unit 52 until the number of frames of the video reaches 300 frames.

[0096] Note that video storage unit 13 may store the video for a period during which the face region of living organism 900 is detected from the video. For example, video storage unit 13 may start storing the video when a face region is detected from the video by region of interest detection unit 11. Then, video storage unit 13 may end storing the video when a face region is no longer detected from the video by region of interest detection unit 11 (detection of the face region is completed).

[0097] Furthermore, when the position of the face area detected in the video has changed significantly, the video storage unit 13 may terminate storage of the video. Such a large change in the position of the face area may occur, for example, when the living body 900 moves significantly.

[0098] As an example, in region of interest detection unit 11 of the third embodiment, a tolerance threshold for a change in the position of the face region (in other words, a tolerance threshold for the movement of the living body 900) may be set in advance. In this case, when region of interest detection unit 11 determines that the amount of change (amount of movement) in the position of the face region between any two frames of the video (for example, between two adjacent frames) is equal to or greater than the tolerance threshold, video storage unit 13 may terminate storage of the video.

[0099] The allowable threshold may be appropriately set by the designer of the pulse wave detection device 3 based on the size of the living body 900 in real space (more specifically, the size of the face of the living body 900). For example, the allowable threshold may be set to a length of 50 pixels in the image. In this example, the length of 50 pixels is set to a length equivalent to, for example, 5 centimeters in real space.

[0100] Pulse wave detection unit 12B identifies pixels having a pixel value equal to or greater than Lth as specific high-luminance pixels among a plurality of pixels included in region of interest 910 in each frame of the image stored in image storage unit 13. For example, pulse wave detection unit 12B identifies pixels having a pixel value equal to or greater than Lth1 in each frame of the image stored in image storage unit 13 as saturated pixels.

[0101] In this case, for example, pulse wave detection unit 12B derives time series data for each of Rave, Gave, and Bave using only pixel values ​​of pixels identified as normal pixels across all frames of the video stored in video storage unit 13. For example, pulse wave detection unit 12B may derive time series data for each of Rave, Gave, and Bave using only pixel values ​​of pixels identified as non-saturated pixels across all frames of the video stored in video storage unit 13.

[0102] Pulse wave detection unit 12B may derive time series data for each of Rave, Gave, and Bave based on IMG2, as in embodiment 1. Alternatively, pulse wave detection unit 12B may derive time series data for each of Rave, Gave, and Bave based on IMG3, as in embodiment 2.

[0103] In the video stored in the video storage unit 13, the number of pixels included in the region of interest 910 needs to be the same across all frames. Also, it is desirable that each pixel in the video represents color information of the same location of the living body 900 across all frames.

[0104] Therefore, when the living body 900 moves, the image storage unit 13 may generate an image by tracking the same location of the living body 900 using a predetermined image processing technique. Alternatively, the imaging device 50 may be provided with a function for tracking the living body 900. Furthermore, as described above, when the living body 900 moves significantly, the image storage unit 13 may end storage of the image.

[0105] Pulse wave detection device 3 can detect pulse waves using information on pixels of the same number of pixels (e.g., pixel value distribution of the same number of pixels) contained in region of interest 910 across all frames of the video. That is, pulse wave detection device 3 can detect pulse waves while reducing the influence of errors caused by differences in the number of pixels contained in region of interest 910 between frames of the video.

[0106] As described above, the pulse wave detection device 3 reduces the influence of specific high-brightness pixels across all frames of the image stored in the image memory unit 13 (in other words, across the entire duration of the image stored in the image memory unit 13), and then detects pulse waves based on the changes over time in the pixel values ​​of multiple pixels included in the region of interest 910.

[0107] However, as will be clear to those skilled in the art, pulse wave detection device 3 does not necessarily need to reduce the influence of specific high luminance pixels across all frames of the image. Pulse wave detection device 3 only needs to be able to detect a pulse wave based on the time change in pixel values ​​of multiple pixels included in region of interest 910 after reducing the influence of specific high luminance pixels in at least one frame of the image stored in image storage unit 13.

[0108] [Software implementation example] The functions of pulse wave detection devices 1 to 3 (hereinafter referred to as the "devices") can be realized by a program for causing a computer to function as the devices, and by a program for causing a computer to function as each control block of the devices (in particular, each part included in video analysis devices 10 to 10B).

[0109] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The control device and storage device execute the program to realize each function described in each of the above embodiments.

[0110] The program may be non-transitory and may be recorded in one or more computer-readable recording media. The recording media may or may not be included in the device. In the latter case, the program may be provided to the device via any wired or wireless transmission medium.

[0111] In addition, some or all of the functions of each of the control blocks can be realized by a logic circuit. For example, an integrated circuit in which a logic circuit that functions as each of the control blocks is formed is also included in the scope of the present invention. In addition, the functions of each of the control blocks can be realized by, for example, a quantum computer.

[0112] Furthermore, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI ​​may be executed by the control device or another device (for example, an edge computer or a cloud server).

[0113] [Additional Notes] One aspect of the present disclosure is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. An embodiment obtained by appropriately combining the technical means disclosed in each of the different embodiments is also included in the technical scope of one aspect of the present disclosure. Furthermore, by combining the technical means disclosed in each of the embodiments, new technical features can be formed. [Explanation of symbols]

[0114] 1, 2, 3 Pulse wave detector 10, 10A, 10B Video analysis device 11 Region of interest detection section 12, 12A, 12B Pulse wave detector 13 Video storage section 50 Imaging device 51 Color filter section 52 Imaging unit 520 Image sensor 510 Color filter unit 511R Red color filter 511G, 511G1, 511G2 Green color filter 511B Blue color filter 610 Saturated pixels (specific high brightness pixels) 615 surrounding pixels (specific high brightness pixels) 620, 620A Normal pixels (pixels excluding specific high brightness pixels) 900 Living organisms 910 Area of ​​Interest IMG Image (one frame of footage showing a living body) IMG2 Region of interest full color image IMG3 Low-resolution region of interest full color image Lth1 Saturation threshold (pixel value threshold) Lth2 pixel value threshold

Claims

1. a region of interest detection unit that detects a region of interest of a living body from an image showing the living body based on a predetermined algorithm; a pulse wave detection unit that detects a pulse wave of the living body based on a time change in pixel values ​​of a plurality of pixels included in the region of interest after reducing an influence of a specific high luminance pixel having a pixel value equal to or greater than a pixel value threshold, The pulse wave detection unit is Identifying pixels other than the specific high luminance pixel from the plurality of pixels as normal pixels; The image analyzing device detects the pulse wave when the number of the normal pixels is equal to or greater than a pixel number threshold.

2. the pixel value threshold is set as a value indicating a high probability of pixel value saturation occurring; The video analysis device according to claim 1 , wherein the pulse wave detection section identifies, among the plurality of pixels, pixels having a pixel value equal to or greater than the pixel value threshold as the specific high luminance pixel.

3. the pixel value threshold is set to a value equal to a predetermined saturated pixel value; 3. The video analysis device according to claim 2, wherein the pulse wave detection section identifies, as saturated pixels, the specific high luminance pixels, which are pixels among the plurality of pixels and have a pixel value equal to the pixel value threshold value.

4. An image analysis device as described in any one of claims 1 to 3, wherein the pulse wave detection unit detects the pulse wave based on the change in pixel value of the normal pixel over time.

5. The pixel value of the specific high-luminance pixel is referred to as a specific high-luminance pixel value, and the pixel value of the normal pixel is referred to as a normal pixel value, The pulse wave detection unit includes: A specific weighting factor, which is a weighting factor for the specific high luminance pixel value, is set to be smaller than a normal weighting factor, which is a weighting factor for the normal pixel value; and 4. The video analysis device according to claim 1, wherein the pulse wave is detected in accordance with a predetermined arithmetic formula using (i) a weighted specific high-luminance pixel value obtained by multiplying the specific high-luminance pixel value by the specific weighting coefficient, and (ii) a weighted normal pixel value obtained by multiplying the normal pixel value by the normal weighting coefficient.

6. Further comprising a video storage unit for storing the video, 6. The video analysis device according to claim 1, wherein the pulse wave detection unit detects the pulse wave based on changes in pixel values ​​of the plurality of pixels over time after reducing the influence of the specific high-luminance pixels in at least one frame of the video stored in the video storage unit.

7. A video analysis device according to any one of claims 1 to 6, and an imaging device that captures the image.

8. a region of interest detection step of detecting a region of interest of the living body from an image showing the living body based on a predetermined algorithm; and a pulse wave detection step of detecting a pulse wave of the living body based on a time change in pixel values ​​of a plurality of pixels included in the region of interest after reducing an influence of a specific high luminance pixel having a pixel value equal to or greater than a pixel value threshold, The pulse wave detection step includes: identifying pixels, excluding the specific high luminance pixel, from the plurality of pixels as normal pixels; detecting the pulse wave when the number of the normal pixels is equal to or greater than a pixel number threshold.

Images