Image processing device, image processing method, and program
The image processing apparatus and method allow self-measurement of pupillary light reflex by capturing and analyzing eye images, addressing the need for user-friendly daily monitoring without dedicated equipment, achieving accurate results.
Patent Information
- Application Number
- JP2025506279
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-03-13
- Publication Date
- 2026-11-11
- Estimated Expiration
- 2043-03-13
AI Technical Summary
Existing systems for measuring pupillary light reflex require dedicated apparatuses and are not suitable for daily self-care applications where the subject can easily perform the measurement.
An image processing apparatus and method that measures pupillary light reflex by capturing images of a subject's eyes, determining convergence and pupil size changes, and calculating an index based on time-series measurements, allowing self-measurement without specialized equipment.
Enables accurate and user-friendly generation of pupillary light reflex information from images, suitable for daily health monitoring.
Smart Images

Figure 0007948413000001 
Figure 0007948413000002 
Figure 0007948413000003
Abstract
Description
Technical Field
[0001] The present disclosure relates to the technical field of an image processing apparatus, an image processing method, and a storage medium that perform processing related to measurement of pupillary light reflex using images.
Background Art
[0002] Systems that measure the pupil of a subject based on a facial image captured of the subject are known. For example, Patent Document 1 discloses a system that detects the pupil region of a subject based on video signals from two provided cameras, and performs analysis of the pupil area, pupil diameter, pupil position, and the like.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] In general, measurement of pupillary light reflex has required a dedicated apparatus or system. On the other hand, when performing measurement related to pupillary light reflex on a daily basis for purposes such as self-care, it is desirable that the subject himself / herself can easily perform the measurement.
[0005] In view of the above-described problems, one of the objects of the present disclosure is to provide an image processing apparatus, an image processing method, and a storage medium capable of suitably generating information related to the pupillary light reflex of a subject from an image obtained by imaging the subject.
Means for Solving the Problems
[0006] One aspect of the image processing apparatus is: an image obtained by imaging a subject who opened their eyes after closing their eyes The position of the pupil a convergence measurement unit that measures the degree of convergence of the subject after the eye opening, based on the degree of convergence Whether or not there has been a change Based on this, a determination means for determining whether or not there is a change in the subject's focus, If it is determined that there is no change in focus, the pupil of the subject is determined based on the image taken of the subject. size A pupil measurement means for measuring pupil size, A pupillary light reflex calculation means that calculates an index related to the pupillary light reflex of the subject based on the time-series measurement results of the pupillary size, This is an image processing device that has the following features.
[0007] One aspect of the image processing method is: Computers Images of subjects who opened their eyes after closing them. The position of the pupil Based on this, the degree of convergence of the subject after eye opening is measured, The degree of the aforementioned congestion Whether or not there has been a change Based on this, the presence or absence of a change in the subject's focus is determined. If it is determined that there is no change in focus, the pupil of the subject is determined based on the image taken of the subject. size Measure and Based on the time-series measurement results of the pupil size, an index relating to the pupillary light reflex of the subject is calculated. This is an image processing method. Note that "computer" includes any electronic device (which may include a processor contained within an electronic device) and may be composed of multiple electronic devices.
[0008] One aspect of the program is: Images of subjects who opened their eyes after closing them. The position of the pupil Based on this, the degree of convergence of the subject after eye opening is measured, The degree of the aforementioned congestion Whether or not there has been a change Based on this, the presence or absence of a change in the subject's focus is determined. If it is determined that there is no change in focus, the pupil of the subject is determined based on the image taken of the subject. size Measure and Based on the time-series measurement results of the pupil size, an index related to the pupillary light reflex of the subject is calculated. It is a program that instructs a computer to perform a process. [Effects of the Invention]
[0009] It is possible to suitably generate information related to the light reflex of a subject from an image obtained by imaging the subject. [Brief Description of the Drawings]
[0010] [Figure 1] 1 shows a schematic configuration of a light reflex measurement system according to the first embodiment. [Figure 2] This shows a state during light reflex measurement when the light reflex measurement system is a single terminal device. [Figure 3] 1 shows an example of the hardware configuration of an image processing apparatus common to each embodiment. [Figure 4] 2 is an example of functional blocks of the image processing apparatus related to the light reflex measurement processing in the first embodiment. [Figure 5] This is an example of a camera image obtained by imaging the face of a subject. [Figure 6] This is an example of a graph showing temporal changes in pupil size accompanying the light reflex. [Figure 7] This is an example of a flowchart related to the light reflex measurement processing in the first embodiment. [Figure 8] 1 shows a schematic configuration of a light reflex measurement system according to a modified example. [Figure 9] 1 shows a schematic configuration of a light reflex measurement system according to the second embodiment. [Figure 10] 3 is a block diagram of an image processing apparatus according to the third embodiment. [Figure 11] This is an example of a flowchart executed by the image processing apparatus in the third embodiment. [Mode for Carrying Out the Invention]
[0011] Hereinafter, embodiments of an image processing apparatus, an image processing method, and a storage medium will be described with reference to the drawings.
[0012] <First Embodiment> (1) System Configuration Figure 1 shows a schematic configuration of the pupillary light reflex measurement system 100 according to the first embodiment. The pupillary light reflex measurement system 100 is a system that simply measures the pupillary light reflex of a subject 6 based on an image of the subject's face captured by a visible light camera, and mainly comprises an image processing device 1, an input device 2, an output device 3, a storage device 4, and a measurement device 5 including a camera (imaging device) 51. The subject 6 can simply measure their own pupillary light reflex using the pupillary light reflex measurement system 100, for example, for the purpose of managing their health status (including self-care).
[0013] The image processing device 1 measures the pupillary light reflex of the subject 6 based on the facial image of the subject 6 generated by the camera 51 (including video, which is a predetermined number of images obtained in time series; the same applies hereinafter), and outputs the measurement results. The image processing device 1 communicates data with the input device 2, output device 3, storage device 4, and measuring device 5 via a communication network or by direct wireless or wired communication.
[0014] Input device 2 is an interface that accepts user input (manual input). The user who inputs information using input device 2 may be the subject 6 themselves, or a person who manages or supervises subject 6. Input device 2 may be various user input interfaces such as a touch panel, buttons, keyboard, mouse, or voice input device. Input device 2 supplies the input signal generated based on the user's input to the image processing device 1.
[0015] The output device 3 outputs predetermined information based on the output signal supplied from the image processing device 1. In this case, the output signal includes at least one of a display signal or an audio signal. The output device 3 then displays the information based on the display signal supplied from the image processing device 1 and outputs the information as audio based on the audio signal supplied from the image processing device 1. The output device 3 includes, for example, at least one of a display device such as a display or projector and an audio output device such as a speaker.
[0016] The storage device 4 is a memory that stores various information necessary for measuring pupillary light reflectance, etc. The storage device 4 may be an external storage device such as a hard disk connected to or built into the image processing device 1, or it may be a storage medium such as flash memory. The storage device 4 may also be a server device that communicates data with the image processing device 1. Furthermore, the storage device 4 may be composed of multiple devices.
[0017] The measuring device 5 is one or more sensors, including a camera 51 which is a visible light camera. For example, the measuring device 5 may also include an illuminance sensor for detecting changes in light intensity under the environment in which the pupillary light reflectance of the subject 6 is measured. The measuring device 5 supplies the signals measured by each sensor to the image processing device 1. Hereafter, the image generated by the camera 51 will also be referred to as a "camera image". The camera 51 is an example of a "shooting means".
[0018] The configuration of the pupillary light reflectance measurement system 100 shown in Figure 1 is an example, and various modifications may be made to this configuration. For example, the image processing device 1, input device 2, output device 3, storage device 4, and measurement device 5 may all be implemented by a single terminal device such as a smartphone or tablet terminal.
[0019] Figure 2 shows the procedure for measuring pupillary light reflectance when the pupillary light reflectance measurement system 100 is a single terminal device (e.g., a smartphone). As shown in Figure 2, the subject 6 holds the pupillary light reflectance measurement system 100, which is the terminal device, and adjusts the orientation of the terminal device so that their face is included in the shooting range of the camera 51. The pupillary light reflectance measurement system 100 may be fixed to a tripod or the like. Then, in the state shown in Figure 2, the subject 6 follows the instructions (guidance) output by the pupillary light reflectance measurement system 100, closing their eyes for a predetermined time and then opening them, causing the pupillary light reflectance measurement system 100 to perform the measurement.
[0020] (2) Hardware configuration Figure 3 shows the hardware configuration of the image processing device 1. The image processing device 1 includes a processor 11, memory 12, and interface 13 as hardware components. The processor 11, memory 12, and interface 13 are connected via a data bus 90.
[0021] The processor 11 functions as a controller (arithmetic unit) that controls the entire image processing device 1 by executing programs stored in memory 12. The processor 11 is, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or a TPU (Tensor Processing Unit). The processor 11 may consist of multiple processors. The processor 11 is an example of a computer.
[0022] Memory 12 is composed of various volatile and non-volatile memories such as RAM (Random Access Memory), ROM (Read Only Memory), and flash memory. Memory 12 also stores programs for executing processes performed by the image processing device 1. Some of the information stored in memory 12 may be stored in one or more external storage devices capable of communicating with the image processing device 1, or in a storage medium that is removable from the image processing device 1. Furthermore, memory 12 may function as at least part of the storage device 4.
[0023] Interface 13 is an interface for electrically connecting the image processing device 1 with other devices. These interfaces may be wireless interfaces such as network adapters for wirelessly transmitting and receiving data with other devices, or they may be hardware interfaces for connecting with other devices via cables, etc.
[0024] Note that the hardware configuration of the image processing device 1 is not limited to the configuration shown in Figure 3. For example, the image processing device 1 may include at least one of the input device 2, output device 3, storage device 4, and measuring device 5.
[0025] (3) Overview of the pupillary light reflectance measurement process Next, we will explain the pupillary light reflex measurement process, which is a process related to the measurement of pupillary light reflex. In general, the image processing device 1 instructs the subject 6 to close and open their eyes in sequence, and measures the pupil size of the subject 6 over time based on the camera image generated after eye opening. At this time, the image processing device 1 determines whether or not there is a change in focus during the pupil size measurement period by measuring the degree of convergence, and uses the pupil size measurement result when no change in focus occurs to calculate the pupillary light reflex index. This makes it possible for the image processing device 1 to accurately measure pupillary light reflex based on the camera image.
[0026] Figure 4 shows an example of a functional block of the image processing device 1 related to pupillary light reflectance measurement processing. Functionally, the processor 11 of the image processing device 1 includes an instruction unit 14, a congestion measurement unit 15, a focus change determination unit 16, a pupil size measurement unit 17, and a pupillary light reflectance output unit 18. In Figure 4, blocks where data is exchanged are connected by solid lines, but the combinations of blocks where data is exchanged are not limited to those shown. The same applies to the diagrams of other functional blocks described later.
[0027] When the instruction unit 14 detects user input from the input device 2 instructing the start of pupillary light reflex measurement, or when the predetermined timing for pupillary light reflex measurement arrives, it determines that the pupillary light reflex measurement should be started and instructs the subject 6 to close and then open their eyes in sequence. In this case, the instruction unit 14 instructs the subject to open their eyes after a predetermined time has elapsed following the instruction to close their eyes. The length of the predetermined time is, for example, the length of time the eyes need to be closed for the pupillary light reflex to be observed, and a default value is stored in the storage device 4 or memory 12, etc. In this case, the instruction unit 14 may use any face recognition technology to detect the subject 6's closed eyes from the camera image. In this case, the instruction unit 14 instructs the subject 6 to open their eyes after a predetermined time has elapsed following the detection of the subject 6's closed eyes from the camera image.
[0028] Furthermore, the instruction unit 14 preferably instructs the subject 6 to direct their gaze (i.e., focus) on a location at a predetermined distance in order to stabilize the subject's focus before instructing them to close and open their eyes (this is also called "pre-eye-closing gaze instruction"). The aforementioned "predetermined distance" is, for example, a distance of 6m or more at which the focal length becomes substantially infinity. Note that the location at the predetermined distance is not limited to a location at 6m or more away, but may be any location where the distance from the subject 6 does not change. After the instruction unit 14 gives the pre-eye-closing gaze instruction, if the focus change determination unit 16 determines that there is no change in focus, the instruction unit 14 then sequentially gives the instructions to close and open the eyes. The instruction unit 14 notifies the convergence measurement unit 15, the focus change determination unit 16, and the pupil size measurement unit 17, respectively, that it has given the instructions to close and open the eyes, and notifies the convergence measurement unit 15 and the focus change determination unit 16, respectively, that it has given the pre-eye-closing gaze instruction.
[0029] The convergence measurement unit 15 measures the degree of convergence (i.e., the state of crossed eyes) of the subject's eyes 6 (also called the "degree of convergence") based on camera images acquired from the camera 51 via the interface 13. Here, the convergence measurement unit 15 measures the degree of convergence based on camera images generated during the period in which pupillary light reflex is estimated to occur in the subject's eyes (also called the "pupillary light reflex estimation period"). The target period is defined, for example, from the time a predetermined period of time has elapsed since the subject's eyes were opened in response to an eye-opening instruction from the instruction unit 14. The predetermined period mentioned above is the estimated time length in which pupillary light reflex occurs after eye opening, and a default value is stored in the storage device 4 or memory 12, etc. In this case, the convergence measurement unit 15, for example, uses arbitrary image recognition technology to detect the subject's eyes opening based on the latest camera image obtained from the camera 51 after the eye-opening instruction from the instruction unit 14, and recognizes the period from the time the subject's eyes were detected until a predetermined period of time has elapsed as the pupillary light reflex estimation period. The pupillary light reflectance estimation period is an example of a "predetermined period."
[0030] Furthermore, if a gaze input before closing the eyes is given, the convergence measurement unit 15 measures the degree of convergence based on the camera image obtained after the gaze input before closing the eyes is given. In this case, for example, the convergence measurement unit 15 measures the degree of convergence during the period from the gaze input before closing the eyes to the instruction to close the eyes. The convergence measurement unit 15 supplies the measured degree of convergence to the focus change determination unit 16.
[0031] The focus change determination unit 16 determines whether or not there is a change in the subject's focus during the pupillary light reflectance estimation period, and based on the determination result, determines whether or not the pupillary light reflectance output unit 18 needs to measure and output the pupillary light reflectance. In other words, the focus change determination unit 16 defines the stability of the subject's focus (i.e., stationarity) during the pupillary light reflectance estimation period as a necessary condition for measuring and outputting the pupillary light reflectance. Accordingly, the focus change determination unit 16 instructs the pupillary light reflectance output unit 18 to measure (i.e., calculate the pupillary light reflectance index described later) and output the pupillary light reflectance only if the subject's focus is stable during the pupillary light reflectance estimation period.
[0032] Generally, the presence or absence of a focus change can be determined by the presence or absence of a change in the degree of congestion, and if there is no change in the degree of congestion, it can be assumed that there is no focus change. Therefore, the focus change determination unit 16 determines whether or not there is a focus change of the subject 6 during the pupillary light reflection estimation period based on the time-series degree of congestion measured by the congestion measurement unit 15 from the camera image generated during the pupillary light reflection estimation period. For example, the focus change determination unit 16 determines whether or not the degree of congestion has substantially changed based on a comparison of a predetermined number of congestion variances, the difference between the maximum and minimum values, or other statistical quantities representing variability obtained during the pupillary light reflection estimation period with a predetermined threshold. The above threshold is stored in advance in a storage device 4 or memory 12, for example.
[0033] The focus change determination unit 16 then determines that a change in focus occurred during the pupillary light reflection estimation period if it determines that the degree of convergence has substantially changed. In this case, the focus change determination unit 16 requests the instruction unit 14 to re-output an instruction. Here, in the camera image obtained during the pupillary light reflection estimation period in which a change in focus occurred, a change in the pupil due to a change in focus known as the near response has occurred, and there is a high possibility that the pupillary light reflection cannot be accurately measured. Therefore, if it is determined that a change in focus occurred during the pupillary light reflection estimation period, the focus change determination unit 16 requests the instruction unit 14 to re-measure the pupillary light reflection. The instruction unit 14 outputs the pre-eye-closing gaze instruction, the eye-closing instruction and the eye-opening instruction in order if a pre-eye-closing gaze instruction was given, and outputs the eye-closing instruction and the eye-opening instruction in order if a pre-eye-closing gaze instruction was not given.
[0034] On the other hand, if the focus change determination unit 16 determines that the degree of convergence has not substantially changed, it determines that there was no change in focus during the pupillary light reflection estimation period. In this case, the focus change determination unit 16 instructs the pupillary light reflection output unit 18 to measure and output the pupillary light reflection. Here, if there was no change in focus during the pupillary light reflection estimation period, no change in pupil due to a change in focus occurred, and it is possible to accurately measure the pupillary light reflection of the subject 6 from the camera image obtained during the pupillary light reflection estimation period. Therefore, the pupillary light reflection output unit 18 can output an accurate measurement result of the pupillary light reflection by measuring and outputting the pupillary light reflection when it is determined that there was no change in focus during the pupillary light reflection estimation period.
[0035] Preferably, the focus change determination unit 16 may further determine whether there is a change in the subject's focus before closing and after opening their eyes, in addition to determining whether there is a change in the subject's focus during the pupillary light reflex estimation period. That is, the focus change determination unit 16 may define the stability of the subject's focus before closing their eyes based on the eye-closing instruction and after opening their eyes based on the eye-opening instruction as a condition (necessary condition) for measuring and outputting the pupillary light reflex. In this case, the focus change determination unit 16 determines whether there is a change in the subject's focus based on the difference between, for example, the degree of convergence measured by the convergence measurement unit 15 immediately before the subject's eyes close and the degree of convergence measured by the convergence measurement unit 15 after the subject's eyes open. If the difference is greater than a threshold, the focus change determination unit 16 considers that there has been a change in the subject's focus before and after closing and opening their eyes, and requests the instruction unit 14 to re-output the instruction, regardless of whether there is a change in focus during the pupillary light reflex estimation period. On the other hand, if the focus change determination unit 16 finds no change in the subject's focus before closing and opening their eyes, and there is no change in focus during the pupillary light reflex estimation period, it instructs the pupillary light reflex output unit 18 to measure and output the pupillary light reflex. However, even if there is no change in the subject's focus before closing and opening their eyes, if there is a change in focus during the pupillary light reflex estimation period, the focus change determination unit 16 requests the instruction unit 14 to re-output the instruction. In this way, by making stability of focus before and after the instruction to close and open eyes a necessary condition for measuring the pupillary light reflex, more accurate pupillary light reflex measurement results can be obtained.
[0036] Furthermore, if a gaze command is given before closing the eyes, the focus change determination unit 16 may determine that the subject's focus is stable after the gaze command is given before closing the eyes as a necessary condition for giving the eye-closing command, and determine whether or not there has been a change in the subject's focus after the gaze command is given before closing the eyes. In this case, for example, the focus change determination unit 16 determines whether or not there has been a change in the time series of convergence values supplied from the convergence measurement unit 15 in the preceding predetermined time. In this case, for example, the focus change determination unit 16 determines whether or not the convergence values have substantially changed within the predetermined time based on a comparison between a predetermined number of convergence values obtained within the predetermined time, the variance of the maximum value and the difference between the maximum and minimum values, or other statistical quantities representing variability, and a predetermined threshold. If the focus change determination unit 16 determines that the convergence values have not substantially changed, it considers that there has been no change in the subject's focus (i.e., the focus is stable) and instructs the instruction unit 14 to output an eye-closing command. On the other hand, if the focus change determination unit 16 determines that the degree of congestion has substantially changed, it considers that there has been a change in the subject's focus (i.e., the focus is not stable), and then proceeds to determine whether or not there has been a change in the degree of congestion of the time series supplied in the preceding predetermined time.
[0037] The pupil size measurement unit 17 measures the pupil size of the subject 6 during the pupillary light reflex estimation period. In this case, the pupil size measurement unit 17 generates a time-series measurement result of the pupil size of the subject 6 during the pupillary light reflex estimation period by measuring the pupil size of the subject 6 from each of the camera images generated during the pupillary light reflex estimation period. The pupil size measurement unit 17 then supplies the pupil size measurement result to the pupillary light reflex output unit 18.
[0038] Furthermore, the pupil size measurement unit 17 may measure the pupil size of the subject 6 from each of the camera images generated during the pupillary light reflection estimation period, regardless of the determination result of the focus change determination unit 16 regarding the presence or absence of a focus change in the subject 6. In this case, for example, the pupil size measurement unit 17 may output the pupil size measurement result generated during the pupillary light reflection estimation period to the pupillary light reflection output unit 18 only when it receives a determination result from the focus change determination unit 16 indicating that there was no focus change. In another example, the pupil size measurement unit 17 may receive the determination result of the presence or absence of a focus change by the focus change determination unit 16 and output the determination result and the pupil size measurement result generated during the pupillary light reflection estimation period to the pupillary light reflection output unit 18.
[0039] Alternatively, the pupil size measurement unit 17 may, after the focus change determination unit 16 has determined that there is no change in the subject's focus, measure the pupil size of the subject 6 from each of the camera images generated during the pupillary light reflex estimation period and stored in the storage device 4 or memory 12, etc. That is, in this case, if the focus change determination unit 16 has determined that there is a change in the subject's focus, the pupil size measurement unit 17 will not measure the pupil size based on the camera images generated during the relevant pupillary light reflex estimation period.
[0040] The pupillary light reflection output unit 18 calculates an index related to pupillary light reflection (also called the "pupillary light reflection index") based on the pupil size measurement result by the pupil size measurement unit 17 during the pupillary light reflection estimation period, and displays or outputs information regarding the calculation result of the pupillary light reflection index via the output device 3. Here, the pupillary light reflection output unit 18 performs the calculation of the pupillary light reflection index, etc., when it receives an instruction from the focus change determination unit 16 to measure and output pupillary light reflection, that is, when it is determined that there was no change in the focus of the subject 6 during the pupillary light reflection estimation period (and before closing and after opening the eyes). The type of pupillary light reflection index to be calculated varies depending on the application to which the pupillary light reflection measurement system 100 is applied, and specific examples are given in "(4) Convergence level, pupil size, and pupillary light reflex index " and "(7) application This will be discussed later in the section.
[0041] Here, the information regarding the calculation result of the pupillary light reflection index that the pupillary light reflection output unit 18 outputs to the output device 3 may be information indicating the calculated pupillary light reflection index itself, or it may be information regarding the state of the subject 6 estimated based on the pupillary light reflection index. For the latter example, see "(7) application This will be explained in detail in the section. The pupillary light reflection output unit 18 generates an output signal (i.e., at least one of a display signal or an audio signal) to output information regarding the calculation result of the calculated pupillary light reflection index, and supplies the output signal to the output device 3 via the interface 13. In this way, the pupillary light reflection output unit 18 causes the output device 3 to output information regarding the calculation result of the pupillary light reflection index.
[0042] Alternatively, the image processing device 1 may calculate a predetermined number of pupillary light reflection indices by executing the processing of the instruction unit 14, the convergence measurement unit 15, the focus change determination unit 16, the pupil size measurement unit 17, and the pupillary light reflection output unit 18 a predetermined number of times. In this case, the pupillary light reflection output unit 18 calculates the time average or other representative value of the pupillary light reflection indices for the predetermined number of times and outputs the calculation result to the output device 3. This makes it possible to output a highly accurate pupillary light reflection indices that have undergone statistical processing.
[0043] The instruction unit 14, congestion measurement unit 15, focus change determination unit 16, pupil size measurement unit 17, and pupillary light reflection output unit 18 described in Figure 4 can be realized, for example, by the processor 11 executing a program. Alternatively, the necessary programs may be recorded on any non-volatile storage medium and installed as needed to realize each component. At least a portion of these components may be realized not only by software programs, but also by any combination of hardware, firmware, and software. Furthermore, at least a portion of these components may be realized using user-programmable integrated circuits, such as FPGAs (Field-Programmable Gate Arrays) or microcontrollers. In this case, the program composed of the above components may be realized using this integrated circuit. At least a portion of each component may also be composed of ASSPs (Application Specific Standard Produce), ASICs (Application Specific Integrated Circuits), or quantum processors (quantum computer control chips). Thus, each component may be realized by various hardware. The same applies to other embodiments described later. Furthermore, each of these components may be realized through the collaboration of multiple computers, for example, using cloud computing technology.
[0044] (4) Convergence level, pupil size, and pupillary light reflex index First, let's explain specific examples of convergence and pupil size. Figure 5 is an example of a camera image of subject 6's face.
[0045] The image processing device 1 recognizes the following regions of the subject 6's eyes (both eyes in this case) 9a, iris 9b, and pupil 9c from a camera image of the subject 6's face, based on arbitrary image recognition technology. Then, the image processing device 1 calculates the pupil size and convergence degree based on the recognized regions.
[0046] First, let's explain how to calculate the pupil size. The image processing device 1 calculates the pupil size (i.e., pupil diameter) corresponding to the length of arrow 90. Here, the image processing device 1 may calculate the pupil size for both eyes separately and then generate the average of the calculated pupil sizes.
[0047] Next, the calculation of the degree of convergence will be explained. As an example of the degree of convergence, the image processing device 1 calculates the interpupillary distance corresponding to the length of arrow 91. In this way, the image processing device 1 can accurately recognize convergence by calculating the degree of convergence based on both eyes. In this case, the camera image is an image of at least both eyes of the subject 6, and the image processing device 1 calculates the degree of convergence based on the position of the pupils 9c of both eyes in the camera image.
[0048] The image processing device 1 may calculate pupil information based on a camera image taken from only one eye of the subject. In this case, for example, the image processing device 1 may calculate the convergence degree as the relative position of the center of the pupil 9c with respect to both ends of the eye 9a (i.e., the distance corresponding to the lengths of arrows 93 and 94). Thus, the image processing device 1 may calculate a value indicating the relative position of the pupil 9c in the eye 9a as the convergence degree.
[0049] Here, the image processing device 1 may perform a normalization process to convert the pupil size and interpupillary distance from sizes based on the number of pixels on the camera image to sizes on a predetermined scale (e.g., actual size), thereby generating normalized pupil size and interpupillary distance. In this case, for example, the image processing device 1 may utilize the characteristic that the size of the iris 9b has little individual variation and does not change over time, and normalize the pupil size and interpupillary distance based on the size of the iris 9b. In this case, for example, information showing the relationship between the size of the iris 9b on the image and the size of the iris 9b after normalization is stored in the storage device 4 or memory 12, and the image processing device 1 performs the normalization described above by referring to this information. In another example, if multiple cameras with different viewpoints are provided as cameras 51 in the pupillary light reflection measurement system 100, the image processing device 1 may recognize the actual size of the pupil size and interpupillary distance by reconstructing the face of the subject 6 in three dimensions from the camera images of the multiple cameras based on any three-dimensional reconstruction technique such as SfM (Structure From Motion).
[0050] Next, we will explain specific examples of pupillary light reflex indices. Figure 6 is an example of a graph showing the change in pupil size over time in relation to pupillary light reflex.
[0051] In this case, after a time lag (i.e., latency) elapses from the time "t1" when subject 6 opens their eyes in response to the eye-opening instruction until the pupil begins to constrict, the pupil size (here referred to as pupillary radius) of subject 6 gradually decreases from its maximum value "Dmax" to its minimum value "Dmin" at time "t2". Subsequently, the pupil size expands again and reaches a steady state around time "t3", a predetermined time after time t2.
[0052] In this case, for example, the image processing device 1 calculates the following as pupillary light reflection indices: the minimum value Dmin, the maximum value Dmax, the maximum pupillary constriction amount corresponding to the length of arrow 95 (i.e., Dmax-Dmin), the maximum pupillary constriction rate corresponding to the ratio of the maximum value Dmax to the minimum value Dmin, the pupillary constriction rate corresponding to the slope of line 96, and the re-expansion rate corresponding to the slope of line 97. The slope of line 96 corresponds to the rate of decrease in pupil size during the pupillary size decrease period, and the slope of line 97 corresponds to the rate of increase in pupillary size during the pupillary size increase (re-expansion) period.
[0053] Furthermore, the pupillary light reflex index is not limited to the index described above, but may be any index based on the time-series pupil size measured during the pupillary light reflex estimation period.
[0054] (5) Processing flow Figure 7 is an example of a flowchart relating to the pupillary light reflectance measurement process performed by the image processing device 1. Here, as an example, the pupillary light reflectance measurement process when a gaze direction is given before closing the eyes is described.
[0055] First, the image processing device 1 outputs a pre-eye-closing gaze instruction via the output device 3 to indicate the subject's gaze direction (step S11). Then, the image processing device 1 measures the degree of convergence of the subject 6 based on each of the time-series camera images generated by the camera 51 after step S11 (step S12).
[0056] The image processing device 1 then determines whether or not the subject 6's focus is stationary (step S13). In this case, the image processing device 1 determines whether or not the subject 6's focus is stationary based on whether or not there is a change in the time-series congestion level obtained in step S12. If the image processing device 1 determines that the subject 6's focus is not stationary (step S13; No), it returns to step S12 and measures the congestion level.
[0057] Then, if it is determined that the subject 6's focus is stable (step S13; Yes), the image processing device 1 outputs instructions for subject 6 to close and open their eyes via the output device 3 (step S14). In this case, for example, after the image processing device 1 outputs an instruction for subject 6 to close their eyes, it detects that subject 6 has closed their eyes and then outputs an instruction for subject 6 to open their eyes after a predetermined time has elapsed.
[0058] Next, the image processing device 1 determines whether or not the subject 6 has opened their eyes (step S15). In this case, the image processing device 1 determines whether or not the subject 6 has opened their eyes based on, for example, the camera image. If the image processing device 1 determines that the subject 6 has not opened their eyes (step S15; No), it continues the determination in step S15.
[0059] Then, if the image processing device 1 determines that the subject 6 has opened their eyes (step S15; Yes), it performs pupil size and convergence measurements for a predetermined time based on the latest camera image (step S16). In this case, the image processing device 1 considers the period from when it determines that the subject 6 has opened their eyes until a predetermined time has elapsed as the pupillary light reflex estimation period, and continuously performs pupil size and convergence measurements based on the camera image generated during the pupillary light reflex estimation period. This provides a predetermined number of pupil size and convergence measurement results (time-series data).
[0060] Next, the image processing device 1 determines whether or not the focus was stationary (step S17). In the first example, the image processing device 1 determines whether or not the focus was stationary during the execution period of step S16 (i.e., the pupillary light reflection estimation period) based on whether or not there was a change in the time series congestion level obtained in step S16. In the second example, the image processing device 1 makes the determination in step S17 by considering the focus before closing the eyes, in addition to whether or not the focus was stationary during the pupillary light reflection estimation period. In this case, the image processing device 1 determines whether or not the focus was stationary based on the congestion level obtained in step S12 and the time series congestion level obtained in step S16, immediately before determining that the focus was stationary in step S13.
[0061] Then, if the image processing device 1 determines that there was no focus stability (step S17; No), it returns to step S11. Note that in step S17, if the image processing device 1 determines the focus stability without considering the congestion measurement result in step S12 (i.e., in the first example), it may return to step S14 instead of returning to step S11.
[0062] Then, if it is determined that the focus is stationary (Step S17; Yes), one or more types of pupillary light reflection indices are calculated based on the time-series pupillary size measurement results measured in Step S16 (Step S18). The image processing device 1 may also calculate the time average (or other representative value) of the pupillary light reflection indices based on a sample of pupillary light reflection indices obtained by repeating Steps S11 to S18 multiple times.
[0063] Then, the image processing device 1 outputs information regarding the calculation result of the pupillary light reflex index via the output device 3 (step S19). In this case, the image processing device 1 may determine the condition of the subject 6, such as the presence or absence of aging phenomena, fatigue, or neurological disorders, from the calculated pupillary light reflex index, depending on the application being applied, and output the determination result via the output device 3. Examples of applications will be described later.
[0064] (6) Variation Next, modifications of the embodiments described above will be explained. The following modifications may be arbitrarily combined and applied to the embodiments described above.
[0065] (Variation 1) The image processing device 1 may output guidance information regarding the shooting distance (i.e., guidance information) via the output device 3, based on the size of the iris of the subject 6 recognized from the camera image, so that the distance between the subject 6 and the camera 51 (shooting distance) becomes a predetermined distance.
[0066] In this case, for example, before the eye-closing gaze instruction in step S11, the image processing device 1 recognizes the size of the subject's iris from the camera image. The image processing device 1 then determines whether the recognized iris size falls within the appropriate size range. The aforementioned appropriate size range is the range of iris sizes corresponding to the shooting distance range that is within the preferred distance range for pupillary light reflectance measurement processing, and is, for example, a range pre-stored in the storage device 4 or memory 12. If the recognized iris size is outside the appropriate size range, the image processing device 1 causes the output device 3 to output guidance information informing the subject 6 that the shooting distance should be adjusted. Specifically, if the recognized iris size is smaller than the appropriate size range, the image processing device 1 outputs guidance information suggesting that the shooting distance should be shortened, and if the recognized iris size is larger than the appropriate size range, it outputs guidance information suggesting that the shooting distance should be lengthened. If the recognized iris size is within the appropriate size range, the image processing device 1 then performs the eye-closing gaze instruction in step S11.
[0067] According to this modified example, the image processing device 1 can be suitably adjusted so that the shooting distance is a distance suitable for measuring pupillary light reflection.
[0068] (Modification 2) The image processing device 1 may further perform a process to control the light source so that the illuminance of the subject 6 remains constant during the pupillary light reflectance estimation period.
[0069] Figure 8 shows a schematic configuration of the pupillary light reflectance measurement system 100 in Modification 2. The pupillary light reflectance measurement system 100 in Modification 2 has a light source 7. The light source 7 is a light source that illuminates the subject 6, and when the pupillary light reflectance measurement system 100 is a smartphone or the like as shown in Figure 2, it is a light or display provided on the side of the camera used by the smartphone or the like.
[0070] In this modified example, the image processing device 1 controls the light intensity of the light source 7. For example, the image processing device 1 causes the light source 7 to emit light at the same intensity for a predetermined period from a predetermined timing after the eye-closing instruction but before the eye-opening instruction until a predetermined time has elapsed. In this case, the above period is set to be long enough to include at least the entire period of pupillary light reflection estimation. If the light source 7 is a light, the image processing device 1 may control the on and off of the light source 7 so that it is on during the above period and off outside of the above period.
[0071] According to this modified example, the image processing device 1 controls the illuminance of the subject 6 to be constant during the pupillary light reflectance estimation period, thereby effectively suppressing a decrease in the measurement accuracy of pupillary light reflectance due to uneven illuminance.
[0072] The image processing device 1 may define a constant illuminance of the subject 6 during the pupillary light reflection estimation period as a condition for measuring (i.e., calculating) and outputting the pupillary light reflection index, and may only measure and output the pupillary light reflection if the illuminance of the subject 6 is stable during the pupillary light reflection estimation period. In this case, the image processing device 1 determines, for example, whether the illuminance of the subject 6 is constant during the pupillary light reflection estimation period based on the time-series illuminance measured by the illuminance sensor of the measuring device 5 during the pupillary light reflection estimation period. In this case, for example, the image processing device 1 determines whether the illuminance has substantially changed based on a comparison between a predetermined threshold and a predetermined threshold for the variance, the difference between the maximum and minimum values, or other statistical quantities representing variation, obtained during the pupillary light reflection estimation period. Even in this case, the image processing device 1 can suitably suppress a decrease in the measurement accuracy of pupillary light reflection due to illuminance unevenness. Instead of an illuminance sensor, for example, the luminance value of a camera image may be used.
[0073] (7) application Next, examples of applications for the pupillary light reflex measurement system 100 will be given. In the following applications, the pupillary light reflex measurement system 100 estimates the condition of subject 6 (particularly health-related conditions) based on the calculated pupillary light reflex index and outputs the estimated result of subject 6's condition. Here, as specific examples of applications for the pupillary light reflex measurement system 100, examples of applications for quantitative assessment of age-related functional decline and applications for quantitative assessment of eye strain will be given.
[0074] (7-1) Quantitative assessment of age-related functional decline In an application for quantitatively assessing age-related functional decline, for example, the image processing device 1 calculates pupil size measured immediately after eye opening (i.e., maximum pupil size Dmax), pupil size when pupillary light reflex occurs after eye opening (i.e., minimum pupil size Dmin or pupil size after re-dilation), and pupil constriction velocity as pupillary light reflex indices. The image processing device 1 then compares the calculated values of the various pupillary light reflex indices with reference values for pupillary light reflex indices to quantitatively estimate the degree of age-related functional decline in the subject 6. The image processing device 1 then outputs the estimation results to the output device 3. The above-mentioned reference values may be general baseline values for various pupillary light reflex indices at the subject 6's age, or they may be past calculated values of the subject 6's pupillary light reflex indices. Furthermore, the above-mentioned reference values may be thresholds for determining the presence or level of age-related functional decline.
[0075] Here, the image processing device 1 may use a model to estimate the degree of age-related functional decline in the subject 6, and output the information output by the model to the output device 3. The above-mentioned model may be an equation, a lookup table, or a machine learning model such as a neural network, and for example, when the calculated values of various pupillary light reflectance indices (or the difference between the calculated values and reference values, etc.) are input, it outputs an estimation result regarding the degree of age-related functional decline (for example, the estimated age of the subject 6). The parameters of the above-mentioned model are stored in advance in the storage device 4 or memory 12, etc. The image processing device 1 may also display a graph or the like that shows the calculated values of various pupillary light reflectance indices and their corresponding reference values in a comparable manner.
[0076] With this application, subject 6 can easily measure their pupillary light reflex using their own smartphone or other device, and quantitatively understand age-related functional decline. Furthermore, the image processing device 1 can suggest activities to prevent age-related functional decline and visualize the effectiveness of these preventative measures, thereby increasing the user's (subject 6's) awareness of continuing age-related functional decline prevention activities.
[0077] (7-2) Quantitative assessment of eye strain In an application for quantitatively assessing eye strain, the image processing device 1 calculates, for example, pupillary light reflex indices such as maximum pupillary constriction rate, pupillary constriction rate, and re-expansion rate. The image processing device 1 then compares the calculated values of the various pupillary light reflex indices with reference values for pupillary light reflex indices to quantitatively estimate the degree of eye strain in the subject 6. The image processing device 1 then outputs the estimation results to the output device 3. The above-mentioned reference values may be general baseline values for various pupillary light reflex indices for the subject 6's age, or they may be past calculated values of the subject 6's pupillary light reflex indices. Furthermore, the above-mentioned reference values may be thresholds for determining the presence or level of eye strain in the subject 6.
[0078] Here, the image processing device 1 may use a model to estimate the degree of eye strain in the subject 6 and output the information output by the model to the output device 3. The above-mentioned model may be an equation, a lookup table, or a machine learning model such as a neural network, and for example, when the calculated values of various pupillary light reflectance indices (or the difference between the calculated values and reference values, etc.) are input, it outputs an estimation result regarding the degree of eye strain in the subject 6. The parameters of the above-mentioned model are stored in advance in the storage device 4 or memory 12, etc. The image processing device 1 may also display a graph or the like that shows the calculated values of various pupillary light reflectance indices and their corresponding reference values in a comparable manner as information representing the degree of eye strain in the subject 6.
[0079] With such an application, subject 6 can easily measure their pupillary light reflex using their own smartphone or other device, and quantitatively assess their eye strain.
[0080] <Second Embodiment> Figure 9 shows a schematic configuration of the pupillary light reflectance measurement system 100A in the second embodiment. The pupillary light reflectance measurement system 100A according to the second embodiment includes an image processing device 1A that functions as a server and a terminal device 8 that is used by the subject and functions as a client. The image processing device 1A and the terminal device 8 communicate data via a network 99. Hereafter, components identical to those in the first embodiment will be denoted by the same reference numerals as appropriate, and their descriptions will be omitted.
[0081] The terminal device 8 is a terminal used by the user who will be the subject of the examination, and has input, display, communication, and imaging functions, and functions as a measuring device 5 including the input device 2, output device 3, and camera 51 shown in Figure 1. The terminal device 8 may be, for example, a personal computer, a tablet terminal such as a smartphone, or a PDA (Personal Digital Assistant). The terminal device 8 transmits the subject's face image output by the camera 51 to the image processing device 1A via the network 99.
[0082] Image processing device 1A has the same hardware configuration as image processing device 1 shown in Figure 2, and the processor 11 of image processing device 1A has the functional blocks shown in Figure 4, which were described in the first embodiment. Image processing device 1A receives camera images from terminal device 8 via network 99 and performs pupillary light reflectance measurement processing of the subject. In addition, based on a display request from terminal device 8, image processing device 1A transmits an output signal for outputting the processing result to terminal device 8 via network 99.
[0083] Thus, the image processing device 1A in the second embodiment performs processing related to the measurement of the pupillary light reflex of the subject who is the user of the terminal device 8, and can suitably present the pupillary light reflex measurement results to the subject via the terminal device 8.
[0084] <Third Embodiment> Figure 10 is a block diagram of the image processing device 1X in the third embodiment. The image processing device 1X mainly includes a congestion measuring means 15X, a determination means 16X, and a pupil measuring means 17X. Note that the image processing device 1X may be composed of multiple devices.
[0085] The convergence measurement means 15X measures the degree of convergence of the subject after opening their eyes, based on images taken of the subject after they have opened their eyes after closing them. The convergence measurement means 15X can be, for example, the convergence measurement unit 15 in the first or second embodiment.
[0086] The determination means 16X determines whether or not there is a change in the subject's focus based on the degree of convergence. The determination means 16X can be, for example, the focus change determination unit 16 in the first or second embodiment.
[0087] The pupil measurement means 17X measures the pupil of the subject based on an image taken of the subject when it is determined that there is no change in focus. The pupil measurement means 17X can be, for example, the pupil size measurement unit 17 in the first or second embodiment.
[0088] Figure 11 is an example of a flowchart executed by the image processing device 1X in the third embodiment. First, the convergence measurement means 15X measures the degree of convergence of the subject after opening their eyes, based on an image taken of the subject after they have opened their eyes after closing them (step S21). The determination means 16X determines whether or not there has been a change in the subject's focus, based on the degree of convergence (step S22). The pupil measurement means 17X measures the pupil of the subject, based on an image taken of the subject, if it is determined that there has been no change in focus (step S23).
[0089] According to the third embodiment, the image processing device 1X can suitably measure the pupil, which changes in accordance with the pupillary light reflex of the subject.
[0090] In each of the embodiments described above, the program can be stored using various types of non-transitory computer-readable medium and supplied to a computer, such as a processor. Non-transitory computer-readable mediums include various types of tangible storage mediums. Examples of non-transitory computer-readable mediums include magnetic storage mediums (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical storage mediums (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, and semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (Random Access Memory)). The program may also be supplied to the computer by various types of transient computer-readable mediums. Examples of transient computer-readable mediums include electrical signals, optical signals, and electromagnetic waves. Transitory computer-readable mediums can supply the program to the computer via wired communication channels such as electric wires and optical fibers, or via wireless communication channels.
[0091] In addition, some or all of the above embodiments may be described as follows, but are not limited to these.
[0092] [Note 1] A convergence measurement means for measuring the degree of convergence of a subject after opening their eyes, based on images taken of the subject after they have opened their eyes after closing their eyes, A determination means for determining whether or not there is a change in the subject's focus based on the degree of convergence, When it is determined that there is no change in focus, a pupil measurement means measures the pupil of the subject based on the image taken of the subject, An image processing device having [Note 2] The image processing apparatus according to Appendix 1, further comprising pupillary light reflex calculation means for calculating an index relating to the pupillary light reflex of the subject based on the time-series measurement results of the pupil. [Note 3] The determination means determines whether or not there is a change in focus during the predetermined period based on the image taken of the subject during the predetermined period after the eyes have opened. The image processing apparatus according to Appendix 1, wherein the pupil measurement means measures the pupil based on the image taken of the subject during the predetermined period when it is determined that there is no change in focus during the predetermined period. [Note 4] The determination means further determines whether or not there is a change in focus before closing the eyes and after opening the eyes, The image processing apparatus according to Appendix 3, wherein the pupil measurement means measures the pupil based on the image taken of the subject during the predetermined period when it is determined that there is no change in focus during the predetermined period and that there is no change in focus before closing the eyes and after opening the eyes. [Note 5] The image processing apparatus according to Appendix 3, further comprising a light source control means for controlling the amount of light from a light source that illuminates the subject during the predetermined period, such that the amount of light from the light source remains constant. [Note 6] The aforementioned image is an image of at least both eyes of the subject, The image processing apparatus according to Appendix 1, wherein the convergence measurement means calculates the degree of convergence based on the positions of the pupils of both eyes in the image. [Note 7] The image processing apparatus according to Appendix 1, further comprising a guidance information output means that outputs guidance information regarding the distance between the subject and the imaging means that generates the image, based on the measurement results obtained by measuring the iris of the subject based on the aforementioned image. [Note 8] The image processing apparatus according to Appendix 1, further comprising an instruction means for instructing the subject to close their eyes and to open their eyes after a predetermined time has elapsed since closing their eyes. [Note 9] The image processing apparatus according to Appendix 8, wherein the instruction means provides instructions regarding the subject's gaze, and if it is determined that there is no change in the subject's focus after the instruction, it instructs the subject to close their eyes. [Note 10] The pupil measurement means is an image processing device as described in Appendix 1, which measures the size of the pupil. [Note 11] The image processing apparatus described in Appendix 2, wherein the pupillary light reflection calculation means outputs information regarding the subject's condition estimated based on the index using an output device. [Note 12] The image processing apparatus according to Appendix 11, wherein the pupillary light reflection calculation means outputs the degree of functional decline due to aging of the subject, estimated based on the index, as information regarding the state. [Note 13] The image processing apparatus according to Appendix 11, wherein the pupillary light reflection output means outputs the degree of eye strain of the subject estimated based on the index as information relating to the state. [Note 14] Computers Based on images taken of the subject after they opened their eyes following the closing of their eyes, the degree of convergence of the subject after opening their eyes was measured. Based on the degree of convergence, it is determined whether or not there is a change in the subject's focus. If it is determined that there is no change in focus, the pupil of the subject is measured based on the image taken of the subject. Image processing methods. [Note 15] Based on images taken of the subject after they opened their eyes following the closing of their eyes, the degree of convergence of the subject after opening their eyes was measured. Based on the degree of convergence, it is determined whether or not there is a change in the subject's focus. A storage medium containing a program that causes a computer to perform a process of measuring the pupil of the subject based on the image of the subject taken when it is determined that there is no change in focus.
[0093] Although the present invention has been described above with reference to embodiments, the present invention is not limited to the above embodiments. Various modifications to the structure and details of the present invention can be made as understood by those skilled in the art within the scope of the present invention. That is, the present invention includes the full disclosure, including the claims, and of course, various modifications and alterations that those skilled in the art could make in accordance with the technical idea. Furthermore, the above-mentioned patent and non-patent disclosures are incorporated herein by reference. [Explanation of Symbols]
[0094] 1, 1A, 1X Image Processing Device 2 Input devices 3. Output device 4 Storage device 5. Measuring device 7 light source 8 Terminal devices 11 processors 12 memory 13 Interfaces 51 Camera 90 Data Bus 99 Network 100, 100A Axis Light Reflectance Measurement System
Claims
1. A convergence measurement means for measuring the degree of convergence of a subject after opening their eyes, based on the position of the pupil in an image taken of the subject after they have opened their eyes after closing their eyes, A determination means for determining whether or not there is a change in the subject's focus based on whether or not there is a change in the degree of convergence, When it is determined that there is no change in focus, a pupillary measuring means measures the pupil size of the subject based on the image taken of the subject, A pupillary light reflex calculation means that calculates an index related to the pupillary light reflex of the subject based on the time-series measurement results of the pupillary size, An image processing device having
2. The determination means determines whether or not there is a change in focus during the predetermined period based on the image taken of the subject during the predetermined period after the eyes have opened. The image processing apparatus according to claim 1, wherein the pupil measurement means measures the pupil size based on the image taken of the subject during the predetermined period if it is determined that there is no change in focus during the predetermined period.
3. The determination means further determines whether or not there is a change in focus before closing the eyes and after opening the eyes, The image processing apparatus according to claim 2, wherein the pupil measurement means measures the pupil size based on the image taken of the subject during the predetermined period if it is determined that there is no change in focus during the predetermined period and that there is no change in focus before closing the eyes and after opening the eyes.
4. The image processing apparatus according to claim 2, further comprising a light source control means for controlling the amount of light from a light source that illuminates the subject during the predetermined period, such that the amount of light from the light source remains constant.
5. The aforementioned image is an image of at least both eyes of the subject, The image processing apparatus according to claim 1, wherein the convergence measuring means calculates the degree of convergence based on the positions of the pupils of both eyes in the image.
6. The image processing apparatus according to claim 1, further comprising a guidance information output means that outputs guidance information relating to the distance between the subject and the imaging means that generates the image, based on the measurement result obtained by measuring the size of the subject's iris based on the aforementioned image.
7. The image processing apparatus according to claim 1, further comprising an instruction means for instructing the subject to close their eyes and to open their eyes after a predetermined time has elapsed since closing their eyes.
8. Computers Based on the position of the pupil in an image taken of the subject after opening their eyes following eye closure, the degree of convergence of the subject after eye closure is measured. Based on whether or not there is a change in the degree of convergence, the presence or absence of a change in the subject's focus is determined. If it is determined that there is no change in focus, the pupil size of the subject is measured based on the image taken of the subject. Based on the time-series measurement results of the pupil size, an index relating to the pupillary light reflex of the subject is calculated. Image processing methods.
9. Based on the position of the pupil in an image taken of the subject after opening their eyes following eye closure, the degree of convergence of the subject after eye closure is measured. Based on whether or not there is a change in the degree of convergence, the presence or absence of a change in the subject's focus is determined. If it is determined that there is no change in focus, the pupil size of the subject is measured based on the image taken of the subject. A program that causes a computer to perform a process to calculate an index related to the pupillary light reflex of the subject based on the time-series measurement results of the pupil size.
Citation Information
Patent Citations
Eyeball examination apparatus and eyeball examination method
JP2004329879A
Pupillary light reflex measurement device, pupillary light reflex measurement method, and pupillary light reflex measurement program
JP2020141906A
Systems and methods for assessing pupillary response
JP2022546092A
Ocular analysis
US20190029513A1
Pupil measuring device
WO2002003853A1
