Occupant status monitoring device

Abstract

To provide an occupant state monitoring apparatus capable of accurately monitoring a state of an occupant who is in a vehicle.SOLUTION: An occupant state monitoring apparatus 11 mainly includes an imaging section 21 and a calculation control section 26. The imaging section 21 captures an image of an eyeball 20 of an occupant 18 who is in a vehicle 10 to acquire an image 29. The calculation control section 26 detects a line of sight of the occupant 18 and a device disposed in a vehicle compartment 16 from a part of the eyeball 20 reflected in the image 29, and monitors a state of the occupant 18 on the basis of the device and a change in the line of sight.SELECTED DRAWING: Figure 1B

Description

[Technical Field]

[0001] The present invention relates to an occupant status monitoring device. [Background technology]

[0002] 2. Description of the Related Art As a conventional device for monitoring the state of an occupant in a vehicle, for example, the structure described in the following patent document is known.

[0003] Patent Document 1 discloses a vehicle equipped with a gaze detection device that detects the driver's gaze direction and a light projection unit that projects light from a light source in a predetermined direction. When the control device determines, based on the detection result of the gaze detection device, that the driver's gaze direction has deviated from the front of the vehicle by more than a predetermined angle, it projects light at a position near the driver's gaze direction and closer to the front. This effectively corrects the driver's tendency to look away without occupying a large installation space in the vehicle cabin.

[0004] In Patent Document 2, a camera captures the user's face, eyes, etc., and image processing is used to detect and analyze the user's gaze point to determine whether the user is the driver of a moving object. Furthermore, if it is determined that the user is the driver and that the moving speed is equal to or greater than a set speed, the electronic device implements accident prevention measures such as forcibly restricting its own functions or halting operation. In this way, serious accidents can be prevented before they occur. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2012-101564 [Patent Document 2] Japanese Patent Application Publication No. 2018-073339 Summary of the Invention [Problem to be solved by the invention]

[0006] However, the inventions described in the above-mentioned patent documents leave room for improvement in terms of more accurately monitoring the state of the occupant.

[0007] Specifically, the inventions described in the above-mentioned patent documents cannot directly detect the presence of a device such as a smartphone near the dashboard. Therefore, when a driver of a vehicle is looking away from the vehicle and staring at a device such as a smartphone placed on the dashboard, it is not easy to detect this inattentive behavior.

[0008] One possible method for detecting inattentive behavior of a vehicle occupant staring at a smartphone while the vehicle is in motion is to monitor the occupant's line of sight. Specifically, taking into consideration that the smartphone is typically located in the horizontal center of the dashboard, if the occupant's line of sight is directed toward the horizontal center of the dashboard, the system determines that the occupant is inattentively staring at the smartphone and issues a warning to that effect. However, this method has the problem that a false warning may be issued if the occupant is simply looking toward the front edge of the vehicle while in motion, which may cause discomfort to the occupant.

[0009] The present invention has been made in view of the above problems, and an object of the present invention is to provide an occupant condition monitoring device that can accurately monitor the condition of an occupant riding in a vehicle. [Means for solving the problem]

[0010] The occupant state monitoring device of the present invention includes a photographing unit that photographs the eyeballs of an occupant riding in a vehicle to obtain an image, and a calculation control unit, wherein the calculation control unit detects the line of sight of the occupant and devices arranged in a vehicle cabin from the part of the eyeball reflected in the image, and monitors the state of the occupant based on changes in the line of sight and the devices, of the occupant in the image The aforementioned The eyeball partial image photographed of the eyeball has a first eyeball partial image that shows the area in front of the vehicle and a second eyeball partial image that shows vehicle components of the vehicle, and if the device is present in the second eyeball partial image, it is determined that the occupant is looking away. The present invention The occupant status monitoring device The vehicle monitoring system includes an imaging unit that captures an image of an occupant's eyeball by imaging the eyeball, and an arithmetic and control unit, wherein the arithmetic and control unit detects the occupant's line of sight and devices arranged in the vehicle cabin from the portion of the eyeball reflected in the image, and monitors the occupant's state based on changes in the line of sight and the devices. of the occupant in the image The aforementioned If a non-moving light-emitting object is present in the partial eyeball image obtained by photographing the eyeball, it is determined that the occupant is looking aside. The occupant condition monitoring device of the present invention includes a photographing unit that photographs the eyeballs of an occupant riding in a vehicle to obtain an image, and a calculation control unit, and the calculation control unit detects the line of sight of the occupant and devices arranged in the vehicle compartment from the part of the eyeball reflected in the image, monitors the state of the occupant based on changes in the line of sight and the devices, and monitors the state of the vehicle. Depending on the brightness outside, the image of the occupant The aforementioned The method for determining whether the occupant is looking away from the vehicle from an eyeball partial image obtained by photographing the eyeball is different. [Effects of the Invention]

[0011] According to the occupant status monitoring device of the present invention, by detecting equipment placed in the vehicle cabin based on the image reflected in the occupant's eyeball, it is possible to effectively monitor, for example, an occupant's inattentiveness, such as staring at equipment. [Brief explanation of the drawings]

[0012] [Figure 1A] 1 is a side view showing a vehicle equipped with an occupant state monitoring device according to an embodiment of the present invention; [Figure 1B] 1 is a diagram showing a front part of a vehicle interior equipped with an occupant state monitoring device according to an embodiment of the present invention; [Figure 2] 1 is a block diagram showing a connection configuration of an occupant state monitoring device according to an embodiment of the present invention; [Figure 3A] 1 is a schematic diagram showing the state of an occupant in an occupant state monitoring device according to an embodiment of the present invention; [Figure 3B] 2 is a schematic diagram showing the eyeballs of an occupant in the occupant state monitoring device according to the embodiment of the present invention; FIG. [Figure 4] 4 is a flowchart illustrating a method for monitoring the state of an occupant according to an embodiment of the present invention. [Figure 5A] 3 is a schematic diagram showing an image of an eyeball portion in the occupant state monitoring device according to the embodiment of the present invention; FIG. [Figure 5B] 3 is a schematic diagram showing an image of an eyeball portion when it is bright outside the vehicle in the occupant state monitoring device according to the embodiment of the present invention; FIG. [Figure 5C] 3 is a schematic diagram showing an image of an eyeball portion when it is dark outside the vehicle in the occupant state monitoring device according to the embodiment of the present invention; FIG. DETAILED DESCRIPTION OF THE INVENTION

[0013] An occupant state monitoring device 11 according to an embodiment of the present invention will be described in detail below with reference to the drawings. In the following description, the same components are basically designated by the same reference numerals, and repeated description will be omitted.

[0014] Fig. 1A is a side view showing a vehicle 10 equipped with an occupant state monitoring device 11. Fig. 1B is a view showing the front interior of the vehicle 10 equipped with the occupant state monitoring device 11.

[0015] The occupant state monitoring device 11 is a device for monitoring the state of an occupant 18 riding in the vehicle 10. The occupant state monitoring device 11 mainly comprises a photographing unit 21, a storage unit 25, and an arithmetic and control unit 26. The specific functions and configuration of the occupant state monitoring device 11 will be described later with reference to Figure 2 and subsequent figures.

[0016] The vehicle 10 is, for example, an automobile, a train, etc. The vehicle 10 as an automobile is, for example, an engine-equipped vehicle, an EV (Electrical Vehicle), an HEV (Hybrid Electrical Vehicle), or a PHEV (Plug-in Hybrid Electrical Vehicle).

[0017] An occupant 18 who drives the vehicle 10 is seated in a driver's seat 13. The occupant 18 drives the vehicle 10 by operating a steering wheel 14, a brake pedal, an accelerator pedal, and the like (not shown).

[0018] A windshield 12 is disposed at the front portion of the vehicle body 28.

[0019] 1B, a display 15 is disposed near the center in the left-right direction of the dashboard 19. The display 15 is a multi-function display that displays information about the vehicle 10, such as the outside temperature and the operating status of the air conditioner, and also functions as a notification unit that displays an alarm, which will be described later. Here, a speaker that emits an alarm sound may be used as the notification unit.

[0020] An imaging unit 21 is disposed on the dashboard 19 above the display 15 to capture an image of the head 31 of the occupant 18 driving the vehicle 10. The imaging unit 21 is called a DMS (Driver Monitor System). The imaging unit 21 is, for example, an infrared camera.

[0021] Meters 23 are disposed on the rear side above the steering wheel 14. The meters 23 display vehicle speed, engine rotation speed, and the like.

[0022] A portable device 22 may be disposed near the center of the dashboard 19 in the left-right direction. The portable device 22 is, for example, a communication device such as a smartphone. The portable device 22 is detachable from the dashboard 19.

[0023] The occupant state monitoring device 11 monitors the state of the occupant 18 driving the vehicle 10 using the image capture unit 21, and if it determines that the occupant 18 is looking away, such as continuously staring at the portable device 22, it notifies the occupant 18 of this. In this way, the occupant 18 can recognize his or her own inattentive state through the notification, and can return from the inattentive state to a normal state where he or she is concentrating on driving. This operation will be described later with reference to a flowchart.

[0024] FIG. 2 is a block diagram showing the connection configuration of the occupant state monitoring device 11. As shown in FIG.

[0025] The occupant state monitoring device 11 mainly includes a calculation control unit 26 , an image capturing unit 21 , a memory unit 25 , an illuminance sensor 35 , a timer 36 , a display 15 , and a notification unit 27 .

[0026] The arithmetic and control unit 26 has a CPU, RAM, ROM, etc. An input terminal of the arithmetic and control unit 26 is connected to the photographing unit 21, the memory unit 25, the illuminance sensor 35, and the timer 36. An output terminal of the arithmetic and control unit 26 is connected to the display 15 and the notification unit 27. As will be described later, the arithmetic and control unit 26 detects the line of sight of the occupant 18 and devices arranged in the passenger compartment 16 from the portion of the eyeball 20 reflected in the image 29, and monitors the state of the occupant 18, namely, looking away, based on changes in the line of sight and the devices.

[0027] The photographing unit 21 photographs the occupant 18 riding in the vehicle 10. The photographing unit 21 is, for example, an infrared camera, and is capable of photographing the head 31 of the occupant 18 during the day and at night.

[0028] The memory unit 25 stores information required to detect inattentive behavior of the occupant 18 using the occupant state monitoring device 11. For example, the memory unit 25 stores an eyeball partial image 32, a first eyeball partial image 33, a second eyeball partial image 34, an image 29, etc., which will be described later.

[0029] The illuminance sensor 35 is a photodiode or the like that detects the brightness in the cabin 16 of the vehicle 10 or outside the vehicle, and outputs an electrical signal indicating the brightness to the calculation control unit 26. By detecting the brightness with the illuminance sensor 35, it is possible to detect whether the vehicle is traveling during the day or night. As a result, as will be described later, a method for detecting inattentiveness by the occupant 18 can be switched, thereby enabling highly accurate detection of inattentiveness. The illuminance sensor 35 may be one that is provided in a car navigation system, an automatic light system, or the like.

[0030] The timer 36 measures the time or duration and detects whether the vehicle 10 is traveling during the day or night.

[0031] As described above, the display 15 is a display device that displays various information related to the vehicle 10.

[0032] The notification unit 27 is, for example, a speaker disposed in the vehicle body 28, and when it determines that the occupant 18 is looking away, it notifies the occupant 18 by emitting a sound to that effect.

[0033] 3A is a schematic diagram showing the state of the occupant 18 captured by the image capturing unit 21. The image capturing unit 21 captures an image of the eyeball 20 provided in the head 31 of the occupant 18. Furthermore, the calculation control unit 26 calculates the gaze direction, which is the direction in which the occupant 18 is gazing, from the image of the head 31 or the eyeball 20 captured.

[0034] 3B shows the eyeball 20 and pupil 17 of the occupant 18 described above. The eyeball 20 reflects light rays on its surface. Therefore, while the occupant 18 is driving the vehicle 10, the front view of the vehicle 10, the dashboard 19, etc. are reflected on the surface of the eyeball 20. In this embodiment, as will be described later, this phenomenon is utilized to detect an object that the occupant 18 is looking at.

[0035] 4 is a flowchart showing a method for monitoring the state of the occupant 18. A method for monitoring inattentiveness as the state of the occupant 18 by the occupant state monitoring device 11 will be described with reference to FIG.

[0036] In step S10, the occupant 18 boards the vehicle 10.

[0037] In step S11, the vehicle 10 starts moving based on an instruction from the occupant 18.

[0038] In step S12, the arithmetic and control unit 26 causes the photographing unit 21 to photograph the head 31 and eyeballs 20 of the occupant 18. The arithmetic and control unit 26 causes the photographing unit 21 to continue photographing until the vehicle 10 has finished traveling.

[0039] In step S13, the calculation control unit 26 measures the time that the line of sight of the occupant 18 remains fixed.

[0040] Specifically, the calculation and control unit 26 determines whether the line of sight of the occupant 18 is directed toward the portable device 22 based on the position of the pupil 17, the posture of the occupant 18, the position or angle of the head 31, etc. If the portable device 22 is placed near the center in the left-right direction of the dashboard 19, for example, the calculation and control unit 26 determines whether the line of sight of the occupant 18 is directed toward the center in the left-right direction of the dashboard 19 based on an image of the occupant 18 captured by the image capturing unit 21.

[0041] Furthermore, the calculation control unit 26 determines whether the line of sight of the occupant 18 is fixed in the direction of the portable device 22. Thereafter, if the line of sight of the occupant 18 is fixed, the calculation control unit 26 causes the timer 36 to measure the time for which the line of sight of the occupant 18 is fixed.

[0042] In step S14, the calculation control unit 26 determines whether the time during which the gaze of the occupant 18 remains fixed is longer than a predetermined threshold time. As a result, the calculation control unit 26 determines whether the gaze stay time is equal to or longer than a certain time.

[0043] If the answer to step S14 is YES, that is, if the time the occupant's line of sight remains fixed is equal to or longer than a certain period, in other words, if the occupant's line of sight movement is small, the calculation control unit 26 proceeds to step S15.

[0044] If the answer is NO in step S14, or if the time the occupant 18's line of sight remains fixed is less than a certain amount, that is, if the occupant 18's line of sight movement is large, the calculation control unit 26 proceeds to step S21. In this case, the calculation control unit 26 determines that the occupant 18 is not looking aside, and does not issue a warning to the occupant 18.

[0045] In step S15, the calculation control unit 26 determines whether it is bright outside the vehicle 10. Specifically, if the amount of light in the environment outside the vehicle detected by the above-mentioned illuminance sensor 35 is equal to or greater than a certain level, the calculation control unit 26 determines that it is bright outside the vehicle 10. Furthermore, the calculation control unit 26 can determine whether it is daytime or nighttime at the current time based on the time measured by the above-mentioned timer 36, and determine that it is bright outside the vehicle if it is daytime, or that it is not bright outside the vehicle if it is nighttime.

[0046] If the answer to step S15 is YES, that is, if the amount of light in the environment outside the vehicle 10 is equal to or greater than a certain level, the calculation control unit 26 proceeds to step S16.

[0047] If the answer to step S15 is NO, that is, if the amount of light in the environment outside the vehicle 10 is less than a certain amount, the arithmetic control unit 26 proceeds to step S17.

[0048] In step S16, the arithmetic and control unit 26 determines whether or not the portable device 22, which is an example of the light-emitting body 30, is present in the captured image.

[0049] 5A shows an image 29 captured by the image capturing unit 21. The image 29 is a portion of an image of the head 31 of the occupant 18 captured by the image capturing unit 21. The image 29 includes an eyeball partial image 32. The eyeball partial image 32 is a portion of the image 29 in which the eyeball 20 of the occupant 18 is captured.

[0050] The eyeball partial image 32 includes a first eyeball partial image 33 which is an upper part, and a second eyeball partial image 34 which is a lower part.

[0051] The first eyeball partial image 33 is an upper portion of the eyeball partial image 32, and is a portion that passes through the windshield 12 shown in FIG. 1A and reflects the view ahead of the vehicle 10. When the vehicle 10 is traveling during the day and the outside of the vehicle is bright, the first eyeball partial image 33 reflects brightly. On the other hand, when the vehicle 10 is traveling at night and the outside of the vehicle is bright, the first eyeball partial image 33 reflects darkly.

[0052] The second eyeball partial image 34 is a portion below the eyeball partial image 32, and is a portion in which the dashboard 19, a vehicle component shown in FIG. 1A, is reflected. The surface of the dashboard 19 is generally black. Therefore, when it is bright outside the vehicle, the second eyeball partial image 34 reflects light that is darker than the first eyeball partial image 33.

[0053] 1A, a portable device 22 such as a smartphone may be placed on dashboard 19 as light-emitting body 30. In this case, referring to FIG. 5B, the screen of portable device 22 is a light-emitting LCD screen or organic EL display, and therefore portable device 22 appears brighter than dashboard 19 in eyeball partial image 32. In particular, in second eyeball partial image 34 in which dashboard 19 appears dark, the lower portion of portable device 22 appears noticeably bright.

[0054] Therefore, by checking whether or not the light-emitting object 30 is present in the second eyeball partial image 34, it can be determined whether or not the occupant 18 is looking aside at the portable device 22 placed on the dashboard 19. In other words, if the light-emitting object 30 is present in the second eyeball partial image 34, it can be determined that the occupant 18 is looking aside at the portable device 22 placed on the dashboard 19. On the other hand, if the light-emitting object 30 is not present in the second eyeball partial image 34, it can be determined that the portable device 22 is not placed on the dashboard 19, and the occupant 18 is not looking aside at the portable device 22.

[0055] Therefore, in step S16, if the light-emitting object 30 is present in the second eyeball partial image 34, the calculation control unit 26 determines that the occupant 18 is looking aside. On the other hand, if the light-emitting object 30 is not present in the second eyeball partial image 34, the calculation control unit 26 determines that the occupant 18 is not looking aside.

[0056] If the answer to step S16 is YES, that is, if it is determined that the occupant 18 is looking aside due to the presence of the light-emitting body 30 in the second eyeball partial image 34, the arithmetic and control unit 26 proceeds to step S18.

[0057] If the answer is NO in step S16, that is, if the light-emitting body 30 is not present in the second eyeball partial image 34 and it is determined that the occupant 18 is not looking away, the calculation control unit 26 proceeds to step S21 and does not issue an alert.

[0058] In step S17, the arithmetic and control unit 26 determines whether or not there is a stationary light-emitting body 30 in the captured image.

[0059] FIG. 5C shows the image 29 in step S17. When it is dark outside the vehicle, such as at night, both the first eyeball partial image 33 and the second eyeball partial image 34 appear dark. Furthermore, when the vehicle 10 is traveling at night, a moving light-emitting object 37 appears in the eyeball partial image 32. The moving light-emitting object 37 moves in the eyeball partial image 32. The moving light-emitting object 37 is, for example, light emitted from the headlights of a vehicle traveling in the opposite lane, and is a factor outside the vehicle. Therefore, the presence or absence of the moving light-emitting object 37 does not affect the occupant 18's inattentiveness.

[0060] On the other hand, when the portable device 22 is placed on the dashboard 19 at night, the light-emitting body 30, which is the portable device 22 with an illuminating screen, is displayed in the eyeball portion image 32. The light-emitting body 30 is fixed to a predetermined location on the dashboard 19, and is therefore a factor inside the passenger compartment 16, and does not move while the vehicle 10 is traveling.

[0061] For this reason, in step S17, if the portable device 22, which is a stationary light-emitting body 30, is recognized in the eyeball partial image 32, it is determined that the occupant 18 is looking away from the portable device 22.

[0062] If the answer to step S17 is YES, that is, if the portable device 22, which is a stationary light-emitting body 30, is recognized in the eyeball portion image 32, the arithmetic and control unit 26 proceeds to step S18.

[0063] If the answer is NO in step S17, that is, if the portable device 22 that is the stationary light-emitting body 30 does not exist in the eyeball portion image 32, the calculation control unit 26 proceeds to step S21 and does not issue a notification.

[0064] In step S18, the calculation control unit 26 notifies the occupant 18. Specifically, the calculation control unit 26 issues a voice or warning sound from a speaker or the like serving as the notification unit 27 to correct the occupant's inattentive behavior. The notification unit 27 may also be the display 15, and in this case, an image to correct the occupant's inattentive behavior is displayed on the display 15. By notifying the occupant 18 via the notification unit 27, the occupant 18 can correct his or her inattentive behavior.

[0065] In step S19, the calculation control unit 26 determines whether the occupant 18 continues to look aside. The processing in step S16 is the same as that in steps S13 to S17 described above.

[0066] If the answer to step S19 is YES, that is, if the occupant 18 continues to look aside, the calculation control unit 26 returns to step S18 and continues the notification.

[0067] If the answer is NO in step S19, that is, if the occupant 18 has stopped looking aside, the calculation control unit 26 proceeds to step S20.

[0068] In step S20, the calculation control unit 26 causes the notification unit 27 to end notification.

[0069] In step S21, the occupant 18 ends the driving of the vehicle 10. That is, the occupant 18 stops the vehicle 10.

[0070] The above is a description of the operation of the occupant state monitoring device 11 to monitor inattentiveness as the state of the occupant 18.

[0071] According to the occupant state monitoring device 11 of this embodiment, by detecting devices arranged in the vehicle interior 16 based on the image 29 reflected in the eyeball 20 of the occupant 18, it is possible to effectively determine whether the occupant 18 is looking inattentively, for example, by continuously gazing at the portable device 22. Furthermore, since the occupant state monitoring device 11 detects and reports inattentiveness based on both the line of sight of the occupant 18 and the portable device, it is possible to prevent false reports based on false detection of inattentiveness and reduce the discomfort of the occupant 18.

[0072] Furthermore, in step S14 described above, if the gaze time exceeds a certain period of time, it is determined that the occupant 18 is looking away, thereby making it possible to more accurately determine the state of the occupant 18.

[0073] In addition, in the above-mentioned steps S16 and S17, it is possible to accurately detect a state in which the occupant 18 is staring at the portable device 22, which is a device disposed on a vehicle component such as the dashboard 19. Furthermore, it is possible to easily detect inattentive behavior in which the occupant 18 is staring at a portable communication device, which is an example of the light-emitting body 30.

[0074] Furthermore, in the above-mentioned step S15, by branching the determination process based on the brightness outside the vehicle, it is possible to determine whether the occupant 18 is looking away from the vehicle during the day or night.

[0075] Although the embodiments of the present invention have been described above, the present invention is not limited to these and can be modified within the scope of the present invention. In addition, the above-described embodiments can be combined with each other.

[0076] For example, in the above-described embodiment, looking away is used as a state monitored by the calculation and control unit 26, but other states may also be monitored. For example, a state in which the occupant 18 loses his / her balance extremely may also be a state monitored by the calculation and control unit 26. [Explanation of symbols]

[0077] 10 vehicles 11 Occupant status monitoring device 12 Windshield 13 sheets 14 Steering wheel 15 Display 16 Cabin 17 Hitomi 18 crew members 19 Dashboard 20 Eyeball 21 Photography Department 22 Portable devices 23 Meters 25 Memory section 26 Calculation control unit 27. Information Department 28 Body 29 images 30 Luminous Object 31 Head 32 Eyeball partial image 33 First eyeball partial image 34 Second eyeball partial image 35 Illuminance sensor 36 Timer 37 Moving Light Source

Claims

1. An imaging unit that captures images by photographing the eyeballs of occupants in a vehicle; an arithmetic control unit; The arithmetic and control unit Detecting the line of sight of the occupant and devices arranged in the vehicle cabin from the portion of the eyeball reflected in the image; monitor the state of the occupant based on the change in the line of sight and the device; the eyeball partial image of the image capturing the eyeball of the occupant includes a first eyeball partial image capturing an area ahead of the vehicle and a second eyeball partial image capturing a vehicle component of the vehicle; An occupant state monitoring device, characterized in that if the device is present in the second eyeball partial image, it is determined that the occupant is looking aside.

2. A photographing unit that captures images by photographing the eyeballs of occupants in a vehicle; an arithmetic control unit; The arithmetic and control unit Detecting the line of sight of the occupant and devices arranged in the vehicle cabin from the portion of the eyeball reflected in the image; monitor the state of the occupant based on the change in the line of sight and the device; An occupant status monitoring device characterized in that if a non-moving light-emitting object is present in an eyeball portion image of the occupant's eyeball in the image, it is determined that the occupant is looking away.

3. A photographing unit that captures images by photographing the eyeballs of occupants in a vehicle; an arithmetic control unit; The arithmetic and control unit Detecting the line of sight of the occupant and devices arranged in the vehicle cabin from the portion of the eyeball reflected in the image; monitor the state of the occupant based on the change in the line of sight and the device; An occupant state monitoring device characterized in that a method for determining whether an occupant is looking away from the vehicle is changed depending on the brightness outside the vehicle from an eyeball partial image obtained by photographing the eyeball of the occupant in the image.

Images