Imaging state examination device

Abstract

To allow a driver to appropriately grasp the position of driver's face in a captured image even during adjustment of a seat or the like.SOLUTION: An imaging state examination device for examining an imaging state of an imaging device 11 that images a driver, comprises: a position detection unit 334 that detects a position of a face image of the driver in an image captured by the imaging device at a certain point; an icon display unit 336 that displays an icon FI so as to correspond to the position of the face image in the image within a certain frame on a display device 21; and a position change and display unit 338 that changes and displays the position of the icon in the frame on the display device on the basis of an amount of adjustment to a state of a seat on which the driver is seated and an amount of adjustment to a state of the imaging device.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] The present disclosure relates to an imaging state confirmation device.

Background Art

[0002] Conventionally, a device for determining an abnormal state of a driver based on a face image of the driver captured by a camera has been known (Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, depending on the seating state of the driver on the seat, the position of the driver's face may deviate from the imaging range of the camera. In such a case, it is necessary to change the position of the seat on which the driver is seated or the orientation of the camera, etc. to adjust the position of the driver's face. However, when an adjustment operation is performed to adjust the position of the seat or the orientation of the camera, there is a possibility that the position of the driver's face moves during the adjustment operation. In this case, it becomes difficult to appropriately adjust the position of the seat or the orientation of the camera.

[0005] In view of the above problems, an object of the present disclosure is to enable the driver to appropriately grasp the position of the driver's face in the captured image even during adjustment of the seat or the like.

Means for Solving the Problems

[0006] The gist of the present disclosure is as follows.

[0007] (1) An imaging state confirmation device for confirming an imaging state by an imaging device that images a driver, A position detection unit that detects the position of the driver's face image in the image captured by the imaging device at any given time; An icon display unit that displays an icon within an arbitrary frame of the display device so as to correspond to the position of the face image in the image; An imaging state confirmation device comprising: a position change display unit that changes and displays the position of the icon within the frame of the display device based on an adjustment amount of the state of the seat on which the driver is seated or an adjustment amount of the state of the imaging device. (2) A deviation amount calculation unit that calculates a deviation amount from an appropriate position or an appropriate range of the position of the driver's face image in the image captured by the imaging device at the given time; Further comprising: a deviation amount correction unit that corrects the deviation amount based on an adjustment amount of the state of the seat on which the driver is seated or an adjustment amount of the state of the imaging device. The icon display unit and the position change display unit determine the display position of the icon based on the deviation amount. The imaging state confirmation device according to (1) above. (3) The icon display unit displays the image captured by the imaging device at the given time within the frame. The imaging state confirmation device according to (1) or (2) above. (4) Further comprising an imaging notification unit that notifies the driver of a seating posture before the given time. The imaging state confirmation device according to any one of (1) to (3) above. (5) An image determination unit that determines whether or not a driver's face image is included in the image received from the imaging device so as to satisfy a predetermined standard; Further comprising: a warning notification unit that notifies the driver of a warning when the driver's face image is not included so as to satisfy a predetermined standard. The imaging notification unit notifies the driver to assume a seating posture for vehicle driving after or simultaneously with the notification of the warning by the warning notification unit. The imaging state confirmation device according to (4) above.

Advantages of the Invention

[0008] According to the present disclosure, even during adjustment of a seat or the like, the driver can appropriately grasp the position of the driver's face in the captured image.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Mode for Carrying Out the Invention

[0010] Hereinafter, embodiments will be described in detail with reference to the drawings. In the following description, the same reference numerals are assigned to similar components.

[0011] <Configuration of the Device> With reference to FIGS. 1 and 2, the configuration of a driver monitoring system 1 including an imaging state confirmation device according to one embodiment will be described. FIG. 1 is a schematic block diagram showing the configuration of the driver monitoring system 1. FIG. 2 is a schematic side view partially showing the interior of a vehicle 100 equipped with the driver monitoring system 1.

[0012] The driver monitoring system 1 is mounted on the vehicle 100 and monitors the state of the driver of the vehicle 100. As shown in FIG. 2, the vehicle 100 includes a steering wheel 102 attached via a steering column 101 and a driver's seat 103 on which the driver sits. The driver's seat 103 includes a seat cushion 103a and a seat back 103b.

[0013] As shown in FIG. 1, in the present embodiment, the driver monitoring system 1 includes a driver monitoring camera 11, a seat sensor 12, a column sensor 13, a seat adjustment switch 14, a column adjustment switch 15, a display 21, a speaker 22, an actuator 25, and an electronic control unit (hereinafter referred to as "ECU") 30.

[0014] The driver monitoring camera 11, the seat sensor 12, the column sensor 13, the seat adjustment switch 14, the column adjustment switch 15, the display 21, the speaker 22, the actuator 25, and the ECU 30 are communicably connected via, for example, an in-vehicle network 27. The in-vehicle network 27 is a network compliant with a standard such as CAN (Controller Area Network), for example.

[0015] The driver monitoring camera 11 is an example of an imaging device that images the driver. In the present embodiment, the driver monitoring camera 11 is provided at the upper part of the steering column 101 and is arranged facing the driver so as to be able to image the driver, specifically, a part of the driver's face and upper body. In the present embodiment, the driver monitoring camera 11 is arranged to image in the direction toward the rear of the vehicle 100, that is, in the direction from the steering wheel 102 toward the driver's seat 103.

[0016] The driver monitoring camera 11 includes a camera and a projector. For example, the camera is a CMOS (Complementary Metal Oxide Semiconductor) camera or a CCD (Charge Coupled Device) camera, and the projector is an LED (Light Emitting Diode). Also, in order to be able to photograph the driver's face without giving discomfort to the driver even in low illuminance situations such as at night, the projector is preferably a near-infrared LED, and it is also preferable that the camera can detect near-infrared rays. For example, the projector is two near-infrared LEDs arranged on both sides of the camera. Also, a filter such as a visible light cut filter may be provided in the camera. The driver monitoring camera 11 outputs the images taken at predetermined intervals to the ECU 30 via the in-vehicle network 27.

[0017] Note that the driver monitoring camera 11 may be provided at a position different from the upper part of the steering column 101 as long as it can image the driver of the vehicle 100. For example, the driver monitoring camera 11 may be provided on the steering wheel 102, the rearview mirror, the meter panel, the meter hood, etc. of the vehicle 100.

[0018] The seat sensor 12 is an example of a detector that detects the state of the driver's seat 103 on which the driver is seated. Specifically, it detects the adjustable parameters of the driver's seat 103. For example, the seat sensor 12 detects the position of the driver's seat 103 in the vehicle front-rear direction, the position in the vehicle up-down direction, the angle of the seat back 103b, the angle of the seat cushion 103a, etc. The seat sensor 12 outputs the detection result to the ECU 30 via the in-vehicle network 27.

[0019] The column sensor 13 is an example of a detector that detects the state of the steering column 101 to which the driver monitoring camera 11 is attached. Specifically, it detects the adjustable parameters of the steering column 101. For example, the column sensor 13 detects the tilt angle of the steering column 101, the position in the vehicle front-rear direction, etc. The column sensor 13 outputs the detection result to the ECU 30 via the in-vehicle network 27.

[0020] The seat adjustment switch 14 is an example of a device for the user to adjust the state of the driver's seat 103. Specifically, the seat adjustment switch 14 is used to electrically adjust the adjustable parameters of the driver's seat 103. Therefore, by pressing the seat adjustment switch 14, the driver can move the driver's seat 103 in the front-back direction or up-down direction, or change the angle of the seat back 103b or the seat cushion 103a. The seat adjustment switch 14 outputs an operation signal from the driver to the ECU 30 via the in-vehicle network 27.

[0021] Also, the column adjustment switch 15 is an example of a device for the user to adjust the state of the steering column 101. The column adjustment switch 15 is used to electrically adjust the adjustable parameters of the steering column 101. Therefore, by pressing the column adjustment switch 15, the tilt angle and the front-back position of the steering column 101 are changed, and as a result, the imaging direction and the imaging position by the driver monitor camera 11, that is, the state of the driver monitor camera 11 are changed. The column adjustment switch 15 outputs an operation signal from the driver to the ECU 30 via the in-vehicle network 27.

[0022] The display 21 is an example of a display device for displaying an image. The display 21 is a display device of an arbitrary method, such as a liquid crystal display or an organic EL display. The display 21 is arranged so that at least the driver can view its screen. Therefore, the display 21 is arranged, for example, on the instrument panel, the meter panel, etc. of the vehicle 100. The display 21 receives an image signal from the ECU 30 via the in-vehicle network 27 and displays an image according to this image signal. Note that the vehicle 100 may be provided with another method of display device, such as a head-up display, instead of or in addition to the display 21 as a display device.

[0023] The speaker 22 is an example of a device that outputs sound. The speaker 22 receives an audio signal from the ECU 30 via the in-vehicle network 27 and outputs sound according to this audio signal.

[0024] The actuator 25 is an example of a device for changing the state of the driver's seat 103 and the state of the steering column 101. The actuator 25 changes the adjustable parameters of the driver's seat 103 according to a signal from the ECU 30. Specifically, the actuator 25 moves the driver's seat 103 in the front-rear direction or the up-down direction, or changes the angle of the seat back 103b or the seat cushion 103a. Also, the actuator 25 changes the adjustable parameters of the steering column 101 according to a signal from the ECU 30. Specifically, the actuator 25 changes the tilt angle and the front-rear position of the steering column 101.

[0025] In this embodiment, although the actuator 25 is connected to the ECU 30, it may be directly connected to the seat adjustment switch 14 and the column adjustment switch 15. Also, the adjustment of the state of the driver's seat 103 and the adjustment of the state of the steering column 101 may be performed manually instead of electrically. In this case, the seat adjustment switch 14, the column adjustment switch 15, and the actuator 25 are not provided.

[0026] The ECU 30 controls the image displayed on the display 21 and the sound output from the speaker 22. Also, the ECU 30 functions as an imaging state confirmation device for confirming the imaging state by the driver monitor camera 11. As shown in FIG. 1, the ECU 30 includes a communication interface 31, a storage unit 32, and a processor 33.

[0027] The communication interface 31 is a circuit for connecting the ECU 30 to the in-vehicle network 27 and the actuator 25.

[0028] The storage unit 32 stores data. The storage unit 32 has, for example, at least one of a volatile semiconductor memory, a non-volatile semiconductor memory, a hard disk drive (HDD), and a solid state drive (SSD). The storage unit 32 stores a program executed by the processor 33 of the ECU 30. Further, the storage unit 32 stores data transmitted from the driver monitoring camera 11 or the like.

[0029] The processor 33 has one or more CPUs (Central Processing Unit) and its peripheral circuits. The processor 33 may further have other arithmetic circuits such as a logical arithmetic unit or a numerical arithmetic unit. The processor 33 executes the program stored in the storage unit 32.

[0030] FIG. 3 is a functional block diagram of the processor 33 of the ECU 30. As shown in FIG. 3, the processor 33 includes an image determination unit 331, a warning notification unit 332, an imaging notification unit 333, a position detection unit 334, a deviation amount calculation unit 335, an icon display unit 336, a deviation amount correction unit 337, and a position change display unit 338.

[0031] The image determination unit 331 determines whether the driver's face image is included in the image received from the driver monitor camera 11 so as to satisfy a predetermined standard. The warning notification unit 332 notifies the driver of a warning when the image determination unit 331 determines that the driver's face image is not included so as to satisfy the predetermined standard. The imaging notification unit 333 notifies the driver to assume a sitting posture for vehicle driving after or simultaneously with the notification of the warning by the warning notification unit 332. The position detection unit 334 detects the position of the driver's face image in the image captured by the driver monitor camera 11 at an arbitrary point in time after the notification by the imaging notification unit 333. The deviation amount calculation unit 335 calculates the deviation amount of the position of the driver's face image in the image captured by the driver monitor camera 11 from the appropriate position or appropriate range at the above point in time. The icon display unit 336 displays an icon in an arbitrary frame of the display 21 so as to correspond to the position of the face image in the image captured by the driver monitor camera 11. In addition, the icon display unit 336 also displays the image captured by the driver monitor camera 11 in such a frame. The deviation amount correction unit 337 corrects the deviation amount based on the adjustment amount of the state of the driver seat 103 or the adjustment amount of the state of the driver monitor camera 11. In addition, the position change display unit 338 changes and displays the position of the icon in the frame of the driver monitor camera 11 based on the adjustment amount of the state of the driver seat 103 or the adjustment amount of the state of the driver monitor camera 11. Each of these units included in the processor 33 is a functional module realized by, for example, a computer program operating on the processor 33. Alternatively, each unit included in the processor 33 may be a dedicated arithmetic circuit provided in the processor 33.

[0032] <Overview of Imaging State Confirmation Process> Next, with reference to FIG. 4, the imaging state confirmation process according to the present embodiment will be described. FIG. 4 is a diagram showing an example of an image displayed on the screen 21a of the display 21.

[0033] FIG. 4(A) shows a state where an image captured by the driver monitor camera 11 is displayed on the screen 21a of the display 21. In FIG. 4(A), the solid line indicates the driver image DI appearing in the image captured by the driver monitor camera 11, and the dashed line indicates the icon FI. In the example shown in FIG. 4(A), since the viewing angle of the driver monitor camera 11 is too low for the driver, the upper part of the driver's face is not reflected in the driver monitor camera 11. As a result, the image displayed on the screen 21a of the display 21 shown in FIG. 4(A) does not include the upper part of the driver's face image DF in the driver image DI.

[0034] By the way, the image captured by the driver monitor camera 11 is used for, for example, detecting the driver's drowsiness, detecting the driver's glance aside, or detecting the driver's abnormal state by performing image processing. However, in order to perform such detection, it is necessary that the image captured by the driver monitor camera 11 includes an image of the entire driver's face. However, as shown in FIG. 4(A), if a part of the driver's face image DF is not included in the image captured by the driver monitor camera 11, such detection cannot be appropriately performed. Therefore, it is necessary to adjust the state of the driver seat 103 or the state of the steering column 101 (that is, the state of the driver monitor camera 11) so that the image captured by the driver monitor camera 11 includes an image of the entire driver's face.

[0035] Here, in the present embodiment, as shown in FIG. 4(A), an icon FI is displayed at a position corresponding to the driver's face image DF. In particular, in the present embodiment, an icon FI in the form of a broken line in a circular or elliptical shape that matches the contour of the driver's face image DF is displayed. Such an icon FI is, for example, obtained by performing arbitrary image recognition processing on an image captured by the driver monitor camera 11 to recognize the face image included in the image, and arranging the icon FI according to the recognized face image, so as to be displayed at a position corresponding to the driver's face image DF. In particular, in the example shown in FIG. 4(A), since a part of the driver's face image DF is not included in the image captured by the driver monitor camera 11, the icon FI also has an elliptical shape with a part missing.

[0036] Thereafter, the icon FI is moved based on the adjustment amount of the state of the driver's seat 103 or the adjustment amount of the state of the steering column 101. In particular, the icon FI moves so as to correspond to the change in the position of the driver's face image in the image captured by the driver monitor camera 11 accompanying the adjustment of the state of the driver's seat 103 or the adjustment of the state of the steering column 101. Therefore, for example, when the vertical position of the driver's seat 103 is lowered, the position of the icon FI in the screen 21a of the display 21 drops. Also, for example, when the tilt angle of the steering column 101 increases (the shooting direction of the driver monitor camera 11 moves upward), the position of the icon FI in the screen 21a of the display 21 drops. When the position of the icon FI in the screen 21a of the display 21 drops in this way, as shown in FIG. 4(B), the icon FI comes to fit within the screen 21a of the display 21. As a result, it becomes possible to appropriately detect the driver's dozing, looking aside, and abnormal states based on the image captured by the driver monitor camera 11.

[0037] Incidentally, when the driver performs an adjustment operation to adjust the state of the driver's seat 103 or the steering column 101, the position of the driver's face may move during the adjustment operation. For this reason, if an image captured by the driver monitor camera 11 is displayed in real time on the screen 21a of the display 21, the driver may not always be able to appropriately adjust the state of the driver's seat 103 or the steering column 101. In contrast, in the present embodiment, an icon FI corresponding to the driver's face image DF is displayed within the screen 21a of the display 21, and the position of the icon FI is changed as the state of the driver's seat 103 or the steering column 101 is adjusted. The position of the icon FI does not change even if the position of the driver's face changes due to the adjustment operation. Therefore, the driver can adjust the state of the driver's seat 103 or the steering column 101 so that the driver's face image is included in the image captured by the driver monitor camera 11.

[0038] Note that FIG. 4(A) shows a case where an image captured by the driver monitor camera 11 is displayed over the entire screen 21a of the display 21 (that is, within the frame of the entire screen 21a). However, the image captured by the driver monitor camera 11 may be displayed within a part of the frame of the screen 21a of the display 21. In this case, the icon DI will move within this part of the frame as the state of the driver's seat 103 or the steering column 101 is adjusted.

[0039] <Specific Control> Next, with reference to FIGS. 5 and 6, specific control will be described. FIG. 5 is a flowchart showing the flow of an adjustment start process for starting the imaging state adjustment process described later. The adjustment start process is periodically executed by the processor 33 of the ECU 30.

[0040] As shown in FIG. 5, when the adjustment start process is executed, first, the image determination unit 331 acquires the image currently captured by the driver monitor camera 11 (step S11). The image captured by the driver monitor camera 11 is transmitted to the ECU 30 via the in-vehicle network 27 and stored in the storage unit 32. The image determination unit 331 acquires the current image from the storage unit 32.

[0041] Next, the image determination unit 331 determines whether or not the face image of the driver is included in the image acquired in step S11 so as to satisfy a predetermined standard (step S12). Specifically, the image determination unit 331 recognizes the face image included in the image acquired in step S11 by, for example, any image recognition process. The face image recognized at this time includes not only the image of the entire face but also the image of a part of the face. Then, the image determination unit 331 determines whether the face image recognized in this way satisfies the criteria necessary to detect the driver's dozing, looking aside, or abnormal state. Specifically, the image determination unit 331 determines, for example, whether or not the parts (for example, both eyes, nose, mouth) necessary to detect the state of the face (eye opening / closing, line of sight direction, face direction, etc.) are included in the face image. In this case, the image determination unit 331 determines that the face image of the driver satisfies a predetermined standard when all the parts necessary to detect the state of the face are included in the face image. On the other hand, the image determination unit 331 determines that the face image of the driver does not satisfy a predetermined standard when a part of the parts necessary to detect the state of the face is not included in the face image. Note that the standard that the face image should satisfy may be a standard different from the above-described standard (that is, whether or not the parts necessary to detect the state of the face are included in the face image) as long as it is a standard necessary to detect the driver's dozing, looking aside, or abnormal state.

[0042] If it is determined in step S12 that the face image of the driver is included so as to satisfy a predetermined standard, since the face image of the driver is appropriately captured, the adjustment start process is terminated. In this case, the imaging state adjustment process described later is not executed.

[0043] On the other hand, if it is determined in step S12 that the driver's face image is not included so as to satisfy a predetermined standard, the warning notification unit 332 notifies the driver of a warning (step S13). In the present embodiment, the warning notification unit 332 notifies the driver of a warning to the effect that the driver's face cannot be recognized by the driver monitoring camera 11. Specifically, the warning notification unit 332 causes such a warning to be displayed on the display 21 and outputs a voice representing such a warning from the speaker 22.

[0044] In addition, the warning notification unit 332 notifies the driver of an inquiry as to whether or not to start adjusting the imaging state, and determines whether or not the driver has approved the adjustment of the imaging state (step S14). Specifically, the warning notification unit 332, for example, causes such an inquiry, as well as an approval button and a rejection button, to be displayed on the display 21. Then, when the approval button is pressed by the driver, the warning notification unit 332 determines that the driver has approved the adjustment of the imaging state. On the other hand, when the rejection button is pressed by the driver, the warning notification unit 332 determines that the driver has rejected the adjustment of the imaging state.

[0045] If it is determined in step S14 that the driver has approved the adjustment of the imaging state, an imaging state adjustment process described later is started (step S15). On the other hand, if it is determined in step S14 that the driver has rejected the adjustment of the imaging state, the adjustment start process ends without starting the imaging state adjustment process. In this case, the execution timing of the next adjustment start process may be delayed until an arbitrary timing (for example, when the ignition switch of the vehicle 100 is turned on next time).

[0046] FIG. 6 is a flowchart showing the flow of an imaging state adjustment process for adjusting the imaging state. The imaging state adjustment process is executed by the processor 33 of the ECU 30 when the adjustment start process shown in FIG. 5 proceeds to step S15.

[0047] As shown in FIG. 6, when the imaging state adjustment process is started, first, the imaging notification unit 333 notifies the driver of the seating posture (step S21). Specifically, the imaging notification unit 333 notifies the driver to assume a seating posture for vehicle driving. For example, the imaging notification unit 333 causes the display 21 to display a message requesting the driver to assume a seating posture for vehicle driving, and causes the speaker 22 to output a voice making such a request. More specifically, the imaging notification unit 333 causes the display 21 to display a message requesting the driver to rest his / her head on the headrest and remain stationary, and causes the speaker 22 to output a voice making such a request. Further, in the present embodiment, after the imaging notification unit 333 notifies the driver of the seating posture, the imaging notification unit 333 notifies the driver of the timing for imaging. Specifically, the imaging notification unit 333 causes the display 21 to display a countdown until the imaging timing, and outputs a voice from the speaker 22.

[0048] Next, the position detection unit 334 acquires, from the storage unit 32, an image captured by the driver monitor camera 11 at an arbitrary point in time (step S22). The arbitrary point in time is, for example, a point in time after the notification regarding the seating posture in step S21 has been made. In particular, in the present embodiment, the arbitrary point in time is a point in time immediately after the imaging notification unit 333 has notified the driver of the timing for imaging. Therefore, in the present embodiment, the position detection unit 334 acquires, from the storage unit 32, an image captured by the driver monitor camera 11 immediately after the imaging notification unit 333 has notified the driver of the timing for imaging.

[0049] Next, the position detection unit 334 detects the position of the face image of the driver in the image acquired in step S22 (step S23). Similar to step S12 described above, the position detection unit 334 recognizes the face image included in the image acquired in step S22 by any image recognition process. In addition, the position detection unit 334 calculates the position of the face image of the driver in the image acquired in step S22. Specifically, the position detection unit 334 estimates, for example, the coordinates of the position that is the center of the face from the recognized face image.

[0050] In addition, in the present embodiment, the deviation amount calculation unit 335 calculates the deviation amount of the position of the driver's face image in the image acquired in step S22 from the appropriate position or the appropriate range (step S23). The deviation amount calculation unit 335 calculates the distance between a preset appropriate position of the face image (for example, the position at the center of the image acquired in step S22) and the position of the face image detected by the position detection unit 334 as the deviation amount. Alternatively, the deviation amount calculation unit 335 calculates the distance from a preset appropriate range of the face image (for example, a certain range closer to the center of the image acquired in step S22) to the position of the face image detected by the position detection unit 334 as the deviation amount.

[0051] Next, the icon display unit 336 displays the icon FI at a position corresponding to the position of the driver's face image in the image acquired in step S22 within an arbitrary frame (in the present embodiment, the entire screen 21a) of the screen 21a of the display 21 (step S24). In particular, in the present embodiment, the icon display unit 336 determines the display position of the icon FI based on the deviation amount calculated by the deviation amount calculation unit 335. As a result, the icon FI is displayed at a position deviated from the appropriate position or the appropriate range by the amount of deviation. In addition, in the present embodiment, the icon display unit 336 also displays the image acquired in step S22 within an arbitrary frame of the screen 21a of the display 21. As a result, an image as shown in FIG. 4(A) is displayed on the display 21.

[0052] Next, the deviation amount correction unit 337 determines whether the state of the driver seat 103 or the state of the steering column 101 has been adjusted based on the output signals from the seat sensor 12 and the column sensor 13 (step S25). Step S25 is repeated while it is determined that the state of the driver seat 103 and the state of the steering column 101 have not been adjusted.

[0053] On the other hand, when it is determined in step S25 that the state of the driver's seat 103 and the state of the steering column 101 have been adjusted, the deviation amount correction unit 337 corrects the deviation amount based on the adjustment amount of the state of the driver's seat 103 or the adjustment amount of the state of the steering column 101. In the present embodiment, the deviation amount correction unit 337 corrects the deviation amount by an amount corresponding to the amount of change in the position of the driver's face accompanying the adjustment of the state of the driver's seat 103 or the adjustment of the state of the steering column 101. Therefore, for example, when the driver's seat 103 moves downward by a predetermined amount, the deviation amount in the vertical direction is corrected by an amount corresponding to the movement amount.

[0054] Next, the position change display unit 338 changes and displays the position of the icon FI within the screen 21a of the display 21 based on the adjustment amount of the state of the driver's seat 103 or the adjustment amount of the state of the steering column 101 (step S27). In the present embodiment, the position change display unit 338 determines the display position of the icon FI based on the deviation amount corrected in step S25, similarly to step S24. As a result, the icon FI will move and be displayed by an amount corresponding to the adjustment amount of the state of the driver's seat 103 or the adjustment amount of the state of the steering column 101.

[0055] Next, the position change display unit 338 determines whether the position of the driver's face is appropriate (step S28). In the present embodiment, the position change display unit 338 determines whether the position of the driver's face is appropriate based on whether the deviation amount corrected in step S25 is less than or equal to a predetermined reference value. If the deviation amount corrected in step S25 is greater than the predetermined reference value, it means that the position of the face is still deviated from the appropriate position or the appropriate range, so it is determined that the position of the face is not appropriate. On the other hand, if the deviation amount corrected in step S25 is less than or equal to the predetermined reference value, it means that the position of the face is within the appropriate position or the appropriate range or close to the appropriate position or the appropriate range, so it is determined that the position of the face is appropriate.

[0056] If it is determined in step S28 that the position of the face is not appropriate, the process returns to step S25. On the other hand, if it is determined in step S28 that the position of the face is appropriate, the position change display unit 338 notifies the driver that the face is in the appropriate position. Specifically, the position change display unit 338 causes the display 21 to display that the face is in the appropriate position and that no further adjustment is required, and outputs such a voice from the speaker 22.

[0057] <Modification example> In the above embodiment, the icon display unit 336 also displays the image acquired in step S22 in an arbitrary frame of the screen 21a of the display 21 in step S24 of FIG. 6 in addition to the icon FI. However, the icon display unit 336 may display only the icon FI without displaying the image acquired in step S22. Further, the icon display unit 336 and the position change display unit 338 may display the current deviation amount in addition to the icon FI.

[0058] In the above embodiment, the deviation amount is calculated by the deviation amount calculation unit 335 and the deviation amount is corrected by the deviation amount correction unit 337. However, the deviation amount may not be calculated. In this case, the icon display unit 336 displays the icon FI at a position corresponding to the position of the face image calculated by the position detection unit 334. In addition, the position change display unit 338 changes the display position of the icon FI based on the adjustment amount of the state of the driver's seat 103 or the adjustment amount of the state of the steering column 101.

[0059] Also, in the above embodiment, the notification regarding the sitting posture in step S21 is performed after the warning by the warning notification unit 332 in step S13. However, the notification regarding the sitting posture in step S21 may be performed simultaneously with the warning by the warning notification unit 332 in step S13. In this case, the inquiry as to whether or not to start adjusting the imaging state in step S14 is not made. Therefore, when it is determined in step S12 that the driver's face image is not included so as to satisfy a predetermined standard, the imaging state adjustment process will be started.

[0060] As described above, the preferred embodiments according to the present disclosure have been described. However, the present disclosure is not limited to these embodiments, and various modifications and changes can be made within the scope of the claims.

Explanation of Reference Numerals

[0061] 1 Driver Monitoring System 11 Driver Monitoring Camera 30 ECU 33 Processor

Claims

1. An imaging state confirmation device for confirming an imaging state by an imaging device that images a driver, comprising: a position detection unit that detects the position of the face image of the driver in an image captured by the imaging device at any given point in time; an icon display unit that displays an icon within an arbitrary frame of a display device so as to correspond to the position of the face image in the image; a position change display unit that changes and displays the position of the icon within the frame of the display device based on an adjustment amount of the state of the seat on which the driver is seated or an adjustment amount of the state of the imaging device.

2. a deviation amount calculation unit that calculates a deviation amount from an appropriate position or an appropriate range of the position of the face image of the driver in the image captured by the imaging device at the given point in time; a deviation amount correction unit that corrects the deviation amount based on an adjustment amount of the state of the seat on which the driver is seated or an adjustment amount of the state of the imaging device; and the icon display unit and the position change display unit determine the display position of the icon based on the deviation amount. The imaging state confirmation device according to Claim 1.

3. The icon display unit displays the image captured by the imaging device at the given point in time within the frame. The imaging state confirmation device according to Claim 1 or 2.

4. The imaging state confirmation device according to Claim 1 or 2, further comprising an imaging notification unit that notifies the driver of a seating posture before the given point in time.

5. an image determination unit that determines whether or not a face image of the driver is included in the image received from the imaging device so as to satisfy a predetermined standard; a warning notification unit that notifies the driver of a warning when the face image of the driver is not included so as to satisfy the predetermined standard; and the imaging notification unit notifies the driver to assume a seating posture for vehicle driving after or simultaneously with the notification of the warning by the warning notification unit. The imaging state confirmation device according to Claim 4.

Images