Notification control device, notification control method, and non-transitory computer recording medium
By detecting the target objects around the vehicle and the driver's status, setting the imaginary plane to judge the gaze situation, only sending a notification when the number of target objects is small, and adjusting the identification and determination time according to the number of target objects, the multiple target objects outside the vehicle are solved, resulting in the result of multiple target objects outside the vehicle The unnecessary alarm problem improves the driver's operating experience.
Patent Information
- Application Number
- CN202410549652.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-05-09
- Filing Date
- 2024-05-06
- Publication Date
- 2024-11-12
AI Technical Summary
When there are multiple targets that should be watched outside the vehicle, the existing alarm device may unnecessarily notify the driver, causing the driver to get bored.
By detecting the status of the target objects around the vehicle and the driver, setting an imaginary plane to determine whether the driver is staring at the target object, only a notification is issued when the number of target objects is small, and the identification and determination time is adjusted according to the number of target objects to avoid not Necessary alerts.
It effectively suppresses unnecessary alarms, reduces the driver's boredom with notifications, and ensures that the driver will not be subject to unnecessary interference when mastering multiple targets.
Smart Images

Figure CN118928423A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a notification control device, a notification control method and a non-transitory computer recording medium. Background Art
[0002] In Japanese Patent Gazette No. 2019-185218, as an existing alarm device that can notify based on the driver's gaze status, the following structure is disclosed: based on line of sight information showing the direction of the driver's line of sight and eye position information showing the driver's eye position in three-dimensional coordinates, the gaze point that the driver is looking at is estimated, and based on the target object to be looked at and the gaze point, it is determined whether the driver is looking at the target object, and notification is made if it is determined that the driver is not looking at it. Summary of the invention
[0003] When there are multiple targets that should be watched outside the vehicle, it is assumed that the driver will not fix his sight on one of the targets, but will direct his sight toward all targets without omission to grasp the position of each target, etc. Therefore, according to the above-mentioned conventional alarm device, when there are multiple targets that should be watched outside the vehicle, even if the driver has grasped each target, since the sight is not directed toward one of the targets, the notification (alarm) related to the target that should be watched will be issued, and the driver may be annoyed by the notification.
[0004] The present invention has been made with attention paid to such a problem, and an object of the present invention is to prevent the driver from being annoyed by notifications regarding an object that the driver should focus on. Means for solving technical problems
[0005] The gist of the present disclosure is as follows.
[0006] (1) A notification control device for notifying a driver of a vehicle, the device comprising: detecting targets to be noticed that exist around the vehicle based on surrounding data indicating the surrounding conditions of the vehicle, setting the driver's field of view based on driver data indicating the driver's status, and when the number of targets is less than a specified number, setting imaginary planes on which the targets are projected relative to the vehicle at the positions of the targets, and if the driver's field of view does not overlap with the projected portion of the targets on the imaginary plane within a specified period after the targets are detected, a notification is given to the driver that there are targets to be noticed, and when the number of targets is greater than the specified number, the driver is not notified.
[0007] (2) A notification control device for notifying a driver of a vehicle, the device comprising: detecting a target object to be noticed existing around the vehicle based on surrounding data indicating the surrounding conditions of the vehicle; setting the driver's field of view based on driver data indicating the driver's status; and setting a virtual plane on which the target object is projected in a manner relative to the vehicle at the position of the target object; if, within a specified period after the target object is detected, the driver's field of view overlaps with the projected portion of the target object on the virtual plane for more than a specified recognition determination time, it is determined that the driver has recognized the target object; if there are targets that the driver has not recognized among the detected targets, the driver is notified of the existence of the targets to be noticed; and when the number of detected targets is large, the recognition determination time is shortened compared to when the number is small.
[0008] (3) A notification control device according to (2) above, wherein when the number of target objects is less than a specified number, the identification judgment time is set to a second judgment time, and when the number of target objects is greater than a specified number, the identification judgment time is set to a first judgment time that is smaller than the second judgment time.
[0009] (4) The notification control device according to any one of (1) to (3) above, wherein the number of detected target objects is corrected based on a weighting coefficient set for each type of target object.
[0010] (5) A notification control method, which is a notification control method based on a notification control device for notifying a driver of a vehicle, wherein targets that should be noticed and exist around the vehicle are detected based on surrounding data indicating the surrounding conditions of the vehicle, and the driver's field of view is set based on driver data indicating the driver's status. When the number of targets is less than a specified number, imaginary planes on which the targets are projected are set at the positions of the targets in a manner relative to the vehicle. If the driver's field of view and the projected portion of the targets on the imaginary plane do not overlap within a specified period after the targets are detected, a notification is given to the driver to report the existence of targets that should be noticed. When the number of targets is greater than the specified number, the notification is not given to the driver.
[0011] (6) A notification control method, which is a notification control method based on a notification control device for notifying a driver of a vehicle, wherein: a target object that should be noticed existing around the vehicle is detected based on surrounding data indicating the surrounding conditions of the vehicle, the driver's field of view is set based on driver data indicating the driver's status, and at the position of the target object, an imaginary plane on which the target object is projected is set in a manner relative to the vehicle. If, within a specified period after the target object is detected, the driver's field of view overlaps with the projected portion of the target object on the imaginary plane for more than a specified recognition judgment time, it is determined that the driver has recognized the target object. If there are targets that the driver has not recognized among the detected targets, the driver is notified of the existence of the targets that should be noticed. When the number of detected targets is large, the recognition judgment time is shortened compared to when the number is small.
[0012] (7) A non-transitory computer recording medium, which is a non-transitory computer recording medium containing a computer program for a notification control device for notifying a driver of a vehicle, the non-transitory computer recording medium containing a computer program for causing the notification control device to perform the following processing: detecting targets that should be noticed and exist around the vehicle based on surrounding data representing the surrounding conditions of the vehicle, setting the driver's field of view based on driver data representing the driver's status, and when the number of targets is less than a specified number, setting virtual planes on which the targets are projected at the positions of the targets in a manner relative to the vehicle, and if the driver's field of view and the projected part of the targets on the virtual plane do not overlap within a specified period after the targets are detected, then notifying the driver of the existence of targets that should be noticed, and not implementing the notification to the driver when the number of targets is greater than the specified number.
[0013] (8) A non-transitory computer recording medium, which is a non-transitory computer recording medium containing a computer program for a notification control device for notifying a driver of a vehicle, the non-transitory computer recording medium containing a computer program for causing the notification control device to perform the following processing: detecting a target object that should be noticed existing around the vehicle based on surrounding data representing the surrounding conditions of the vehicle, setting the driver's field of view based on driver data representing the driver's status, and setting a virtual plane on which the target object is projected in a manner relative to the vehicle at the position of the target object; if within a specified period after the target object is detected, the driver's field of view overlaps with the projected portion of the target object on the virtual plane for more than a specified recognition judgment time, it is determined that the driver has recognized the target object; if there are targets that the driver has not recognized among the detected targets, the driver is notified of the existence of the targets that should be noticed; when the number of detected targets is large, the recognition judgment time is shortened compared to when the number is small. Effects of the Invention
[0014] According to these aspects of the present invention, when there are a plurality of objects to be watched outside the vehicle, it is possible to suppress unnecessary warnings to the driver, thereby suppressing the driver from being annoyed by notifications about the objects. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] Figure 1 This is a diagram showing a schematic system configuration of a vehicle according to the first embodiment of the present invention. Figure 2 It is a diagram showing the hardware configuration of the control device. Figure 3 This is a flowchart for explaining the details of the notification process according to the first embodiment of the present invention. Figure 4 It is a diagram illustrating the driver's field of view. Figure 5A 1 is a diagram for explaining an example of a method for determining whether the driver has recognized a fixation target object. Figure 5B 1 is a diagram for explaining an example of a method for determining whether the driver has recognized a fixation target object. Figure 6 This is a flowchart for explaining the details of the notification process according to the second embodiment of the present invention. DETAILED DESCRIPTION
[0016] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, the same components are given the same reference numerals.
[0017] (First Embodiment) Figure 1 This is a system schematic diagram of a vehicle 100 according to the first embodiment of the present invention.
[0018] The vehicle 100 includes a surrounding sensor 1, a driver sensor 2, an output device 3, and a control device 4. The surrounding sensor 1, the driver sensor 2, the output device 3, and the control device 4 are communicatively connected via an in-vehicle network 5 based on a standard such as a controller area network. The vehicle 100 may be a vehicle with an automatic driving function or a driving assistance function, or may be a manually driven vehicle.
[0019] The surrounding sensor 1 is a sensor for generating surrounding data indicating the conditions around the vehicle 100. In the present embodiment, one or more external cameras for capturing images of the surroundings of the vehicle 100 are provided as the surrounding sensor 1. The external camera captures the surroundings of the vehicle 100 at a predetermined frame rate (e.g., 10 [Hz] to 40 [Hz]) and generates a surrounding image in which the surroundings of the vehicle 100 are reflected. Each time the external camera generates a surrounding image, it transmits the generated surrounding image to the control device 4 as surrounding data.
[0020] In addition, a distance measuring sensor that measures the distance to other vehicles, pedestrians, bicycles, and other targets existing around the vehicle 100 may be provided as the surrounding sensor 1 instead of or in addition to the external camera. Examples of distance measuring sensors include a laser radar (LiDAR) that irradiates radar light and measures the distance based on the reflected light, and a millimeter wave radar sensor that irradiates radio waves and measures the distance based on the reflected waves.
[0021] The driver sensor 2 is a sensor for generating driver data indicating the state of the driver. In the present embodiment, a driver monitoring camera for capturing the appearance of the driver including the driver's face is provided as the driver sensor 2. The driver monitoring camera captures the appearance of the driver at a predetermined frame rate (e.g., 10 [Hz] to 40 [Hz]) and generates an appearance image in which the appearance of the driver is reflected. Each time the driver monitoring camera generates an appearance image of the driver, it sends the generated appearance image to the control device 4 as driver data.
[0022] The output device 3 is a device for notifying the driver of the vehicle 100 through the driver's physical senses (such as vision, hearing, and touch). In this embodiment, the output device 3 includes a display (such as an instrument display, a center display, or a head-up display, etc.) and a speaker arranged at a position where the driver can visually recognize. The display displays information (such as text information or image information) corresponding to the display signal output from the control device 4. The speaker outputs sound corresponding to the sound signal output from the control device 4.
[0023] The control device 4 is an ECU (Electronic Control Unit) including a communication unit 41, a storage unit 42, and a processing unit 43 (see Figure 2), at least configured to be able to determine a target object outside the vehicle that should be watched (watched target object), and to notify the driver of the target object via the output device 3 based on the driver's recognition of the target object. In addition to the above-mentioned surrounding data and driver data, various data such as vehicle position data obtained by a positioning sensor and vehicle speed data obtained by a vehicle speed sensor can be input into the control device 4 as needed.
[0024] Figure 2 It is a diagram showing the hardware configuration of the control device 4 .
[0025] The control device 4 includes a communication unit 41 , a storage unit 42 , and a processing unit 43 .
[0026] The communication unit 41 includes an interface circuit for connecting the control device 4 to the in-vehicle network 5. The communication unit 41 supplies data (peripheral data, driver data, etc.) received from the outside to the processing unit 43. In addition, the communication unit 41 sends display signals and audio signals output from the processing unit 43 to the output device 3.
[0027] The storage unit 42 includes a storage medium such as a HDD (Hard Disk Drive), an SSD (Solid Disk Drive), or a semiconductor memory, and stores various computer programs and data used in the processing of the processing unit 43 .
[0028] The processing unit 43 has one or more CPUs (Central Processing Units) and their peripheral circuits, and executes various computer programs stored in the storage unit 42, such as a processor. Figure 3 , an example of notification processing which is one of the processing performed by the processing unit 43 and then the control device 4 is described.
[0029] Figure 3 This is a flowchart for explaining the details of the notification process according to this embodiment.
[0030] In step S1 , the control device 4 detects a target object existing around the vehicle 100 based on the surrounding data received from the surrounding sensor 1 , specifically, the surrounding image received from the external camera.
[0031] In the present embodiment, the control device 4 detects the area representing the target object and the type of the target object represented in the area in the surrounding image by sequentially inputting the surrounding image received from the external camera into the discriminator. The discriminator can be, for example, a convolutional neural network (CNN) having a plurality of convolutional layers connected in series from the input side to the output side. Then, the control device 4 estimates the distance from the external camera to the target object using the standard size of the target object stored in the storage unit 42 for each type of the target object and the size of the target object detected in the surrounding image, and tracks the target object detected in the surrounding image along a time series, thereby calculating the position and speed of the target object. In addition, the method for detecting the target object is not limited to such a method, as long as the detection is performed using various known methods.
[0032] In step S2, the control device 4 determines the target object to be watched among the targets existing around the vehicle 100 (hereinafter referred to as the "watch target target"). The watch target target can be, for example, another vehicle or pedestrian or bicycle approaching the vehicle 100, that is, a target that may collide with the vehicle 100. However, the present invention is not limited thereto, and for example, a predetermined target such as a pedestrian or bicycle can be determined as the watch target target, and a target whose distance from the vehicle 100 is less than a predetermined threshold in a direction perpendicular to the traveling direction of the vehicle 100 (lateral direction) can be determined as the watch target target.
[0033] In step S3 , the control device 4 sets the driver's field of view based on the driver data received from the driver sensor 2 , specifically, the driver's appearance image received from the driver monitoring camera.
[0034] In this embodiment, the control device 4 sequentially performs image processing on the facial image received from the driver monitoring camera 21, detects the position of the pupil center as the moving point (i.e., the driver's viewpoint position), and the position of the Purkinje image (corneal reflection image) as the reference point, and detects the driver's line of sight direction based on the positional relationship between the Purkinje image and the pupil center (the position of the moving point relative to the reference point). Figure 4 As shown, the control device 4 sets a viewing cone having a predetermined vertex angle (viewing angle) with the viewpoint position of the driver as the vertex and a sight line vector extending from the viewpoint position toward the sight line direction as the central axis as the driver's view field.
[0035] In addition, the method for setting the driver's field of view is not limited to this method, and it can be set by various well-known methods. Figure 4 As shown, the shape of the field of view is a cone, but the shape of the field of view is not limited to a cone, and may also be an elliptical cone or a polygonal cone or other cones. Figure 4The viewing cone shown is a so-called straight cone whose central axis passes through the centroid of the base, but it may also be a so-called oblique cone whose central axis does not pass through the centroid of the base.
[0036] In step S4 , the control device 4 determines whether the number of attention target objects (hereinafter referred to as “the number of attention target objects”) Nobj is greater than a predetermined number Nth set in advance.
[0037] As described above, when there are multiple gaze target objects outside the vehicle 100, when the number of gaze target objects Nobj increases, it is assumed that the driver will not fix his sight on one of the multiple gaze target objects, but will direct his sight toward each object without omission to grasp the position of each object, etc. Therefore, if the driver is arbitrarily notified (alarmed) about the gaze target objects simply because the driver's sight is not directed toward one of the multiple gaze target objects, the notification will be made even though the driver is in the process of directing his sight toward each gaze target object to grasp them, or even though the driver has grasped each gaze target object, and the driver may be annoyed by the notification.
[0038] Therefore, in this embodiment, it is determined whether the number of the objects to be watched Nobj is greater than the specified number Nth. If the number of the objects to be watched Nobj is greater than the specified number Nth, no notification related to the objects to be watched is performed, and the current processing is terminated regardless of whether the objects to be watched enter the driver's field of view. If the number of the objects to be watched Nobj is less than the specified number Nth, the processing proceeds to step S5, and in order to determine the necessity of the notification related to the objects to be watched, it is confirmed whether the objects to be watched enter the driver's field of view.
[0039] Thus, when there are a plurality of attention target objects outside the vehicle 100, it is possible to suppress a situation where a notification related to the attention target objects is issued even though the driver is in the process of directing his / her sight toward each of the attention target objects to grasp them, or a situation where a notification related to the attention target objects is issued even though the driver has grasped each of the attention target objects. Therefore, when there are a plurality of attention target objects outside the vehicle, it is possible to suppress a situation where an unnecessary warning is issued to the driver.
[0040] In addition, in the present embodiment, the prescribed number Nth is set to 6, but it may be other values. In addition, in the present embodiment, the number of objects to be watched Nobj is set to the number of simple objects. For example, when 4 pedestrians and 1 bicycle are detected as objects to be watched, the number of objects to be watched Nobj is 5. However, it is not limited to this. The number of objects to be watched Nobj may be calculated on the basis of weighting corresponding to the type of the object, for example, for pedestrians, the number of objects per person is set to 1, for bicycles, the number of objects per person is set to 2, etc. That is, the number of objects may be corrected based on the weighting coefficient set for each type of the object. In this example, the weighting coefficient of the pedestrian is 1, and the weighting coefficient of the bicycle is 2. Therefore, when 4 pedestrians and 1 bicycle are detected as objects to be watched, the number of objects to be watched Nobj is 6 (= 4 pedestrians × weighting coefficient 1 + 1 bicycle × weighting coefficient 2).
[0041] In step S5, the control device 4 determines whether the driver has recognized the target object. When the driver has recognized each target object, the control device 4 does not implement the notification related to the target object and ends the current processing. On the other hand, when the driver has not recognized even one target object, the control device 4 enters the processing of step S6.
[0042] In this embodiment, for example, Figure 5A As shown, the control device 4 sets an imaginary plane on which the gaze target object is projected in a manner orthogonal to the direction of vehicle travel. If, within a specified period after the gaze target object is detected, the driver's field of view on the imaginary plane overlaps with the projected portion of the gaze target object for more than a specified recognition judgment time Trec, it is determined that the driver has recognized the gaze target object.
[0043] On the other hand, for example Figure 5B As shown, if the driver's field of view and the projection position of the gaze object on the virtual plane do not overlap for more than the specified recognition judgment time Trec within a specified period after the gaze object is detected, the control device 4 determines that the driver has failed to recognize the gaze object.
[0044] exist Figure 5A and Figure 5B In the embodiment, the virtual plane is set at a position that is the shortest distance from the driver's viewpoint to the gaze target object, but is not limited thereto, and can be set at a position that includes the gaze target object. In addition, the virtual plane is set for each gaze target object.
[0045] In step S6, the control device 4 notifies the driver about the target object to be watched via the output device 3. The notification method is not particularly limited, and for example, the failure to recognize the target object to be watched may be notified by performing a voice broadcast, or by issuing a warning sound, or by using image information or text information, or by a combination thereof.
[0046] According to the present embodiment described above, the control device 4 (notification control device) for notifying the driver of the vehicle 100 is configured as follows: based on the surrounding data indicating the surrounding conditions of the vehicle 100, the attention target objects existing around the vehicle 100 are detected, and the driver's field of view is set based on the driver data indicating the driver's status. When the number of attention target objects Nobj is less than the specified number Nth, at the positions of the attention target objects, imaginary planes on which the attention target objects are projected are respectively set in a manner relative to the vehicle 100. If, within a specified period after the attention target objects are detected, the driver's field of view and the projection position of the attention target objects on the imaginary plane do not overlap for more than the specified recognition judgment time, the driver is notified of the existence of the attention target objects. When the number of attention target objects Nobj is greater than the specified number Nth, the notification is not implemented to the driver.
[0047] Thus, when there are a plurality of attention target objects outside the vehicle 100, the driver is not notified about the attention target objects, so that it is possible to suppress the notification about the attention target objects to the driver even though the driver is in the process of directing his / her sight toward each attention target object to grasp them, or the notification about the attention target objects to the driver even though the driver has grasped each attention target object. Therefore, when there are a plurality of attention target objects outside the vehicle 100, it is possible to suppress the unnecessary warning to the driver.
[0048] (Second Embodiment) Next, a second embodiment of the present invention will be described. This embodiment differs from the first embodiment in that the recognition determination time Trec is changed according to the number of gaze target objects Nobj, thereby suppressing the unnecessary implementation of an alarm when there are multiple gaze target objects outside the vehicle 100. The following description will focus on this difference.
[0049] As described above, when there are multiple gaze target objects outside the vehicle 100, when the number of gaze target objects Nobj increases, it is assumed that the driver will not fix his sight on one of the multiple gaze target objects, but will direct his sight toward each object without omission to grasp the position of each object, etc. That is, it is assumed that if the number of gaze target objects Nobj increases, the time for visually recognizing each object will be relatively shortened.
[0050] Therefore, when the number of gaze target objects Nobj is large, if the recognition judgment time Trec is not shortened accordingly, it is possible that although a certain gaze target object has been visually recognized, it is still judged that the gaze target object has not been recognized due to the short visual recognition time (the time when the driver's field of view overlaps with the projection part of the gaze target object). As a result, although the gaze target object has been grasped, a notification related to the gaze target object is still made, and the driver may be annoyed by the notification.
[0051] Therefore, in this embodiment, the recognition determination time Trec is changed according to the number of the attention target objects Nobj. Specifically, when the number of the attention target objects Nobj is large, the recognition determination time Trec is shortened compared to when it is small. Figure 6 An example of notification processing according to this embodiment will be described.
[0052] Figure 6 Detailed description of the notification process according to the present embodiment. Figure 6 In the embodiment, the contents of the processing from step S1 to step S6 are the same as those in the first embodiment, and thus the description thereof is omitted here.
[0053] In step S21 , the control device 4 sets the recognition determination time Trec to a predetermined first determination time T1 .
[0054] In step S22, the control device 4 sets the recognition determination time Trec to a predetermined second determination time T2.
[0055] The first determination time T1 is set to a value smaller than the second determination time T2. Thus, when the number of attention target objects Nobj is large, the recognition determination time Trec can be shortened, thereby preventing a situation where a certain attention target object is determined to be unrecognizable even though the attention target object is visually recognized.
[0056] The method of changing the recognition determination time Trec is not limited to this method. For example, the recognition determination time Trec may be gradually or stepwise reduced as the number of fixation target objects Nobj increases.
[0057] According to the present embodiment described above, the control device 4 (notification control device) for notifying the driver of the vehicle 100 is constructed as follows: based on the surrounding data indicating the surrounding conditions of the vehicle 100, the attention target existing around the vehicle 100 is determined, and the driver's field of view is set according to the driver data indicating the driver's status. At the position of the attention target, an imaginary plane on which the attention target is projected is set in a manner relative to the vehicle 100. If, within a specified period after the attention target is detected, the driver's field of view overlaps with the projected portion of the attention target on the imaginary plane for more than a specified recognition judgment time Trec, it is determined that the driver has recognized the attention target. If there is an object among the attention target that the driver has not recognized, the driver is notified of the existence of the attention target. When the number of attention target objects Nobj is large, the recognition judgment time Trec is shortened compared to when it is small.
[0058] In this embodiment, the control device 4 is configured as follows: when the number of gaze target objects Nobj is less than the specified number Nth, the identification judgment time Trec is set to the second judgment time T2; when the number of gaze target objects Nobj is greater than the specified number Nth, the identification judgment time Trec is set to the first judgment time T1 which is smaller than the second judgment time T2.
[0059] Thus, when there are multiple gaze target objects outside the vehicle, the recognition judgment time Trec can be shortened, so that it is possible to suppress the situation where a certain gaze target object is judged as not being recognized even though the gaze target object has been visually recognized. Therefore, it is possible to suppress the situation where a notification related to the gaze target object is given to the driver even though each gaze target object has been grasped. That is, when there are multiple gaze target objects outside the vehicle, it is possible to suppress the situation where an unnecessary alarm is given to the driver.
[0060] Although the embodiments of the present invention have been described above, the above embodiments merely illustrate a part of application examples of the present invention, and the technical scope of the present invention is not limited to the specific configurations of the above embodiments.
[0061] For example, in the above-described embodiment, the computer program (notification process) executed in the control device 4 may be provided in a form recorded in a computer-readable removable recording medium such as a semiconductor memory, a magnetic recording medium, or an optical recording medium.
Claims
1. A notification control device, which is a notification control device for notifying a driver of a vehicle, comprising: Detecting a target object to be watched that exists around the vehicle based on surrounding data indicating the surrounding conditions of the vehicle, setting the driver's field of view based on driver data representing the driver's state, When the number of the target objects is less than a specified number, virtual planes on which the target objects are projected are respectively set at the positions of the target objects in a manner opposite to the vehicle, and if within a specified period after the target objects are detected, the field of view of the driver and the projected portion of the target objects on the virtual plane do not overlap for more than a specified recognition determination time, the driver is notified of the existence of the target objects that he should pay attention to. When the number of the target objects is greater than the predetermined number, the notification is not performed on the driver.
2. A notification control device, which is a notification control device for notifying a driver of a vehicle, comprising: Detecting a target object to be watched that exists around the vehicle based on surrounding data indicating the surrounding conditions of the vehicle, setting the driver's field of view based on driver data representing the driver's state, At the position of the target object, an imaginary plane on which the target object is projected is set in a manner opposite to the vehicle. If, within a specified period after the target object is detected, the driver's field of view overlaps with the projected portion of the target object on the imaginary plane for more than a specified recognition determination time, it is determined that the driver has recognized the target object. If there is an object that the driver has not recognized among the detected objects, the driver is notified of the existence of the object that he should pay attention to. When the number of the detected targets is large, the recognition and determination time is shortened compared to when the number is small.
3. The notification control device according to claim 2, wherein: When the number of the target objects is less than a predetermined number, the recognition determination time is set to a second determination time, When the number of the target objects is greater than the predetermined number, the recognition determination time is set to a first determination time that is smaller than the second determination time.
4. The notification control device according to claim 1 or claim 2, wherein: The number of the detected targets is corrected based on a weighting coefficient set for each type of the target.
5. A notification control method, which is a notification control method based on a notification control device for notifying a driver of a vehicle, wherein: Detecting a target object to be watched that exists around the vehicle based on surrounding data indicating the surrounding conditions of the vehicle, setting the driver's field of view based on driver data representing the driver's state, When the number of the target objects is less than a specified number, virtual planes on which the target objects are projected are respectively set at the positions of the target objects in a manner opposite to the vehicle, and if within a specified period after the target objects are detected, the field of view of the driver and the projected portion of the target objects on the virtual plane do not overlap for more than a specified recognition determination time, the driver is notified of the existence of the target objects that he should pay attention to. When the number of the target objects is greater than the predetermined number, the notification is not performed on the driver.
6. A notification control method, which is a notification control method based on a notification control device for notifying a driver of a vehicle, wherein: Detecting a target object to be watched that exists around the vehicle based on surrounding data indicating the surrounding conditions of the vehicle, setting the driver's field of view based on driver data representing the driver's state, At the position of the target object, an imaginary plane on which the target object is projected is set in a manner opposite to the vehicle. If, within a specified period after the target object is detected, the driver's field of view overlaps with the projected portion of the target object on the imaginary plane for more than a specified recognition determination time, it is determined that the driver has recognized the target object. If there is an object that the driver has not recognized among the detected objects, the driver is notified of the existence of the object that he should pay attention to. When the number of the detected targets is large, the recognition and determination time is shortened compared to when the number is small.
7. A non-transitory computer recording medium comprising a computer program for a notification control device for notifying a driver of a vehicle, The non-transitory computer recording medium contains a computer program for causing the notification control device to execute the following processing: Detecting a target object to be watched that exists around the vehicle based on surrounding data indicating the surrounding conditions of the vehicle, setting the driver's field of view based on driver data representing the driver's state, When the number of the target objects is less than a specified number, virtual planes on which the target objects are projected are respectively set at the positions of the target objects in a manner opposite to the vehicle, and if within a specified period after the target objects are detected, the field of view of the driver and the projected portion of the target objects on the virtual plane do not overlap for more than a specified recognition determination time, the driver is notified of the existence of the target objects that he should pay attention to. When the number of the target objects is greater than the predetermined number, the notification is not performed on the driver.
8. A non-transitory computer recording medium comprising a computer program for a notification control device for notifying a driver of a vehicle, The non-transitory computer recording medium contains a computer program for causing the notification control device to execute the following processing: Detecting a target object to be watched that exists around the vehicle based on surrounding data indicating the surrounding conditions of the vehicle, setting the driver's field of view based on driver data representing the driver's state, At the position of the target object, an imaginary plane on which the target object is projected is set in a manner opposite to the vehicle. If, within a specified period after the target object is detected, the driver's field of view overlaps with the projected portion of the target object on the imaginary plane for more than a specified recognition determination time, it is determined that the driver has recognized the target object. If there is an object that the driver has not recognized among the detected objects, the driver is notified of the existence of the object that he should pay attention to. When the number of the detected targets is large, the recognition and determination time is shortened compared to when the number is small.
