Inattentive driving detection device, occupant monitoring device, server device, and inattentive driving detection method

Abstract

An inattention detection device (100) comprises: a cumulative inattention determination unit (110) that acquires a cumulative value related to intermittent inattention by an occupant of a moving body, and performs cumulative inattention determination, which is a determination as to whether a cumulative inattention state is present by using the cumulative value and a threshold value given in advance; a cumulative inattention site acquisition unit (120) that acquires a cumulative inattention site based on the position of the moving body at a time when it is determined by the cumulative inattention determination unit that the cumulative inattention state is present; an observation direction acquisition unit (130) that acquires an observation direction, which is a direction in which the occupant of the moving body is assumed to be observing; a cumulative inattention frequently-occurring site acquisition unit (140) that acquires a cumulative inattention frequently-occurring site where cumulative inattention by occupants of a plurality of moving bodies occurs frequently; an allowable observation direction acquisition unit (150) that acquires an allowable observation direction in which observation should be allowed for each cumulative inattention frequently-occurring site; and a cumulative inattention validity determination unit (160) that, when the cumulative inattention site acquired by the cumulative inattention site acquisition unit and the cumulative inattention frequently-occurring site acquired by the cumulative inattention frequently-occurring site acquisition unit overlap and when the observation direction acquired by the observation direction acquisition unit and the allowable observation direction acquired by the allowable observation direction acquisition unit overlap, outputs cumulative inattention negative information which is information for denying the result of the cumulative inattention determination by the cumulative inattention determination unit.

Description

[Technical Field]

[0001] The disclosed technology relates to an inattentive driving detection technology that detects inattentive driving by a passenger in a vehicle. [Background technology]

[0002] Among inattentive driving detection technologies is a technology that accumulates the inattentive driving time, which is the time that a passenger spends looking away, and detects inattentive driving based on the accumulated time (hereinafter, inattentive driving based on the accumulated time will also be referred to as "accumulated inattentive driving"). Patent Document 1 describes a "driving support device" that detects inattentive driving based on the accumulated time. Specifically, the "driving assistance device" of Patent Document 1 "measures the cumulative time T1 during which the gaze direction is within the gaze area and the cumulative time T2 during which the gaze direction is outside the gaze area" (paragraph

[0037] ), which "represents the normal range of directions in which a driver should look when not distracted driving" (paragraph

[0035] ), and by comparing the time ratio Rt calculated using the cumulative time T1 and the cumulative time T2 with a threshold value (paragraphs

[0038] -

[0039] ), it distinguishes between a safe state and a state of "distracted driving" (paragraph

[0039] ), and if it identifies a state of "distracted driving", it outputs an alarm (paragraph

[0040] ). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2018-067198 Summary of the Invention [Problem to be solved by the invention]

[0004] Here, observation states that are determined to be cumulative inattentiveness include, for example, observation states that are not considered necessary for driving, or observation states that are considered to be attempts to collect information necessary for driving. However, conventional technology has the problem that if the amount of inattentive time or the proportion of inattentive time simply increases, it will be determined to be cumulative inattentiveness regardless of the observation state, and will detect excessive cumulative inattentiveness.

[0005] The present disclosure is intended to solve the above problem, and aims to prevent excessive detection of cumulative inattentive driving. [Means for solving the problem]

[0006] The inattentive driving detection device of the present disclosure comprises: an accumulated inattentive state determination unit that acquires an accumulated value related to intermittent inattentive state by an occupant of the vehicle and performs an accumulated inattentive state determination by using the accumulated value and a predetermined threshold value; an accumulated inattentive point acquisition unit that acquires accumulated inattentive points based on the position of the moving body when the accumulated inattentive state is determined to be present by the accumulated inattentive state determination unit; an observation direction acquisition unit that acquires an observation direction that is a direction in which the occupant of the moving body is likely to be observing; an accumulative inattentiveness frequent occurrence point acquisition unit that acquires accumulative inattentiveness frequent occurrence points, which are points where accumulative inattentiveness by occupants of each of a plurality of moving bodies frequently occurs; an allowable observation direction acquisition unit that acquires an allowable observation direction, which is a direction in which observation should be allowed for each of the cumulative inattentive looking points; a validity determination unit that outputs cumulative inattentive driving negation information, which is information that negates the result of the cumulative inattentive driving determination unit, when the cumulative inattentive driving points acquired by the cumulative inattentive driving point acquisition unit and the cumulative inattentive driving frequent points acquired by the cumulative inattentive driving frequent point acquisition unit overlap, and when the observation direction acquired by the observation direction acquisition unit and the allowable observation direction acquired by the allowable observation direction acquisition unit overlap; Equipped with: [Effects of the Invention]

[0007] According to the present disclosure, it is possible to suppress excessive detection of cumulative inattentive driving. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of a basic configuration of an inattentive driving detection device 100 (100A) according to the first embodiment of the present disclosure. [Figure 2] FIG. 2 is a diagram showing an example of the relationship between the inattentive driving detection device 100 of the present disclosure and peripheral devices. [Figure 3] FIG. 3 is a flowchart showing an example of processing by the inattentive driving detection device 100 (100A) according to the first embodiment of the present disclosure. [Figure 4] FIG. 4 is a first diagram for explaining cumulative inattentive driving detection by the inattentive driving detection device 100 of the present disclosure. [Figure 5] FIG. 5 is a second diagram for explaining cumulative inattentive driving detection by the inattentive driving detection device 100 of the present disclosure. [Figure 6] FIG. 6 is a diagram illustrating an example of a basic configuration of an inattentive driving detection device 100 (100B) according to the second embodiment of the present disclosure. [Figure 7] FIG. 7 is a flowchart showing an example of processing by the inattentive driving detection device 100 (100B) according to the second embodiment of the present disclosure. [Figure 8] FIG. 8 is a diagram illustrating an example of a basic configuration of an inattentive driving detection device 100 (100C) according to the third embodiment of the present disclosure. [Figure 9] FIG. 9 is a flowchart showing an example of processing by the inattentive driving detection device 100 (100C) according to the third embodiment of the present disclosure. [Figure 10] FIG. 10 is a diagram illustrating an example of a basic configuration of an inattentive driving detection device 100 (100D) according to the fourth embodiment of the present disclosure. [Figure 11] FIG. 11 is a flowchart showing an example of the processing of the inattentive driving detection device 100 (100D) according to the fourth embodiment of the present disclosure. [Figure 12] FIG. 12 is a diagram illustrating an example of a basic configuration of an occupant monitoring device 200E (an occupant monitoring device including the function of the inattentive driving detection device 100D of the present disclosure) according to the fifth embodiment of the present disclosure. [Figure 13]FIG. 13 is a flowchart showing an example of processing by the occupant monitoring device 200E (the occupant monitoring device including the inattentive driving detection device 100D of the present disclosure) according to the fifth embodiment of the present disclosure. [Figure 14] FIG. 14 is a diagram illustrating an example of a basic configuration of an inattentive driving detection device 100 (100F) and a server device 300F according to the sixth embodiment of the present disclosure. [Figure 15] FIG. 15 is a flowchart showing an example of processing by the inattentive driving detection device 100 (100F) according to the sixth embodiment of the present disclosure. [Figure 16] FIG. 16 is a diagram illustrating a first example of a hardware configuration for realizing the functions of the present disclosure. [Figure 17] FIG. 17 is a diagram illustrating a second example of a hardware configuration for realizing the functions of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0009] In order to explain the present disclosure in more detail, embodiments of the present disclosure will be described below with reference to the accompanying drawings.

[0010] Embodiment 1 The first embodiment will explain the basic configuration of the inattentive driving detection device of the present disclosure.

[0011] FIG. 1 is a diagram illustrating an example of a basic configuration of an inattentive driving detection device 100 (100A) according to the first embodiment of the present disclosure. FIG. 2 is a diagram showing an example of the relationship between the inattentive driving detection device 100 of the present disclosure and peripheral devices. The inattentive driving detection device 100A determines whether an occupant of a moving body is in an accumulated inattentive driving state, and outputs the determination result. The mobile object 10 (10-1, 10-2, 10-3, . . . , 10-n, n≧1) is a vehicle that moves manually or automatically with an occupant on board, and includes, for example, a vehicle. The mobile object 10 is equipped with, for example, an inattentive driving detection device 100 and an occupant monitoring device 200 as shown in FIG. 2. The inattentive driving detection device 100 or the occupant monitoring device 200 can communicate with an external device via a communication unit (not shown), and in FIG. 2, is configured to be able to communicate with a server device 300. The occupant may be, for example, a driver. If the vehicle is an automatically controlled vehicle, the driver may be a member of the occupants who corresponds to a driver of a manually controlled vehicle. The cumulative inattentive state is a state of inattentiveness determined based on a cumulative value of intermittent inattentive states of the occupant. An intermittent inattentive state is determined using a cumulative value of intermittent inattentive states that are not determined to be normal inattentive states, whereas an inattentive state that continues for a predetermined period of time (first time) is determined to be a normal inattentive state, for example. This inattentive state is referred to as "cumulative inattentive state" in contrast to the normal inattentive state, and as "cumulative inattentive state" in contrast to the normal inattentive state. In the description, the inattentive detection device 100 (100A) is shown as one that determines only cumulative inattentive state, but it may also be configured to determine normal inattentive state in addition to cumulative inattentive state. The cumulative value is a cumulative value related to intermittent inattention. The cumulative value is, for example, the cumulative time that the occupant intermittently looks at a location other than the traveling direction (a range in which the occupant's observation should be permitted based on the traveling direction or predicted traveling direction of the moving body). Alternatively, the cumulative value is, for example, the cumulative number of times that the occupant intermittently looks at a location other than the traveling direction (a range in which the occupant's observation should be permitted based on the traveling direction or predicted traveling direction of the moving body). Alternatively, the cumulative value may be any value other than the above as long as it indicates the state of intermittent inattention.

[0012] The inattentive driving detection device 100A shown in Figure 1 is configured to include a cumulative inattentive driving judgment unit 110A, a cumulative inattentive driving point acquisition unit 120A, an observation direction acquisition unit 130A, a cumulative inattentive driving frequent point acquisition unit 140A, an allowable observation direction acquisition unit 150A, and a validity determination unit 160A.

[0013] The cumulative inattentive driving state determining unit 110A determines whether or not the driver is in an inattentive driving state by using a cumulative value related to intermittent inattentive driving. Specifically, the cumulative inattentive driving determination unit 110A acquires a cumulative value relating to intermittent inattentive driving by the occupant of the vehicle, and performs a cumulative inattentive driving determination, which is a determination of whether or not there is a cumulative inattentive driving state, using the cumulative value and a predetermined threshold value. The cumulative inattentive driving determination unit 110A, for example, acquires a cumulative value from the occupant monitoring device 200, compares the cumulative value with a threshold value each time the cumulative value is acquired, and determines whether the cumulative value is equal to or greater than the threshold value. If the cumulative value is equal to or greater than the threshold value, the cumulative inattentive driving determination unit 110A determines that the driver is in an inattentive driving state. Alternatively, the cumulative inattentive driving determination unit 110A may be configured to determine that the driver is in an inattentive driving state using, for example, a known technique for determining cumulative inattentive driving other than the above-described determination method. The cumulative inattentive driving determination unit 110A outputs a result of the cumulative inattentive driving determination, for example, a result of the cumulative inattentive driving determination indicating that the cumulative value has reached a threshold value or more.

[0014] The cumulative inattentive state acquisition unit 120A acquires cumulative inattentive state points based on the position of the moving body 10 (10-n) when the cumulative inattentive state determination unit 110A determines that the moving body 10 (10-n) is in an accumulated inattentive state. The cumulative inattentive point is expressed as information such as the position at the moment when it is determined that the driver is in an inattentive state, or a representative value or average value of the positions during the time when the inattentive state values ​​(cumulative values) are accumulated. The cumulative inattentive point acquisition unit 120A acquires information relating to the positions of the cumulative inattentive points from, for example, a mobile-mounted device mounted on the mobile body. Alternatively, the cumulative inattentive point acquisition unit 120A may be configured to calculate information relating to the positions of the cumulative inattentive points using information acquired from, for example, a mobile-mounted device mounted on the mobile body.

[0015] The observation direction acquisition unit 130A acquires the observation direction that is the direction from which the occupant of the moving body 10 (10-n) is likely to be observing. The observation direction is represented by the occupant's facial direction, the occupant's line of sight, or information calculated from the occupant's facial direction and the occupant's line of sight. The observation direction may be represented by information indicating a region consisting of a plurality of observation directions. The observation direction may be represented by a representative value or average value of the region consisting of a plurality of observation directions. The observation direction acquisition unit 130A acquires the observation direction from the occupant monitoring device 200 mounted on the moving body. Alternatively, the observation direction acquisition unit 130A may be configured to acquire the observation direction by calculating it using information acquired from the occupant monitoring device 200.

[0016] The cumulative inattentive driving frequent point acquiring unit 140A acquires cumulative inattentive driving frequent points, which are points where cumulative inattentive driving by occupants of each of a plurality of moving bodies frequently occurs. The cumulative inattentive driving points are location information that indicates points where cumulative inattentive driving is occurring frequently, and is generated based on information collected from multiple mobile bodies. The cumulative inattentive driving frequent points include those represented by information indicating an area consisting of a plurality of cumulative inattentive driving frequent points. The cumulative inattentive driving points may be expressed as information such as a representative value or average value of an area consisting of a plurality of cumulative inattentive driving points. The cumulative inattentive driving frequent point acquiring unit 140A acquires information relating to cumulative inattentive driving frequent points output from the server device 300, for example, at a pre-stored fixed time or at predetermined intervals. Alternatively, for example, when the cumulative inattentive state is determined to be present by the cumulative inattentive state determination unit 110A, the cumulative inattentive state acquisition unit 140A uses the cumulative inattentive state points acquired by the cumulative inattentive state acquisition unit 120A to acquire information relating to the cumulative inattentive state points included in the area based on the cumulative inattentive state points from the server device 300. The information relating to the cumulative inattentive driving high incidence points includes location information indicating the locations of the cumulative inattentive driving high incidence points. The cumulative inattentive driving frequent point acquisition unit 140A extracts and outputs position information indicating the positions of the cumulative frequent inattentive driving points included in the information relating to the cumulative frequent inattentive driving points. The information relating to the cumulative high incidence points of inattentive driving also includes permissible observation direction information indicating the permissible observation direction at the cumulative high incidence points.

[0017] The permissible observation direction acquisition unit 150A acquires the permissible observation direction, which is the direction in which observation should be permitted, for each cumulative inattentive looking frequent point. The allowable observation direction is information generated based on information collected from multiple moving bodies, and is represented as information indicating the direction that observation should be allowed at each point where cumulative inattentive driving occurs frequently. For example, if the moving body 10 (10-n) is a vehicle and the cumulative frequent inattentive driving point is a point included in a merging area on a motorway, the allowable observation direction is a direction based on the position of the occupant, heading toward the road where the vehicle will merge (the road to be merged). Also, for example, if the moving body 10 (10-n) is a vehicle and the cumulative frequent inattentive driving point is a point included in the merging area from a branch road to a main road, the allowable observation direction is a direction based on the position of the occupant, heading toward the road where the vehicle is expected to merge (the road to be merged). Also, for example, if the moving body 10 (10-n) is a vehicle and the cumulative frequent inattentive driving point is a point included in the surrounding area of ​​an intersection, the allowable observation direction is a direction based on the position of the occupant, and is the direction toward the road connected to the intersection (the merging road). The allowable viewing direction may be expressed by information indicating a region consisting of a plurality of allowable viewing directions, or may be expressed by a representative value or an average value of the region consisting of a plurality of allowable viewing directions. The permissible observation direction acquisition unit 150A acquires permissible observation direction information included in the information related to the accumulated inattentive driving frequent locations.

[0018] The validity determination unit 160A determines the validity of the cumulative inattentive driving determination made by the cumulative inattentive driving determination unit 110A. The validity determination unit 160A determines whether the cumulative inattentiveness points acquired by the cumulative inattentiveness point acquisition unit 120A overlap with the cumulative inattentiveness frequent points acquired by the cumulative inattentiveness frequent point acquisition unit 140A. This determination includes determining whether the cumulative inattentiveness points and the cumulative inattentiveness frequent points match, or determining whether an area based on the cumulative inattentiveness points and an area based on the cumulative inattentiveness frequent points at least partially overlap. The validity determination unit 160A also determines whether the observation direction acquired by the observation direction acquisition unit 130A overlaps with the allowable observation direction acquired by the allowable observation direction acquisition unit 150A. This determination includes determining whether the observation direction and the allowable observation direction match, or whether the directional region based on the observation direction overlaps at least partially with the directional region based on the cumulative inattentive driving frequency points. If the cumulative inattentiveness points acquired by the cumulative inattentiveness point acquisition unit 120A overlap with the cumulative inattentiveness frequent points acquired by the cumulative inattentiveness frequent point acquisition unit 140A, and if the observation direction acquired by the observation direction acquisition unit 130A overlaps with the permissible observation direction acquired by the permissible observation direction acquisition unit 150A, the validity judgment unit 160A judges that the cumulative inattentiveness judgment by the cumulative inattentiveness judgment unit 110A is invalid, and outputs cumulative inattentiveness negation information, which is information that negates the result of the cumulative inattentiveness judgment by the cumulative inattentiveness judgment unit 110A. The validity determination unit 160A may be further configured to determine that the cumulative inattentive driving judgment is valid when a pre-stored cumulative inattentive driving warning condition is satisfied, and to output cumulative inattentive driving judgment affirmative information that is information affirming the result of the cumulative inattentive driving judgment (see the embodiment described later).

[0019] In addition to the above components, the inattentive driving detection device 100 (100A) also includes a control unit (not shown), a storage unit (not shown), and a communication unit (not shown). A control unit (not shown) controls the entire inattentive driving detection device 100 (100A) and each of its components. The control unit (not shown) activates the inattentive driving detection device 100 (100A) in accordance with, for example, an external command. The control unit (not shown) also controls the state (operating state = state such as startup, shutdown, or sleep) of the inattentive driving detection device 100 (100A). A storage unit (not shown) stores each piece of data used in the inattentive driving detection device 100 (100A). The storage unit (not shown) stores, for example, the output (output data) from each component in the inattentive driving detection device 100 (100A), and outputs data requested by each component to the requesting component. The communication unit (not shown) communicates with external devices. For example, communication is performed between the inattentive driving detection device 100 (100A) and peripheral devices (the occupant monitoring device 200, the server device 300). For example, when the inattentive driving detection device 100 (100A) and the occupant monitoring device 200 are not connected by wire, the communication unit (not shown) has a function to communicate between the inattentive driving detection device 100 (100A) and the occupant monitoring device 200. The communication unit (not shown) also has a function to communicate with the server device 300, which is an external device. The control unit (not shown), the storage unit (not shown), and the communication unit (not shown) are the same in the embodiments described below.

[0020] FIG. 3 is a flowchart showing an example of processing by the inattentive driving detection device 100 (100A) according to the first embodiment of the present disclosure. The process shown in FIG. 3 is an inattentive driving detection method using the inattentive driving detection device 100. The inattentive driving detection device 100A starts processing when it acquires a cumulative value relating to the cumulative inattentive driving. The inattentive driving detection device 100A acquires the cumulative value relating to the cumulative inattentive driving from the occupant monitoring device 200, for example.

[0021] First, the inattentive driving detection device 100A executes an accumulated inattentive driving determination process (step ST1010). In the cumulative inattentive driving judgment process, the cumulative inattentive driving judgment unit 110A of the inattentive driving detection device 100A acquires a cumulative value related to intermittent inattentive driving by the occupants of the moving body, and performs a cumulative inattentive driving judgment, which is a judgment of whether or not there is a cumulative inattentive driving state, using the cumulative value and a predetermined threshold value. For example, the cumulative inattentive behavior determination unit 110A first acquires the accumulated value output from the occupant monitoring device 200. The cumulative inattentive behavior determination unit 110A then compares the accumulated value related to intermittent inattentive behavior with a pre-stored threshold value. If the accumulated value related to intermittent inattentive behavior exceeds the pre-stored threshold value, the cumulative inattentive behavior determination unit 110A determines that the driver is in an inattentive behavior state. The cumulative inattentive behavior determination unit 110A then notifies the cumulative inattentive behavior point acquisition unit 120A, the observation direction acquisition unit 130A, the cumulative inattentive behavior frequent point acquisition unit 140A, and the allowable observation direction acquisition unit 150A that it has determined that the driver is in an inattentive behavior state.

[0022] When determining that the inattentive driving detection device 100A is not in an accumulated inattentive state ("NO" in step ST1020), the inattentive driving detection device 100A ends the process shown in FIG. 3 and waits until the next accumulated value is acquired.

[0023] When determining that the driver is in an accumulated inattentive state (step ST1020 "YES"), the inattentive driving detection device 100A then executes an accumulated inattentive driving point acquisition process (step ST1030). In the cumulative inattentive state acquisition process, the cumulative inattentive state acquisition unit 120A of the inattentive state detection device 100A acquires the cumulative inattentive state based on the position of the moving body (10-n) when the cumulative inattentive state is determined to be in a cumulative inattentive state by the cumulative inattentive state determination unit 110A. When the cumulative inattentive state acquisition unit 120A receives a notification from the cumulative inattentive state determination unit 110A indicating that a cumulative inattentive state has been determined, it acquires cumulative inattentive state information indicating the cumulative inattentive state. The cumulative inattentive state information is expressed as a location or area where a cumulative inattentive state has occurred, based on the location of the vehicle acquired from a vehicle-mounted device via a communication unit (not shown). The cumulative inattentive state acquisition unit 120A outputs the cumulative inattentive state information to the validity determination unit 160A.

[0024] Next, the inattentive driving detection device 100A executes an observation direction acquisition process (step ST1040). In the observation direction acquisition process, the observation direction acquisition unit 130A of the inattentive driving detection device 100A acquires the observation direction that is the direction in which the occupant of the moving object is likely to be looking. When the observation direction acquisition unit 130A receives a notification indicating that the cumulative inattentive state has been determined from the cumulative inattentive state determination unit 110A, it acquires observation direction information indicating the observation direction. The observation direction information indicates, for example, the facial orientation of the occupant, the line of sight of the occupant, or the direction the occupant is likely to be observing based on the facial orientation and line of sight of the occupant acquired using video captured by the occupant monitoring device 200 of the interior of the vehicle. The observation direction acquisition unit 130A outputs the observation direction information to the validity determination unit 160A.

[0025] Next, the inattentive driving detection device 100A executes a cumulative inattentive driving frequent point acquisition process (step ST1050). In the cumulative inattentive driving spot acquisition process, the cumulative inattentive driving spot acquisition unit 140A of the inattentive driving detection device 100A acquires cumulative inattentive driving spot, which is a spot where cumulative inattentive driving by the occupants of each of the multiple moving bodies occurs frequently. When the cumulative inattentiveness frequent point acquisition unit 140A receives a notification from the cumulative inattentiveness determination unit 110A indicating that a cumulative inattentiveness state has been determined, it acquires cumulative inattentiveness frequent point information indicating the cumulative inattentiveness frequent points. The cumulative inattentiveness frequent point information indicates the locations or areas of the cumulative inattentiveness frequent points, which are points where cumulative inattentiveness by the occupants of each of the multiple mobile bodies frequently occurs. For example, the cumulative inattentiveness frequent point acquisition unit 140A uses the cumulative inattentiveness points acquired by the cumulative inattentiveness point acquisition unit 120A to acquire information related to the cumulative inattentiveness frequent points included in the area based on the cumulative inattentiveness points from the server device 300. The cumulative inattentiveness frequent point acquisition unit 140A outputs the cumulative inattentiveness frequent point information included in the acquired information related to the cumulative inattentiveness frequent points to the validity determination unit 160A.

[0026] Next, the inattentive driving detection device 100A executes the allowable observation direction acquisition process (step ST1060). In the allowable observation direction acquisition process, the allowable observation direction acquisition unit 150A of the inattentive driving detection device 100A acquires the allowable observation direction, which is the direction in which observation should be allowed, for each of the cumulative inattentive driving frequent points. When the allowable observation direction acquisition unit 150A receives a notification from the accumulated inattentive state determination unit 110A indicating that a cumulative inattentive state has been determined, it acquires allowable observation direction information indicating the allowable observation direction included in the information related to the cumulative inattentive state obtained from the server device 300 by the accumulated inattentive state frequent point acquisition unit 140A. The allowable observation direction information indicates a direction or a directional area consisting of multiple directions that is allowable for observation at the accumulated inattentive state frequent points, which are points where cumulative inattentive behavior by occupants of each of multiple moving bodies frequently occurs. The allowable observation direction acquisition unit 150A outputs the acquired allowable observation direction information to the validity determination unit 160A.

[0027] Next, the inattentive driving detection device 100A executes the validity determination process (step ST1070). In the validity determination process, the validity determination unit 160A of the inattentive behavior detection device 100A determines the validity of the determination made by the cumulative inattentive behavior determination unit 110A that the driver is in a cumulative inattentive behavior state. The validity judgment unit 160A of the inattentive driving detection device 100A judges that the cumulative inattentive driving judgment by the cumulative inattentive driving judgment unit 110A is invalid if the cumulative inattentive driving points acquired by the cumulative inattentive driving point acquisition unit 120A overlap with the cumulative inattentive driving points acquired by the cumulative inattentive driving frequent point acquisition unit 140A, and if the observation direction acquired by the observation direction acquisition unit 130A overlaps with the allowable observation direction acquired by the allowable observation direction acquisition unit 150A. The validity determination unit 160A acquires cumulative inattentive point information from the cumulative inattentive point acquisition unit 120A, acquires cumulative inattentive point information from the cumulative inattentive frequent point acquisition unit 140A, acquires observation direction information from the observation direction acquisition unit 130A, and acquires permissible observation direction information from the permissible observation direction acquisition unit 150A. The validity determination unit 160A compares the cumulative inattentive driving points indicated in the cumulative inattentive driving point information with the cumulative inattentive driving frequent points indicated in the cumulative inattentive driving frequent point information, and also compares the observation direction indicated in the observation direction information with the allowable observation direction indicated in the allowable observation direction information. If the cumulative inattentiveness points and the cumulative inattentiveness frequent points overlap and if the observation direction and the permissible observation direction overlap, the validity determination unit 160A determines that the cumulative inattentiveness determination by the cumulative inattentiveness determination unit 110A is invalid. If the cumulative inattentiveness points and the cumulative inattentiveness frequent points do not overlap, or if the observation direction and the permissible observation direction do not overlap, the validity determination unit 160A determines that the cumulative inattentiveness determination by the cumulative inattentiveness determination unit 110A is valid.

[0028] When determining that the cumulative inattentive driving determination is not valid ("NO" in step ST1080), the inattentive driving detection device 100A then executes a cumulative inattentive driving negative information output process (step ST1090). In the cumulative inattentive driving negation information output process, the validity determining unit 160A of the inattentive driving detection device 100A outputs cumulative inattentive driving negation information that negates the result of the cumulative inattentive driving determination by the cumulative inattentive driving determination unit 110A. If the validity determination unit 160A determines that the cumulative inattentive behavior determination by the cumulative inattentive behavior determination unit 110A is invalid, it generates cumulative inattentive behavior negation information and outputs it to a component within the inattentive behavior detection device 100 that uses the results of the cumulative inattentive behavior determination or to an external device outside the inattentive behavior detection device 100.

[0029] When determining that the cumulative inattentive driving judgment is appropriate ("YES" in step ST1080), or after executing the cumulative inattentive driving negative information output process, the inattentive driving detection device 100A ends the process shown in FIG.

[0030] Accumulative inattentiveness detection by the inattentiveness detection device 100 of the present disclosure will be described. FIG. 4 is a first diagram for explaining cumulative inattentive driving detection by the inattentive driving detection device 100 of the present disclosure. FIG. 5 is a second diagram for explaining cumulative inattentive driving detection by the inattentive driving detection device 100 of the present disclosure. FIG. 4 shows a case where the moving object 1000 is a vehicle, and the cumulative inattentive driving frequent point is a point included in a merging area (merging road 2000, merged road 3000) on a motorway. When a moving object 1000 is moving from a merging road 2000 to a merged road 3000 in a traveling direction 1100 (or a predicted traveling direction), if the observation direction 1200 of the occupant of the moving object 1000 is within the allowable observation range α (assuming the allowable observation range α is set in advance), it is normally determined that the occupant is not looking inattentively. However, in a situation such as that shown in FIG. 4, it is expected that the occupant will alternate between an observation direction 1200 that checks the road ahead of the merging road 3000 and an observation direction 1300 that checks the road behind the merging road 3000. In this case, the observation directions in the observation range β between the observation direction 1200 and the observation direction 1300 are accumulated, and if the accumulated inattentiveness is determined mainly using the accumulated value, excessive accumulated inattentiveness will be detected. In the present disclosure, by configuring as described above, as shown in Figure 5, the range of permissible observation directions can be set for each point using permissible observation directions 4010 at cumulative inattentiveness frequent points, which are points where cumulative inattentiveness by occupants of each of the multiple moving bodies occurs frequently, relative to the normal permissible observation direction 4000 (corresponding to the permissible observation range α).

[0031] The inattentive driving detection device of the present disclosure is configured, for example, as follows. an accumulated inattentive state determination unit that acquires an accumulated value related to intermittent inattentive state by an occupant of the vehicle and performs an accumulated inattentive state determination by using the accumulated value and a predetermined threshold value; an accumulated inattentive point acquisition unit that acquires accumulated inattentive points based on the position of the moving body when the accumulated inattentive state is determined to be present by the accumulated inattentive state determination unit; an observation direction acquisition unit that acquires an observation direction that is a direction in which the occupant of the moving body is likely to be observing; an accumulative inattentiveness frequent occurrence point acquisition unit that acquires accumulative inattentiveness frequent occurrence points, which are points where accumulative inattentiveness by occupants of each of a plurality of moving bodies frequently occurs; an allowable observation direction acquisition unit that acquires an allowable observation direction, which is a direction in which observation should be allowed for each of the cumulative inattentive looking points; a validity determination unit that outputs cumulative inattentive driving negation information, which is information that negates the result of the cumulative inattentive driving determination unit, when the cumulative inattentive driving points acquired by the cumulative inattentive driving point acquisition unit and the cumulative inattentive driving frequent points acquired by the cumulative inattentive driving frequent point acquisition unit overlap, and when the observation direction acquired by the observation direction acquisition unit and the allowable observation direction acquired by the allowable observation direction acquisition unit overlap; An inattentive driver detection device comprising: As a result, the present disclosure has the effect of providing an inattentive driving detection device that can prevent excessive detection of cumulative inattentive driving.

[0032] The inattentive driving detection method of the present disclosure is configured, for example, as follows. An inattentive driving detection method using an inattentive driving detection device, an accumulated inattentiveness determination unit of the inattentiveness detection device acquires an accumulated value relating to intermittent inattentiveness by an occupant of the vehicle, and performs an accumulated inattentiveness determination, which is a determination of whether or not the occupant is in an accumulated inattentive state, using the accumulated value and a predetermined threshold value; an accumulated inattentive point acquisition unit of the inattentive detection device acquires an accumulated inattentive point based on the position of the moving body when the accumulated inattentive state is determined to be present by the accumulated inattentive state determination unit; an observation direction acquisition unit of the inattentive driving detection device acquires an observation direction that is a direction in which an occupant of the moving body is likely to be observing; an accumulated inattentiveness frequent occurrence point acquisition unit of the inattentiveness detection device acquires accumulated inattentiveness frequent occurrence points, which are points where cumulative inattentiveness by occupants of each of the plurality of moving bodies frequently occurs, an allowable observation direction acquisition unit of the inattentive driving detection device acquires an allowable observation direction, which is a direction in which observation should be allowed for each of the cumulative inattentive driving frequent points; When the cumulative inattentive driving points acquired by the cumulative inattentive driving point acquisition unit and the cumulative inattentive driving frequent points acquired by the cumulative inattentive driving frequent point acquisition unit overlap, and when the observation direction acquired by the observation direction acquisition unit and the allowable observation direction acquired by the allowable observation direction acquisition unit overlap, the validity determination unit of the inattentive driving detection device outputs accumulated inattentive driving negation information, which is information that negates the result of the cumulative inattentive driving determination by the cumulative inattentive driving determination unit. A method for detecting inattentive driving. As a result, the present disclosure has the effect of providing an inattentive driving detection method that can prevent excessive detection of cumulative inattentive driving.

[0033] The inattentive driving detection device of the present disclosure is further configured, for example, as follows. the moving body is a vehicle, When the cumulative inattentiveness frequent point is a point included in a merging area of ​​a motorway, the allowable observation direction is a direction based on the position of the occupant and is a direction toward a merging road where the vehicle is expected to merge; A distraction detection device. As a result, the present disclosure has the effect of preventing the output of the cumulative inattentiveness judgment result when an occupant of a vehicle traveling in a merging lane merging onto a motorway, such as an expressway, intermittently glances at the road to obtain information necessary for driving. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to an inattentive driving detection system, an occupant monitoring device, or the above inattentive driving detection method.

[0034] Embodiment 2 In the second embodiment, an embodiment will be described in which an alarm is suppressed using the output from the inattentive driving detection device according to the first embodiment. In the second embodiment, among the configurations according to the second embodiment, redundant explanations of the same configurations as those already explained will be omitted as appropriate.

[0035] The configuration of an inattentive driver detection device according to a second embodiment of the present disclosure will be described. FIG. 6 is a diagram illustrating an example of a basic configuration of an inattentive driving detection device 100 (100B) according to the second embodiment of the present disclosure. The inattentive driving detection device 100B, like the inattentive driving detection device 100A, determines whether an occupant of a moving body is in an accumulated inattentive driving state and outputs the determination result. In addition to the above, the inattentive driving detection device 100B further controls to issue an alarm when it is appropriate to determine that the driver is in an accumulated inattentive driving state.

[0036] The inattentive driving detection device 100B is configured to include a cumulative inattentive driving judgment unit 110B, a cumulative inattentive driving point acquisition unit 120B, an observation direction acquisition unit 130B, a cumulative inattentive driving frequent point acquisition unit 140B, an allowable observation direction acquisition unit 150B, a validity judgment unit 160B, and an alarm control unit 170B.

[0037] The cumulative inattentive driving judgment unit 110B, cumulative inattentive driving point acquisition unit 120B, observation direction acquisition unit 130B, cumulative inattentive driving frequent point acquisition unit 140B, and allowable observation direction acquisition unit 150B are each configured to achieve the same functions as the cumulative inattentive driving judgment unit 110A, cumulative inattentive driving point acquisition unit 120A, observation direction acquisition unit 130A, cumulative inattentive driving frequent point acquisition unit 140A, and allowable observation direction acquisition unit 150A, which have already been described.

[0038] The validity determination unit 160B determines the validity of the cumulative inattentive driving judgment, and outputs cumulative inattentive driving denial information. The validity determination unit 160B has a configuration similar to that of the validity determination unit 160A already described, and in addition, it outputs cumulative inattentive driving negation information, which is information that negates the result of the cumulative inattentive driving judgment by the cumulative inattentive driving judgment unit 110B, to the warning control unit 170B.

[0039] The warning control unit 170B controls the issuance of a warning to warn the occupant that he or she has been in an accumulated inattentive state. The warning control unit 170B outputs a warning control signal that prevents the output of a warning based on the result of the cumulative inattentive driving judgment by the cumulative inattentive driving judgment unit 110B, based on the cumulative inattentive driving negation information output by the validity judgment unit 160B. The alarm control unit 170B outputs an alarm control signal to, for example, an alarm output device (not shown).

[0040] FIG. 7 is a flowchart showing an example of processing by the inattentive driving detection device 100 (100B) according to the second embodiment of the present disclosure. The process shown in FIG. 7 is an inattentive driving detection method using the inattentive driving detection device 100B. Inattentive driving detection device 100B executes the processes of steps ST2010, ST2020, ST2030, ..., and ST2080 in the same manner as the processes of steps ST1010, ST1020, ST1030, ..., and ST1080 of inattentive driving detection device 100A already described. Detailed description of the processes of steps ST2010, ST2020, ST2030, ..., and ST2080 will be omitted.

[0041] When determining that the cumulative inattentive driving determination is not valid ("NO" in step ST2080), the inattentive driving detection device 100B then executes a cumulative inattentive driving negative information output process (step ST2090). In the cumulative inattentive driving negation information output process, the validity determination unit 160B of the inattentive driving detection device 100B outputs cumulative inattentive driving negation information that negates the result of the cumulative inattentive driving determination by the cumulative inattentive driving determination unit 110B. When the cumulative inattentive driving judgment unit 110B judges that the cumulative inattentive driving judgment is invalid, the validity judgment unit 160B generates cumulative inattentive driving negation information and executes the inattentive driving detection device 100 using the result of the cumulative inattentive driving judgment. B Internal components or inattentiveness detection device 100 B Output to an external device. The validity determination unit 160B outputs the accumulated inattentive behavior denial information to, in particular, the warning control unit 170B.

[0042] Next, the inattentive driving detection device 100B executes the warning suppression process (step ST2100). In the warning suppression process, the warning control unit 170B of the inattentive driving detection device 100B outputs a warning control signal that prevents the output of a warning based on the result of the cumulative inattentive driving judgment by the cumulative inattentive driving judgment unit 110B, based on the cumulative inattentive driving negation information output by the validity judgment unit 160B. The alarm control unit 170B outputs an alarm control signal to an alarm output device (not shown) to prevent the alarm output device from outputting an alarm.

[0043] After executing the warning suppression process, or when it is determined that the cumulative inattentive driving determination is appropriate ("YES" in step ST2080), the inattentive driving detection device 100B ends the process shown in FIG.

[0044] The inattentive driving detection device of the present disclosure is further configured, for example, as follows. a warning control unit that outputs a warning control signal to prevent the output of a warning based on the result of the cumulative inattentive behavior determination by the cumulative inattentive behavior determination unit, based on the cumulative inattentive behavior negation information output by the validity determination unit; Equipped with A distraction detection device. As a result, the present disclosure further has the effect of providing an inattentive driving detection device that can be controlled to prevent excessive detection of cumulative inattentive driving and not to issue excessive warnings to occupants. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to an inattentive driving detection system, an occupant monitoring device, or the above inattentive driving detection method.

[0045] Embodiment 3 In the third embodiment, a warning is given to the occupant after determining the appropriateness of the accumulated inattentive state. In the third embodiment, redundant explanations of the configurations according to the third embodiment that are similar to the configurations already explained will be omitted as appropriate.

[0046] The configuration of an inattentive driving detection device according to a third embodiment of the present disclosure will be described. FIG. 8 is a diagram illustrating an example of a basic configuration of an inattentive driving detection device 100 (100C) according to the third embodiment of the present disclosure. The inattentive driving detection device 100C, like the inattentive driving detection device 100A or the inattentive driving detection device 100B, determines whether an occupant of a moving body is in an accumulated inattentive driving state and outputs the determination result. Similar to the inattentive driving detection device 100B, the inattentive driving detection device 100C controls to issue an alarm when it is determined that the driver is in an accumulated inattentive driving state. In addition to the above, the inattentive driving detection device 100C performs control to issue a warning to the occupant after determining the validity of the accumulated inattentive driving state.

[0047] The inattentive driving detection device 100C is configured to include a cumulative inattentive driving judgment unit 110C, a cumulative inattentive driving point acquisition unit 120C, an observation direction acquisition unit 130C, a cumulative inattentive driving frequent point acquisition unit 140C, an allowable observation direction acquisition unit 150C, a validity judgment unit 160C, and an alarm control unit 170C. The cumulative inattentive driving judgment unit 110C, cumulative inattentive driving point acquisition unit 120C, observation direction acquisition unit 130C, cumulative inattentive driving frequent point acquisition unit 140C, and allowable observation direction acquisition unit 150C are each configured to achieve the same functions as the cumulative inattentive driving judgment unit 110A or cumulative inattentive driving judgment unit 110B, cumulative inattentive driving point acquisition unit 120A or cumulative inattentive driving point acquisition unit 120B, observation direction acquisition unit 130A or observation direction acquisition unit 130B, cumulative inattentive driving frequent point acquisition unit 140A or cumulative inattentive driving frequent point acquisition unit 140B, and allowable observation direction acquisition unit 150A or allowable observation direction acquisition unit 150B, which have already been described.

[0048] The validity determination unit 160C determines the validity of the cumulative inattentive driving determination made by the cumulative inattentive driving determination unit 110C, and outputs cumulative negative inattentive driving information or cumulative positive inattentive driving information. The validity determination unit 160C has a configuration similar to that of the validity determination unit 160B already described, and outputs cumulative inattentive driving negation information, which is information that negates the result of the cumulative inattentive driving judgment by the cumulative inattentive driving judgment unit 110C, to the warning control unit 170C. In addition, if the cumulative inattentiveness points acquired by the cumulative inattentiveness point acquisition unit 120C do not overlap with the cumulative inattentiveness frequent points acquired by the cumulative inattentiveness frequent point acquisition unit 140C, or if the observation direction acquired by the observation direction acquisition unit 130C does not overlap with the permissible observation direction acquired by the permissible observation direction acquisition unit 150C, the validity judgment unit 160C judges that the cumulative inattentiveness judgment by the cumulative inattentiveness judgment unit 110C is valid, and outputs cumulative inattentiveness positive information, which is information that affirms the result of the cumulative inattentiveness judgment by the cumulative inattentiveness judgment unit 110C.

[0049] The warning control unit 170C controls the issuance of a warning to warn the occupant that he or she has been in an accumulated inattentive state. The warning control unit 170C outputs a warning control signal that prevents the output of a warning based on the result of the cumulative inattentive driving judgment by the cumulative inattentive driving judgment unit 110C, based on the cumulative inattentive driving negation information output by the validity judgment unit 160C. In addition to the above, the warning control unit 170C outputs a warning control signal to output a warning based on the cumulative inattentive driving judgment result by the cumulative inattentive driving judgment unit 110C, based on the cumulative inattentive driving positive information output by the validity judgment unit 160C. The alarm control unit 170C outputs an alarm control signal to, for example, an alarm output device (not shown).

[0050] FIG. 9 is a flowchart showing an example of processing by the inattentive driving detection device 100 (100C) according to the third embodiment of the present disclosure. The process shown in FIG. 9 is an inattentive driving detection method using the inattentive driving detection device 100C. Inattentive driving detection device 100C executes the processes of steps ST3010, ST3020, ST3030, ..., and ST3100 in the same manner as the processes of steps ST2010, ST2020, ST2030, ..., and ST2100 of inattentive driving detection device 100B. Detailed description of the processes of steps ST3010, ST3020, ST3030, ..., and ST3100 will be omitted.

[0051] When it is determined that the cumulative inattentive driving judgment is appropriate ("YES" in step ST2080), the inattentive driving detection device 100C then executes a cumulative inattentive driving judgment positive information output process (step ST3110). In the cumulative inattentive driving affirmative information output process, the validity determining unit 160C of the inattentive driving detection device 100C outputs cumulative inattentive driving affirmative information that is information that affirms the result of the cumulative inattentive driving determination by the cumulative inattentive driving determination unit 110C. If the validity determination unit 160C determines that the cumulative inattentiveness determination by the cumulative inattentiveness determination unit 110C is valid, it generates cumulative inattentiveness positive information and outputs it to a component within the inattentiveness detection device 100 that uses the results of the cumulative inattentiveness determination or to an external device outside the inattentiveness detection device 100. The validity determination unit 160C outputs the accumulated inattentive behavior affirmative information to, in particular, the warning control unit 170C.

[0052] Next, the inattentive driving detection device 100C executes an alarm output process (step ST3120). In the alarm output process, the alarm control unit 170C of the inattentive driving detection device 100C outputs an alarm control signal to output an alarm based on the cumulative inattentive driving judgment result by the cumulative inattentive driving judgment unit 110C, based on the cumulative inattentive driving positive information output by the validity judgment unit 160C. The alarm control unit 170C outputs an alarm control signal to an alarm output device (not shown) to prevent the alarm output device from outputting an alarm.

[0053] The inattentive driving detection device 100C terminates the processing shown in FIG. 9 after executing the warning output processing, after executing the warning suppression processing, or when it determines that the cumulative inattentive driving judgment is appropriate (step ST3080 "YES").

[0054] The inattentive driving detection device of the present disclosure is further configured, for example, as follows. The validity determination unit If the cumulative inattentiveness points acquired by the cumulative inattentiveness point acquisition unit do not overlap with the cumulative inattentiveness frequent points acquired by the cumulative inattentiveness frequent point acquisition unit, or if the observation direction acquired by the observation direction acquisition unit does not overlap with the allowable observation direction acquired by the allowable observation direction acquisition unit, output cumulative inattentiveness positive information, which is information that affirms the result of the cumulative inattentiveness determination by the cumulative inattentiveness determination unit. A distraction detection device. As a result, the present disclosure further has the effect of providing an inattentive driving detection device that is capable of outputting the result of a cumulative inattentive driving judgment indicating that a judgment has been made as to the validity of a cumulative inattentive driving state. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to an inattentive driving detection system, an occupant monitoring device, or the above inattentive driving detection method.

[0055] The inattentive driving detection device of the present disclosure is further configured, for example, as follows. The alarm control unit a warning control signal is output to output a warning based on the cumulative inattentive driving judgment result by the cumulative inattentive driving judgment unit, based on the cumulative inattentive driving affirmative information output by the validity judgment unit; A distraction detection device. As a result, the present disclosure further has the effect of providing an inattentive driving detection device that can be controlled to issue an alarm to the occupant after determining the validity of an accumulated inattentive driving state. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to an inattentive driving detection system, an occupant monitoring device, or the above inattentive driving detection method.

[0056] Embodiment 4 In the fourth embodiment, an inattentive driving detection device will be described that calculates a cumulative value relating to intermittent inattentive driving. In the fourth embodiment, redundant explanations of the configurations according to the fourth embodiment that are similar to the configurations already explained will be omitted as appropriate.

[0057] A configuration of an inattentive driving detection device according to a fourth embodiment of the present disclosure will be described. FIG. 10 is a diagram illustrating an example of a basic configuration of an inattentive driving detection device 100 (100D) according to the fourth embodiment of the present disclosure. Inattention detection device 100D, like inattention detection device 100A, inattention detection device 100B, or inattention detection device 100C, determines whether an occupant of a moving body is in an accumulated inattention state and outputs the determination result. Inattentive driving detection device 100D, like inattentive driving detection device 100B or inattentive driving detection device 100C, controls to issue an alarm when it is appropriate to determine that the driver is in an accumulated inattentive driving state. Similar to the inattentive driving detection device 100C, the inattentive driving detection device 100D determines the validity of the accumulated inattentive driving state and then controls to issue a warning to the occupant. In addition to the above, the inattentive driving detection device 100D calculates a cumulative value relating to intermittent inattentive driving, and determines whether or not the driver is in an accumulated inattentive state using the calculated cumulative value.

[0058] The inattentive driving detection device 100D is configured to include a cumulative inattentive driving judgment unit 110D, a cumulative inattentive driving point acquisition unit 120D, an observation direction acquisition unit 130D, a cumulative inattentive driving frequent point acquisition unit 140D, an allowable observation direction acquisition unit 150D, a validity determination unit 160D, an alarm control unit 170D, an observation direction acquisition unit 181, a mobile body state acquisition unit 182, and an inattentive driving accumulation unit 183. The cumulative inattentive point acquisition unit 120D, observation direction acquisition unit 130D, cumulative inattentive frequent point acquisition unit 140D, allowable observation direction acquisition unit 150D, validity determination unit 160D, and alarm control unit 170D may be configured to realize functions similar to those of the cumulative inattentive point acquisition units 120A, 120B, 120C, observation direction acquisition units 130A, 130B, 130C, cumulative inattentive frequent point acquisition units 140A, 140B, 140C, allowable observation direction acquisition units 150A, 150B, 150C, validity determination units 160A, 160B, 160C, and alarm control units 170B, 170C, respectively, which have already been described. Detailed explanations of the cumulative inattentive point acquisition unit 120D, observation direction acquisition unit 130D, cumulative inattentive point frequent acquisition unit 140D, allowable observation direction acquisition unit 150D, validity determination unit 160D, and warning control unit 170D will be omitted.

[0059] The observation direction acquisition unit 181 calculates the observation direction of the occupant of the moving body. The observation direction acquisition unit 181 acquires, for example, a video of the interior of a vehicle captured by the occupant monitoring device 200, and calculates and acquires the occupant's observation direction by performing image analysis processing or the like using the video. The observation direction is the direction from which the occupant is likely to be observing, and observation direction information indicating the observation direction is information calculated using the occupant's facial direction, the occupant's line of sight, or the occupant's facial direction and line of sight.

[0060] The mobile object state acquisition unit 182 acquires the mobile object state including the current position of the mobile object, the speed of the mobile object, and the traveling direction of the mobile object. The mobile object state acquisition unit 182 acquires mobile object state information indicating the state of the mobile object from, for example, a mobile object mounted device (for example, an electronic control unit mounted on an automobile) mounted on the mobile object.

[0061] The inattentiveness accumulation unit 183 calculates an accumulated value related to intermittent inattentiveness by an occupant of the mobile body, using the observation direction acquired by the observation direction acquisition unit 181 and the mobile body state acquired by the mobile body state acquisition unit 182. The inattentiveness accumulation unit 183 calculates an accumulated value by counting and accumulating the inattentiveness time or the number of inattentiveness occurrences when the observation direction deviates from a range based on the traveling direction or the predicted traveling direction. Inattentive driving accumulation unit 183 outputs the calculated accumulated value to accumulated inattentive driving determination unit 110D.

[0062] The cumulative inattentive driving state determining unit 110D determines whether or not the driver is in an inattentive driving state by using a cumulative value related to intermittent inattentive driving. Accumulative inattentive driving determination unit 110D performs cumulative inattentive driving determination, which is a determination of whether or not there is a cumulative inattentive driving state, using the cumulative value and a predetermined threshold value, and outputs the result of the cumulative inattentive driving determination. Specifically, the cumulative inattentive driving judgment unit 110D acquires a cumulative value relating to intermittent inattentive driving by the occupant of the vehicle, and performs a cumulative inattentive driving judgment, which is a judgment as to whether or not there is a cumulative inattentive driving state, using the cumulative value and a predetermined threshold value. The cumulative inattentive driving determination unit 110D, for example, acquires a cumulative value from the occupant monitoring device 200, compares the cumulative value with a threshold value each time the cumulative value is acquired, and determines whether the cumulative value is equal to or greater than the threshold value. If the cumulative value is equal to or greater than the threshold value, the cumulative inattentive driving determination unit 110D determines that the driver is in an inattentive driving state. Alternatively, the cumulative inattentive driving determination unit 110D may be configured to determine that the driver is in an inattentive driving state using, for example, a known technique for determining cumulative inattentive driving other than the above-described determination method. The cumulative inattentive driving determination unit 110D outputs the result of the cumulative inattentive driving determination. For example, the cumulative inattentive driving determination unit 110D outputs the result of the cumulative inattentive driving determination indicating that the cumulative value has reached or exceeded a threshold value. The cumulative inattentive driving determination unit 110D may be configured to include an inattentive driving accumulation unit 183. In this case, the cumulative inattentive driving determination unit 110D calculates a cumulative value relating to intermittent inattentive driving by an occupant of the mobile body using the observation direction acquired by the observation direction acquisition unit 130 and the mobile body state acquired by the mobile body state acquisition unit 182, performs a cumulative inattentive driving determination, which is a determination as to whether or not there is a cumulative inattentive driving state, using the cumulative value and a predetermined threshold value, and outputs the result of the cumulative inattentive driving determination.

[0063] The processing of the inattentive driving detection device 100 according to the fourth embodiment of the present disclosure will be described. FIG. 11 is a flowchart showing an example of the processing of the inattentive driving detection device 100 (100D) according to the fourth embodiment of the present disclosure. The process shown in FIG. 11 is an inattentive driving detection method using the inattentive driving detection device 100D. The inattentive driving detection device 100D starts the process when, for example, it receives a notification from the occupant monitoring device 200 indicating that the process has started.

[0064] First, the inattentive driving detection device 100D executes the observation direction calculation process (step ST4010). In the observation direction calculation process, the observation direction acquisition unit 181 of the inattentive driving detection device 100D acquires, for example, a video of the interior of the vehicle acquired by the occupant monitoring device 200, and calculates the observation direction of the occupant by performing image analysis processing using the acquired video. The observation direction acquisition unit 181 outputs observation direction information indicating the observation direction to the observation direction acquisition unit 130D.

[0065] Next, inattentive driving detection device 100D executes a moving object state acquisition process (step ST4020). In the moving object state acquisition process, the moving object state acquisition unit 182 of the inattentive driving detection device 100D acquires the moving object state including the current position of the moving object, the speed of the moving object, and the traveling direction of the moving object.

[0066] Next, inattentive driving detection device 100D executes inattentive driving accumulation processing (step ST4030). In the inattentiveness accumulation process, the inattentiveness accumulation unit 183 of the inattentiveness detection device 100D calculates an accumulated value related to intermittent inattentiveness by the occupant of the mobile body, using the observation direction acquired by the observation direction acquisition unit 130D and the mobile body state acquired by the mobile body state acquisition unit 182. When the observation direction deviates from a range based on the traveling direction or predicted traveling direction, the inattentiveness accumulation unit 183 calculates an accumulated value by counting and accumulating the inattentiveness time or the number of inattentiveness occurrences. Inattentive driving accumulation unit 183 outputs the accumulated value relating to the accumulated inattentive driving to accumulated inattentive driving determination unit 110D.

[0067] After executing the inattentive driving detection device 100D performs the inattentive driving accumulation process, the process proceeds to step ST3010. The inattentive driving detection device 100D executes the same processes as those of the inattentive driving detection device 100C, which have already been described, from step ST3010 onwards.

[0068] The inattentive driving detection device of the present disclosure is further configured, for example, as follows. A mobile object state acquisition unit that acquires the mobile object state including the current position and the moving direction of the mobile object. Furthermore, The cumulative inattentiveness determination unit Using the observation direction acquired by the observation direction acquisition unit and the mobile body state acquired by the mobile body state acquisition unit, a cumulative value related to intermittent inattentive behavior by an occupant of the mobile body is calculated, and the cumulative inattentive behavior determination, which is a determination of whether or not there is a cumulative inattentive behavior, is performed using the cumulative value and a predetermined threshold value, and the result of the cumulative inattentive behavior determination is output. A distraction detection device. As a result, the present disclosure has the effect of providing an inattentive driving detection device that is capable of calculating a cumulative value related to intermittent inattentive driving. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to an inattentive driving detection system, an occupant monitoring device, or the above inattentive driving detection method.

[0069] Embodiment 5. A fifth embodiment describes a form of an occupant monitoring device having the functions of the present disclosure. In the fifth embodiment, the same configuration as that already explained in the fourth embodiment will not be explained again.

[0070] FIG. 12 is a diagram illustrating an example of a basic configuration of an occupant monitoring device 200E (an occupant monitoring device 200 including the function of the inattentive driving detection device 100D of the present disclosure) according to the fifth embodiment of the present disclosure. The occupant monitoring device 200E shown in FIG. 12 is an occupant monitoring device 200 incorporating the inattentive driving detection device 100D already described.

[0071] The occupant monitoring device 200E is configured to include a cumulative inattentive behavior judgment unit 110E, a cumulative inattentive behavior point acquisition unit 120E, an observation direction acquisition unit 130E, a cumulative inattentive behavior frequent point acquisition unit 140E, an allowable observation direction acquisition unit 150E, a validity judgment unit 160E, an alarm control unit 170E, an observation direction acquisition unit 181E, a mobile body state acquisition unit 182E, an inattentive behavior accumulation unit 183E, and an image acquisition unit 210. The cumulative inattentive driving judgment unit 110E, cumulative inattentive driving point acquisition unit 120E, observation direction acquisition unit 130E, cumulative inattentive driving frequent point acquisition unit 140E, allowable observation direction acquisition unit 150E, validity judgment unit 160E, alarm control unit 170E, observation direction acquisition unit 181E, moving body state acquisition unit 182E, and inattentive driving accumulation unit 183E are each configured to realize the same functions as the cumulative inattentive driving judgment unit 110D, cumulative inattentive driving point acquisition unit 120D, observation direction acquisition unit 130D, cumulative inattentive driving frequent point acquisition unit 140D, allowable observation direction acquisition unit 150D, validity judgment unit 160D, alarm control unit 170D, observation direction acquisition unit 181E, moving body state acquisition unit 182, and inattentive driving accumulation unit 183 in the inattentive driving detection device 100D already described.

[0072] The video acquisition unit 210 acquires a video of the interior of a moving body (vehicle). The video acquisition unit 210 acquires video from an imaging device that captures the interior of a moving body (vehicle).

[0073] The observation direction acquisition unit 181E calculates the observation direction of the occupant of the moving body. The observation direction acquisition unit 181E acquires, based on the video acquired by the video acquisition unit 210, the observation direction that is the direction from which the passenger of the moving body (vehicle) is likely to be observing. The observation direction acquisition unit 181E, like the observation direction acquisition unit 181 already described, acquires, for example, a video of the interior of a moving object acquired by the occupant monitoring device 200, and calculates and acquires the observation direction of the occupant by performing image analysis processing or the like using the video. The observation direction is the direction from which the occupant is likely to be observing, and the observation direction information indicating the observation direction is information calculated using the occupant's facial direction, the occupant's line of sight, or the occupant's facial direction and line of sight.

[0074] Similar to the mobile object state acquisition unit 182 already described, the mobile object state acquisition unit 182E acquires the mobile object state including the current position of the mobile object, the speed of the mobile object, and the traveling direction of the mobile object. The mobile object state acquisition unit 182E acquires mobile object state information indicating the mobile object state from, for example, a mobile object mounted device (for example, an electronic control unit mounted on an automobile) mounted on the mobile object.

[0075] The inattentiveness accumulation unit 183E calculates an accumulated value related to intermittent inattentiveness by an occupant of the moving body using the observation direction acquired by the observation direction acquisition unit 181E and the moving body state acquired by the moving body state acquisition unit 182E. The inattentiveness accumulation unit 183E calculates an accumulated value by counting and accumulating the inattentiveness time or the number of inattentiveness occurrences when the observation direction deviates from a range based on the traveling direction or the predicted traveling direction. Inattentive driving accumulation unit 183E outputs the calculated accumulated value to accumulated inattentive driving determination unit 110E.

[0076] Like the cumulative inattentive driving judgment unit 110D already described, the cumulative inattentive driving judgment unit 110E acquires a cumulative value relating to intermittent inattentive driving by the vehicle occupants, and performs a cumulative inattentive driving judgment, which is a judgment of whether or not there is a cumulative inattentive driving state, using the cumulative value and a predetermined threshold value.

[0077] The cumulative inattentive driving point acquisition unit 120E, like the cumulative inattentive driving point acquisition unit 120 already described, acquires the cumulative inattentive driving point, which is the position of the vehicle when the cumulative inattentive driving state is determined to be in a cumulative inattentive driving state by the cumulative inattentive driving determination unit 110.

[0078] The observation direction acquisition unit 130E, like the observation direction acquisition unit 130 already described, acquires the observation direction that is the direction from which the passenger of the moving body is likely to be observing. The observation direction acquisition unit 130E acquires the observation direction, which is the direction in which the passenger of the moving body is likely to be observing, from the observation direction acquisition unit 181E.

[0079] Similar to the cumulative inattentive driving frequent point acquisition unit 140 already described, the cumulative inattentive driving frequent point acquisition unit 140E acquires cumulative inattentive driving frequent points, which are points where cumulative inattentive driving frequently occurs.

[0080] The allowable observation direction acquisition unit 150E, like the allowable observation direction acquisition unit 150 already described, acquires an allowable observation direction, which is a direction in which observation should be permitted for each of the cumulative inattentive driving frequent points.

[0081] Similar to the validity determination unit 160 already described, when the cumulative inattentiveness points acquired by the cumulative inattentiveness point acquisition unit 120E overlap with the cumulative inattentiveness frequent points acquired by the cumulative inattentiveness frequent point acquisition unit 140E, and when the observation direction acquired by the observation direction acquisition unit 130E overlaps with the allowable observation direction acquired by the allowable observation direction acquisition unit 150E, the validity determination unit 160E determines that the cumulative inattentiveness determination by the cumulative inattentiveness determination unit 110 is invalid, and outputs cumulative inattentiveness negation information, which is information that negates the result of the cumulative inattentiveness determination by the cumulative inattentiveness determination unit 110E.

[0082] Similar to the alarm control unit 170 already described, the alarm control unit 170E controls an alarm output device (not shown) based on the cumulative inattentive driving negation information output by the validity determination unit 160E so as not to output an alarm based on the result of the cumulative inattentive driving determination by the cumulative inattentive driving determination unit 110E.

[0083] The processing of the occupant monitoring device 200 according to the fifth embodiment of the present disclosure will be described. FIG. 13 is a flowchart showing an example of processing by the occupant monitoring device 200E (the occupant monitoring device 200 including the inattentive driving detection device 100D of the present disclosure) according to the fifth embodiment of the present disclosure. The process shown in FIG. 13 is a method for detecting inattentive driving using the occupant monitoring device 200E. The occupant monitoring device 200E starts processing, for example, when the moving body is ready to move.

[0084] First, the occupant monitoring device 200E executes an observation direction calculation process (step ST4010). In the observation direction calculation process, the observation direction acquisition unit 181E of the occupant monitoring device 200E acquires, for example, a video image of the interior of the vehicle acquired by the occupant monitoring device 200, and calculates the observation direction of the occupant by performing image analysis processing etc. using the acquired video. The observation direction acquisition unit 181E outputs observation direction information indicating the observation direction to the observation direction acquisition unit 130E.

[0085] Next, the occupant monitoring device 200E executes a moving object state acquisition process (step ST4020). In the moving body state acquisition process, the moving body state acquisition unit 182E of the occupant monitoring device 200E acquires the moving body state including the current position of the moving body, the speed of the moving body, and the traveling direction of the moving body.

[0086] Next, the occupant monitoring device 200E executes an inattentive driving accumulation process (step ST4030). In the inattentiveness accumulation process, the inattentiveness accumulation unit 183E of the occupant monitoring device 200E calculates an accumulated value related to intermittent inattentiveness by the occupant of the moving body using the observation direction acquired by the observation direction acquisition unit 181E and the moving body state acquired by the moving body state acquisition unit 182E. The inattentiveness accumulation unit 183E calculates an accumulated value by counting and accumulating the inattentiveness time or the number of inattentiveness occurrences when the observation direction deviates from a range based on the traveling direction or the predicted traveling direction. The inattentive driving accumulation unit 183 outputs the accumulated inattentive driving value to the accumulated inattentive driving determination unit 110E.

[0087] After executing the inattentive driving behavior accumulation process, the occupant monitoring device 200E proceeds to the process of step ST3010. The occupant monitoring device 200E executes the same processes as those of the inattentive driving detection device 100C after step ST3010, which have already been described.

[0088] The occupant monitoring device of the present disclosure is configured, for example, as follows. an image acquisition unit that acquires an image of the interior of the vehicle; an observation direction acquisition unit that acquires an observation direction, which is a direction from which an occupant of the vehicle is likely to be observing, based on the image acquired by the image acquisition unit; an accumulated inattentive state determination unit that acquires an accumulated value related to intermittent inattentive state by an occupant of the vehicle and performs an accumulated inattentive state determination by using the accumulated value and a predetermined threshold value; an accumulated inattentive state acquisition unit that acquires an accumulated inattentive state, which is a position of the vehicle when the accumulated inattentive state is determined to be in an accumulated inattentive state by the accumulated inattentive state determination unit; a cumulative inattentive driving frequent occurrence point acquisition unit that acquires cumulative inattentive driving frequent occurrence points, which are points where cumulative inattentive driving frequently occurs; an allowable observation direction acquisition unit that acquires an allowable observation direction, which is a direction in which observation should be allowed for each of the cumulative inattentive looking points; a validity determination unit that outputs cumulative inattentive driving negation information, which is information that negates the result of the cumulative inattentive driving determination unit, when the cumulative inattentive driving points acquired by the cumulative inattentive driving point acquisition unit and the cumulative inattentive driving frequent points acquired by the cumulative inattentive driving frequent point acquisition unit overlap, and when the observation direction acquired by the observation direction acquisition unit and the allowable observation direction acquired by the allowable observation direction acquisition unit overlap; a warning control unit that controls a warning output device based on the cumulative inattentive driving behavior denial information output by the validity determination unit so as not to output a warning based on the result of the cumulative inattentive driving behavior determination unit; An occupant monitoring device comprising: As a result, the present disclosure has the effect of providing an occupant monitoring device that can prevent excessive detection of accumulated inattentive driving. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to an inattentive driving detection system or the above inattentive driving detection method.

[0089] Embodiment 6 In the sixth embodiment, a mode will be described in which an inattentive driving detection device and a server device cooperate with each other. The sixth embodiment is a configuration in which the inattentive driving detection device shown in the fourth embodiment has a function of providing information to a server device. In the sixth embodiment, the same configuration as that of the fourth embodiment already explained will not be explained again.

[0090] The configurations of an inattentive driving detection device 100 and a server device 300 according to a sixth embodiment of the present disclosure will be described. FIG. 14 is a diagram illustrating an example of a basic configuration of an inattentive driving detection device 100 (100F) and a server device 300F according to the sixth embodiment of the present disclosure. The inattentive driving detection device 100F shown in FIG. 14 is the same as the inattentive driving detection device 100C already described, but with a configuration modified to operate in cooperation with a server device 300. The inattentive driving detection device 100F, like the inattentive driving detection device 100C, determines the validity of the determination result as to whether the occupant of the moving body is in an accumulated inattentive state, and outputs the determination result. The inattentive driving detection device 100F, like the inattentive driving detection device 100C, controls to issue an alarm when it is determined that the driver is in an accumulated inattentive driving state. The inattentive driving detection device 100F, like the inattentive driving detection device 100C, determines the validity of the accumulated inattentive driving state and then controls to issue a warning to the occupant. The inattentive driving detection device 100F further operates in cooperation with an external server device 300 when determining the validity of the determination result that the driver is in an accumulated inattentive driving state.

[0091] The inattentive driving detection device 100F includes a cumulative inattentive driving determination unit 110F, a cumulative inattentive driving point acquisition unit 120F, an observation direction acquisition unit 130F, a cumulative inattentive driving frequent point acquisition unit 140F, an allowable observation direction acquisition unit 150F, a validity determination unit 160F, an alarm control unit 170F, and a cumulative inattentive driving information output unit 19F. 0、 It is composed of the following.

[0092] Like the cumulative inattentive driving state determining unit 110 already described, the cumulative inattentive driving state determining unit 110F determines whether the cumulative inattentive driving state is present by using a cumulative value relating to intermittent inattentive driving. Specifically, the cumulative inattentive driving determination unit 110A acquires a cumulative value relating to intermittent inattentive driving by the occupant of the vehicle, and performs a cumulative inattentive driving determination, which is a determination of whether or not there is a cumulative inattentive driving state, using the cumulative value and a predetermined threshold value.

[0093] Similar to the cumulative inattentive state acquisition unit 120 already described, the cumulative inattentive state acquisition unit 120F acquires cumulative inattentive state points based on the position of the moving body 10 (10-n) when the cumulative inattentive state determination unit 110A determines that the moving body 10 (10-n) is in an inattentive state.

[0094] The observation direction acquisition unit 130F, like the observation direction acquisition unit 130 already described, acquires the observation direction that is the direction from which the occupant of the moving body 10 (10-n) is likely to be observing.

[0095] When the cumulative inattentive behavior frequency point acquisition unit 140F receives the result of the cumulative inattentive behavior judgment output by the cumulative inattentive behavior judgment unit 110F, it uses the cumulative inattentive behavior frequency points acquired by the cumulative inattentive behavior frequency point acquisition unit 120F to acquire, from the external device, the server device 300, cumulative inattentive behavior frequency points corresponding to positions that overlap with the cumulative inattentive behavior frequency points.

[0096] The permissible observation direction acquisition unit 150F acquires the permissible observation direction at the cumulative inattentive driving point and at cumulative inattentive driving frequent points around the cumulative inattentive driving point. The allowable observation direction acquisition unit 150F uses the cumulative inattentive viewing points acquired by the cumulative inattentive viewing point acquisition unit 120F to acquire from the external device, the server device 300, the allowable observation direction, which is the direction that should be allowed for observation at the cumulative inattentive viewing frequent points that correspond to positions overlapping with the cumulative inattentive viewing points.

[0097] Similar to the validity determination unit 160 already described, the validity determination unit 160F determines the validity of the cumulative inattentive behavior determination made by the cumulative inattentive behavior determination unit 110F. The validity determination unit 160F determines the validity of the cumulative inattentive behavior determination made by the cumulative inattentive behavior determination unit 110F, and outputs cumulative negative inattentive behavior information or cumulative positive inattentive behavior information. The validity determination unit 160F has a configuration similar to that of the validity determination unit 160C already described, and outputs accumulated inattentive driving denial information that is information that denies the result of the accumulated inattentive driving determination by the accumulated inattentive driving determination unit 110F. In addition, if the cumulative inattentiveness points acquired by the cumulative inattentiveness point acquisition unit 120F do not overlap with the cumulative inattentiveness frequent points acquired by the cumulative inattentiveness frequent point acquisition unit 140F, or if the observation direction acquired by the observation direction acquisition unit 130F does not overlap with the permissible observation direction acquired by the permissible observation direction acquisition unit 150F, the validity judgment unit 160F judges that the cumulative inattentiveness judgment by the cumulative inattentiveness judgment unit 110F is valid, and outputs cumulative inattentiveness positive information, which is information that positively confirms the result of the cumulative inattentiveness judgment by the cumulative inattentiveness judgment unit 110F.

[0098] The warning control unit 170F, like the warning control unit 170 already described, controls the issuance of a warning to warn the occupant that he or she is in an accumulated inattentive state. The warning control unit 170F outputs a warning control signal that prevents the output of a warning based on the result of the cumulative inattentive driving judgment by the cumulative inattentive driving judgment unit 110F, based on the cumulative inattentive driving negation information output by the validity judgment unit 160F. In addition to the above, the warning control unit 170F outputs a warning control signal to output a warning based on the result of the cumulative inattentive driving judgment by the cumulative inattentive driving judgment unit 110F, based on the cumulative inattentive driving affirmative information output by the validity judgment unit 160F. The alarm control unit 170F outputs an alarm control signal to, for example, an alarm output device (not shown).

[0099] The accumulated inattentive driving information output unit 190 provides the information relating to the accumulated inattentive driving to the server device 300F. When the result of the cumulative inattentive driving judgment by the cumulative inattentive driving judgment unit 110F indicates a cumulative inattentive driving state, the cumulative inattentive driving information output unit 190 outputs the cumulative inattentive driving points acquired by the cumulative inattentive driving point acquisition unit 120F and the observation direction acquired by the observation direction acquisition unit 130F to the external device, server device 300F. Alternatively, the cumulative inattentive driving information output unit 190 may point , and the observation direction, as well as the result of the cumulative inattentive driving determination indicating that the driver is in an accumulated inattentive driving state, are output to the server device 300F, which is an external device. The cumulative inattentive driving information output unit 190 may output cumulative inattentive driving positive information or cumulative inattentive driving negative information instead of the result of the cumulative inattentive driving determination indicating that the driver is in a cumulative inattentive driving state.

[0100] The server device 300F collects information on cases where it is determined that the occupant of each of the plurality of moving bodies is in an accumulated inattentive state, and extracts information on accumulated inattentive driving high occurrence points. Furthermore, the server device 300F provides information related to the extracted cumulative inattentive driving frequent locations when the validity of the inattentive driving detection determination made by the inattentive driving detection device 100 in the moving body is determined.

[0101] The server device 300F shown in FIG. 14 includes a cumulative inattentive driving information acquisition unit 310, a cumulative inattentive driving information storage unit 320, a cumulative inattentive driving frequent spot determination unit 330, and a cumulative inattentive driving frequent spot information output unit 340.

[0102] The cumulative inattentive driving information acquisition unit 310 acquires information relating to cumulative inattentive driving from each of a plurality of moving bodies. The cumulative inattentive driving information acquisition unit 310 acquires, from each of a plurality of moving bodies, the observation direction, which is the direction in which the occupant of the moving body is likely to be observing, and the cumulative inattentive driving point, which is based on the position of the moving body when it is determined that the occupant is in a cumulative inattentive driving state. Alternatively, the cumulative inattentive driving information acquisition unit 310 acquires, from each of the multiple moving bodies, the cumulative inattentive driving point and observation direction, as well as cumulative inattentive driving affirmative information, which is information that affirms the result of the cumulative inattentive driving determination that the occupant is in a cumulative inattentive driving state.

[0103] The accumulated inattentive driving information storage unit 320 stores the accumulated inattentive driving information. The cumulative inattentive driving information storage unit 320 uses the cumulative inattentive driving points and observation directions acquired by the cumulative inattentive driving information acquisition unit 310 to associate the observation directions with each cumulative inattentive driving point and store them in a storage unit (not shown). Alternatively, the cumulative inattentive driving information storage unit 320 uses the cumulative inattentive driving points, observation directions, and cumulative inattentive driving positive information acquired by the cumulative inattentive driving information acquisition unit 310 to associate an observation direction with each cumulative inattentive driving point and store the association in a storage unit (not shown). Alternatively, the cumulative inattentive viewing information storage unit 320 further uses the non-acceptable viewing directions for each position that have been stored in advance to associate the viewing directions for each cumulative inattentive viewing point, excluding the non-acceptable viewing directions, with the cumulative inattentive viewing point and store them in a storage unit not shown.

[0104] The cumulative inattentive driving frequent point determining unit 330 extracts and determines cumulative inattentive driving frequent points. The cumulative inattentiveness frequent point determination unit 330 uses the observation direction for each cumulative inattentiveness point stored in the cumulative inattentiveness information storage unit 320 to extract cumulative inattentiveness frequent points, which are points where cumulative inattentiveness by occupants of each of the multiple moving bodies frequently occurs.

[0105] The cumulative inattentive driving frequent spot information output unit 340 provides information on cumulative inattentive driving frequent spots in response to information output from the inattentive driving detection device 100F in a moving body. The cumulative inattentive driving frequent spot information output unit 340 outputs information relating to the cumulative inattentive driving frequent spot extracted by the cumulative inattentive driving frequent spot determination unit to the mobile body. Furthermore, when the cumulative inattentive driving frequent point information output unit 340 acquires the cumulative inattentive driving points from the mobile body, it outputs to the mobile body the allowable observation direction of the cumulative inattentive driving frequent point that indicates the same position as the cumulative inattentive driving point.

[0106] In addition to the above components, the server device 300F includes a control unit (not shown), a storage unit (not shown), and a communication unit (not shown). A control unit (not shown) controls the entire server device 300F and each of its components. The control unit (not shown) starts up the server device 300F, for example, in accordance with an external command. The control unit (not shown) also controls the state (operating state, such as start-up, shutdown, or sleep) of the server device 300F. A storage unit (not shown) stores each piece of data used in the server device 300F. The storage unit (not shown) stores, for example, output (output data) from each component in the server device 300F, and outputs data requested by each component to the requesting component. The communication unit (not shown) communicates with external devices. For example, communication is performed between the server device 300F and peripheral devices (the inattentive driving detection device 100F, the occupant monitoring device 200). The communication unit (not shown) has a function of communicating between the server device 300F and the inattentive driving detection device 100F. The communication unit (not shown) also has a function of communicating between the server device 300F and the occupant monitoring device 200. The control unit (not shown), the storage unit (not shown), and the communication unit (not shown) are the same in the server device 300 of the other embodiments.

[0107] Here, the processing of the inattentive driving detection device 100 (100F) according to the sixth embodiment of the present disclosure will be described. FIG. 15 is a flowchart showing an example of processing by the inattentive driving detection device 100 (100F) according to the sixth embodiment of the present disclosure. The process shown in FIG. 15 is an inattentive driving detection method using the inattentive driving detection device 100F. The inattentive driving detection device 100F executes the processes of steps ST6010, ST6020, ST6030, ..., and ST6080 in a manner similar to the processes of steps ST1010, ST1020, ST1030, ..., and ST1080 of the already-described inattentive driving detection device 100. Detailed descriptions of the processes of steps ST6010, ST6020, ST6030, ..., and ST6080 will be omitted as appropriate. The inattentive driving detection device 100F starts processing when it acquires a cumulative value relating to the cumulative inattentive driving. The inattentive driving detection device 100F acquires the cumulative value relating to the cumulative inattentive driving from the occupant monitoring device 200, for example.

[0108] The inattentive driving detection device 100F first executes the cumulative inattentive driving determination process (step ST6010) in the same manner as the cumulative inattentive driving determination process already described.

[0109] When determining that the driver is not in an accumulated inattentive state ("NO" in step ST6020), the inattentive driving detection device 100F ends the process shown in FIG. 15 and waits until the next accumulated value is acquired.

[0110] If the inattentive driving detection device 100F determines that the driver is in a cumulative inattentive driving state (step ST6020 "YES"), it then executes a cumulative inattentive driving point acquisition process (step ST6030) in the same manner as the cumulative inattentive driving point acquisition process already described.

[0111] Next, the inattentive driving detection device 100F executes the observation direction acquisition process (step ST6040) in the same manner as the observation direction acquisition process already described.

[0112] Next, the inattentive driving detection device 100F executes a cumulative inattentive driving frequent occurrence point acquisition process (step ST6050). In the cumulative inattentive driving spot acquisition process, the cumulative inattentive driving spot acquisition unit 140F of the inattentive driving detection device 100F acquires cumulative inattentive driving spots, which are spots where cumulative inattentive driving by occupants of each of the multiple moving bodies occurs frequently. When the cumulative inattentiveness frequent point acquisition unit 140F receives a notification from the cumulative inattentiveness determination unit 110F indicating that a cumulative inattentiveness state has been determined, it acquires cumulative inattentiveness frequent point information indicating the cumulative inattentiveness frequent points. The cumulative inattentiveness frequent point information indicates the locations or areas of the cumulative inattentiveness frequent points, which are points where cumulative inattentiveness by occupants of each of multiple mobile bodies frequently occurs. For example, the cumulative inattentiveness frequent point acquisition unit 140F uses the cumulative inattentiveness points acquired by the cumulative inattentiveness point acquisition unit 120F to acquire information related to the cumulative inattentiveness frequent points included in the area based on the cumulative inattentiveness points from the server device 300F. The cumulative inattentiveness frequent point acquisition unit 140F outputs the cumulative inattentiveness frequent point information included in the acquired information related to the cumulative inattentiveness frequent points to the validity determination unit 160F. When the cumulative inattentive behavior frequency point acquisition unit 140F receives the result of the cumulative inattentive behavior judgment output by the cumulative inattentive behavior judgment unit 110F, it uses the cumulative inattentive behavior frequency points acquired by the cumulative inattentive behavior frequency point acquisition unit 120F to acquire cumulative inattentive behavior frequency points corresponding to positions that overlap with the cumulative inattentive behavior frequency points from the external device, server device 300F.

[0113] Next, the inattentive driving detection device 100F executes an allowable observation direction acquisition process (step ST6060). In the allowable observation direction acquisition process, the allowable observation direction acquisition unit 150F of the inattentive driving detection device 100F acquires the allowable observation direction, which is the direction in which observation should be allowed, for each cumulative inattentive driving frequent point. When the allowable observation direction acquisition unit 150F receives a notification from the accumulated inattentive state determination unit 110F indicating that a cumulative inattentive state has been determined, the allowable observation direction acquisition unit 150F acquires allowable observation direction information indicating the allowable observation direction included in the information related to the cumulative inattentive frequent point acquired from the server device 300F by the accumulated inattentive frequent point acquisition unit 140F. The allowable observation direction information indicates a direction or a directional area consisting of multiple directions that is allowable for observation at the cumulative inattentive frequent point, which is a point where cumulative inattentive behavior by occupants of each of multiple mobile bodies frequently occurs. The allowable observation direction acquisition unit 150F outputs the acquired allowable observation direction information to the validity determination unit 160F. The permissible observation direction acquisition unit 150F acquires the permissible observation direction at the cumulative inattentive driving point and at cumulative inattentive driving frequent points around the cumulative inattentive driving point. The allowable observation direction acquisition unit 150F uses the cumulative inattentive viewing points acquired by the cumulative inattentive viewing point acquisition unit 120F to acquire from an external device, a server device 300F, an allowable observation direction that is a direction that should be allowed for observation at a cumulative inattentive viewing frequency point that corresponds to a position that overlaps with the cumulative inattentive viewing point.

[0114] Next, the inattentive driving detection device 100F executes the validity determination process (step ST6070) in the same manner as the validity determination process already described.

[0115] When determining that the inattentive driving behavior is not valid in the validity determination process ("NO" in step ST6080), the inattentive driving behavior detection device 100F executes an accumulated inattentive driving behavior negative information output process (step ST6090). In the cumulative inattentive driving negative information output process, the validity determining unit 160F of the inattentive driving detection device 100F outputs cumulative inattentive driving negative information that is information that denies the result of the cumulative inattentive driving determination by the cumulative inattentive driving determination unit 110F. If the validity determination unit 160F determines that the cumulative inattentive behavior determination by the cumulative inattentive behavior determination unit 110F is invalid, it generates cumulative inattentive behavior negation information and outputs it to a component within the inattentive behavior detection device 100 that uses the results of the cumulative inattentive behavior determination or to an external device outside the inattentive behavior detection device 100. The validity determination unit 160F outputs the accumulated inattentive behavior denial information to the server device 300F via the accumulated inattentive behavior information output unit 190 in particular.

[0116] After executing the accumulated inattentive driving detection device 100F negative inattentive driving information output process, the inattentive driving detection device 100F then executes accumulated inattentive driving information output process (step ST6110). In the cumulative inattentive driving information output process, the cumulative inattentive driving information output unit 190 of the inattentive driving detection device 100F point , and the observation direction, as well as the result of the adequacy determination by the adequacy determination unit 160F (accumulated inattentive behavior denial information), are output to the server device 300F, which is an external device.

[0117] When the inattentive driving detection device 100F determines that the cumulative inattentive driving judgment is valid in the validity judgment process ("YES" in step ST6080), it then executes cumulative inattentive driving positive information output process (step ST6100). In the cumulative inattentive driving affirmative information output process, the validity determining unit 160F of the inattentive driving detection device 100F outputs cumulative inattentive driving affirmative information that is information that affirms the result of the cumulative inattentive driving determination by the cumulative inattentive driving determination unit 110F. If the validity determination unit 160F determines that the cumulative inattentiveness determination by the cumulative inattentiveness determination unit 110F is valid, it generates cumulative inattentiveness positive information and outputs it to a component within the inattentiveness detection device 100 that uses the results of the cumulative inattentiveness determination or to an external device outside the inattentiveness detection device 100. The validity determination unit 160F outputs the accumulated inattentive behavior positive information to the server device 300F via the accumulated inattentive behavior information output unit 190 in particular.

[0118] After executing the accumulated inattentive driving detection device 100F positive inattentive driving information output process, the inattentive driving detection device 100F then executes accumulated inattentive driving information output process (step ST6110). In the cumulative inattentive driving information output process, the cumulative inattentive driving information output unit 190 of the inattentive driving detection device 100F outputs the cumulative inattentive driving points acquired by the cumulative inattentive driving point acquisition unit 120F and the observation direction acquired by the observation direction acquisition unit 130F to the external device, server device 300F. Alternatively, the cumulative inattentive driving information output unit 190 may point , and the observation direction, as well as the result of the adequacy determination by the adequacy determination unit 160F (accumulated inattentive behavior positive information), are output to the server device 300F, which is an external device. After executing the accumulated inattentive driving information output process, the inattentive driving detection device 100F ends the process. Although both cases have been described, where the validity determination unit 160F outputs cumulative inattentiveness negative information and where the validity determination unit 160F outputs cumulative inattentiveness positive information, for example, if the setting is such that cumulative inattentiveness information is output only when cumulative inattentiveness negative information is output, the cumulative inattentiveness point and observation direction may be output as cumulative inattentiveness information without adding cumulative inattentiveness negative information and cumulative inattentiveness positive information.

[0119] Here, the processing of the server device 300F according to the sixth embodiment of the present disclosure will be described. The process performed by server device 300F is a method for providing accumulated inattentive driving frequent locations that provides information related to accumulated inattentive driving to a mobile body.

[0120] When communication is established with a communication unit (not shown) on the mobile object side, the server device 300F first executes an accumulated inattentive driving information acquisition process. In the cumulative inattentive state information acquisition process, cumulative inattentive state information acquisition unit 310 of server device 300F acquires cumulative inattentive state information. Cumulative inattentive state information acquisition unit 310 acquires, from each of a plurality of mobile bodies, an observation direction in which the occupant of the mobile body is likely to be looking, and a cumulative inattentive state point based on the position of the mobile body when it is determined that the occupant is in an accumulated inattentive state.

[0121] Next, the server device 300F executes an accumulated inattentive driving information storage process. In the cumulative inattentive information storage process, cumulative inattentive information storage unit 320 of server device 300F stores the cumulative inattentive information. Using the cumulative inattentive point and observation direction acquired by cumulative inattentive information acquisition unit 310, cumulative inattentive information storage unit 320 associates and stores the observation direction for each cumulative inattentive point. When the cumulative inattentiveness information is supplemented with the cumulative inattentiveness judgment result, cumulative inattentiveness positive information, or cumulative inattentiveness negative information, the cumulative inattentiveness information storage unit 320 stores the cumulative inattentiveness point and observation direction in association with the cumulative inattentiveness judgment result, cumulative inattentiveness positive information, or cumulative inattentiveness negative information.

[0122] Next, the server device 300F executes a process for determining a cumulative inattentive driving frequent point. In the cumulative inattentive driving frequent point determination process, the cumulative inattentive driving frequent point determination unit 330 of the server device 300F extracts and determines information related to the cumulative inattentive driving frequent points. The cumulative inattentiveness frequent point determination unit 330 uses the observation direction for each cumulative inattentiveness point stored in the cumulative inattentiveness information storage unit 320 to extract cumulative inattentiveness frequent points, which are points where cumulative inattentiveness by occupants of each of the multiple moving bodies frequently occurs.

[0123] Next, the server device 300F executes a process for outputting information on accumulated inattentive driving frequent locations. In the cumulative inattentive driving frequent spot information output process, the cumulative inattentive driving frequent spot information output unit 340 of the server device 300F outputs information relating to the cumulative inattentive driving frequent spot extracted by the cumulative inattentive driving frequent spot determination unit 330 to the mobile body. When the cumulative inattentive driving information acquisition unit 310 acquires cumulative inattentive driving information from the inattentive driving detection device 100 of the mobile body, the cumulative inattentive driving frequent point information output unit 340 outputs information relating to the cumulative inattentive driving frequent points included in a range based on the cumulative inattentive driving points to the inattentive driving detection device 100 of the mobile body, based on the cumulative inattentive driving points of the mobile body.

[0124] After executing the accumulated inattentive driving frequent spot information output process, the server device 300F ends the process.

[0125] The configuration of the inattentive driving detection device 100 and the configuration of the server device 300 shown in embodiment 6 are configured to link the inattentive driving detection device 100 and the server device 300, and when the inattentive driving detection device 100 determines the appropriateness of cumulative inattentive driving, the server device 300 can provide the information necessary to determine the appropriateness, thereby realizing a more efficient configuration.

[0126] The inattentive driving detection device of the present disclosure is further configured, for example, as follows. The cumulative inattentive spot acquisition unit When the result of the cumulative inattentive driving determination output by the cumulative inattentive driving determination unit is received, Using the cumulative inattentive point acquisition unit, Acquire, from a server device, which is an external device, a cumulative inattentive driving frequent occurrence point, which is a point where the cumulative inattentive driving frequently occurs and which corresponds to a position overlapping with the cumulative inattentive driving point; A distraction detection device. As a result, the present disclosure further has the effect of providing an inattentive driving detection device that makes it possible to obtain only information related to cumulative inattentive driving points from among all cumulative inattentive driving points held by the server device. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to the occupant monitoring device or the above inattentive driving detection method. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to an inattentive driving detection system including the occupant monitoring device and the server device.

[0127] The inattentive driving detection device of the present disclosure is further configured, for example, as follows. The allowable observation direction acquisition unit Using the accumulated inattentiveness points acquired by the accumulated inattentiveness point acquisition unit, an allowable observation direction, which is a direction that should be allowed for observation at the accumulated inattentiveness frequent point corresponding to a position overlapping with the accumulated inattentiveness points, is acquired from a server device, which is an external device. A distraction detection device. As a result, the present disclosure further has the effect of being able to provide an inattentive driving detection device that makes it possible to obtain only the allowable observation directions of cumulative inattentive driving points related to the cumulative inattentive driving points from the allowable observation directions of all cumulative inattentive driving points held by the server device. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to an inattentive driving detection system including the occupant monitoring device and the server device.

[0128] The inattentive driving detection device of the present disclosure is further configured, for example, as follows. When the result of the cumulative inattentiveness determination by the cumulative inattentiveness determination unit indicates a cumulative inattentive state, an accumulated inattentive driving information output unit that outputs the accumulated inattentive driving points acquired by the accumulated inattentive driving point acquisition unit and the observation direction acquired by the observation direction acquisition unit to a server device that is an external device; Furthermore, A distraction detection device. As a result, the present disclosure further has the effect of providing an inattentive driving detection device that enables information related to the cumulative inattentive driving points for each moving object to be used by an external device. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to an inattentive driving detection system including the occupant monitoring device and the server device.

[0129] The inattentive driving detection device of the present disclosure is further configured, for example, as follows. The cumulative inattentive looking information output unit The cumulative inattentiveness point , and the observation direction, in addition to a result of the validity determination by the validity determination unit; and outputting the result to a server device, which is an external device. A distraction detection device. As a result, the present disclosure further has the effect of providing an inattentive driving detection device that allows the results of cumulative inattentive driving judgment for each moving object to be used by an external device. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to an inattentive driving detection system including the occupant monitoring device and the server device.

[0130] The server device of the present disclosure is configured, for example, as follows. an accumulated inattentive driving information acquisition unit that acquires, from each of a plurality of moving bodies, an observation direction that is a direction in which an occupant of the moving body is likely to be observing, and an accumulated inattentive driving point based on the position of the moving body when it is determined that the occupant is in an accumulated inattentive driving state; an accumulated inattentive driving information storage unit that uses the accumulated inattentive driving points and the observation directions acquired by the accumulated inattentive driving information acquisition unit to associate the observation directions with each of the accumulated inattentive driving points and store them; a cumulative inattentiveness frequent occurrence point determination unit that extracts cumulative inattentiveness frequent occurrence points, which are points where cumulative inattentiveness by occupants of each of a plurality of moving bodies frequently occurs, using the observation direction for each cumulative inattentiveness point stored in the cumulative inattentiveness information storage unit; an accumulated inattentive spot information output unit that outputs information related to the accumulated inattentive spot information extracted by the accumulated inattentive spot information determining unit to the moving object; A server device comprising: As a result, the present disclosure has the effect of being able to provide cumulative inattentive driving points, which are points where cumulative inattentive driving by occupants of each of multiple moving bodies occurs frequently, and being able to provide a server device that makes it possible to prevent excessive detection of cumulative inattentive driving by the inattentive driving detection device of each moving body. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to an inattentive driving detection system including the inattentive driving detection device, or to a method for providing a cumulative list of frequent inattentive driving locations.

[0131] The method for providing accumulated inattentive driving locations according to the present disclosure is configured, for example, as follows. A method for providing cumulative inattentive driving spot information to a mobile body by a server device, comprising: an accumulated inattentive state information acquisition unit of the server device acquires, from each of the plurality of moving bodies, an observation direction that is a direction in which an occupant in the moving body is likely to be looking, and an accumulated inattentive state point based on the position of the moving body when it is determined that the occupant is in an accumulated inattentive state; an accumulated inattentive driving information storage unit of the server device uses the accumulated inattentive driving points and the observation directions acquired by the accumulated inattentive driving information acquisition unit to associate the observation directions with each of the accumulated inattentive driving points and store them; a cumulative inattentiveness frequent point extraction unit of the server device extracts cumulative inattentiveness frequent points, which are points where cumulative inattentiveness by occupants of each of a plurality of moving bodies frequently occurs, using the observation direction for each of the cumulative inattentiveness points stored in the cumulative inattentiveness information storage unit; an accumulated inattentive spot information output unit of the server device outputs information related to the accumulated inattentive spot occurrences extracted by the accumulated inattentive spot occurrences extraction unit to the mobile object; A method for providing locations where frequent inattentive behavior occurs. As a result, the present disclosure has the effect of providing a method for providing cumulative inattentiveness points, which are points where cumulative inattentiveness by occupants of each of multiple mobile bodies occurs frequently, for each mobile body, and making it possible to prevent excessive detection of cumulative inattentiveness by the inattentiveness detection device of each mobile body. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to the above inattentive driving detection method.

[0132] The server device of the present disclosure is configured, for example, as follows. The cumulative inattentive looking information acquisition unit The cumulative inattentive state information is obtained from each of the plurality of moving bodies, and the cumulative inattentive state information is obtained from each of the plurality of moving bodies. The cumulative inattentive state information is obtained from each of the plurality of moving bodies and the cumulative inattentive state information is obtained from each of the plurality of moving bodies. the cumulative inattentive driving information storage unit uses the cumulative inattentive driving points, the observation direction, and the cumulative inattentive driving positive information acquired by the cumulative inattentive driving information acquisition unit to associate the observation direction with each cumulative inattentive driving point and store the information. 2. The server device according to claim 1, wherein: As a result, the present disclosure has the effect of providing a server device that makes it possible to extract points where cumulative inattentive driving is frequent by utilizing the results of determining the appropriateness of cumulative inattentive driving for each moving body. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to an inattentive driving detection system including the inattentive driving detection device, or to a method for providing a cumulative list of frequent inattentive driving locations.

[0133] The server device of the present disclosure is configured, for example, as follows. The cumulative inattentive looking information storage unit Furthermore, by using the unacceptable observation directions for each position stored in advance, the observation directions excluding the unacceptable observation directions from among the observation directions for each of the cumulative inattentive points are stored in association with the cumulative inattentive points. 2. The server device according to claim 1, wherein: As a result, the present disclosure has the effect of providing a server device that makes it possible to extract cumulative inattentive driving frequent points by utilizing unacceptable observation directions for each preset position. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to an inattentive driving detection system including the inattentive driving detection device, or to a method for providing a cumulative list of frequent inattentive driving locations.

[0134] The server device of the present disclosure is configured, for example, as follows. The cumulative inattentive spot information output unit When the cumulative inattentive driving points are acquired from the moving body, the allowable observation direction of the cumulative inattentive driving frequent points, which indicates the same position as the cumulative inattentive driving points, is output to the moving body. The server device according to claim 1, further comprising: As a result, the present disclosure has the effect of providing a server device that can provide an acceptable observation direction for a cumulative inattentive driving frequency point for each moving body as needed. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to an inattentive driving detection system including the inattentive driving detection device, or to a method for providing a cumulative list of frequent inattentive driving locations.

[0135] Here, a hardware configuration for realizing the functions of the present disclosure will be described. FIG. 16 is a diagram illustrating a first example of a hardware configuration for realizing the functions of the present disclosure. FIG. 17 is a diagram illustrating a second example of a hardware configuration for realizing the functions of the present disclosure. The inattentive driving detection device 100 (100A, 100B, 100C, 100D, 100F), the occupant monitoring device 200E, and the server device 300 (300F) of the present disclosure are each realized by hardware such as shown in FIG. 16 or FIG.

[0136] As shown in FIG. 16, each of the inattentive driving detection devices 100 (100A, 100B, 100C, 100D, 100F) and the occupant monitoring device 200E includes, for example, a processor 10001, a memory 10002, an input / output interface 10003, and a communication circuit 10004. The processor 10001 and the memory 10002 are, for example, installed in a computer. The memory 10002 stores the computer, which includes a cumulative inattentive driving judgment unit 110 (110A, 110B, 110C, 110D, 110E, 110F), a cumulative inattentive driving point acquisition unit 120 (120A, 120B, 120C, 120D, 120E, 120F), an observation direction acquisition unit 130 (130A, 130B, 130C, 130D, 130E, 130F), a cumulative inattentive driving frequent point acquisition unit 140 (140A, 140B, 140C, 140D, 140E, 140F), an allowable observation direction acquisition unit 150 (150A, 150B, 150C, 150D, 150E, 150F), and a validity determination unit. The memory stores a program for causing the memory to function as a control unit (not shown), such as a warning control unit 160 (160A, 160B, 160C, 160D, 160E, 160F), a warning control unit 170 (170B, 170C, 170D, 170E, 170F), an observation direction acquisition unit 181, 181E, a moving object state acquisition unit 182, 182E, an inattentiveness accumulation unit 183, 183E, an accumulated inattentiveness information output unit 190 (190F), and the like. The processor 10001 reads out and executes the program stored in the memory 10002, whereby a cumulative inattentive driving judgment unit 110 (110A, 110B, 110C, 110D, 110E, 110F), a cumulative inattentive driving point acquisition unit 120 (120A, 120B, 120C, 120D, 120E, 120F), an observation direction acquisition unit 130 (130A, 130B, 130C, 130D, 130E, 130F), a cumulative inattentive driving frequent point acquisition unit 140 (140A, 140B, 140C, 140D, 140E, 140F), an allowable observation direction acquisition unit 150 (150A, 150B, 150C, 150D, 150E, 150F), a validity determination unit 160 (160A, 160B, 160C, 160D, 160E, 160F), a validity determination unit 170 (170A, 170B, 170C, 170D, 170E, 170F), a validity determination unit 180 (180A, 180B, 180C, 180D, 180E, 180F), a validity determination unit 190 (190A, 190B, 190C, 190D, 190E, 190F), a validity determination unit 200 (200A, 200B, 200C, 200D, 200E, 200F), a validity determination unit 210 (210B, The functions of 160 (160A, 160B, 160C, 160D, 160E, 160F), alarm control unit 170 (170B, 170C, 170D, 170E, 170F), observation direction acquisition units 181, 181E, moving object state acquisition units 182, 182E, inattentive behavior accumulation units 183, 183E, accumulated inattentive behavior information output unit 190 (190F), and a control unit not shown are realized. Furthermore, a storage unit (not shown) is realized by the memory 10002 or another memory (not shown). Furthermore, the communication circuit 10004 realizes a communication unit (not shown).

[0137] Similarly, the server device 300 (300F) is configured with, for example, a processor 10001, a memory 10002, an input / output interface 10003, and a communication circuit 10004, as shown in FIG. The processor 10001 and the memory 10002 are, for example, installed in a computer. Memory 10002 stores programs that cause the computer to function as cumulative inattentive driving information acquisition unit 310, cumulative inattentive driving information storage unit 320, cumulative inattentive driving frequent spot determination unit 330, cumulative inattentive driving frequent spot information output unit 340, and a control unit (not shown). When processor 10001 reads and executes the programs stored in memory 10002, the functions of cumulative inattentive driving information acquisition unit 310, cumulative inattentive driving information storage unit 320, cumulative inattentive driving frequent spot determination unit 330, cumulative inattentive driving frequent spot information output unit 340, and a control unit (not shown) are realized. Furthermore, the memory 10002 or another memory (not shown) implements a storage unit (not shown) in the server device 300 (300F). Furthermore, the communication circuit 10004 realizes a communication unit (not shown) in the server device 300 (300F).

[0138] The processor 10001 is, for example, a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor, a microcontroller, or a digital signal processor (DSP). Memory 10002 may be a non-volatile or volatile semiconductor memory such as RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable Read Only Memory) or flash memory, or a magnetic disk such as a hard disk or flexible disk, or an optical disk such as a CD (Compact Disc) or DVD (Digital Versatile Disc), or a magneto-optical disk. The processor 10001 and the memory 10002 or the communication circuit 10004 are connected in a state where they can transmit data to each other. The processor 10001, the memory 10002, and the communication circuit 10004 are also connected in a state where they can transmit data to other hardware via the input / output interface 10003.

[0139] Alternatively, in the inattentiveness detection device 100 (100A, 100B, 100C, 100D, 100F) or the occupant monitoring device 200E, a cumulative inattentiveness determination unit 110 (110A, 110B, 110C, 110D, 110E, 110F), a cumulative inattentiveness point acquisition unit 120 (120A, 120B, 120C, 120D, 120E, 120F), an observation direction acquisition unit 130 (130A, 130B, 130C, 130D, 130E, 130F), a cumulative inattentiveness frequent point acquisition unit 140 (140A, 140B, 140C, 140D, 140E, 140F), and an allowable observation direction acquisition unit 150 (150A, 150B, 150C, 150D, 150E, 150F), validity determination unit 160 (160A, 160B, 160C, 160D, 160E, 160F), alarm control unit 170 (170B, 170C, 170D, 170E, 170F), observation direction acquisition unit 181, 181E, moving body state acquisition unit 182, 182E, The functions of the inattentive driving accumulation units 183, 183E, the accumulated inattentive driving information output unit 190 (190F), and a control unit (not shown) may be realized by a dedicated processing circuit 20001, as shown in FIG. Similarly, the functions of the cumulative inattentive driving information acquisition unit 310, cumulative inattentive driving information storage unit 320, cumulative inattentive driving frequent location determination unit 330, cumulative inattentive driving frequent location information output unit 340, and a control unit (not shown) in the server device 300 (300F) may be realized by a dedicated processing circuit 20001, as shown in FIG. 17 . The processing circuit 20001 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), an FPGA (Field-Programmable Gate Array), an SoC (System-on-a-Chip), or a system LSI (Large-Scale Integration). Furthermore, the memory 20002 or another memory not shown implements a storage unit not shown. Memory 20002 may be a non-volatile or volatile semiconductor memory such as RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable Read Only Memory) or flash memory, or a magnetic disk such as a hard disk or flexible disk, or an optical disk such as a CD (Compact Disc) or DVD (Digital Versatile Disc), or a magneto-optical disk. Furthermore, the communication circuit 20004 realizes a communication unit (not shown). The processing circuit 20001 and the memory 20002 or the communication circuit 20004 are connected in a state where they can transmit data to each other. In addition, the processing circuit 20001, the memory 20002, and the communication circuit 20004 are connected in a state where they can transmit data to each other and to other hardware via the input / output interface 20003. In addition, in the inattentiveness detection device 100 (100A, 100B, 100C, 100D, 100F) or the occupant monitoring device 200E, the cumulative inattentiveness determination unit 110 (110A, 110B, 110C, 110D, 110E, 110F), the cumulative inattentiveness point acquisition unit 120 (120A, 120B, 120C, 120D, 120E, 120F), the observation direction acquisition unit 130 (130A, 130B, 130C, 130D, 130E, 130F), the cumulative inattentiveness frequent point acquisition unit 140 (140A, 140B, 140C, 140D, 140E, 140F), the allowable observation direction acquisition unit The functions of 150 (150A, 150B, 150C, 150D, 150E, 150F), the validity determination unit 160 (160A, 160B, 160C, 160D, 160E, 160F), the alarm control unit 170 (170B, 170C, 170D, 170E, 170F), the observation direction acquisition unit 181, 181E, the moving object state acquisition unit 182, 182E, the inattentive behavior accumulation unit 183, 183E, the accumulated inattentive behavior information output unit 190 (190F), and a control unit (not shown) may be realized by separate processing circuits, or may be realized collectively by a processing circuit. Similarly, in the server device 300 (300F), the functions of the cumulative inattentive behavior information acquisition unit 310, the cumulative inattentive behavior information storage unit 320, the cumulative inattentive behavior frequent location determination unit 330, the cumulative inattentive behavior frequent location information output unit 340, and a control unit (not shown) may be realized by separate processing circuits, or may be realized collectively by a processing circuit.

[0140] Alternatively, in the inattentiveness detection device 100 (100A, 100B, 100C, 100D, 100F) or the occupant monitoring device 200E, a cumulative inattentiveness determination unit 110 (110A, 110B, 110C, 110D, 110E, 110F), a cumulative inattentiveness point acquisition unit 120 (120A, 120B, 120C, 120D, 120E, 120F), an observation direction acquisition unit 130 (130A, 130B, 130C, 130D, 130E, 130F), a cumulative inattentiveness frequent point acquisition unit 140 (140A, 140B, 140C, 140D, 140E, 140F), and an allowable observation direction acquisition unit Some of the functions of the units 150 (150A, 150B, 150C, 150D, 150E, 150F), the validity determination unit 160 (160A, 160B, 160C, 160D, 160E, 160F), the alarm control unit 170 (170B, 170C, 170D, 170E, 170F), the observation direction acquisition unit 181, 181E, the moving object state acquisition unit 182, 182E, the inattentive behavior accumulation unit 183, 183E, the accumulated inattentive behavior information output unit 190 (190F), and a control unit not shown may be realized by the processor 10001 and the memory 10002, and the remaining functions may be realized by the processing circuit 20001. Similarly, in the server device 300 (300F), some of the functions of the cumulative inattentive driving information acquisition unit 310, the cumulative inattentive driving information storage unit 320, the cumulative inattentive driving frequent spot determination unit 330, the cumulative inattentive driving frequent spot information output unit 340, and a control unit (not shown) may be realized by the processor 10001 and the memory 10002, and the remaining functions may be realized by the processing circuit 20001.

[0141] It should be noted that the present disclosure allows for free combination of the embodiments, modification of any of the components of the embodiments, or omission of any of the components of the embodiments. [Industrial Applicability]

[0142] The technology disclosed herein can prevent excessive detection of cumulative inattentive driving, and is therefore suitable for use in inattentive driving detection devices and occupant monitoring devices that detect intermittent inattentive driving by occupants of a moving body such as a vehicle, server devices that provide these devices with information regarding locations where cumulative inattentive driving is frequent, and technologies related to inattentive driving detection systems and occupant monitoring systems that include these devices. [Explanation of symbols]

[0143] 10 (10-1, 10-2, 10-3, . . . , 10-n (n ≧ 1)) moving body, 100 (100A, 100B, 100C, 100D, 100F) inattentiveness detection device, 110 (110A, 110B, 110C, 110D, 110E, 110F) cumulative inattentiveness determination unit, 120 (120A, 120B, 120C, 120D, 120E, 120F) cumulative inattentiveness point acquisition unit, 130 (130A, 130B, 130C, 130D, 130E, 130F) observation direction acquisition unit, 140 (140A, 140B, 140C, 140D, 140E, 140F) Accumulated inattentiveness frequent occurrence point acquisition unit, 150 (150A, 150B, 150C, 150D, 150E, 150F), allowable observation direction acquisition unit, 160 (160A, 160B, 160C, 160D, 160E, 160F), validity determination unit, 170 (170B, 170C, 170D, 170E, 170F), warning control unit, 181, 181E, observation direction acquisition unit, 182, 182E, moving body state acquisition unit, 183, 183E, inattentiveness accumulation unit, 190 (190F), accumulated inattentiveness information output unit, 200, 200E, occupant monitoring device, 210, video acquisition unit, 300, server device, 1000, vehicle (moving body), 1100, traveling direction (predicted traveling direction), 1200 Normal allowable observation direction, 1300 Allowable observation direction at points where cumulative inattentive driving is frequent, 2000 Merging lane, 3000 Merged lane, 4000 Normal allowable observation direction, 4010 Allowable observation direction at points where cumulative inattentive driving is frequent, 10001 Processor, 10002 Memory, 10003 Input / output interface, 10004 Communication circuit, 20001 Processing circuit, 20002 Memory, 20003 Input / output interface, 20004 Communication circuit.

Claims

1. an accumulated inattentive state determination unit that acquires an accumulated value related to intermittent inattentive state by an occupant of the vehicle and performs an accumulated inattentive state determination by using the accumulated value and a predetermined threshold value; an accumulated inattentive point acquisition unit that acquires accumulated inattentive points based on the position of the moving body when the accumulated inattentive state is determined to be present by the accumulated inattentive state determination unit; an observation direction acquisition unit that acquires an observation direction that is a direction in which the occupant of the moving body is likely to be observing; an accumulative inattentiveness frequent occurrence point acquisition unit that acquires accumulative inattentiveness frequent occurrence points, which are points where accumulative inattentiveness by occupants of each of a plurality of moving bodies frequently occurs; an allowable observation direction acquisition unit that acquires an allowable observation direction, which is a direction in which observation should be allowed for each of the cumulative inattentive looking points; a validity determination unit that outputs cumulative inattentive driving negation information, which is information that negates the result of the cumulative inattentive driving determination unit, when the cumulative inattentive driving points acquired by the cumulative inattentive driving point acquisition unit and the cumulative inattentive driving frequent points acquired by the cumulative inattentive driving frequent point acquisition unit overlap, and when the observation direction acquired by the observation direction acquisition unit and the allowable observation direction acquired by the allowable observation direction acquisition unit overlap; An inattentive driver detection device comprising:

2. the moving body is a vehicle, When the cumulative inattentive driving frequent point is a point included in a merging area on a motorway, the permissible observation direction is a direction based on the position of the occupant and is a direction toward a merging road where the vehicle is expected to merge. The inattentive driving detection device according to claim 1 .

3. a warning control unit that outputs a warning control signal to prevent the output of a warning based on the result of the cumulative inattentive behavior determination by the cumulative inattentive behavior determination unit, based on the cumulative inattentive behavior negation information output by the validity determination unit; Equipped with 3. The inattentive driving detection device according to claim 1 or 2.

4. The validity determination unit If the cumulative inattentiveness points acquired by the cumulative inattentiveness point acquisition unit do not overlap with the cumulative inattentiveness frequent points acquired by the cumulative inattentiveness frequent point acquisition unit, or if the observation direction acquired by the observation direction acquisition unit does not overlap with the allowable observation direction acquired by the allowable observation direction acquisition unit, output cumulative inattentiveness positive information, which is information that affirms the result of the cumulative inattentiveness determination by the cumulative inattentiveness determination unit.

4. The inattentive driving detection device according to claim 3.

5. The alarm control unit a warning control signal is output to output a warning based on the cumulative inattentive driving judgment result by the cumulative inattentive driving judgment unit, based on the cumulative inattentive driving affirmative information output by the validity judgment unit; 5. The inattentive driving detection device according to claim 4.

6. a mobile object state acquisition unit that acquires a mobile object state including a current position of the mobile object and a traveling direction of the mobile object; Equipped with The cumulative inattentiveness determination unit Using the observation direction acquired by the observation direction acquisition unit and the mobile body state acquired by the mobile body state acquisition unit, a cumulative value related to intermittent inattentive behavior by an occupant of the mobile body is calculated, and the cumulative inattentive behavior determination, which is a determination of whether or not there is a cumulative inattentive behavior, is performed using the cumulative value and a predetermined threshold value, and the result of the cumulative inattentive behavior determination is output.

3. The inattentive driving detection device according to claim 1 or 2.

7. The cumulative inattentive spot acquisition unit When the result of the cumulative inattentive driving judgment output by the cumulative inattentive driving judgment unit is received, the cumulative inattentive driving frequent points corresponding to positions overlapping with the cumulative inattentive driving points acquired by the cumulative inattentive driving point acquisition unit are acquired from a server device that is an external device.

3. The inattentive driving detection device according to claim 1 or 2.

8. The allowable observation direction acquisition unit Using the accumulated inattentiveness points acquired by the accumulated inattentiveness point acquisition unit, an allowable observation direction, which is a direction that should be allowed for observation at the accumulated inattentiveness frequent point corresponding to a position overlapping with the accumulated inattentiveness points, is acquired from a server device, which is an external device. The inattentive driving detection device according to claim 7 .

9. a cumulative inattentive driving information output unit that outputs the cumulative inattentive driving points acquired by the cumulative inattentive driving point acquisition unit and the observation direction acquired by the observation direction acquisition unit to a server device that is an external device when a result of the cumulative inattentive driving determination by the cumulative inattentive driving determination unit indicates a cumulative inattentive driving state; Furthermore, 3. The inattentive driving detection device according to claim 1 or 2.

10. The cumulative inattentive looking information output unit outputting the accumulated inattentive looking points, the observation directions, and the result of the determination of the appropriateness by the appropriateness determination unit to a server device, which is an external device; The inattentive driving detection device according to claim 9 .

11. an image acquisition unit that acquires an image of the interior of the vehicle; an observation direction acquisition unit that acquires an observation direction, which is a direction from which an occupant of the vehicle is likely to be observing, based on the image acquired by the image acquisition unit; an accumulated inattentive state determination unit that acquires an accumulated value related to intermittent inattentive state by an occupant of the vehicle and performs an accumulated inattentive state determination by using the accumulated value and a predetermined threshold value; an accumulated inattentive state acquisition unit that acquires an accumulated inattentive state, which is a position of the vehicle when the accumulated inattentive state is determined to be in an accumulated inattentive state by the accumulated inattentive state determination unit; a cumulative inattentive driving frequent occurrence point acquisition unit that acquires cumulative inattentive driving frequent occurrence points, which are points where cumulative inattentive driving frequently occurs; an allowable observation direction acquisition unit that acquires an allowable observation direction, which is a direction in which observation should be allowed for each of the cumulative inattentive looking points; a validity determination unit that outputs cumulative inattentive driving negation information, which is information that negates the result of the cumulative inattentive driving determination unit, when the cumulative inattentive driving points acquired by the cumulative inattentive driving point acquisition unit and the cumulative inattentive driving frequent points acquired by the cumulative inattentive driving frequent point acquisition unit overlap, and when the observation direction acquired by the observation direction acquisition unit and the allowable observation direction acquired by the allowable observation direction acquisition unit overlap; a warning control unit that controls a warning output device based on the cumulative inattentive driving behavior denial information output by the appropriateness determination unit so as not to output a warning based on the result of the cumulative inattentive driving behavior determination unit; An occupant monitoring device comprising:

12. an accumulated inattentive driving information acquisition unit that acquires, from each of a plurality of moving bodies, an observation direction that is a direction in which an occupant of the moving body is likely to be observing, and an accumulated inattentive driving point based on the position of the moving body when it is determined that the occupant is in an accumulated inattentive driving state; an accumulated inattentive driving information storage unit that uses the accumulated inattentive driving points and the observation directions acquired by the accumulated inattentive driving information acquisition unit to associate the observation directions with each of the accumulated inattentive driving points and store them; a cumulative inattentiveness frequent occurrence point extraction unit that extracts cumulative inattentiveness frequent occurrence points, which are points where cumulative inattentiveness by occupants of each of a plurality of moving bodies frequently occurs, using the observation direction for each of the cumulative inattentiveness points stored in the cumulative inattentiveness information storage unit; an accumulated inattentive spot information output unit that outputs information related to the accumulated inattentive spot occurrences extracted by the accumulated inattentive spot occurrences extraction unit to the mobile body; A server device comprising:

13. the cumulative inattentive driving information acquisition unit acquires, from each of the plurality of moving bodies, the cumulative inattentive driving point and the observation direction, as well as cumulative inattentive driving affirmative information, which is information that affirms a result of a cumulative inattentive driving determination that the occupant is in the cumulative inattentive driving state; the cumulative inattentive driving information storage unit uses the cumulative inattentive driving points, the observation direction, and the cumulative inattentive driving positive information acquired by the cumulative inattentive driving information acquisition unit to associate the observation direction with each cumulative inattentive driving point and store the information.

13. The server device according to claim 12.

14. The cumulative inattentive looking information storage unit Furthermore, by using the unacceptable observation directions for each position stored in advance, the observation directions excluding the unacceptable observation directions from among the observation directions for each of the cumulative inattentive points are stored in association with the cumulative inattentive points.

13. The server device according to claim 12.

15. The cumulative inattentive spot information output unit When the cumulative inattentive driving points are acquired from the moving body, the allowable observation direction of the cumulative inattentive driving frequent points, which indicates the same position as the cumulative inattentive driving points, is output to the moving body.

15. The server device according to claim 12, further comprising:

16. An inattentive driving detection method using an inattentive driving detection device, an observation direction acquisition unit of the inattentive driving detection device acquires an observation direction that is a direction in which an occupant of the moving body is likely to be observing; an accumulated inattentiveness determination unit of the inattentiveness detection device acquires an accumulated value relating to intermittent inattentiveness by an occupant of the vehicle, and performs an accumulated inattentiveness determination, which is a determination of whether or not the occupant is in an accumulated inattentive state, using the accumulated value and a predetermined threshold value; an accumulated inattentive point acquisition unit of the inattentive detection device acquires an accumulated inattentive point based on the position of the moving body when the accumulated inattentive state is determined to be present by the accumulated inattentive state determination unit; an accumulated inattentiveness frequent occurrence point acquisition unit of the inattentiveness detection device acquires accumulated inattentiveness frequent occurrence points, which are points where cumulative inattentiveness by occupants of each of the plurality of moving bodies frequently occurs, an allowable observation direction acquisition unit of the inattentive driving detection device acquires an allowable observation direction, which is a direction in which observation should be allowed for each of the cumulative inattentive driving frequent points; When the cumulative inattentive driving points acquired by the cumulative inattentive driving point acquisition unit and the cumulative inattentive driving frequent points acquired by the cumulative inattentive driving frequent point acquisition unit overlap, and when the observation direction acquired by the observation direction acquisition unit and the allowable observation direction acquired by the allowable observation direction acquisition unit overlap, the validity determination unit of the inattentive driving detection device outputs accumulated inattentive driving negation information, which is information that negates the result of the cumulative inattentive driving determination by the cumulative inattentive driving determination unit. A method for detecting inattentive driving.

Images