Motion evaluation device, motion evaluation method, and program
The motion evaluation device enhances driving evaluations by incorporating road environment data and exemplary behavior models to assess driver actions, providing a more comprehensive evaluation of driving performance.
Patent Information
- Application Number
- JP2025544056
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-09-07
- Publication Date
- 2026-02-16
- Estimated Expiration
- 2043-09-07
AI Technical Summary
Existing motion evaluation technologies for vehicle drivers do not account for road environments, limiting the ability to perform comprehensive and favorable driving evaluations.
A motion evaluation device that acquires driver motions and road environment data, using a database to associate position information with exemplary behavior models, allowing for evaluation of actions beyond direct driving operations.
Enables more accurate and comprehensive driving evaluations by considering the road environment and occupant actions before actual driving operations, improving the assessment of driver behavior.
Smart Images

Figure 0007814632000001 
Figure 0007814632000002 
Figure 0007814632000003
Abstract
Description
[Technical Field]
[0001] The disclosed technology relates to a motion evaluation technology for evaluating the motion of a driver of a vehicle. [Background technology]
[0002] In recent years, technological developments have been made to encourage drivers of mobile vehicles to drive in an exemplary manner. Patent Document 1 discloses a technique for evaluating the driving operation of a vehicle driver. The technology described in Patent Document 1 uses information about devices acquired by sensors to create a database of time-series data on the operation of devices related to driving operations of a vehicle for each location, assuming that exemplary driving operations have been performed, and uses this database to evaluate driving operations based on the difference between operation data related to actual driving operations and operation data related to exemplary driving operations (paragraphs
[0016] ,
[0020] ,
[0021] ,
[0024] , etc. of Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-294250 Summary of the Invention [Problem to be solved by the invention]
[0004] However, depending on the environment of the road on which the vehicle is traveling (road environment), it may be preferable for the vehicle to operate before the occupant actually performs driving operations, for example, when the occupant is observing the surrounding situation in order to gather information necessary for driving operations. The technology described in Patent Document 1 has a problem in that it is not possible to perform evaluation based on actions other than driving operations estimated from the state of devices related to driving operations, and therefore it is not possible to perform a more favorable driving evaluation.
[0005] The present disclosure is intended to solve the above-mentioned problems, and aims to enable a more favorable driving evaluation than conventional methods. [Means for solving the problem]
[0006] The action evaluation device of the present disclosure includes: a motion acquisition unit that acquires a motion of a driver of the vehicle; a position acquisition unit that acquires the position of the moving object; a road environment acquisition unit that refers to a database that stores in advance position information and road environment information in association with each other, and acquires the road environment information corresponding to the position acquired by the position acquisition unit; refer to a database in which the road environment information and an exemplary behavior model showing exemplary behavior according to the road environment are associated and stored in advance, and acquire an exemplary behavior model according to the road environment information acquired by the road environment acquisition unit at the position of the moving object; a model acquisition unit; an evaluation value calculation unit that calculates an evaluation value of the action based on the action acquired by the action acquisition unit and the exemplary behavior model acquired by the model acquisition unit; Equipped with It is something. Alternatively, the action evaluation device of the present disclosure is a motion acquisition unit that acquires a motion of a driver of the vehicle; a position acquisition unit that acquires the position of the moving object; a model acquisition unit that acquires an exemplary behavior model corresponding to the road environment at the position of the mobile object using a database that associates and pre-stores location information with an exemplary behavior model that shows exemplary behavior corresponding to the road environment; an evaluation value calculation unit that calculates an evaluation value of the action based on the action acquired by the action acquisition unit and the exemplary behavior model acquired by the model acquisition unit; A motion evaluation device comprising: an accumulated inattentive state determination unit that acquires an accumulated value related to intermittent inattentive state by the occupant and performs an accumulated inattentive state determination by using the accumulated value and a predetermined threshold value; an accumulated inattentive point acquisition unit that acquires accumulated inattentive points based on the position of the moving body when the accumulated inattentive state is determined to be present by the accumulated inattentive state determination unit; an observation direction acquisition unit that acquires an observation direction that is a direction in which the occupant of the moving body is likely to be observing; an accumulative inattentiveness frequent occurrence point acquisition unit that acquires accumulative inattentiveness frequent occurrence points, which are points where accumulative inattentiveness by occupants of each of a plurality of moving bodies frequently occurs; an allowable observation direction acquisition unit that acquires an allowable observation direction, which is a direction in which observation should be allowed for each of the cumulative inattentive looking points; Furthermore, The model acquisition unit When the cumulative inattentive driving point and the cumulative inattentive driving frequent point overlap, and, When the observation direction acquired by the observation direction acquisition unit overlaps with the allowable observation direction, Observing the permissible observation direction at the position of the cumulative inattentive viewing point is acquired as the exemplary behavior model. It is something. [Effects of the Invention]
[0007] According to the present disclosure, an effect is achieved in that a more preferable driving evaluation can be performed compared to the conventional art. [Brief explanation of the drawings]
[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of an action evaluating device according to a first embodiment of the present disclosure. [Figure 2] FIG. 2 is a diagram illustrating a configuration example of an action evaluating system including an action evaluating device according to the first embodiment of the present disclosure. [Figure 3] FIG. 3 is a flowchart illustrating an example of processing performed by the action evaluating device according to the first embodiment of the present disclosure. [Figure 4] FIG. 4 is a diagram illustrating a configuration example of an action evaluating system including an action evaluating device according to the second embodiment of the present disclosure. [Figure 5] FIG. 5 is a flowchart illustrating an example of processing performed by the action evaluating device according to the second embodiment of the present disclosure. [Figure 6] FIG. 6 is a diagram illustrating a configuration example of an action evaluating system including an action evaluating device according to the third embodiment of the present disclosure. [Figure 7] FIG. 7 is a flowchart illustrating an example of processing performed by the action evaluating device according to the third embodiment of the present disclosure. [Figure 8] FIG. 8 is a diagram illustrating a configuration example of an action evaluating system including an action evaluating device according to the fourth embodiment of the present disclosure. [Figure 9] FIG. 9 is a first diagram for explaining an example of accumulated inattentive behavior handled by the action evaluation device according to the fourth embodiment. [Figure 10] FIG. 10 is a second diagram for explaining an example of accumulated inattentive behavior handled by the action evaluation device according to the fourth embodiment. [Figure 11] FIG. 11 is a flowchart illustrating an example of processing performed by the action evaluating device according to the fourth embodiment of the present disclosure. [Figure 12] FIG. 12 is a flowchart illustrating an example of processing performed by the model acquiring unit in the action evaluating device according to the fourth embodiment of the present disclosure. [Figure 13] FIG. 13 is a diagram illustrating a relationship between an action evaluating device according to the fifth embodiment of the present disclosure and a server device that generates a database used in the action evaluating device. [Figure 14] FIG. 14 is a diagram illustrating a first configuration example of an action evaluating system E including an action evaluating device according to the fifth embodiment of the present disclosure. [Figure 15] FIG. 15 is a diagram illustrating a second configuration example of an action evaluating system including an action evaluating device according to the fifth embodiment of the present disclosure. [Figure 16] FIG. 16 is a diagram illustrating a third exemplary configuration of an action evaluating system including an action evaluating device according to the fifth embodiment of the present disclosure. [Figure 17] FIG. 17 is a flowchart illustrating an example of processing by the action information providing unit in the action evaluating device according to the fifth embodiment of the present disclosure. [Figure 18] FIG. 18 is a flowchart illustrating an example of processing performed by the server device when action information is provided from the action evaluating device according to the fifth embodiment of the present disclosure. [Figure 19] FIG. 19 is a diagram illustrating a first example of a hardware configuration for realizing the functions according to the configuration of the present disclosure. [Figure 20] FIG. 20 is a diagram illustrating a second example of a hardware configuration for realizing the functions according to the configuration of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION
[0009] In order to explain the present disclosure in more detail, embodiments of the present disclosure will be described below with reference to the accompanying drawings.
[0010] Embodiment 1 In the first embodiment, a basic form of the present disclosure will be described.
[0011] An example of the configuration of the action evaluation device will be described. FIG. 1 is a diagram illustrating an example of a configuration of an action evaluating apparatus 100 according to the first embodiment of the present disclosure. The action evaluation device 100 evaluates the action of a passenger on board a moving body. The moving body is a vehicle or the like. The movement evaluation device 100 evaluates whether the movement of the occupant deviates from a model movement stored in advance. The action evaluation device 100 shown in FIG. 1 includes an action acquisition unit 111, a position acquisition unit 112, a model acquisition unit 113, and an evaluation value calculation unit 114.
[0012] The motion acquisition unit 111 acquires the motion of a driver driving a vehicle. The action acquisition unit 111 acquires the action itself performed by the occupant. The movement acquired by the movement acquisition unit 111 is, for example, the movement of the occupant determined using a video image of the interior of the vehicle. This makes it possible to obtain both the behavior before and the behavior after the driving operation, compared to conventional driving operations that are inferred from the state of the equipment. In this case, the actions that can be acquired by the action acquisition unit 111 are represented in the form of, for example, the direction in which the occupant's face is facing, the direction in which the occupant is looking, the position of the occupant's hands, a change value indicating how much each of these has changed over time, and a time indicating how long each of these remains constant.
[0013] The position acquisition unit 112 acquires the position of the moving object. The position acquisition unit 112 acquires positions in chronological order from at least one of a GPS (Global Positioning System) device mounted on a mobile object and a car navigation device, for example. The position acquisition unit 112 can output action information, which is a set of information indicating the acquired position and information indicating the action acquired by the action acquisition unit 111.
[0014] The model acquisition unit 113 acquires an exemplary behavior model that indicates an exemplary behavior according to the road environment at the position acquired by the position acquisition unit 112. For example, the model acquisition unit 113 acquires an exemplary behavior model that corresponds to the road environment at the location of the mobile body using a database that pre-stores location information and an exemplary behavior model that shows exemplary behavior according to the road environment in association with the location information. The "road environment" refers to the environment around the road in which an occupant must take an action before actually operating the vehicle. When the moving body is a vehicle, the road environment includes at least one of a freeway, a merging area of a freeway, an area near an intersection, an area near a crosswalk, the presence or absence of a traffic light, the shape of the road, the width of the road, the degree of vehicle congestion, or the degree of pedestrian congestion. An example of a motorway is an expressway. A merging area of an expressway is, for example, an area including an acceleration lane located at a merging point between a main lane of an expressway and a merging lane that merges onto the main lane. The vicinity of an intersection indicates, for example, an environment in which an intersection exists in the direction of travel of the vehicle based on the actual position of the vehicle. The vicinity of a pedestrian crossing indicates, for example, an environment in which a pedestrian crossing exists in the direction of travel of the vehicle based on the actual position of the vehicle. The presence or absence of a traffic light indicates, for example, the environment, such as whether or not there is a traffic light in the direction of travel of the vehicle based on the actual position of the vehicle. The shape of the road includes, for example, an environment in which the road in the direction of travel of the vehicle is curved with respect to the actual position of the vehicle. The width of the road indicates the environment, for example, the width of the road in the direction of travel of the vehicle based on the actual position of the vehicle. The degree of vehicle congestion indicates the number of vehicles traveling on the road in the direction of travel of the vehicle, based on the actual position of the vehicle. When there are many vehicles traveling on the road (for example, in the case of a traffic jam), it is possible to evaluate the behavior of the occupant, such as the driver, based on the idea that it is better to prepare to press the brake pedal than when there are few vehicles traveling on the road. The degree of pedestrian congestion indicates the number of people walking around the roadway in the direction of travel of the vehicle, based on the actual position of the vehicle. When there are many people walking around the roadway and the roadway is narrow, it is possible to evaluate the behavior of the occupant, for example, the driver, based on the idea that it would be better for the occupant to observe the sidewalk. The "model behavior model" is information indicating model behavior according to the road environment. The model behavior model includes at least one of a viewing direction, cumulative inattentive glances, or a position of a body part. The "viewing direction" is the direction from which the occupant is likely to be looking. The "observation direction" includes at least one of the direction in which the occupant's face is facing (face orientation) and the occupant's line of sight. By including this behavior in the model behavior model, it becomes possible to evaluate whether the occupant is observing the direction of the sidewalk when the mobile object is located in a road environment such as near a crosswalk. Also, it becomes possible to evaluate whether the occupant is observing the direction of the road sign when the mobile object is located in a road environment where a road sign is located diagonally above and in front of the mobile object. "Cumulative inattentiveness" refers to an inattentive behavior based on a cumulative value of intermittent inattentiveness by a vehicle occupant, and is a behavior that occurs when, for example, the cumulative value reaches or exceeds a threshold value over a predetermined unit of time. By including this behavior in the model behavior model, it becomes possible to evaluate, for example, when the vehicle is in a merging area of a highway, whether the occupant is sufficiently observing alternately the area in front of the vehicle and the area behind the road where the vehicle is merging before merging. The "position of body parts" includes, for example, the angle of the hand position relative to the steering wheel. By including this movement in the model behavior model, it becomes possible to evaluate, for example, whether the occupant is ready to operate the turn signal before entering an intersection when the vehicle is turning right or left at an intersection. The exemplary behavior model may include driving operations performed on the moving object, such as accelerating or decelerating the vehicle's speed, turning on or off a turn signal, and the like.
[0015] The evaluation value calculation unit 114 calculates an evaluation value of the action performed by the occupant. The evaluation value calculation unit 114 calculates an evaluation value of the action based on the action acquired by the action acquisition unit 111 and the exemplary behavior model acquired by the model acquisition unit 113. The evaluation value can be calculated using known techniques. The evaluation value calculation unit 114, for example, compares the behavior acquired by the behavior acquisition unit 111 with the exemplary behavior model acquired by the model acquisition unit 113 to calculate a difference value, and derives an evaluation value indicating the degree of deviation of the actual behavior from the exemplary behavior model using the difference value. In this case, the evaluation value can also be expressed as the degree of deviation, or as a driving degree.
[0016] In addition to the above components, the action evaluation device 100 is configured to include a control unit (not shown), a storage unit (not shown), and a communication unit (not shown). A control unit (not shown) controls the entire action evaluation device 100 and each of its components. The control unit (not shown) starts up the action evaluation device 100 in accordance with, for example, an external command. The control unit (not shown) also controls the state of the action evaluation device 100 (operation state = state such as startup, shutdown, or sleep). A storage unit (not shown) stores each piece of data used in the action evaluation device 100. The storage unit (not shown), for example, stores the output (output data) from each component in the action evaluation device 100, and outputs data requested by each component to the requesting component. The communication unit (not shown) communicates with external devices. For example, communication is performed between the action evaluation device 100 (100A) and peripheral devices (an occupant monitoring device 300A and a server device 600E, which will be described later). For example, when the action evaluation device 100 and the occupant monitoring device are not connected by wire, the communication unit (not shown) has a function of communicating between the action evaluation device 100 and the occupant monitoring device 300A. The communication unit (not shown) also has a function of communicating with the server device 600E, which is an external device. The control unit (not shown), the storage unit (not shown), and the communication unit (not shown) are the same in the embodiments described below.
[0017] Next, a configuration example of an action evaluation system including an action evaluation device will be described. FIG. 2 is a diagram showing an example of the configuration of an action evaluation system 1A including an action evaluation apparatus 100A according to the first embodiment of the present disclosure. The action evaluation system 1A shown in FIG. 2 includes an action evaluation device 100A, a model behavior database 200A (database), an occupant monitoring device 300A, and an output device 400A. The passenger monitoring device 300A, the model behavior database 200A (database), the action evaluation device 100A, and the output device 400A will be described in detail in this order.
[0018] The occupant monitoring device 300A is a device that monitors the state of an occupant, and is a device used in, for example, a DMS (Driver Monitoring System). The occupant monitoring device 300A includes an image acquisition unit 301A and a motion determination unit 302A.
[0019] The video acquisition unit 301A acquires a video of the interior of a moving object. The video acquisition unit 301A acquires video from, for example, an imaging device that captures the interior of a moving object.
[0020] The movement determining unit 302A determines the movement of the occupant captured in the video acquired by the video acquiring unit 301A. The movement determining unit 302A acquires the video from the video acquiring unit 301A, and determines the movement of the occupant using the acquired video. The technique for determining the movement of the occupant can be realized using known techniques.
[0021] The occupant monitoring device 300A outputs information indicating the occupant's movement determined by the movement determining unit 302A to the movement evaluating device 100A.
[0022] The model behavior database 200A (database) is a database that stores in advance location information and model behavior models in association with each other. The exemplary behavior database 200A (database) may be a database that stores location information and exemplary behavior models in association with each other, or may be a database that stores location information, road environment information indicating the road environment, and exemplary behavior models in association with each other. The location information is information in the form of, for example, coordinate values of map data. The location information is not limited to a single point, but may be information indicating an area. The road environment information is information that indicates the road environment so that each of the above-mentioned types of road environment can be distinguished.
[0023] The action evaluation device 100A shown in FIG. 2 is communicably connected to an occupant monitoring device 300A, a model behavior database 200A (database), and an output device 400A. The action evaluation device 100A includes an action acquisition unit 111A, a position acquisition unit 112A, a model acquisition unit 113A, and an evaluation value calculation unit 114A.
[0024] The action acquisition unit 111A has the same functions as the action acquisition unit 111 already described, and a detailed description thereof will be omitted. The action acquisition unit 111A acquires the occupant's actions output by the occupant monitoring device 300A and uses them for processing.
[0025] The position acquisition unit 112A has the same functions as the position acquisition unit 112 already described, and a detailed description thereof will be omitted.
[0026] Model acquisition unit 113A has the same functions as model acquisition unit 113 already described, and detailed description thereof will be omitted. The model acquisition unit 113A refers to the model behavior database 200A to acquire a model behavior model that corresponds to the road environment at the location of the moving object.
[0027] Evaluation value calculation section 114A has the same functions as evaluation value calculation section 114 already described, and detailed description thereof will be omitted. The evaluation value calculation unit 114A outputs the calculated evaluation value to the output device 400A.
[0028] The output device 400A has at least one of a display function, a sound output function, and a vibration output function. The output device 400A shown in FIG. 2 outputs based on the information received from the action evaluation device 100A. For example, the output device 400A receives a command to display an image including an evaluation value from the action evaluation device 100A, and displays the image including the evaluation value.
[0029] An example of processing by the action evaluation device will be described. Since the processing of the action evaluating apparatus 100 and the processing of the action evaluating apparatus 100A are similar, an example of the processing of the action evaluating apparatus 100A will be described here as a representative example. FIG. 3 is a flowchart showing an example of processing performed by the action evaluating apparatus 100A according to the first embodiment of the present disclosure. Upon receiving a command from a control unit (not shown) or an external command, the action evaluation device 100A starts the processing shown in Fig. 3. The action evaluation device 100A starts the processing, for example, when operation of a moving object is started.
[0030] First, the action evaluation apparatus 100A executes an action acquisition process (step ST1110). In the action acquisition process, the action acquisition unit 111A of the action evaluation device 100A acquires the action of the occupant driving the moving body. The action acquisition unit 111A acquires information relating to the action output from the occupant monitoring device 300A and outputs the information to the position acquisition unit 112A.
[0031] Next, the action evaluation device 100A executes a position acquisition process (step ST1120). In the position acquisition process, the position acquisition unit 112A of the action evaluation device 100A acquires the position of the moving object. Upon acquiring the information relating to the motion output by the motion acquisition unit 111A, the position acquisition unit 112A acquires position information indicating the position of the moving object. The position acquisition unit 112A outputs motion information, which is a set of the position information and the information relating to the motion, to the model acquisition unit 113A.
[0032] Next, the action evaluation apparatus 100A executes a model acquisition process (step ST1130). In the model acquisition process, the model acquisition unit 113A of the action evaluation device 100A acquires an exemplary behavior model that indicates an exemplary behavior according to the road environment at the position acquired by the position acquisition unit 112A. When the model acquisition unit 113A acquires the behavior information output by the position acquisition unit 112A, it uses the position information included in the behavior information to refer to the model behavior database 200A and acquires an model behavior model that corresponds to the road environment at the position of the moving object. The model acquisition unit 113A outputs the motion information and the exemplary behavior model to the evaluation value calculation unit 114A.
[0033] The action evaluation device 100A then executes an evaluation value calculation process (step ST1140). In the evaluation value calculation process, the evaluation value calculation unit 114A of the action evaluation device 100A calculates an evaluation value of the action based on the action acquired by the action acquisition unit 111 and the exemplary behavior model acquired by the model acquisition unit 113A. Specifically, for example, when the evaluation value calculation unit 114A acquires the motion information and the exemplary behavior model output by the model acquisition unit 113A, the evaluation value calculation unit 114A compares the information related to the motion included in the motion information with the exemplary behavior model to calculate a difference value. Using the difference value, the evaluation value calculation unit 114A calculates an evaluation value (deviation degree) indicating the degree of deviation of the actual motion from the exemplary behavior model. The evaluation value calculation unit 114A outputs the evaluation value as the calculation result to the output device 400A. As a result, the output device 400A displays the evaluation value.
[0034] The action evaluation apparatus 100A then executes an end determination process (step ST1150). In the termination determination process, a control unit (not shown) of the action evaluation apparatus 100A determines whether to terminate the processing of the action evaluation apparatus 100A. The control unit (not shown) determines whether to terminate the processing of the action evaluation apparatus 100A in accordance with, for example, an external termination command or an execution program. If the control unit (not shown) determines not to end the processing of the action evaluation device 100A, the process proceeds to step ST1110, and the processing is repeated from step ST1110. When the control unit (not shown) determines that the processing of the action evaluation apparatus 100A should be ended, the action evaluation apparatus 100A ends the processing.
[0035] According to the above disclosure, a more preferable driving evaluation can be performed than in the past. For example, before the occupant actually performs a driving operation on the vehicle, it becomes possible to evaluate the actions that the occupant should perform. Furthermore, for example, the evaluation of the occupant's actions can be changed depending on the road environment at the location of the vehicle.
[0036] The action evaluation device of the present disclosure is configured, for example, as follows. a motion acquisition unit that acquires a motion of a driver of the vehicle; a position acquisition unit that acquires the position of the moving object; a model acquisition unit that acquires an exemplary behavior model corresponding to the road environment at the position of the mobile object using a database that associates and pre-stores location information with an exemplary behavior model that shows exemplary behavior corresponding to the road environment; an evaluation value calculation unit that calculates an evaluation value of the action based on the action acquired by the action acquisition unit and the exemplary behavior model acquired by the model acquisition unit; A motion evaluation device comprising: As a result, the present disclosure has an effect of providing an action evaluation device that performs a more favorable driving evaluation than conventional devices.
[0037] The action evaluation method of the present disclosure is configured, for example, as follows. a motion acquisition step in which a motion acquisition unit of the motion evaluation device acquires a motion of a occupant driving the moving object; a position acquisition step in which a position acquisition unit of the action evaluation device acquires a position of the moving object; a model acquisition step in which a model acquisition unit of the action evaluation device acquires an exemplary behavior model corresponding to the road environment at the position of the moving object using a database in which position information and an exemplary behavior model showing exemplary behavior corresponding to the road environment are associated and stored in advance; an evaluation value calculation step in which an evaluation value calculation unit of the action evaluation device calculates an evaluation value of the action based on the action acquired by the action acquisition unit and the exemplary behavior model; A motion evaluation method comprising: As a result, the present disclosure has the effect of providing an action evaluation method that can perform a more preferable driving evaluation than conventional methods.
[0038] The action evaluation device of the present disclosure is further configured, for example, as follows. The movement acquired by the movement acquisition unit is a movement of the occupant determined using an image of an interior of the vehicle. A behavior evaluation device characterized by: As a result, the present disclosure has the effect of making it possible to evaluate various occupant actions that are not directly reflected in driving operations, as compared to conventional methods. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to a motion evaluation system or the above motion evaluation method.
[0039] The action evaluation device of the present disclosure is further configured, for example, as follows. The road environment includes at least one of a motorway, a merging area of a motorway, a vicinity of an intersection, a vicinity of a pedestrian crossing, the presence or absence of a traffic light, the shape of a road, the width of a road, the degree of vehicle congestion, or the degree of pedestrian congestion. A behavior evaluation device characterized by: This provides an advantage that the present disclosure makes it possible to evaluate the occupant's behavior at a point where desirable behavior is likely to occur before the actual driving operation. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to a motion evaluation system or the above motion evaluation method.
[0040] The action evaluation device of the present disclosure is further configured, for example, as follows. The exemplary behavior model includes at least one of a viewing direction, a cumulative inattentiveness, or a position of a body part. A behavior evaluation device characterized by: This provides an advantage, for example, in that it is possible to evaluate whether the occupant's observation direction is facing in a direction that allows them to collect information necessary for driving, or to evaluate whether the occupant's body parts are in a position that allows them to prepare for driving. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to a motion evaluation system or the above motion evaluation method.
[0041] The action evaluation device of the present disclosure is further configured, for example, as follows. The observation direction includes at least one of a face direction of the occupant or a line of sight direction of the occupant. A behavior evaluation device characterized by: As a result, the present disclosure provides an effect of further improving the accuracy of evaluating the observation direction. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to a motion evaluation system or the above motion evaluation method.
[0042] Embodiment 2 In the second embodiment, a configuration will be described in which a component for performing action judgment is provided inside the action evaluation device. In addition, the second embodiment will explain a mode in which the action evaluation device includes a component that determines whether to issue a warning to the occupant. In the second embodiment, among the components according to the second embodiment, those components that are the same as the components according to the first embodiment that have already been described will not be described again.
[0043] A configuration example of an action evaluation device and an action evaluation system including the device according to a second embodiment of the present disclosure will be described. FIG. 4 is a diagram showing an example of the configuration of an action evaluation system 1B including an action evaluation apparatus 100B according to the second embodiment of the present disclosure. The movement evaluation system 1B includes a movement evaluation device 100B, a model behavior database 200B (database), an output device 400B, and an imaging device 500B. The model behavior database 200B (database) is the same as the model behavior database 200A already described, and the output device 400B is the same as the output device 400A already described, so that redundant description of each will be omitted. The imaging device 500B and the action evaluation device 100B will be described in detail in that order.
[0044] Imaging device 500B captures an image of the interior of a moving object and outputs the captured image. When the moving body is a vehicle, imaging device 500B is an in-vehicle camera for capturing images of the interior of the vehicle.
[0045] The action evaluation device 100B includes the same components as the action evaluation devices 100 and 100A already described. In addition, the action evaluation device 100B has a component for determining the action, and a component for determining whether to issue a warning to the occupant. The action evaluation device 100B shown in FIG. 4 includes an image acquisition unit 121B, an action determination unit 122B, an action acquisition unit 111B, a position acquisition unit 112B, a model acquisition unit 113B, an evaluation value calculation unit 114B, and a warning unit 123B. Position acquisition unit 112B is similar to position acquisition units 112 and 112A already described, and model acquisition unit 113B is similar to model acquisition units 113 and 113A already described, so that redundant description will be omitted.
[0046] The video acquisition unit 121B acquires a video of the interior of a moving object. Specifically, the image acquisition unit 121B acquires an image from an imaging device 500B that captures an image of the interior of a moving object.
[0047] The movement determining unit 122B determines the movement of the occupant captured in the video acquired by the video acquiring unit 121B. Specifically, the movement determining unit 122B acquires an image from the image acquiring unit 121B, and determines the movement of the occupant using the acquired image. The technique for determining the movement of the occupant can be realized using known techniques.
[0048] The action acquisition unit 111B has the same functions as the action acquisition unit 111 already described. The movement acquisition unit 111B acquires information relating to the movement of the occupant output by the movement determination unit 122B and uses the information for processing.
[0049] The evaluation value calculation unit 114B has a function of calculating an evaluation value similar to the evaluation value calculation unit 114 already described. Evaluation value calculation unit 114B outputs the calculated evaluation value to warning unit 123B.
[0050] The warning unit 123B issues a warning to the occupant using the evaluation value. Specifically, the warning unit 123B compares the evaluation value with a pre-stored evaluation threshold and determines whether the evaluation value is equal to or greater than the evaluation threshold. For example, if the evaluation value is a deviation and the evaluation threshold is the deviation threshold, the warning unit 123B determines whether the deviation is equal to or greater than the deviation threshold. The warning unit 123B instructs the output device 400B to issue a warning when the determination result indicates that the occupant's behavior deviates from the model behavior indicated in the model behavior model according to the road environment. The warning is given by, for example, at least one of an image display, a sound output, and a vibration output.
[0051] A processing example of the action evaluation device according to the second embodiment of the present disclosure will be described. FIG. 5 is a flowchart showing an example of processing performed by the action evaluating apparatus 100B according to the second embodiment of the present disclosure. Upon receiving a command from a control unit (not shown) or an external command, the action evaluation device 100B starts the processing shown in Fig. 5. The action evaluation device 100B starts the processing, for example, when the operation of the moving object is started.
[0052] First, action evaluation device 100B executes video acquisition processing (step ST2110). In the video acquisition process, video acquisition section 121B of motion evaluation device 100B acquires video from imaging device 500, which captures images of the interior of a moving object. Video acquisition section 121B outputs the acquired video to motion determination section 122B.
[0053] Next, the action evaluation device 100B executes the action determination process (step ST2120). In the movement determination process, the movement determination unit 122B of the movement evaluation device 100B determines the movement of the occupant captured in the video acquired by the video acquisition unit 121B. The movement determination unit 122B outputs information related to the movement of the occupant, which is the determination result, to the movement acquisition unit 111B.
[0054] Next, the action evaluation apparatus 100B executes an action acquisition process (step ST2130). In the action acquisition process, the action acquisition unit 111B of the action evaluation device 100B acquires the action of the occupant driving the moving body. The motion acquisition unit 111B acquires information relating to the motion output from the motion determination unit 122B and outputs the information to the position acquisition unit 112B.
[0055] Next, the action evaluation device 100B executes a position acquisition process (step ST2140). In the position acquisition process, the position acquisition unit 112B of the action evaluation device 100B acquires the position of the moving object. Upon acquiring the information relating to the motion output by the motion acquisition unit 111B, the position acquisition unit 112B acquires position information indicating the position of the moving object. The position acquisition unit 112B outputs motion information, which is a set of the position information and the information relating to the motion, to the model acquisition unit 113B.
[0056] Next, the action evaluation apparatus 100B executes a model acquisition process (step ST2150). In the model acquisition process, the model acquisition unit 113B of the action evaluation device 100B acquires an exemplary behavior model that indicates an exemplary behavior according to the road environment at the position acquired by the position acquisition unit 112A. When the model acquisition unit 113B acquires the behavior information output by the position acquisition unit 112B, it uses the position information included in the behavior information to refer to the model behavior database 200B and acquires an model behavior model that corresponds to the road environment at the position of the moving object. The model acquisition unit 113B outputs the motion information and the exemplary behavior model to the evaluation value calculation unit 114B.
[0057] The action evaluating device 100B then executes an evaluation value calculation process (step ST2160). In the evaluation value calculation process, the evaluation value calculation unit 114B of the action evaluation device 100B calculates an evaluation value of the action based on the action acquired by the action acquisition unit 111 and the exemplary behavior model acquired by the model acquisition unit 113B. Specifically, for example, when the evaluation value calculation unit 114B acquires the motion information and the exemplary behavior model output by the model acquisition unit 113B, the evaluation value calculation unit 114B compares the information related to the motion included in the motion information with the exemplary behavior model to calculate a difference value. Using the difference value, the evaluation value calculation unit 114B calculates an evaluation value (deviation degree) indicating the degree of deviation of the actual motion from the exemplary behavior model. Evaluation value calculation unit 114B outputs the evaluation value as the calculation result to warning unit 123B.
[0058] The action evaluation device 100B then executes an evaluation value determination process ("evaluation value≧evaluation threshold", step ST2170). In the evaluation value determination process, the warning unit 123B of the action evaluation device 100B compares the evaluation value with an evaluation threshold value. The warning unit 123B determines whether the evaluation value is equal to or greater than the evaluation threshold value. Specifically, when the evaluation value is a deviation degree and the evaluation threshold is a deviation threshold, the warning unit 123B determines whether the deviation degree is equal to or greater than the deviation threshold.
[0059] When it is determined that the evaluation value is equal to or greater than the evaluation threshold value ("YES" in step ST2170), the warning unit 123B executes a warning process (step ST2180). In the warning process, the warning unit 123B instructs the output device 400 to issue a warning indicating that the evaluation is low. When issuing a warning command, the warning unit 123B may issue a command to present information such as the evaluation value itself and the degree of lowness of the evaluation. After executing the warning process, the action evaluation device 100B then proceeds to the termination determination process (step ST2190).
[0060] If the warning unit 123B determines that the evaluation value is not equal to or greater than the evaluation threshold, that is, that the evaluation value is less than the evaluation threshold (step ST2170 “NO”), the action evaluation device 100B then proceeds to the termination determination process (step ST2190).
[0061] The action evaluation apparatus 100B executes an end determination process (step ST2190). In the termination determination process, a control unit (not shown) of the action evaluation device 100B determines whether to terminate the processing of the action evaluation device 100B. The control unit (not shown) determines whether to terminate the processing of the action evaluation device 100B in accordance with, for example, an external termination command or an execution program. If the control unit (not shown) determines not to end the processing of the action evaluation device 100B, the process proceeds to step ST2110, and the processing is repeated from step ST2110. When the control unit (not shown) determines that the processing of the action evaluation device 100B should be ended, the action evaluation device 100B ends the processing.
[0062] The action evaluation device of the present disclosure is further configured, for example, as follows. an image acquisition unit that acquires an image from an imaging device that captures an image of the interior of the moving body; a motion determination unit that determines a motion of the occupant captured in the video; Equipped with A behavior evaluation device characterized by: As a result, the present disclosure has a configuration for determining the occupant's movements within the movement evaluation device, and therefore has the effect of being able to evaluate the occupant's movements even if the device for determining the occupant's movements is not installed on the moving body. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to a motion evaluation system or the above motion evaluation method.
[0063] The action evaluation device of the present disclosure is further configured, for example, as follows. a warning unit that issues a warning to the occupant using the evaluation value; Equipped with A behavior evaluation device characterized by: As a result, the present disclosure has an effect of being able to warn the occupant in accordance with the evaluation value. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to a motion evaluation system or the above motion evaluation method.
[0064] Embodiment 3 In the third embodiment, an exemplary behavior model adapted to a road environment can be shared for each similar road environment. In embodiment 3, among the components of embodiment 3, those components that are similar to the components of embodiment 1 or embodiment 2 already described will be omitted from redundant explanation as appropriate.
[0065] A configuration example of an action evaluation device and an action evaluation system including the device according to a third embodiment of the present disclosure will be described. FIG. 6 is a diagram showing an example of the configuration of an action evaluation system 1C including an action evaluation apparatus 100C according to the third embodiment of the present disclosure. The movement evaluation system 1C includes a movement evaluation device 100C, a model behavior database 200C (database), a road environment database 210C (database), an output device 400C, and an imaging device 500C. The output device 400C is similar to the output devices 400A and 400B already described, and the imaging device 500C is similar to the imaging device 500B already described, so that redundant description of each will be omitted. The road environment database 210C (database), the model behavior database 200C (database), and the action evaluation device 100C will be described in detail in that order.
[0066] The road environment database 210C (database) is a database that stores in advance the position information and the road environment information in association with each other.
[0067] The model behavior database 200C (database) is a database that stores in advance the road environment information and the model behavior model in association with each other.
[0068] The road environment database 210C and the model behavior database 200C constitute the databases of the present disclosure. The road environment database 210C and the model behavior database 200C may be in the form of an integrated database.
[0069] The action evaluation device 100C shown in Figure 6 is configured to include an image acquisition unit 121C, an action determination unit 122C, an action acquisition unit 111C, a position acquisition unit 112C, a road environment acquisition unit 131C, a model acquisition unit 113C, an evaluation value calculation unit 114C, and a warning unit 123C.
[0070] Image acquisition unit 121C is configured in the same manner as image acquisition unit 121B already described, motion determination unit 122C is configured in the same manner as motion determination unit 122B already described, motion acquisition unit 111C is configured in the same manner as motion acquisition units 111A and 111B already described, position acquisition unit 112C is configured in the same manner as position acquisition units 112A and 112B already described, evaluation value calculation unit 114C is configured in the same manner as A and 114B already described, and warning unit 123C is configured in the same manner as warning unit 123B already described, and therefore descriptions of each will be omitted to avoid duplication. The road environment acquisition unit 131C and the model acquisition unit 113C will be described.
[0071] The road environment acquisition unit 131C acquires road environment information according to the position of the moving object. The road environment acquisition unit 131C refers to a database (road environment database 210C) that stores in advance position information and road environment information in association with each other, and acquires road environment information corresponding to the position acquired by the position acquisition unit 112C.
[0072] The model acquisition unit 113C acquires an exemplary behavior model according to road environment information. The model acquisition unit 113C refers to a database (model behavior database 200C) that stores road environment information and model behavior models in advance in association with each other, and acquires a model behavior model corresponding to the road environment information acquired by the road environment acquisition unit 131C.
[0073] A processing example of the action evaluation device according to the third embodiment of the present disclosure will be described. FIG. 7 is a flowchart showing an example of processing by the action evaluating apparatus 100C according to the third embodiment of the present disclosure. The action evaluation device 100C starts the processing shown in Fig. 5 upon receiving a command from a control unit (not shown) or an external command. The action evaluation device 100C starts the processing, for example, when operation of a moving object is started.
[0074] First, the action evaluating apparatus 100C executes a video acquisition process (step ST3110) similar to the video acquisition process (step ST2110) already described.
[0075] Next, the action evaluating apparatus 100C executes the action judging process (step ST3120) in the same manner as the action judging process (step ST2120) already explained.
[0076] Next, the action evaluation apparatus 100C executes an action acquisition process (step ST3130) in the same manner as the action acquisition process (step ST2130) already described.
[0077] Next, the action evaluation apparatus 100C executes a position acquisition process (step ST3140) in the same manner as the position acquisition process (step ST2140) already explained.
[0078] Next, action evaluation device 100C executes a road environment acquisition process (step ST3150). In the road environment acquisition process, the road environment acquisition unit 131C of the action evaluation device 100C acquires road environment information according to the position of the moving object. Specifically, the road environment acquisition unit 131C refers to a database (road environment database 210C) that pre-stores location information and road environment information in association with each other, and acquires road environment information corresponding to the location acquired by the location acquisition unit 112C.
[0079] Next, the action evaluation apparatus 100C executes a model acquisition process (step ST3160). In the model acquisition process, the model acquisition unit 113C of the action evaluation device 100C acquires an exemplary behavior model according to the road environment information. Specifically, the model acquisition unit 113C refers to a database (model behavior database 200C) that pre-stores road environment information in association with model behavior models, and acquires a model behavior model corresponding to the road environment information acquired by the road environment acquisition unit 131C.
[0080] The action evaluating apparatus 100C then executes an evaluation value calculation process (step ST3170) in the same manner as the evaluation value calculation process (step ST2160) already described.
[0081] The action evaluating device 100C then executes an evaluation value judgment process ("evaluation value≧evaluation threshold", step ST3180) similar to the evaluation value judgment process ("evaluation value≧evaluation threshold", step ST2170) already described.
[0082] When determining that the evaluation value is equal to or greater than the evaluation threshold value (step ST3180 "YES"), the warning unit 123C of the action evaluation device 100C executes warning processing (step ST3190) in the same manner as the warning processing (step ST2180) already described. After executing the warning process, the action evaluation device 100C then proceeds to the termination determination process (step ST3200).
[0083] If the warning unit 123C determines that the evaluation value is not equal to or greater than the evaluation threshold, that is, that the evaluation value is less than the evaluation threshold (step ST3180 "NO"), the action evaluation device 100C then proceeds to the termination determination process (step ST3200).
[0084] The action evaluation apparatus 100C executes the termination determination process (step ST3200) in the same manner as the termination determination process (step ST2190) already explained.
[0085] In the above-described embodiment, a model behavior model that can be shared for each road environment can be set, so that a more efficient system for evaluating behavior can be constructed.
[0086] The action evaluation device of the present disclosure is further configured, for example, as follows. a road environment acquisition unit that refers to a database that stores the location information and the road environment information in advance in association with each other, and acquires road environment information corresponding to the location acquired by the location acquisition unit; Furthermore, The model acquisition unit referencing a database in which road environment information and model behavior models are stored in advance in association with each other, and acquiring a model behavior model corresponding to the road environment information acquired by the road environment acquisition unit; A behavior evaluation device characterized by: As a result, the present disclosure has the effect of making it possible to set a common model of exemplary behavior for each road environment, thereby enabling the construction of a more efficient system for behavior evaluation. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to a motion evaluation system or the above motion evaluation method.
[0087] Embodiment 4 In the fourth embodiment, we explain a form in which the exemplary behavior model is based on the occupant's behavior of observing in a direction that is acceptable depending on the road environment, such as cumulative inattentiveness, which is determined by accumulating intermittent inattentiveness by the occupant. In embodiment 4, among the components of embodiment 4, duplicate explanations will be omitted as appropriate for components that are similar to the components of embodiment 1, embodiment 2, or embodiment 3 that have already been described.
[0088] A configuration example of an action evaluation device and an action evaluation system including the device according to a fourth embodiment of the present disclosure will be described. FIG. 8 is a diagram showing an example of the configuration of an action evaluation system 1D including an action evaluation device 100D according to the fourth embodiment of the present disclosure. FIG. 9 is a first diagram for explaining an example of accumulated inattentive behavior handled by the action evaluation device 100D according to the fourth embodiment. FIG. 10 is a second diagram for explaining an example of accumulated inattentive behavior handled by the action evaluation device 100D according to the fourth embodiment. The movement evaluation system 1D includes a movement evaluation device 100D, a model behavior database 200D (database), an output device 400D, and an imaging device 500D. The model behavior database 200D (database) is similar to the model behavior databases 200A and 200B already described, the output device 400D is similar to the output devices 400A, 400B, and 400C already described, and the imaging device 500D is similar to the imaging devices 500B and 500C already described, so descriptions of each will be omitted to avoid duplication. The action evaluation device 100D will now be described in detail.
[0089] The action evaluation device 100D is configured to include a cumulative inattentive behavior judgment unit 141D, a cumulative inattentive behavior point acquisition unit 142D, an observation direction acquisition unit 143D, a cumulative inattentive behavior frequent point acquisition unit 144D, an allowable observation direction acquisition unit 145D, a model acquisition unit 113D, an evaluation value calculation unit 114D, and a warning unit 123D.
[0090] The evaluation value calculation unit 114D is configured in the same manner as the already described A, 114B, and 114C, and the warning unit 123D is configured in the same manner as the already described warning units 123B and 123C, so that the explanations of each will be omitted to avoid duplication.
[0091] The cumulative inattentive driving determination unit 141D determines whether the occupant's behavior is cumulative inattentive driving. The cumulative inattentive driving determination unit 141D acquires a cumulative value relating to intermittent inattentive driving by the occupant, and performs a cumulative inattentive driving determination, which is a determination of whether or not there is a cumulative inattentive driving state, using the cumulative value and a predetermined threshold value (accumulation value threshold value). For example, the cumulative inattentive driving determination unit 141D analyzes video acquired from the imaging device 500D to acquire a cumulative value related to intermittent inattentive driving by the occupant, and each time the cumulative value is acquired, compares the cumulative value with a threshold value to determine whether the cumulative value is equal to or greater than the threshold value. If the cumulative value is equal to or greater than the threshold value, the cumulative inattentive driving determination unit 141D determines that the occupant is in an inattentive driving state. Alternatively, the cumulative inattentive driving determination unit 141D may be configured to determine that the occupant is in an inattentive driving state using, for example, a known technique for determining cumulative inattentive driving other than the above-described determination method. The cumulative inattentive driving determination unit 141D outputs a result of the cumulative inattentive driving determination. For example, the cumulative inattentive driving determination unit 141D outputs a result of the cumulative inattentive driving determination indicating that the cumulative value has reached a threshold value or more. The cumulative inattentive driving determination unit 141D may be configured to acquire a cumulative value relating to intermittent inattentive driving by an occupant from an occupant monitoring device.
[0092] Here, we will explain cumulative inattentiveness. FIG. 9 shows a case where the moving object 1000 is a vehicle, and the cumulative inattentive driving frequent point is a point included in a merging area (merging road 2000, merged road 3000) on a motorway. When a moving object 1000 is moving from a merging road 2000 to a merged road 3000 in a traveling direction 1100 (or a predicted traveling direction), if the observation direction 1200 of the occupant of the moving object 1000 is within the allowable observation range α (assuming the allowable observation range α is set in advance), it is normally determined that the occupant is not looking inattentively. However, in a situation such as that shown in FIG. 9 , it is expected that the occupant will alternate between an observation direction 1200 that checks the road ahead of the merging road 3000 and an observation direction 1300 that checks the road behind the merging road 3000. In this case, the observation directions in the observation range β between the observation direction 1200 and the observation direction 1300 will accumulate, and if the accumulated inattentiveness is determined mainly using the accumulated value, excessive accumulated inattentiveness will be detected. In the present disclosure, for example, as shown in Figure 10, performance evaluation can be performed using a range of acceptable observation directions, using an acceptable observation direction 4010 at a cumulative inattentiveness frequent point, which is a point where cumulative inattentiveness by occupants of each of the multiple moving bodies occurs frequently, in comparison with a normal acceptable observation direction 4000 (corresponding to an acceptable observation range α).
[0093] The cumulative inattentive point acquisition unit 142D acquires cumulative inattentive points, which are points at which it has been determined that the occupant has performed the cumulative inattentive behavior. The cumulative inattentive state acquisition unit 142D acquires cumulative inattentive state points based on the position of the moving object when the cumulative inattentive state determination unit 141D determines that the moving object is in an accumulated inattentive state. The cumulative inattentive point is expressed as information such as the position at the moment when it is determined that the driver is in an inattentive state, or a representative value or average value of the positions during the time when the inattentive state values (cumulative values) are accumulated. The cumulative inattentive point acquisition unit 142D acquires information (location information) relating to the positions of the cumulative inattentive points from, for example, a mobile-mounted device mounted on the mobile body. Alternatively, the cumulative inattentive point acquisition unit 142D may be configured to calculate information (location information) relating to the positions of the cumulative inattentive points using information acquired from, for example, a mobile-mounted device mounted on the mobile body.
[0094] The observation direction acquisition unit 143D acquires the observation direction resulting from the accumulated inattentive driving. The observation direction acquisition unit 143D acquires the observation direction that is the direction from which the passenger of the moving body is likely to be observing. The observation direction, like the "observation direction" already described, is represented by the facial direction of the occupant, the line of sight of the occupant, or information calculated from the facial direction of the occupant and the line of sight of the occupant. The observation direction may be represented by information indicating an area consisting of a plurality of observation directions. The observation direction may be represented by a representative value or an average value of the area consisting of a plurality of observation directions. The observation direction acquisition unit 143D acquires the observation direction by analyzing, for example, the video acquired from the imaging device 500D. Alternatively, the observation direction acquisition unit 143D may be configured to acquire the occupant's observation direction from an occupant monitoring device mounted on the moving body. Alternatively, the observation direction acquisition unit 143D may be configured to acquire the observation direction by calculating it using information acquired from the occupant monitoring device mounted on the moving body.
[0095] The cumulative inattentive driving frequent point acquiring unit 144D acquires cumulative inattentive driving frequent points, which are points where cumulative inattentive driving by occupants of each of a plurality of moving bodies frequently occurs. The cumulative inattentive driving points are location information that indicates points where cumulative inattentive driving is occurring frequently, and is generated based on information collected from multiple mobile bodies. The cumulative inattentive driving frequent points include those represented by information indicating an area consisting of a plurality of cumulative inattentive driving frequent points. The cumulative inattentive driving points may be expressed as information such as a representative value or average value of an area consisting of a plurality of cumulative inattentive driving points. The cumulative inattentive driving frequent spot acquisition unit 144D acquires information related to cumulative inattentive driving frequent spots output from a server device (a server device not shown, or a server device 600E related to embodiment 5 described below) at a pre-stored fixed time or at predetermined intervals, for example. Alternatively, for example, when the cumulative inattentive state is determined to be present by the cumulative inattentive state determination unit 141D, the cumulative inattentive state acquisition unit 144D uses the cumulative inattentive state points acquired by the cumulative inattentive state acquisition unit 142D to acquire information relating to the cumulative inattentive state points included in an area based on the cumulative inattentive state points from the server device. The information relating to the cumulative inattentive driving high incidence points includes location information indicating the locations of the cumulative inattentive driving high incidence points. The cumulative inattentive driving frequent point acquisition unit 144D extracts and outputs position information indicating the positions of the cumulative frequent inattentive driving points included in the information relating to the cumulative frequent inattentive driving points. The information relating to the cumulative high incidence points of inattentive driving also includes permissible observation direction information indicating the permissible observation direction at the cumulative high incidence points.
[0096] The permissible observation direction acquisition unit 145D acquires the permissible observation direction, which is the direction in which observation should be permitted for each cumulative inattentive driving frequency point. The allowable observation direction is information generated based on information collected from multiple moving bodies, and is represented as information indicating the direction that observation should be allowed at each point where cumulative inattentive driving occurs frequently. For example, if the moving body is a vehicle and the cumulative frequent inattentive driving point is a point included in a merging area on a motorway, the allowable observation direction is a direction based on the position of the occupant, heading toward the road where the vehicle is expected to merge (the road to be merged). Also, for example, if the moving body is a vehicle and the cumulative frequent inattentive driving point is a point included in the merging area from a branch road to a main road, the allowable observation direction is a direction based on the position of the occupant, heading toward the road where the vehicle is expected to merge (the merging road). Also, for example, if the moving body is a vehicle and the cumulative frequent inattentive driving point is a point included in the surrounding area of an intersection, the allowable observation direction is a direction based on the position of the occupant, and is the direction toward the road connected to the intersection (the merging road). The allowable viewing direction may be expressed by information indicating a region consisting of a plurality of allowable viewing directions, or may be expressed by a representative value or an average value of the region consisting of a plurality of allowable viewing directions. The permissible observation direction acquisition unit 145D acquires permissible observation direction information included in the information related to the accumulated inattentive driving frequent points acquired by the accumulated inattentive driving frequent point acquisition unit 144D.
[0097] The model acquisition unit 113D acquires an exemplary behavior model using the cumulative inattentive driving points, cumulative inattentive driving frequent points, observation direction, and allowable observation direction. When the cumulative inattentive driving point and the cumulative inattentive driving frequent point overlap, and when the observation direction acquired by the observation direction acquisition unit 143D overlaps with the permissible observation direction acquired by the permissible observation direction acquisition unit 145D, the model acquisition unit 113D acquires as a model behavior model observing the permissible observation direction at the position of the cumulative inattentive driving point. Specifically, model acquisition unit 113D determines whether the cumulative inattentive driving points acquired by cumulative inattentive driving point acquisition unit 142D and the cumulative inattentive driving frequent points acquired by cumulative inattentive driving frequent point acquisition unit 144D overlap. This determination includes determining whether the cumulative inattentive driving points and the cumulative inattentive driving frequent points match, or determining whether an area based on the cumulative inattentive driving points and an area based on the cumulative inattentive driving frequent points at least partially overlap. The model acquisition unit 113D also determines whether the observation direction acquired by the observation direction acquisition unit 143D overlaps with the permissible observation direction acquired by the permissible observation direction acquisition unit 145D. This determination includes determining whether the observation direction and the permissible observation direction match, or whether a directional region based on the observation direction overlaps at least partially with a directional region based on the cumulative inattentive driving frequency points. When the cumulative inattentiveness points acquired by the cumulative inattentiveness point acquisition unit 142D and the cumulative inattentiveness frequent points acquired by the cumulative inattentiveness frequent point acquisition unit 144D overlap, and when the observation direction acquired by the observation direction acquisition unit 143D and the permissible observation direction acquired by the permissible observation direction acquisition unit 145D overlap, the model acquisition unit 113D acquires as an exemplary behavior model the observation of the permissible observation direction at the location of the cumulative inattentiveness point. This is because the permissible observation direction at the cumulative inattentiveness frequent point can be said to be the direction in which an occupant, such as a driver, should observe at the location of the moving object. Specifically, for example, when the cumulative inattentiveness frequent point includes a point included in a merging area on a motorway, the permissible observation direction is the direction based on the position of the occupant, heading toward the road where the moving object will merge. By using such an allowable observation direction as a model behavior, the behavior evaluation device of the present disclosure can evaluate the behavior of a occupant driving a moving body by modeling behavior such as cumulative inattentive driving, with the observation direction being the direction toward the merging road in a merging area on a motorway.
[0098] A processing example of the action evaluation device according to the fourth embodiment of the present disclosure will be described. FIG. 11 is a flowchart showing an example of processing by the action evaluating device 100D according to the fourth embodiment of the present disclosure.
[0099] The process shown in FIG. 11 is a motion evaluation method using the motion evaluation device 100D. For example, when the action evaluation device 100D acquires a video from the imaging device 500D, the action evaluation device 100D starts the processing shown in FIG. When the action evaluation device 100D acquires the cumulative value related to the cumulative inattentive behavior, the action evaluation device 100D may start the processing shown in Fig. 11. In this case, the action evaluation device 100D acquires the cumulative value related to the cumulative inattentive behavior from, for example, an occupant monitoring device (for example, the occupant monitoring device 300A already described).
[0100] First, the action evaluation device 100D executes the accumulated inattentive behavior determination process (step ST4110). In the cumulative inattentive driving judgment process, the cumulative inattentive driving judgment unit 141D of the action evaluation device 100D acquires a cumulative value related to intermittent inattentive driving by the occupant of the moving body, and performs a cumulative inattentive driving judgment, which is a judgment of whether or not there is a cumulative inattentive driving state, using the cumulative value and a predetermined threshold value. The cumulative inattentive behavior determination unit 141D, for example, first analyzes the video and accumulates values related to the cumulative inattentive behavior to obtain a cumulative value, or obtains a cumulative value output from an occupant monitoring device. The cumulative inattentive driving determination unit 141D then compares the cumulative value relating to intermittent inattentive driving with a pre-stored threshold value. Next, if the cumulative value relating to intermittent inattentiveness exceeds a pre-stored threshold value, cumulative inattentiveness determination unit 141D determines that the driver is in an accumulated inattentive state. The cumulative inattentive driving determination unit 141D then notifies the cumulative inattentive driving point acquisition unit 142D, the observation direction acquisition unit 143D, the cumulative inattentive driving frequent point acquisition unit 144D, and the allowable observation direction acquisition unit 145D that it has been determined that the driver is in a cumulative inattentive driving state.
[0101] When the action evaluation device 100D determines that the accumulated inattentive state is not present ("NO" in step ST4111), the action evaluation device 100D returns to the processing of step ST4110.
[0102] When determining that the driver has been in an accumulated inattentive state ("YES" in step ST4111), the action evaluation device 100D then executes an accumulated inattentive point acquisition process (step ST4120). In the cumulative inattentive state acquisition process, the cumulative inattentive state acquisition unit 142D of the action evaluation device 100D acquires the cumulative inattentive state based on the position of the moving body when the cumulative inattentive state is determined to be in a cumulative inattentive state by the cumulative inattentive state determination unit 141D. When the cumulative inattentive state acquisition unit 142D receives a notification indicating that a cumulative inattentive state has been determined from the cumulative inattentive state determination unit 141D, it acquires cumulative inattentive state information indicating the cumulative inattentive state. The cumulative inattentive state information is expressed as a position or area where a cumulative inattentive state has occurred, based on the position of the mobile body acquired via a communication unit (not shown). The cumulative inattentive state acquisition unit 142D outputs the cumulative inattentive state information to the model acquisition unit 113D.
[0103] Next, the action evaluation device 100D executes an observation direction acquisition process (step ST4130). In the observation direction acquisition process, the observation direction acquisition unit 143D of the action evaluation device 100D acquires the observation direction that is the direction from which the occupant of the moving object is likely to be observing. When the observation direction acquisition unit 143D receives a notification from the cumulative inattentive driving determination unit 141D indicating that the cumulative inattentive driving state has been determined, the observation direction acquisition unit 143D acquires observation direction information indicating the observation direction. The observation direction information indicates, for example, the facial orientation of the occupant, the line of sight of the occupant, or the direction the occupant is likely to be observing based on the facial orientation and line of sight of the occupant acquired using video captured of the interior of the vehicle. The observation direction acquisition unit 143D outputs the observation direction information to the model acquisition unit 113D.
[0104] Next, the action evaluation device 100D executes a cumulative inattentive driving frequent point acquisition process (step ST4140). In the cumulative inattentive spot occurrence point acquisition process, the cumulative inattentive spot occurrence point acquisition unit 144D of the action evaluation device 100D acquires cumulative inattentive spot occurrence points, which are points where cumulative inattentive behavior by the occupants of each of the multiple moving bodies frequently occurs. When the cumulative inattentiveness frequent point acquisition unit 144D receives a notification from the cumulative inattentiveness determination unit 141D indicating that a cumulative inattentiveness state has been determined, it acquires cumulative inattentiveness frequent point information indicating the cumulative inattentiveness frequent points. The cumulative inattentiveness frequent point information indicates the locations or areas of the cumulative inattentiveness frequent points, which are points where cumulative inattentiveness by the occupants of each of the multiple mobile bodies frequently occurs. For example, the cumulative inattentiveness frequent point acquisition unit 144D uses the cumulative inattentiveness points acquired by the cumulative inattentiveness point acquisition unit 142D to acquire information related to the cumulative inattentiveness frequent points included in the area based on the cumulative inattentiveness points from, for example, a server device. The cumulative inattentiveness frequent point acquisition unit 144D outputs the cumulative inattentiveness frequent point information included in the acquired information related to the cumulative inattentiveness frequent points to the model acquisition unit 113D.
[0105] Next, action evaluation device 100D executes an allowable observation direction acquisition process (step ST4150). In the allowable observation direction acquisition process, the allowable observation direction acquisition unit 145D of the action evaluation device 100D acquires an allowable observation direction, which is a direction in which observation should be allowed for each of the cumulative inattentive viewing frequent points. When the allowable observation direction acquisition unit 145D receives a notification from the accumulated inattentive state determination unit 141D indicating that a cumulative inattentive state has been determined, it acquires allowable observation direction information indicating the allowable observation direction contained in the information related to the cumulative inattentive frequent point acquired from the server device by the accumulated inattentive frequent point acquisition unit 144D. The allowable observation direction information indicates a direction or a directional area consisting of multiple directions that is allowable for observation at the cumulative inattentive frequent point, which is a point where cumulative inattentive behavior by occupants of each of multiple mobile bodies frequently occurs. The allowable observation direction acquisition unit 145D outputs the acquired allowable observation direction information to the model acquisition unit 113D.
[0106] Next, the action evaluation device 100D executes the allowable cumulative inattentive driving determination process (step ST4160). In the allowable cumulative inattentive behavior determination process, the model acquisition unit 113D of the action evaluation device 100D determines whether the viewing direction at the position of the accumulated inattentive behavior point is a direction in which viewing should be allowed (allowable viewing direction). When the cumulative inattentive driving points and the cumulative inattentive driving frequent points overlap, and when the observation direction acquired by the observation direction acquisition unit 143D overlaps with the permissible observation direction acquired by the permissible observation direction acquisition unit 145D, the model acquisition unit 113D acquires as an exemplary behavior model the observation of the permissible observation direction at the position of the cumulative inattentive driving point. Note that the state in which the cumulative inattentive driving points and the cumulative inattentive driving frequent points overlap, and the state in which the observation direction acquired by the observation direction acquisition unit 143D overlaps with the permissible observation direction acquired by the permissible observation direction acquisition unit 145D overlap, are not limited to states in which they strictly match, but also include, for example, states in which the difference value is equal to or less than a predetermined threshold.
[0107] If the model acquiring unit 113D determines that the observation direction does not overlap with the permissible observation direction (step ST4160 "NO"), then the action evaluating device 100D proceeds to the evaluation value calculation process (step ST4180).
[0108] If the model acquiring unit 113D determines that the observation direction overlaps with the permissible observation direction ("YES" in step ST4160), then the action evaluation device 100D executes the permissible accumulated inattentive behavior information output process (step ST4170). In the allowable accumulated inattentive information output process, the model acquisition unit 113D of the action evaluation device 100D acquires allowable accumulated inattentive information including position information indicating the accumulated inattentive points and allowable observation directions indicating the allowable observation directions as an exemplary behavior model. The position information indicating the cumulative inattentive points and the permissible observation direction indicating the permissible observation direction correspond to an exemplary behavior model that indicates the behavior of observing the permissible observation direction at the position of the cumulative inattentive points.
[0109] Here, a detailed example of the processing of the model acquisition unit 113D will be described. FIG. 12 is a flowchart showing an example of processing by the model acquiring unit 113D in the action evaluating apparatus 100D according to the fourth embodiment of the present disclosure. First, the model acquiring unit 113D compares the accumulated inattentive driving points indicated by the accumulated inattentive driving point information with the accumulated inattentive driving frequent points indicated by the accumulated inattentive driving frequent point information (step ST4161). The model acquiring unit 113D then determines whether the cumulative inattentive driving points and the cumulative inattentive driving frequent points overlap (step ST4162). If the cumulative inattentive driving point and the cumulative inattentive driving frequent point overlap (step ST4162 "YES"), the model acquiring unit 113D then compares the observation direction with the allowable observation direction (step ST4163). The model acquiring unit 113D then determines whether the observation direction overlaps with the permissible observation direction (step ST4164).
[0110] If the observation direction overlaps with the permissible observation direction (step ST4164 "YES"), the model acquiring unit 113D then executes the permissible accumulated inattentive driving information output process (step ST4170). In the permissible accumulated inattentive information output process, the model acquisition unit 113D acquires permissible accumulated inattentive information including position information indicating the accumulated inattentive points and permissible observation directions indicating the permissible observation directions as an exemplary behavior model.
[0111] If the cumulative inattentive driving points and the cumulative frequent inattentive driving points do not overlap (step ST4162 "NO"), or if the observation direction and the allowable observation direction do not overlap (step ST4164 "NO"), the model acquisition unit 113D executes a database reference process (step ST4165). In the database reference process, the model acquisition unit 113D references the model behavior database 200, searches for a model behavior model at the cumulative inattentiveness points, and outputs the model behavior model according to the search results. If a model behavior model is found, the model acquisition unit 113D acquires the model behavior model and outputs the model behavior model to the evaluation value calculation unit 114D; if no model behavior model is found, the process ends. When the model acquiring section 113D finishes the process, the action evaluating device 100D then proceeds to the evaluation value calculation process (step ST4180).
[0112] The processes in the allowable cumulative inattentive driving determination process (step ST4160), particularly including the database reference process (step ST4165) and the allowable cumulative inattentive driving information output process (step ST4170), correspond to the model acquisition process of the present disclosure.
[0113] Returning to the explanation of FIG. The action evaluating device 100D then executes an evaluation value calculation process (step ST4180) similar to the evaluation value calculation process (for example, step ST2160) already described. Evaluation value calculation unit 114D outputs the evaluation value as the calculation result to warning unit 123D.
[0114] The action evaluating device 100D then executes the evaluation value judgment process ("evaluation value≧evaluation threshold value", step ST4190) in the same manner as the evaluation value judgment process (for example, step ST2170) already described.
[0115] When it is determined that the evaluation value is equal to or greater than the evaluation threshold value ("YES" in step ST4190), the warning unit 123D executes a warning process (step ST4200). In the warning process, the warning unit 123D instructs the output device 400D to issue a warning indicating that the evaluation is low. When issuing a warning command, the warning unit 123D may issue a command to present information such as the evaluation value itself and the degree of lowness of the evaluation. After the warning unit 123D has executed the process, the action evaluation device 100D then proceeds to an end determination process (step ST4210).
[0116] If the warning unit 123D determines that the evaluation value is not equal to or greater than the evaluation threshold, that is, that the evaluation value is less than the evaluation threshold (step ST4190 "NO"), the action evaluation device 100D then proceeds to the termination determination process (step ST4210).
[0117] The action evaluation device 100D then executes an end determination process (step ST4210). In the termination determination process, a control unit (not shown) of the action evaluation device 100D determines whether to terminate the processing of the action evaluation device 100D. The control unit (not shown) determines whether to terminate the processing of the action evaluation device 100D in accordance with, for example, an external termination command or an execution program. If the control unit (not shown) determines not to end the processing of the action evaluation device 100D, the process proceeds to step ST4110, and the processing is repeated from step ST4110. When the control unit (not shown) determines that the processing of the action evaluation device 100D should be ended, the action evaluation device 100D ends the processing.
[0118] The action evaluation device of the present disclosure is further configured, for example, as follows. an accumulated inattentive state determination unit that acquires an accumulated value related to intermittent inattentive state by the occupant and performs an accumulated inattentive state determination by using the accumulated value and a predetermined threshold value; an accumulated inattentive point acquisition unit that acquires accumulated inattentive points based on the position of the moving body when the accumulated inattentive state is determined to be present by the accumulated inattentive state determination unit; an observation direction acquisition unit that acquires an observation direction that is a direction in which the occupant of the moving body is likely to be observing; an accumulative inattentiveness frequent occurrence point acquisition unit that acquires accumulative inattentiveness frequent occurrence points, which are points where accumulative inattentiveness by occupants of each of a plurality of moving bodies frequently occurs; an allowable observation direction acquisition unit that acquires an allowable observation direction, which is a direction in which observation should be allowed for each of the cumulative inattentive looking points; Furthermore, The model acquisition unit When the cumulative inattentive driving point and the cumulative inattentive driving frequent point overlap, and, When the observation direction acquired by the observation direction acquisition unit overlaps with the allowable observation direction, Observing the permissible observation direction at the position of the cumulative inattentive viewing point is acquired as the exemplary behavior model. A behavior evaluation device characterized by: As a result, the present disclosure has the effect of enabling more accurate behavior evaluation of occupant behavior such as cumulative inattentive behavior. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to a motion evaluation system or the above motion evaluation method.
[0119] The action evaluation device of the present disclosure is further configured, for example, as follows. When the cumulative inattentiveness frequent point includes a point included in a merging area on a motorway, the allowable observation direction is a direction based on the position of the occupant and is a direction toward a merging road where the moving object will merge; A behavior evaluation device characterized by: As a result, the present disclosure has the effect of allowing occupant behavior such as cumulative inattentiveness in a direction where it is preferable to observe at points included in merging areas on expressways, with regard to occupant behavior such as cumulative inattentiveness. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to a motion evaluation system or the above motion evaluation method.
[0120] Embodiment 5 In the fifth embodiment, a form in which the action evaluation device in each moving object and the server device cooperate to generate a database or update the database will be described. In embodiment 5, among the components of embodiment 5, duplicate explanations will be omitted as appropriate for components that are similar to the components of embodiment 1, embodiment 2, embodiment 3, or embodiment 4 that have already been described.
[0121] An action evaluation device according to a fifth embodiment of the present disclosure will be described. FIG. 13 is a diagram showing the relationship between an action evaluating apparatus 100E according to the fifth embodiment of the present disclosure and a server apparatus 600E that generates a database used in the action evaluating apparatus 100E. The action evaluation device 100E (100E-1, 100E-2, 100E-3, ..., 100E-n (n is an integer greater than or equal to 2)) is mounted on a mobile body 700E (700E-1, 700E-2, 700E-3, ..., 700E-n (n is an integer greater than or equal to 2)) and is connected to the server device 600E via a network. Server device 600E acquires operation information from a plurality of moving objects 700E (700E-1, 700E-2, 700E-3, . . . , 700E-n) via the network. The motion evaluation devices 100E (100E-1, 100E-2, 100E-3, . . . , 100E-n) mounted on the respective moving bodies 700E (700E-1, 700E-2, 700E-3, . . . , 700E-n) provide motion information to the server device 600E.
[0122] A configuration example of an action evaluation device and an action evaluation system including the device according to a fifth embodiment of the present disclosure will be described. FIG. 14 is a diagram showing a first configuration example of an action evaluation system 1E including an action evaluation apparatus 100E according to the fifth embodiment of the present disclosure. FIG. 15 is a diagram showing a second configuration example of an action evaluation system 1E' including an action evaluation apparatus 100E' according to the fifth embodiment of the present disclosure. FIG. 16 is a diagram showing a third configuration example of an action evaluation system 1E'' including an action evaluation apparatus 100E'' according to the fifth embodiment of the present disclosure. The action evaluation system 1E (1E', 1E'') includes an action evaluation device 100E (100E', 100E''), an output device 400E, an imaging device 500E, and a server device 600E. The output device 400E is similar to the output devices 400A, 400B, 400C, and 400D already described, and the imaging device 500E is similar to the imaging devices 500B, 500C, and 500D already described, so that redundant description will be omitted. The action evaluation devices (100E, 100E', 100E'') and the server device 600E will be described in detail in that order.
[0123] The action evaluating apparatus according to the fifth embodiment is configured to include the same components as any of the action evaluating apparatuses 100A, 100B, 100C, and 100D already described in the respective embodiments. For example, an action evaluating device 100E shown in FIG. 14 includes the same components as those of the action evaluating device 100B already described in the second embodiment. For example, an action evaluating device 100E' shown in FIG. 15 includes the same components as those of the action evaluating device 100C already described in the third embodiment. For example, an action evaluating device 100E'' shown in FIG. 16 includes the same components as those of the action evaluating device 100D already described in the fourth embodiment. In addition to this configuration, the action evaluating device according to the fifth embodiment further includes an action information providing unit 151E. For example, each of the action evaluation devices 100E, 100E', and 100E'' shown in the respective drawings further includes a action information providing unit 151E. Of the internal configurations of the action evaluation devices 100E, 100E', and 100E'' according to embodiment 5, the components similar to those of the action evaluation devices 100A, 100B, 100C, and 100D already described in each embodiment have already been described in each embodiment, so description thereof will be omitted here. The operation information providing unit 151E will be described.
[0124] The motion information providing unit 151E provides the motion information to the server device 600E that generates the database of the present disclosure. Specifically, the action information providing unit 151E in the action evaluation device 100E, 100E′ outputs action information, which is information combining information related to the action acquired by the action acquisition unit 111E and location information acquired by the location acquisition unit 112E, to the server device 600E. Specifically, the action information providing unit 151E in the action evaluation device 100E″ outputs action information, which is information combining the location information and the information related to the action, to the server device 600E, using the accumulated inattentive point acquisition unit 142E acquired as location information and the observation direction acquired in chronological order by the observation direction acquisition unit as information related to the action.
[0125] Server device 600E generates the database of the present disclosure. Server device 600E determines an exemplary behavior model according to the road environment for each position based on the operation information, and generates a database that associates the positions, road environments, and exemplary behavior models. Furthermore, if a database has already been generated, server device 600E updates the generated database using the determined exemplary behavior model. The database generated in server device 600E is the database already described in each embodiment, specifically, at least one of model behavior databases 200A, 200B, 200C, 200D, 200E (databases) or road environment database 210C (database). The server device 600E provides the generated or updated database to the action evaluation devices 100E, 100E', and 100E'' of the respective moving bodies 700E (700E-1, 700E-2, 700E-3, . . . , 700E-n). Alternatively, the server device 600E may be configured to use the generated or updated database to cooperate with the action evaluation devices 100E, 100E', 100E" of each moving body 700E (700E-1, 700E-2, 700E-3, . . . , 700E-n) and provide information in response to a request from the action evaluation devices 100E, 100E', 100E". The information provided by the server device 600E to the action evaluation devices 100E, 100E', 100E" may be a model behavior model or road environment information.
[0126] An example of the configuration of a server device according to the fifth embodiment will be described. The server devices 600E, 600E', 600E'' shown in FIGS. 14, 15, and 16, respectively, are configured to include a behavior information collection unit 601E and a model behavior database 200E (database).
[0127] The behavior information collection unit 601E collects behavior information from multiple moving bodies 700E (700E-1, 700E-2, 700E-3, ..., 700E-n), associates location information with an exemplary behavior model according to the road environment based on the collected behavior information, and stores the associated information in a database (at least one of the exemplary behavior databases 200A, 200B, 200C, 200D, 200E (databases), or the road environment database 210C (database)). That is, the location information and exemplary behavior model associated with the database according to the fifth embodiment of the present disclosure are each generated based on the location information collected from a plurality of moving bodies 700E (700E-1, 700E-2, 700E-3, ..., 700E-n) and the behavior information including the occupant's behavior.
[0128] A processing example of the action evaluation device according to the fifth embodiment of the present disclosure will be described. FIG. 17 is a flowchart showing an example of processing by the action information providing unit 151 in the action evaluating apparatus 100E, 100E', and 100E'' according to the fifth embodiment of the present disclosure. For example, when the operation information providing unit 151E receives information from an external source, it starts the processing shown in Fig. 17. Alternatively, the operation information providing unit 151E starts the processing shown in Fig. 17 based on, for example, an instruction from a control unit (not shown).
[0129] The motion information providing unit 151E executes a motion information acquisition determination process (step ST5110). The motion information providing unit 151E determines whether or not motion information has been acquired in the motion information acquisition determination process. If the operation information providing unit 151E determines that the operation information has not been acquired ("NO" in step ST5110), it continues the process of step ST5110 until the operation information is acquired.
[0130] When the motion information providing unit 151E determines in the motion information acquisition determining process that the motion information has been acquired ("YES" in step ST5110), it then executes the motion information providing process (step ST5120). In the action information providing process, the action information providing unit 151E outputs action information, which is information combining the position information and information related to the action of the occupant, to the server device 600E. Specifically, the action information providing unit 151E in the action evaluation device 100E, 100E′ outputs action information, which is information combining information related to the action acquired by the action acquisition unit 111E and location information acquired by the location acquisition unit 112E, to the server device 600E. Specifically, the action information providing unit 151E in the action evaluation device 100E″ outputs action information, which is information combining the location information and the information related to the action, to the server device 600E, using the accumulated inattentive point acquisition unit 142E acquired as location information and the observation direction acquired in chronological order by the observation direction acquisition unit as information related to the action.
[0131] After executing the motion information providing process, the motion information providing unit 151E ends the process shown in FIG.
[0132] A processing example of the server device according to the fifth embodiment of the present disclosure will be described. FIG. 18 is a flowchart showing an example of processing performed by the server device 600E when action information is provided from the action evaluation devices 100E, 100E', and 100E'' according to the fifth embodiment of the present disclosure. When server device 600E receives information from, for example, an external source, it starts the process shown in FIG. Alternatively, server device 600E starts the process shown in FIG. 18 based on a command from a control unit (not shown) in server device 600E. Server 600E executes operation information acquisition determination processing (step ST5210). In the operation information acquisition determination process, operation information collection unit 601E of server device 600E determines whether operation information has been acquired.
[0133] If the operation information collection unit 601E determines that the operation information has not been acquired ("NO" in step ST5210), it continues the process of step ST5210 until the operation information is acquired. If the action information collecting section 601E determines that the action information has been acquired (step ST5210 "YES"), then the server device 600E executes an exemplary behavior model storage process (step ST5220). In the model behavior model storage process, the behavior information collection unit 601E of the server device 600E collects behavior information from multiple moving bodies 700E (700E-1, 700E-2, 700E-3, ..., 700E-n), associates location information with a model behavior model corresponding to the road environment based on the collected behavior information, and stores it as a database (at least one of model behavior databases 200A, 200B, 200C, 200D, 200E (databases), or road environment database 210C (database)). Specifically, the motion information collecting unit 601E acquires motion information from the motion evaluation devices 100E, 100E′, and 100E″ of each moving body 700E (700E-1, 700E-2, 700E-3, . . . , 700E-n) and stores the motion information. The motion information collecting unit 601E aggregates the position information and motion-related information included in the stored motion information and determines an exemplary behavior model for each position. For example, when the number of identical motions for each position reaches or exceeds a predetermined threshold (motion count threshold), the motion information collecting unit 601E determines the motion as an exemplary behavior model that shows an exemplary behavior according to the road environment. The motion information collecting unit 601E associates the determined exemplary behavior model with the position information and stores the association data in a database.
[0134] After executing the model behavior model storage process, the action information collecting unit 601E ends the process shown in FIG.
[0135] The action evaluation device of the present disclosure is further configured, for example, as follows. the location information and the exemplary behavior model associated with the database are generated based on location information collected from a plurality of moving bodies and movement information including the movement of the occupant, respectively; A behavior evaluation device characterized by: As a result, the present disclosure has the advantage of being able to use an exemplary behavior model based on a large amount of actual data showing actual behavior at each location, thereby improving the accuracy of driving evaluation or behavior evaluation. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to a motion evaluation system or the above motion evaluation method.
[0136] The action evaluation device of the present disclosure is further configured, for example, as follows. an operation information providing unit that outputs the operation information to a server device that generates the database; Furthermore, A behavior evaluation device characterized by: As a result, the present disclosure has the advantage of being able to use an exemplary behavior model based on a large amount of actual data showing actual behavior at each location, thereby improving the accuracy of driving evaluation or behavior evaluation. Furthermore, the present disclosure achieves the same effects as those described above by applying the above configuration to a motion evaluation system or the above motion evaluation method.
[0137] Here, a hardware configuration for realizing the functions of the present disclosure will be described. FIG. 19 is a diagram illustrating a first example of a hardware configuration for realizing the functions according to the configuration of the present disclosure. FIG. 20 is a diagram illustrating a second example of a hardware configuration for realizing the functions according to the configuration of the present disclosure. The action evaluation devices 100, 100A, 100B, 100C, 100D, 100E (100E-1, 100E-2, 100E-3, . . . , 100E-n (n is an integer of 2 or more)), 100E' (100E'-1, 100E'-2, 100E'-3, . . . , 100E'-n (n is an integer of 2 or more)), 100E'' (100E''-1, 100E''-2, 100E''-3, . . . , 100E''-n (n is an integer of 2 or more)), the occupant monitoring device 300A, and the server device 600E of the present disclosure are each realized by hardware such as shown in FIG. 19 or FIG. 20.
[0138] As shown in FIG. 19, each of the action evaluation devices 100, 100A, 100B, 100C, 100D, 100E, 100E', and 100E'' is configured with, for example, a processor 10001, a memory 10002, an input / output interface 10003, and a communication circuit 10004. The processor 10001 and the memory 10002 are, for example, installed in a computer. The memory 10002 stores the computer, which includes operation acquisition units 111, 111A, 111B, 111C, 111E, and 111E', position acquisition units 112, 112A, 112B, 112C, 112E, and 112E', model acquisition units 113, 113A, 113B, 113C, 113D, 113E, 113E', and 113E', evaluation value calculation units 114, 114A, 114B, 114C, 114D, and 114E, video acquisition units 121B and 121C, 121E, 121E', operation determination units 122B, 122C, 122E, 122E', warning units 123B, 123C, 123D, 123E, road environment acquisition unit 131C, cumulative inattentive driving determination unit 141D, cumulative inattentive driving point acquisition unit 142D, observation direction acquisition unit 143D, cumulative inattentive driving frequent point acquisition unit 144D, allowable observation direction acquisition unit 145D, operation information provision unit 151E, and programs for functioning as a control unit not shown are stored. The processor 10001 reads out and executes the programs stored in the memory 10002, whereby the motion acquisition units 111, 111A, 111B, 111C, 111E, 111E', the position acquisition units 112, 112A, 112B, 112C, 112E, 112E', the model acquisition units 113, 113A, 113B, 113C, 113D, 113E, 113E', 113E', the evaluation value calculation units 114, 114A, 114B, 114C, 114D, 114E, the image acquisition unit 12 The functions of 1B, 121C, 121E, 121E', operation determination units 122B, 122C, 122E, 122E', warning units 123B, 123C, 123D, 123E, road environment acquisition unit 131C, cumulative inattentive driving determination units 141D, 141E, cumulative inattentive driving point acquisition units 142D, 142E, observation direction acquisition units 143D, 143E, cumulative inattentive driving frequent point acquisition units 144D, 144E, allowable observation direction acquisition units 145D, 145E, operation information provision unit 151E, and a control unit not shown are realized. Furthermore, a storage unit (not shown) is realized by the memory 10002 or another memory (not shown). Furthermore, the communication circuit 10004 realizes a communication unit (not shown).
[0139] Similarly, the occupant monitoring device 300A is configured with a processor 10001, a memory 10002, an input / output interface 10003, and a communication circuit 10004, for example. The processor 10001 and the memory 10002 are, for example, installed in a computer. Memory 10002 stores programs that cause the computer to function as image acquisition unit 301A, motion determination unit 302A, and a control unit (not shown). When processor 10001 reads and executes the programs stored in memory 10002, the functions of image acquisition unit 301A, motion determination unit 302A, and a control unit (not shown) are realized. Furthermore, the memory 10002 or another memory (not shown) implements a storage unit (not shown) in the occupant monitoring device 300A. Furthermore, the communication circuit 10004 realizes a communication unit (not shown) in the occupant monitoring device 300A.
[0140] Similarly, the server device 600E is configured with a processor 10001, a memory 10002, an input / output interface 10003, and a communication circuit 10004, for example. The processor 10001 and the memory 10002 are, for example, installed in a computer. A program for causing the computer to function as a motion information collecting unit 601E and a control unit (not shown) is stored in memory 10002. The functions of the motion information collecting unit 601E and the control unit (not shown) are realized by processor 10001 reading and executing the program stored in memory 10002. Furthermore, memory 10002 or another memory (not shown) implements a storage unit (not shown) in server device 600E. Furthermore, communication circuit 10004 realizes a communication unit (not shown) in server device 600E.
[0141] The processor 10001 is, for example, a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor, a microcontroller, or a digital signal processor (DSP). Memory 10002 may be a non-volatile or volatile semiconductor memory such as RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable Read Only Memory) or flash memory, or a magnetic disk such as a hard disk or flexible disk, or an optical disk such as a CD (Compact Disc) or DVD (Digital Versatile Disc), or a magneto-optical disk. The processor 10001 and the memory 10002 or the communication circuit 10004 are connected in a state where they can transmit data to each other. The processor 10001, the memory 10002, and the communication circuit 10004 are also connected in a state where they can transmit data to other hardware via the input / output interface 10003.
[0142] Or, in the action evaluation device 100, 100A, 100B, 100C, 100D, 100E, 100E', 100E'', the action acquisition units 111, 111A, 111B, 111C, 111E, 111E', the position acquisition units 112, 112A, 112B, 112C, 112E, 112E', the model acquisition units 113, 113A, 113B, 113C, 113D, 113E, 113E', 113E', the evaluation value calculation units 114, 114A, 114B, 114C, 114D, 114E, the video acquisition units 121B, 121C, 121E, The functions of 121E', operation judgment units 122B, 122C, 122E, 122E', warning units 123B, 123C, 123D, 123E, road environment acquisition unit 131C, cumulative inattentive driving judgment units 141D, 141E, cumulative inattentive driving point acquisition units 142D, 142E, observation direction acquisition units 143D, 143E, cumulative inattentive driving frequent point acquisition units 144D, 144E, allowable observation direction acquisition units 145D, 145E, operation information provision unit 151E, and a control unit not shown may be realized by a dedicated processing circuit 20001, as shown in Figure 20.
[0143] Similarly, the functions of the image acquisition unit 301A, the operation determination unit 302A, and the control unit (not shown) in the occupant monitoring device 300A may be realized by a dedicated processing circuit 20001.
[0144] Similarly, the functions of the operation information collecting unit 601E and a control unit (not shown) in the server device 600E may be realized by a dedicated processing circuit 20001.
[0145] The processing circuit 20001 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), an FPGA (Field-Programmable Gate Array), an SoC (System-on-a-Chip), or a system LSI (Large-Scale Integration). Furthermore, the memory 20002 or another memory not shown implements a storage unit not shown. Memory 20002 may be a non-volatile or volatile semiconductor memory such as RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable Read Only Memory) or flash memory, or a magnetic disk such as a hard disk or flexible disk, or an optical disk such as a CD (Compact Disc) or DVD (Digital Versatile Disc), or a magneto-optical disk. Furthermore, the communication circuit 20004 realizes a communication unit (not shown). The processing circuit 20001 and the memory 20002 or the communication circuit 20004 are connected in a state where they can transmit data to each other. In addition, the processing circuit 20001, the memory 20002, and the communication circuit 20004 are connected in a state where they can transmit data to each other and to other hardware via the input / output interface 20003. In addition, in the action evaluation devices 100, 100A, 100B, 100C, 100D, 100E, 100E', and 100E'', the action acquisition units 111, 111A, 111B, 111C, 111E, and 111E', the position acquisition units 112, 112A, 112B, 112C, 112E, and 112E', the model acquisition units 113, 113A, 113B, 113C, 113D, 113E, 113E', and 113E', the evaluation value calculation units 114, 114A, 114B, 114C, 114D, and 114E, the image acquisition units 121B, 121C, and 121D The functions of E, 121E', operation determination unit 122B, 122C, 122E, 122E', warning unit 123B, 123C, 123D, 123E, road environment acquisition unit 131C, cumulative inattentive driving determination unit 141D, 141E, cumulative inattentive driving point acquisition unit 142D, 142E, observation direction acquisition unit 143D, 143E, cumulative inattentive driving frequent point acquisition unit 144D, 144E, allowable observation direction acquisition unit 145D, 145E, operation information provision unit 151E, and a control unit not shown may be realized by separate processing circuits, or may be realized together by a processing circuit. Similarly, in the occupant monitoring device 300A, the functions of the video acquisition unit 301A, the operation determination unit 302A, and the control unit (not shown) may be realized by separate processing circuits, or may be realized collectively by a processing circuit. Similarly, in server device 600E, the functions of operation information collecting unit 601E and a control unit (not shown) may be realized by separate processing circuits, or may be realized together by a processing circuit.
[0146] Or, in the action evaluation devices 100, 100A, 100B, 100C, 100D, 100E, 100E', 100E'', the action acquisition units 111, 111A, 111B, 111C, 111E, 111E', the position acquisition units 112, 112A, 112B, 112C, 112E, 112E', the model acquisition units 113, 113A, 113B, 113C, 113D, 113E, 113E', 113E', the evaluation value calculation units 114, 114A, 114B, 114C, 114D, 114E, the video acquisition units 121B, 121C, 121E, 121E', and the action determination unit 122B , 122C, 122E, 122E', warning unit 123B, 123C, 123D, 123E, road environment acquisition unit 131C, cumulative inattentive driving judgment unit 141D, 141E, cumulative inattentive driving point acquisition unit 142D, 142E, observation direction acquisition unit 143D, 143E, cumulative inattentive driving frequent point acquisition unit 144D, 144E, allowable observation direction acquisition unit 145D, 145E, operation information provision unit 151E, and some of the functions of a control unit not shown may be realized by processor 10001 and memory 10002, and the remaining functions may be realized by processing circuit 20001. Similarly, in the occupant monitoring device 300A, some of the functions of the image acquisition unit 301A, the operation determination unit 302A, and the control unit (not shown) may be realized by the processor 10001 and the memory 10002, and the remaining functions may be realized by the processing circuit 20001. Similarly, in the server device 600E, some of the functions of the operation information collection unit 601E and the control unit (not shown) may be realized by the processor 10001 and memory 10002, and the remaining functions may be realized by the processing circuit 20001.
[0147] It should be noted that, within the scope of this disclosure, the embodiments may be freely combined, any component of each embodiment may be modified, or any component of each embodiment may be omitted. For example, the action evaluation device according to the fourth embodiment may be configured by combining the components of the action evaluation device according to another embodiment. [Industrial Applicability]
[0148] The present disclosure is capable of performing a more preferable driving evaluation than conventional methods, and is therefore suitable for use in a behavior evaluation device that evaluates the behavior of a driver driving a moving body such as a vehicle. [Explanation of symbols]
[0149] 1A, 1B, 1C, 1D, 1E Motion evaluation system, 100, 100A, 100B, 100C, 100D, 100E (100E-1, 100E-2, 100E-3, , 100E-n (n is an integer of 2 or more)), 100E´ (100E´-1, 100E´-2, 100E´-3, , 100E´-n (n is an integer of 2 or more)), 100E´´ (100E´´-1, 100E´´-2, 100E´´-3, , 100E´´-n (n is an integer of 2 or more)) Motion evaluation device, 111, 111A, 111B, 111C, 111E, 111E´ Action acquisition unit, 112, 112A, 112B, 112C, 112E, 112E´ Position acquisition unit, 113, 113A, 113B, 113C, 113D, 113E, 113E´, 113E´´ Model acquisition unit, 114, 114A, 114B, 114C, 114D, 114E, 114E´, 114E´´ Evaluation value calculation unit, 121B, 121C, 121E, 121E´ Video acquisition unit, 122B, 122C, 122E, 122E´ Action determination unit, 123B, 123C, 123D, 123E Warning unit, 131C Road environment acquisition unit, 141D, 141E Accumulative inattentiveness determination unit, 142D, 142E Accumulated inattentive driving point acquisition unit, 143D, 143E observation direction acquisition unit, 144D, 144E accumulated inattentive driving frequent point acquisition unit, 145D, 145E allowable observation direction acquisition unit (corresponding to "model acquisition unit"), 151E behavior information provision unit, 200A, 200B, 200C, 200D, 200E model behavior database (database), 210C road environment database (database), 300A occupant monitoring device, 301A video acquisition unit, 302A behavior determination unit, 400A, 400B, 400C, 400D, 400E output device, 500B, 500C, 500D, 500E imaging device, 600E server device, 601E Operation information collection unit, 700E (700E-1, 700E-2, 700E-3,...,700E-n (n is an integer equal to or greater than 2)) moving body, 1000 vehicle (moving body), 1100 direction of travel (predicted direction of travel), 1200 normal allowable observation direction, 1300 allowable observation direction at cumulative inattentiveness frequent points, 2000 merging lane, 3000 merging lane, 4000 normal allowable observation direction, 4010 allowable observation direction at cumulative inattentiveness frequent points, 10001 processor, 10002 memory, 10003 input / output interface, 10004 communication circuit, 20001 processing circuit, 20002 memory, 20003 input / output interface, 20004 communication circuit.
Claims
1. a motion acquisition unit that acquires a motion of a driver of the vehicle; a position acquisition unit that acquires the position of the moving object; a road environment acquisition unit that refers to a database that stores in advance position information and road environment information in association with each other, and acquires road environment information corresponding to the position acquired by the position acquisition unit; a model acquisition unit that refers to a database that associates road environment information with an exemplary behavior model that shows exemplary behavior according to the road environment and stores the information in advance, and acquires an exemplary behavior model according to the road environment information acquired by the road environment acquisition unit at the position of the moving object; an evaluation value calculation unit that calculates an evaluation value of the action based on the action acquired by the action acquisition unit and the exemplary behavior model acquired by the model acquisition unit; A motion evaluation device comprising:
2. a motion acquisition unit that acquires a motion of a driver of the vehicle; a position acquisition unit that acquires the position of the moving object; a model acquisition unit that acquires an exemplary behavior model corresponding to the road environment at the position of the mobile object using a database that associates and pre-stores location information with an exemplary behavior model that shows exemplary behavior corresponding to the road environment; an evaluation value calculation unit that calculates an evaluation value of the action based on the action acquired by the action acquisition unit and the exemplary behavior model acquired by the model acquisition unit; Equipped with an accumulated inattentive state determination unit that acquires an accumulated value related to intermittent inattentive state by the occupant and performs an accumulated inattentive state determination by using the accumulated value and a predetermined threshold value; an accumulated inattentive point acquisition unit that acquires accumulated inattentive points based on the position of the moving body when the accumulated inattentive state is determined to be present by the accumulated inattentive state determination unit; an observation direction acquisition unit that acquires an observation direction that is a direction in which the occupant of the moving body is likely to be observing; an accumulative inattentiveness frequent occurrence point acquisition unit that acquires accumulative inattentiveness frequent occurrence points, which are points where accumulative inattentiveness by occupants of each of a plurality of moving bodies frequently occurs; an allowable observation direction acquisition unit that acquires an allowable observation direction, which is a direction in which observation should be allowed for each of the cumulative inattentive looking points; Furthermore, The model acquisition unit When the cumulative inattentive driving point and the cumulative inattentive driving frequent point overlap, and, When the observation direction acquired by the observation direction acquisition unit overlaps with the allowable observation direction, Observing the permissible observation direction at the position of the cumulative inattentive viewing point is acquired as the exemplary behavior model. A behavior evaluation device characterized by:
3. When the cumulative inattentiveness frequent point includes a point included in a merging area on a motorway, the allowable observation direction is a direction based on the position of the occupant and is a direction toward a merging road where the moving object will merge; 3. The action evaluation device according to claim 2.
4. The movement acquired by the movement acquisition unit is a movement of the occupant determined using an image of an interior of the vehicle.
4. The action evaluation device according to claim 1, wherein the action evaluation device is a motion evaluation device.
5. The road environment includes at least one of a motorway, a merging area of a motorway, a vicinity of an intersection, a vicinity of a pedestrian crossing, the presence or absence of a traffic light, the shape of a road, the width of a road, the degree of vehicle congestion, or the degree of pedestrian congestion.
4. The action evaluation device according to claim 1, wherein the action evaluation device is a motion evaluation device.
6. The exemplary behavior model includes at least one of a viewing direction, a cumulative inattentiveness, or a position of a body part.
4. The action evaluation device according to claim 1, wherein the action evaluation device is a motion evaluation device.
7. The observation direction includes at least one of a face direction of the occupant or a line of sight direction of the occupant.
7. The action evaluation device according to claim 6.
8. an image acquisition unit that acquires an image from an imaging device that captures an image of the interior of the moving body; a motion determination unit that determines a motion of the occupant captured in the video; Equipped with The action evaluation device according to any one of claims 1 to 3.
9. the location information and the exemplary behavior model associated with the database are generated based on location information collected from a plurality of moving bodies and movement information including the movement of the occupant, respectively; 4. The action evaluation device according to claim 1, wherein the action evaluation device is a motion evaluation device.
10. an operation information providing unit that outputs the operation information to a server device that generates the database; Furthermore, The action evaluation device according to claim 9 .
11. a warning unit that issues a warning to the occupant using the evaluation value; Equipped with The action evaluation device according to any one of claims 1 to 3.
12. a motion acquisition step in which a motion acquisition unit of the motion evaluation device acquires a motion of a occupant driving the moving object; a position acquisition step in which a position acquisition unit of the action evaluation device acquires a position of the moving object; a road environment acquisition step in which a road environment acquisition unit of the action evaluation device refers to a database in which position information and road environment information are associated and stored in advance, and acquires the road environment information corresponding to the position acquired by the position acquisition unit; a model acquisition step in which a model acquisition unit of the behavior evaluation device refers to a database in which the road environment information and an exemplary behavior model showing exemplary behavior according to the road environment are associated and stored in advance, and acquires an exemplary behavior model according to the road environment information acquired by the road environment acquisition unit at the position of the moving object; an evaluation value calculation step in which an evaluation value calculation unit of the action evaluation device calculates an evaluation value of the action based on the action acquired by the action acquisition unit and the exemplary behavior model; A motion evaluation method comprising:
13. a motion acquisition step in which a motion acquisition unit of the motion evaluation device acquires a motion of a occupant driving the moving object; a position acquisition step in which a position acquisition unit of the action evaluation device acquires a position of the moving object; a model acquisition step in which a model acquisition unit of the action evaluation device acquires an exemplary behavior model corresponding to the road environment at the position of the moving object using a database in which position information and an exemplary behavior model showing exemplary behavior corresponding to the road environment are associated and stored in advance; an evaluation value calculation step in which an evaluation value calculation unit of the action evaluation device calculates an evaluation value of the action based on the action acquired by the action acquisition unit and the exemplary behavior model; Equipped with a cumulative inattentive driving determination step in which a cumulative inattentive driving determination unit of the action evaluation device acquires a cumulative value related to intermittent inattentive driving by the occupant and performs a cumulative inattentive driving determination, which is a determination of whether the occupant is in a cumulative inattentive driving state, using the cumulative value and a predetermined threshold value; a cumulative inattentive state determination unit that determines whether the vehicle is in an inattentive state by a cumulative inattentive state determination unit; and a cumulative inattentive state determination unit that determines whether the vehicle is in an inattentive state by a cumulative inattentive state determination unit. an observation direction acquisition step in which an observation direction acquisition unit of the action evaluation device acquires an observation direction that is a direction in which the occupant of the moving body is likely to be observing; a cumulative inattentive spot acquisition step in which a cumulative inattentive spot acquisition unit of the action evaluation device acquires cumulative inattentive spot locations, which are locations where cumulative inattentive behavior by occupants of each of a plurality of moving bodies frequently occurs; an allowable observation direction acquisition step in which an allowable observation direction acquisition unit of the action evaluation device acquires an allowable observation direction, which is a direction in which observation should be allowed for each of the cumulative inattentive driving points; Furthermore, In the model acquisition step, the model acquisition unit When the cumulative inattentive driving point and the cumulative inattentive driving frequent point overlap, and, When the observation direction acquired by the observation direction acquisition unit overlaps with the allowable observation direction, Observing the permissible observation direction at the position of the cumulative inattentive viewing point is acquired as the exemplary behavior model. A motion evaluation method comprising:
14. Computer a motion acquisition unit that acquires a motion of a driver of the vehicle; a position acquisition unit that acquires the position of the moving object; a road environment acquisition unit that refers to a database that stores in advance position information and road environment information in association with each other, and acquires road environment information corresponding to the position acquired by the position acquisition unit; a model acquisition unit that refers to a database that associates road environment information with an exemplary behavior model that shows exemplary behavior according to the road environment and stores the information in advance, and acquires an exemplary behavior model according to the road environment information acquired by the road environment acquisition unit at the position of the moving object; an evaluation value calculation unit that calculates an evaluation value of the action based on the action acquired by the action acquisition unit and the exemplary behavior model acquired by the model acquisition unit; A motion evaluation device comprising: A program to run as.
15. Computer a motion acquisition unit that acquires a motion of a driver of the vehicle; a position acquisition unit that acquires the position of the moving object; a model acquisition unit that acquires an exemplary behavior model corresponding to the road environment at the position of the mobile object using a database that associates and pre-stores location information with an exemplary behavior model that shows exemplary behavior corresponding to the road environment; an evaluation value calculation unit that calculates an evaluation value of the action based on the action acquired by the action acquisition unit and the exemplary behavior model acquired by the model acquisition unit; Equipped with an accumulated inattentive state determination unit that acquires an accumulated value related to intermittent inattentive state by the occupant and performs an accumulated inattentive state determination by using the accumulated value and a predetermined threshold value; an accumulated inattentive point acquisition unit that acquires accumulated inattentive points based on the position of the moving body when the accumulated inattentive state is determined to be present by the accumulated inattentive state determination unit; an observation direction acquisition unit that acquires an observation direction that is a direction in which the occupant of the moving body is likely to be observing; an accumulative inattentiveness frequent occurrence point acquisition unit that acquires accumulative inattentiveness frequent occurrence points, which are points where accumulative inattentiveness by occupants of each of a plurality of moving bodies frequently occurs; an allowable observation direction acquisition unit that acquires an allowable observation direction, which is a direction in which observation should be allowed for each of the cumulative inattentive looking points; Furthermore, The model acquisition unit When the cumulative inattentive driving point and the cumulative inattentive driving frequent point overlap, and, When the observation direction acquired by the observation direction acquisition unit overlaps with the allowable observation direction, Observing the permissible observation direction at the position of the cumulative inattentive viewing point is acquired as the exemplary behavior model. A behavior evaluation device characterized by: A program to run as.
Citation Information
Patent Citations
Drive evaluation device
JP2008058459A
Driving operation evaluating device
JP2009294250A
Mobile terminal device and driving evaluation system
JP2013003594A
Information processing system, information processing method, and program
JP2018072988A
Capability evaluation system and capability evaluation device
JP2018124439A