State detection device, state detection method, computer-readable medium, task execution system, and task execution method
The state recognition apparatus improves driver state determination by detecting mirror operation and setting the head position as a reference, enhancing efficiency and accuracy in monitoring driver states.
Patent Information
- Application Number
- DE112022007899
- Authority / Receiving Office
- DE · DE
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2022-10-13
- Publication Date
- 2025-07-31
AI Technical Summary
Existing methods for determining a driver's state in a vehicle, such as using the direction of the face for reference, are inefficient and require improvement.
A state recognition apparatus and method that detects the operation of a vehicle mirror, determines the driver's head position at that time, and sets it as a reference position, utilizing a combination of hardware and software to facilitate efficient state detection.
Provides a more efficient method for determining a driver's state by setting the head position as a reference, enabling accurate monitoring and potential intervention when deviations occur.
Smart Images

Figure 00000000_0000_ABST 
Figure 00000000_0001_ABST
Abstract
Claims
[1] A condition detection device comprising: Detection means for determining that a vehicle mirror is being operated; a determining device for determining a head position of a driver of the vehicle at a time when the operation is performed; and Adjustment means for setting the determined head position as a reference position of a head in the vehicle. [2] The state detection device according to claim 1, wherein the detecting means detects an action of operating the mirror from a first captured image including the mirror to detect that the mirror is operated. [3] The state detection device according to claim 2, wherein the action of operating the mirror is an action of moving the mirror by hand or an action of operating an operation surface of the mirror. [4] The state recognition device according to any one of claims 1 to 3, wherein the determining means acquires a second captured image including a head of the driver and determines the head position of the driver based on coordinates of one or more points related to the head included in the second captured image. [5] The state detection device according to claim 1, wherein the setting means outputs reference information including the detected head position. [6] The state recognition device according to claim 5, wherein the determining means determines the head position of the driver based on a combination of coordinates of each of a plurality of parts of the head, and wherein the setting means determines a posture of the head based on the combination of the coordinates and outputs the reference information including the determined posture of the head. [7] The state recognition device according to claim 5 or 6, wherein the setting means determines identification information of the driver and outputs the reference information including the determined identification information. [8] The state detection device according to claim 5, wherein the setting means has the function of: Outputting the reference information including the driver's head position when the driver's head position is determined within a predetermined period; and Output of reference information including a predetermined head position if the driver's head position is not determined within the predetermined time period. [9] The state recognition device according to claim 8, wherein the predetermined head position is a head position included in the reference information output in the past. [10] A computer-executed state detection method comprising: a detection step of detecting that a mirror of a vehicle is being operated; a determining step for determining a head position of a driver of the vehicle at a time when the operation is performed; and a setting step in which the determined head position is set as the reference position of a head in the vehicle. [11] The state recognition method according to claim 10, wherein the detecting step detects an action of operating the mirror from a first detected image including the mirror to detect that the mirror is operated. [12] The state detection method according to claim 11, wherein the action of operating the mirror is an action of moving the mirror by hand or an action of operating an operation interface of the mirror. [13] The state recognition method according to any one of claims 10 to 12, wherein the determining step acquires a second captured image including a head of the driver and determines the head position of the driver based on coordinates of one or more points related to the head included in the second captured image. [14] The state detection method according to claim 10, wherein the setting step outputs reference information including the detected head position. [15] The state recognition method according to claim 14, wherein the determining step determines the head position of the driver based on a combination of coordinates of each of a plurality of parts of the head, and wherein the setting step determines a posture of the head based on the combination of the coordinates and outputs the reference information including the determined posture of the head. [16] The state recognition method according to claim 14 or 15, wherein the setting step determines identification information of the driver and outputs the reference information including the determined identification information. [17] The state detection method according to claim 14, wherein the setting step comprises: Outputting the reference information including the driver's head position when the driver's head position is determined within a predetermined period; and Outputting reference information including a predetermined head position if the driver's head position is not determined within the predetermined time period. [18] The state recognition method according to claim 17, wherein the predetermined head position is a head position included in the reference information output in the past. [19] A non-transferable computer-readable medium that stores a program that causes a computer to execute: a detection step of determining that a mirror of a vehicle is operated; a determining step for determining a head position of a driver of the vehicle at a time when the operation is performed; and a setting step in which the determined head position is set as the reference position of a head in the vehicle. [20] The computer-readable medium of claim 19, wherein the detecting step detects an action of operating the mirror from a first detected image including the mirror to detect that the mirror is operated. [21] The computer-readable medium of claim 20, wherein the action of operating the mirror is an action of manually moving the mirror or an action of operating an operation interface of the mirror. [22] The computer-readable medium according to any one of claims 19 to 21, wherein the determining step acquires a second captured image including a head of the driver and determines the head position of the driver based on coordinates of one or more points related to the head included in the second captured image. [23] The computer-readable medium of claim 19, wherein the setting step outputs reference information including the determined head position. [24] A computer-readable medium according to claim 23, wherein the determining step determines the driver's head position based on a combination of coordinates of each of a plurality of parts of the head, and wherein the setting step determines a posture of the head based on the combination of the coordinates and outputs the reference information including the determined posture of the head. [25] The computer-readable medium according to claim 23 or 24, wherein the setting step determines identification information of the driver and outputs the reference information including the determined identification information. [26] The computer-readable medium of claim 23, wherein the setting step comprises: Outputting the reference information including the driver's head position when the driver's head position is determined within a predetermined period; and Outputting reference information including a predetermined head position if the driver's head position is not determined within the predetermined time period. [27] The computer-readable medium according to claim 26, wherein the predetermined head position is a head position included in the reference information output in the past. [28] A system for performing tasks that includes: a state detection device and an application device, wherein the condition detection device comprises: Detection means for determining that a vehicle mirror is being operated; a determining device for determining a head position of a driver of the vehicle at a time when the operation is performed; and Setting means for outputting reference information containing the determined head position, and wherein the application device comprises: Recording means for recording the reference information; a task execution device for executing a task using the reference information; and Output means for outputting information about an execution result of the task. [29] The system for performing tasks according to claim 28, wherein the task execution means determines whether a degree of deviation between a current head position of the driver and a head position contained in the reference information satisfies a predetermined condition or not, and wherein the output device generates the output information indicating that a condition of the driver is abnormal when the degree of deviation satisfies the predetermined condition. [30] A method of performing tasks that includes: a condition detection device performs: a detection step of determining that a vehicle mirror is being operated; a determining step for determining a head position of a driver of the vehicle at a time when the operation is performed; and a setting step for outputting reference information including the determined head position; and an application device performs: a capturing step for capturing the reference information; a task execution step for performing a task using the reference information; and an output step for outputting output information about an execution result of the task. [31] Method for performing tasks according to claim 30, wherein the task execution step determines whether a degree of deviation between a current head position of the driver and a head position contained in the reference information satisfies a predetermined condition or not, and wherein the output step generates the output information indicating that a condition of the driver is abnormal when the degree of deviation satisfies the predetermined condition.
Citation Information
Patent Citations
2009-009244