Action Plan Divergence Detection via Sensor Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques fail to accurately determine deviations from planned operations in real-time, particularly in dynamic environments like construction sites, where delays or advancements occur, making it difficult to assess the divergence from the intended action plan.
Innovation Solution
An information processing apparatus and method that utilize sensor information to detect individuals and objects, recognize actions based on relevance, measure the duration of actions, and generate information indicating the degree of divergence from planned action times, enabling easy identification of deviations from the planned operation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If operation time is measured using image analysis of start and end frames, then operation time can be recorded, but it becomes difficult to ascertain deviation from the action plan
Solution Approach 1:
The patent segments the operation monitoring process into multiple intermediate frames between start and end points. By analyzing intermediate frames and detecting object positions at each segment, the system captures continuous operation progress rather than just start/end states, enabling both accurate time measurement and deviation detection from the action plan.
Solution Approach 2:
The system implements feedback by continuously comparing detected object positions and operation progress against the pre-defined action plan. The operation management apparatus provides real-time feedback on whether the operator is following the planned path and timing, enabling immediate identification of deviations and corrective actions.
2Device complexity
If only start and end images are analyzed, then measurement process is simple, but cannot detect intermediate operation states for plan deviation
Solution Approach 1:
The patent applies preliminary action by pre-defining the action plan with expected object positions, paths, and timing before the operation begins. This preliminary setup enables the system to automatically compare intermediate operation states against the planned trajectory, detecting deviations without requiring complex real-time planning algorithms.
Data Source
AI summary
An information processing apparatus includes at least one processor, and the at least one processor carries out: a detection process of detecting a person and an object based on sensor information; a recognition process of recognizing an action of the person based on a relevance between the person and the object; a measurement process of measuring, based on a recognition result of the action, a time period for which the person has continued the action; and a generation process of generating information indicating a degree of divergence from an action plan based on (i) the time period for which the action has been continued and (ii) a time period which is included in the action plan and for which the action should be continued, the action plan being related to the action of the person which has been recognized.