Person-Object Action Duration Measurement for Billing Precision

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing operation analysis systems cannot accurately determine the specific operations carried out by each operator and the duration of these operations in industries such as construction and service, which is crucial for billing purposes.

Innovation Solution

An information processing apparatus and method that detects individuals and objects using sensor information, recognizes actions based on the relevance between the person and object, and measures the duration of these actions, employing techniques like image processing and machine learning to track individuals and identify actions accurately.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If operation analysis system uses recognition of objects and positions to determine operations, then operation type identification is achieved, but the ability to track individual operators and measure operation duration is lost

Engineering Contradiction:
Improveoperation identification accuracyVSAvoidoperator-specific operation duration information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The system segments the operation analysis into three distinct functional components: detection (identifying operators and objects), recognition (determining operation types based on spatial relationships), and measurement (tracking duration for each operator). This segmentation allows each component to specialize in its function, ensuring that operator-specific duration information is captured and preserved throughout the analysis process.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary measurement process that operates between detection and recognition. This intermediary layer specifically tracks the temporal duration of operations for each operator, serving as a mediator that preserves operator-specific information while the recognition process identifies operation types. The measurement process acts as a bridge that maintains the connection between operator identity and operation duration.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If the system focuses on recognizing operations from sensor data, then operation type determination is improved, but tracking individual operator actions and their durations becomes difficult

Engineering Contradiction:
Improveoperation analysis efficiencyVSAvoidtime tracking for individual operations
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The detection process performs preliminary identification of operators and objects before the recognition process determines operation types. By establishing operator identities and object detections in advance, the system creates a foundation that enables subsequent measurement of operation durations for each specific operator, ensuring time tracking is not lost during the recognition phase.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system maintains continuous tracking of operator actions throughout the measurement process. The measurement process continuously monitors and records the duration of operations for each operator as they perform actions, ensuring that time information is captured continuously without interruption. This continuous measurement ensures that operation duration data is preserved while the system efficiently processes operation type recognition.

Inventive Principle:
Principle #20Continuity of useful action

3Reliability

If the system processes sensor information to identify operations, then operation recognition capability is enhanced, but the ability to measure operation duration for each operator is compromised

Engineering Contradiction:
Improveoperation recognition accuracyVSAvoidoperation duration measurement
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The system divides the sensor processing into distinct segments: detection (operator and object identification), recognition (operation type determination), and measurement (duration tracking). Each segment handles specific aspects of the data, ensuring that operation recognition accuracy is maintained while operator-specific duration measurement is precisely captured through the dedicated measurement process.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The measurement process provides feedback about operation duration to the overall system analysis. By continuously monitoring and reporting the time each operator spends on specific operations, the system can adjust and refine its recognition and detection processes to better capture operator-specific patterns, improving both recognition accuracy and duration measurement precision.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20230394882A1Information processing apparatus, information processing method, and computer-readable non-transitory storage medium
Publication Date: 2023.12.07 NEC CORP
  • US20230394882A1 patent drawing
  • US20230394882A1 patent drawing
  • US20230394882A1 patent drawing

AI summary

An information processing apparatus includes at least one processor, and the at least one processor carries out: a detection process of detecting a person and an object based on sensor information; a recognition process of recognizing an action of the person based on a relevance between the person and the object; and a measurement process of measuring, based on a recognition result of the action, a time period for which the person has continued the action.