Operation Sequence Identification Using Sensor Fusion

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods for identifying operation sequences in practical sites, such as kitchens, require manual intervention and are inefficient, especially in calculating operation time periods, as they rely on instruments without automation for identifying sequences performed by employees.

Innovation Solution

An operation sequence identification system that uses a camera and vicinity sensors to acquire and analyze video image data and surrounding environment data, employing machine learning to precisely identify the sequence of individual operations and their contents, thereby automating the process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual intervention is used to identify operation sequences, then flexibility and adaptability are maintained, but productivity and efficiency deteriorate due to time-consuming manual analysis

Engineering Contradiction:

Improveoperation sequence identification efficiencyVSAvoidautomation level

Core Design Contradiction:

ProductivityVSExtent of automation

Solution Approach 1:

The patent replaces manual mechanical analysis with an automated sensing and processing system. Sensors detect operation data, and a processor automatically identifies operation sequences and calculates time periods, substituting human manual intervention with electronic detection and computational analysis.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service operation sequence identification by automatically detecting, analyzing, and processing operation data without external manual intervention. The processor autonomously identifies sequences and calculates metrics from sensor data, making the system self-sufficient in analyzing its own operational data.

Inventive Principle:

Principle #25Self-service

2Measurement precision

If automated sensing systems are deployed to identify operation sequences, then productivity and measurement precision improve, but device complexity increases due to multiple sensors and processing requirements

Engineering Contradiction:

Improveoperation sequence identification precisionVSAvoidsensing system complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The sensing system is designed with multi-functionality where sensors detect multiple types of operation data and the processor performs various analysis functions including sequence identification and time period calculation. This universal approach consolidates multiple functions into a unified system, managing complexity through integration.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The operation sequence identification is segmented into distinct processing stages: data acquisition by sensors, sequence identification by the processor, and time period calculation. This segmentation allows each component to specialize in specific tasks, improving precision while managing overall system complexity through modular functional division.

Inventive Principle:

Principle #1Segmentation

3Loss of time

If existing manual methods are used for calculating operation time periods, then device complexity remains low, but loss of time increases due to inefficient manual calculation processes

Engineering Contradiction:

Improveoperation time period calculation timeVSAvoidautomation level

Core Design Contradiction:

Loss of timeVSExtent of automation

Solution Approach 1:

Manual time period calculation is replaced with automated electronic processing. The processor automatically calculates operation time periods based on sensor data, substituting manual arithmetic operations with electronic computational processes that occur instantaneously.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The automated system enables continuous operation sequence identification and time period calculation without interruption. Sensors continuously detect data and the processor continuously analyzes sequences, eliminating the discontinuous nature of manual analysis and ensuring uninterrupted measurement.

Inventive Principle:

Principle #20Continuity of useful action

Data Source

PatentUS20240346426A1Operation sequence identification device, operation sequence identification system, operation sequence identification method, and non-transitory computer-readable recording medium

Publication Date: 2024.10.17 PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD

AI summary

The operation sequence identification device identifies an operation sequence including a series of individual operations. The operation sequence identification device includes an communication circuit that acquires first sensing information indicating the position of a moving object in an operation area in chronological order and plural pieces of second sensing information indicating surrounding environment states at different positions in the operation area in chronological order, and a control circuit that specifies the order of the series of individual operations based on the first sensing information and that identifies the operation content of each of the series of individual operations based on the second sensing information.