Smart Camera Data Scheduling for Bandwidth-Limited Defect Monitoring

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In production device management systems, image data from smart cameras is large and irreversibly compressed, making it difficult to adjust image processing parameters and causing communication bottlenecks, which hampers the identification of defects and abnormalities in production systems.

Innovation Solution

An image capturing apparatus that captures images, performs image processing, and accumulates data, transmitting processing results during image capturing periods and storing raw image data during suspension periods, allowing for efficient communication and parameter adjustment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If image data is transmitted continuously during image capturing period, then real-time monitoring is improved, but network bandwidth is consumed excessively

Engineering Contradiction:
Improvereal-time monitoring speedVSAvoidnetwork bandwidth consumption
Core Design Contradiction:
SpeedVSQuantity of substance

Solution Approach 1:

The patent segments the image data transmission into two distinct parts: compressed feature values transmitted during the image capturing period for real-time monitoring, and original uncompressed image data transmitted during the image capturing suspension period for detailed analysis. This segmentation allows the system to balance real-time monitoring needs with bandwidth conservation, as the compressed feature values occupy minimal bandwidth while the full image data is transmitted only when the network is less utilized.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements periodic action by alternating between two transmission modes based on the image capturing cycle: during the image capturing period, only compressed feature values are transmitted; during the image capturing suspension period, the original image data is transmitted. This periodic switching of transmission content aligns with the operational cycle of the image capturing apparatus, ensuring real-time monitoring capability while optimizing network bandwidth utilization.

Inventive Principle:
Principle #19Periodic action

2Productivity

If image data is compressed for transmission, then communication efficiency is improved, but image processing parameter adjustment becomes difficult

Engineering Contradiction:
Improvecommunication efficiencyVSAvoidimage processing parameter adjustment capability
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent segments the transmitted data into two categories: compressed feature values for efficient communication during active capturing, and original uncompressed image data for comprehensive analysis during suspension periods. The original image data retains all processing parameters and quality information, enabling full adaptability for adjusting image processing parameters when needed, while the compressed data provides rapid communication capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary compression of image data to extract feature values during the image capturing period, enabling efficient real-time transmission. The original uncompressed image data is preserved and transmitted during the suspension period, serving as a preliminary prepared resource that contains all necessary information for parameter adjustment and detailed defect analysis without requiring re-capturing.

Inventive Principle:
Principle #10Preliminary action

3Quantity of substance

If only processed feature values are transmitted, then network load is reduced, but defect analysis capability is insufficient

Engineering Contradiction:
Improvenetwork data volumeVSAvoiddefect analysis precision
Core Design Contradiction:
Quantity of substanceVSMeasurement precision

Solution Approach 1:

The patent segments the data transmission strategy into two complementary streams: compressed feature values transmitted during image capturing for real-time monitoring with minimal network load, and original uncompressed image data transmitted during image capturing suspension periods for comprehensive defect analysis. This segmentation ensures that both real-time monitoring efficiency and detailed defect analysis precision are maintained through appropriate data transmission at different operational phases.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements periodic transmission of original image data during image capturing suspension periods, complementing the continuous transmission of compressed feature values. This periodic full-data transmission ensures that detailed defect analysis capability is maintained while minimizing overall network load, as the high-volume original data is transmitted only when the image capturing apparatus is not actively capturing, utilizing otherwise idle network capacity.

Inventive Principle:
Principle #19Periodic action

4Measurement precision

If original image data is transmitted continuously, then analysis accuracy is improved, but communication cost increases

Engineering Contradiction:
Improveanalysis accuracyVSAvoidcommunication energy cost
Core Design Contradiction:
Measurement precisionVSLoss of energy

Solution Approach 1:

The patent segments the transmission of original image data to occur only during image capturing suspension periods, rather than continuously. During active image capturing, only compressed feature values are transmitted. This segmentation maintains analysis accuracy by ensuring original image data is available when needed, while dramatically reducing communication energy cost by limiting full-data transmission to periods when the image capturing apparatus is idle.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements periodic transmission of original image data synchronized with the image capturing suspension periods. This periodic action ensures that high-accuracy analysis data is transmitted at regular intervals when the system is not actively capturing images, maintaining measurement precision while minimizing communication energy consumption by avoiding continuous high-bandwidth transmission.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS11317019B2Image capturing apparatus, system, and method
Publication Date: 2022.04.26 CANON KK
  • US11317019B2 patent drawing
  • US11317019B2 patent drawing
  • US11317019B2 patent drawing

AI summary

An image capturing apparatus includes an image capturing portion, a controller to perform image processing to obtain a feature value from image data, and a storage device to accumulate the image data. In an image capturing period of capturing an image of the target object by the image capturing portion, the controller transmits a result of the image processing to a data management server while accumulating the captured image data the storage device, while in an image capturing suspension period of not performing image capturing, the controller transmits the image data accumulated in the storage device to the data management server.