Parallel Image Recognition and Video Processing for High-Speed Object Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional imaging devices face delays in recognizing fast changes in the ambient environment, particularly when mounted on high-speed moving objects, due to the frame rate limitations of 30 frames per second, which can lead to delayed correspondence and potential issues in travel directions.

Innovation Solution

An imaging device with an image pickup device, a video signal processor, and an image recognition unit that processes the image signal in parallel, allowing for simultaneous video signal creation and image recognition, enabling quicker determination and reducing frame delay by executing these processes concurrently.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If image recognition is performed using conventional sequential processing after video signal creation, then processing completeness is maintained, but recognition speed and responsiveness deteriorate due to frame rate limitations

Engineering Contradiction:
Improveimage recognition speedVSAvoidframe delay
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The image recognition unit performs recognition processing on the raw image signal before the video signal processor creates the final video signal. By executing recognition actions preliminarily/parallel to video processing rather than sequentially after, the system achieves immediate recognition without waiting for video processing completion, thereby reducing frame delay and improving recognition speed

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The processing system is divided into independent parallel processing paths: one path for video signal creation and another path for image recognition. This segmentation allows both processes to operate simultaneously without interfering with each other, eliminating the sequential bottleneck and enabling real-time recognition at high speeds

Inventive Principle:
Principle #1Segmentation

2Productivity

If a single processing unit handles both video signal creation and image recognition, then device complexity is reduced, but processing speed and reliability deteriorate due to resource contention

Engineering Contradiction:
Improveprocessing throughputVSAvoidprocessing architecture
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The processing system is divided into independent parallel processing paths: one path for video signal creation and another path for image recognition. This segmentation allows both processes to operate simultaneously without interfering with each other, eliminating the sequential bottleneck and enabling real-time recognition at high speeds

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The image pickup device outputs a raw image signal that serves dual purposes: it is used as input for both video signal processing and image recognition processing. This multi-functionality of the input signal allows the system to pursue both video output and recognition accuracy simultaneously without requiring separate sensing systems, thereby improving productivity without proportionally increasing device complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10878221B2Imaging device capable of performing high-speed image recognition processing
Publication Date: 2020.12.29 SAMSUNG ELECTRONICS CO LTD
  • US10878221B2 patent drawing
  • US10878221B2 patent drawing
  • US10878221B2 patent drawing

AI summary

An imaging device includes an image pickup device, a video signal processor, and an image recognition unit. The image pickup device outputs an image signal composed of a plurality of frames. The video signal processor performs processing for creating a video signal for display from the image signal. The image recognition unit performs a plurality of pieces of recognition processing for the image signal. The processing of the video signal processor and the processing of the image recognition unit are executed in parallel to each other.