Wearable Image Processing Reducing Communication Traffic via Action Recognition

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing technologies face challenges in reducing communication traffic when transmitting photographed images to external devices, leading to increased data transmission and undesirable image quality, particularly in wearable devices with limited battery capacity and prone to blurring.

Innovation Solution

An information processing apparatus with an action recognition unit, image processing unit, and transmission control unit that adapts photographing timing and image processing based on user actions, reducing unnecessary image transmission and optimizing image quality by recognizing user states through sensors and controlling the timing and resolution of image capture and transmission.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If all photographed images are transmitted to external devices, then complete image data is provided for recognition, but communication traffic increases significantly

Engineering Contradiction:

Improveimage data completenessVSAvoidcommunication traffic

Core Design Contradiction:

Loss of informationVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential information (action state) from the photographed image using image processing, and transmits only this extracted information to external devices instead of transmitting the entire image. This resolves the contradiction by providing necessary recognition data while minimizing communication traffic.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent creates a simplified representation (copy) of the image data by converting it into action state information. This copied form contains the essential meaning needed for recognition purposes while occupying minimal transmission bandwidth, thus reducing communication traffic while preserving information completeness.

Inventive Principle:

Principle #26Copying

2Quantity of substance

If image resolution is reduced to decrease data amount, then communication traffic is reduced, but image quality deteriorates

Engineering Contradiction:

Improvedata amountVSAvoidimage quality

Core Design Contradiction:

Quantity of substanceVSManufacturing precision

Solution Approach 1:

The patent changes the parameter of image data from full-resolution pixels to extracted action state descriptors. This parameter transformation reduces data amount significantly while maintaining the quality needed for recognition purposes, as the action state information captures the essential features without requiring high-resolution image data.

Inventive Principle:

Principle #35Parameter changes

3Measurement precision

If continuous photographing is performed to capture all actions, then action recognition accuracy is improved, but power consumption increases

Engineering Contradiction:

Improveaction recognition accuracyVSAvoidpower consumption

Core Design Contradiction:

Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent implements a system where the photographing unit operates autonomously based on detected action states. When an action state is recognized, the system automatically triggers photographing without requiring continuous operation. This self-service mechanism ensures accurate action capture while minimizing power consumption by activating the photographing unit only when necessary.

Inventive Principle:

Principle #25Self-service

4Loss of information

If high-resolution images are transmitted to reduce information loss, then image quality is maintained, but communication traffic increases

Engineering Contradiction:

Improveimage information preservationVSAvoidcommunication traffic

Core Design Contradiction:

Loss of informationVSQuantity of substance

Solution Approach 1:

The patent extracts only the critical action state information from the image data, removing all unnecessary pixel information. This extraction process preserves the essential information needed for recognition while eliminating redundant data, thereby maintaining information preservation while minimizing communication traffic.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by transmitting only the portion of image information that is necessary for action recognition (the extracted action state). This partial transmission approach avoids the excess of transmitting complete high-resolution images while ensuring that sufficient information is provided for accurate recognition.

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS10609279B2Image processing apparatus and information processing method for reducing a captured image based on an action state, transmitting the image depending on blur, and displaying related information

Publication Date: 2020.03.31 SONY GROUP CORP

AI summary

There is provided an information processing apparatus including an action recognition unit that recognizes an action state of a user based on a measurement result obtained by a sensor carried by the user, an image processing unit that performs a process regarding an amount of information on an image photographed by a photographing unit based on an action state of the user recognized by the action recognition unit during photographing by the photographing unit carried by the user, and a transmission control unit that causes the image processed by the image processing unit to be transmitted to an image processing device used to perform image recognition.