Image Capture Sound Detection for Motion Transition Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image capturing systems face challenges in generating accurate synthetic images representing motion transitions, particularly for short-duration motions like golf swings or baseball batting, as they rely on user manipulation timing, which can be inaccurate for beginners, leading to prolonged processing times and missed opportunities.

Innovation Solution

An image processing apparatus that detects specific sounds associated with the motion, sets a determination range based on user manipulation or timer settings, and adjusts the selection range to ensure accurate generation of synthetic images, using a specific sound detecting section, determination range setting section, and control section to optimize image selection and processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the selection range for generating synthetic images is determined with reference to user manipulation timing, then the system can operate with simple control logic, but the accuracy of motion transition capture deteriorates when users are inexperienced or unable to time their manipulation correctly

Engineering Contradiction:
Improveease of operationVSAvoidaccuracy of motion transition capture
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent replaces the mechanical/manual timing system with an acoustic detection system. Instead of relying on user manipulation timing to determine when to capture images, the system uses a sound detecting section to automatically detect specific sounds (e.g., golf club impact sound) and triggers image capture based on acoustic signals. This substitution eliminates the need for users to manually time their manipulation, thereby maintaining ease of operation while significantly improving the accuracy of motion transition capture.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service by allowing the target object or environment to provide the timing signal automatically. The sound detecting section detects sounds generated during the motion (such as impact sounds in sports), and this self-generated acoustic signal serves as the trigger for image capture. This eliminates the need for external user intervention for timing, making the system both easy to operate and highly accurate in capturing the intended motion transitions.

Inventive Principle:
Principle #25Self-service

2Measurement precision

If the system waits for proper user manipulation to determine the selection range, then it can ensure accurate timing reference, but the processing time increases and opportunities to capture appropriate synthetic images are lost

Engineering Contradiction:
Improvetiming reference accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary action by continuously monitoring for specific sounds before the actual image capture process begins. The sound detecting section is ready to detect acoustic signals at any time, and upon detecting the specific sound, immediately triggers the image capture and processing sequence. This preliminary detection mechanism eliminates the need to wait for user manipulation, thereby maintaining accurate timing reference while significantly reducing processing time and preventing loss of capture opportunities.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces the manual timing reference system with an acoustic detection system. Instead of waiting for user manipulation to establish timing reference, the system uses sound detection to automatically identify the correct timing point. This substitution maintains measurement precision by accurately detecting the acoustic signature of the motion event while eliminating the time loss associated with waiting for and processing manual user input.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If the system uses sound detection to determine the selection range, then the accuracy of motion transition capture improves, but the device complexity increases due to additional detection components

Engineering Contradiction:
Improveaccuracy of motion transition captureVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies universality by integrating the sound detecting section into the existing image capturing apparatus, allowing the device to perform multiple functions: both image capture and acoustic detection. The control section, which already exists to manage image capture operations, is extended to also process sound detection signals and determine selection ranges based on acoustic input. This multi-functional approach improves measurement precision while minimizing the increase in device complexity by utilizing existing structural components for multiple purposes.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system merges the sound detection function with the image capture function in a single integrated apparatus. The sound detecting section is combined with the image capturing section and control section, creating a unified system where acoustic signals and visual data work together to determine the selection range for synthetic image generation. This merging approach improves accuracy by combining multiple sensing modalities while avoiding the complexity of completely separate systems by integrating them into a single coordinated apparatus.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for the appropriate generation of synthetic images representing specific motions, reducing processing time and ensuring accurate capture of motion transitions, even for inexperienced users, by using sound detection and adjusted selection ranges.

Implementation Method 1

a specific sound detecting section which detects a specific sound generated during motion of a specific motion conducted by a target object

Methodology Applied
Scientific EffectSound detection: Sound

Data Source

PatentUS8896626B2Image capturing apparatus, image processing apparatus, control method thereof and program
Publication Date: 2014.11.25 SONY GROUP CORP
  • US8896626B2 patent drawing
  • US8896626B2 patent drawing
  • US8896626B2 patent drawing

AI summary

An image processing apparatus includes: a specific sound detecting section which detects a specific sound generated during motion of a specific motion conducted by a target object included in an image group including a plurality of images which continues in a time-series manner; a synthetic image generating section which generates a synthetic image representing transitions of the specific motion; a determination range setting section which sets, as a determination range, a range in the time axis for determination on the generation of the synthetic image on the basis of a user manipulation; and a control section which controls the synthetic image generating section to generate the synthetic image in a case where the specific sound is detected in the set determination range, and not to generate the synthetic image in a case where the specific sound is not detected in the set determination range.