Hands-Free Image Effect Triggering via Speech Semantics

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing technologies require manual user intervention to select and apply image effects, which is inconvenient, especially when the user's hands are not available.

Innovation Solution

A method and apparatus that acquire an original image, collect and recognize speech semantics in the surroundings to trigger a special effect process, processing the image accordingly to generate and display a special image effect, allowing for hands-free operation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual selection of image effects is used, then user control over image processing is achieved, but user convenience deteriorates when hands are not available

Engineering Contradiction:
Improveuser convenienceVSAvoidautomatic effect triggering
Core Design Contradiction:
Ease of operationVSExtent of automation

Solution Approach 1:

The patent replaces manual mechanical interaction (touching the screen to select effects) with acoustic field interaction (voice commands). The microphone captures speech signals, which are then processed through speech recognition to trigger image effects automatically, eliminating the need for manual hand operations while maintaining user control.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces speech recognition technology as an intermediary between the user and the image processing system. Instead of direct manual selection, the user's voice is captured and interpreted by the speech recognition module, which then translates intent into effect selection, providing a natural hands-free interface.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If speech recognition is added to enable hands-free operation, then user convenience is improved, but device complexity increases

Engineering Contradiction:
Improvehands-free operation capabilityVSAvoidsystem structure
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent integrates speech recognition functionality into the existing mobile terminal, making the device multi-functional. The same processing unit that handles image processing also handles speech recognition and semantic analysis, reducing the need for separate dedicated hardware components and minimizing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines multiple functions into unified modules: the speech recognition module integrates speech signal processing, semantic understanding, and effect triggering control. This consolidation reduces the number of separate components and simplifies the overall system architecture while enabling hands-free operation.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11595591B2Method and apparatus for triggering special image effects and hardware device
Publication Date: 2023.02.28 DOUYIN VISION CO LTD
  • US11595591B2 patent drawing
  • US11595591B2 patent drawing
  • US11595591B2 patent drawing

AI summary

The disclosure discloses a method and apparatus for triggering special image effects and a hardware device. The method for triggering special image effects comprises: acquiring an original image from an image source and displaying the original image on a display device; collecting speech in an environment and recognizing the semantics of said speech; triggering a special effects process in response to recognizing predetermined semantics of said speech, the predetermined semantics being preset semantics associated with one or more special effects process; and according to the triggered special effects process, processing the original image to form and display special image effects. According to the method for triggering special image effects in the embodiment of the present disclosure, the image processing effect is triggered by recognition of speech semantics, thereby solving the technical problem in the prior art of inflexible image effect triggering being unable to free up a user's hands.