Camera-Based Pause Detection for Audible Input Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Devices often incorrectly interpret pauses in audible input sequences, leading to premature cessation of processing or unintended audio processing, which can result in battery drain and incorrect command execution.

Innovation Solution

A device with a processor and camera that determines pauses in audible input based on facial expressions and camera signals, ceasing and resuming processing accordingly, and uses lip reading software to identify unintelligible audio separators.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the device uses audio pause detection to stop processing, then processing efficiency is improved, but false pause detection causes incorrect command execution

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidcommand execution accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent introduces camera-based facial expression detection as an intermediary mechanism to verify audio pause detection. The camera captures facial images during audio input, and facial expression analysis serves as a mediator to confirm whether the user has actually finished speaking before the device stops processing, thereby reducing false pause detection while maintaining processing efficiency.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If the device continues processing during user silence, then command execution accuracy is improved, but battery drain increases

Engineering Contradiction:
Improvecommand execution accuracyVSAvoidbattery consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent applies preliminary action by detecting facial expressions during the audio input phase to predict when the user will finish speaking. By analyzing facial muscle movements and mouth positions in real-time, the system can anticipate the end of speech before audio silence occurs, allowing it to stop processing earlier and conserve battery while avoiding premature termination.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If the device uses multiple sensors for pause detection, then detection accuracy is improved, but device complexity increases

Engineering Contradiction:
Improvepause detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent makes the camera serve multiple functions: it captures facial expressions for pause detection verification, records user identity information, and provides visual feedback to the user. By making the camera multi-functional rather than adding a dedicated facial recognition sensor, the system improves measurement precision without proportionally increasing device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10269377B2Detecting pause in audible input to device
Publication Date: 2019.04.23 LENOVO SWITZERLAND INTERNATIONAL GMBH
  • US10269377B2 patent drawing
  • US10269377B2 patent drawing
  • US10269377B2 patent drawing

AI summary

A device includes a processor and a memory accessible to the processor and bearing instructions executable by the processor to process an audible input sequence provided by a user of the device, determine that a pause in providing the audible input sequence has occurred at least partially based on a first signal from at least one camera communicating with the device, cease to process the audible input sequence responsive to a determination that the pause has occurred, determine that providing the audible input sequence has resumed based at least partially based on a second signal from the camera, and resume processing of the audible input sequence responsive to a determination that providing the audible input sequence has resumed.