Playback Control via Lip Movement Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for controlling playback of content on display devices, such as smart televisions, require users to manually pause and resume playback using remote controls, which can be inconvenient and result in missed scenes when users engage in conversations or respond to notifications.
Innovation Solution
An electronic device equipped with an imaging apparatus that captures images of the user and their environment, allowing the device to detect lip movements, postures, and other activities to automatically pause and resume playback based on determined interactions, such as conversations or notifications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If manual pause control using remote control is used, then playback can be paused, but user convenience deteriorates when users need to locate and operate the remote control during interruptions
Solution Approach 1:
The system automatically detects user interruptions through the imaging apparatus and autonomously pauses playback without requiring manual remote control operation. The device serves itself by monitoring user behavior and making playback control decisions based on detected activities such as conversations or notifications.
Solution Approach 2:
The patent replaces the mechanical remote control system with an automated image-based detection system. Instead of requiring physical interaction with a remote control, the system uses an imaging apparatus to detect user actions and automatically controls playback, substituting mechanical operation with optical sensing and automated processing.
2Reliability
If manual pause and resume operations are required, then playback can be controlled, but time is lost when users repeatedly operate the remote control
Solution Approach 1:
The system performs preliminary detection of user interruptions before they occur. By continuously monitoring user activities through the imaging apparatus, the system is ready to automatically pause playback at the appropriate moment, eliminating the need for users to spend time locating and operating the remote control.
Solution Approach 2:
The system establishes a feedback loop where the imaging apparatus continuously monitors user behavior, detects interruptions, and automatically adjusts playback accordingly. This closed-loop system eliminates manual operation time by using real-time feedback from image analysis to control playback automatically.
3Adaptability or versatility
If users engage in conversations or respond to notifications during playback, then social interaction is enabled, but scenes of content are missed
Solution Approach 1:
The system takes preliminary action by automatically pausing playback before the user engages in an interruption activity. By detecting the start of a conversation or notification response and pausing immediately, the system prevents the user from missing content scenes while still allowing them to engage in necessary social interactions.
Solution Approach 2:
The system uses feedback from the imaging apparatus to detect when a user is engaged in an interruption activity and automatically pauses playback. This real-time feedback mechanism ensures that playback is suspended during conversations or notifications, preventing content loss while maintaining social interaction capability.
Data Source
AI summary
An electronic device is provided for control of playback based on image capture. The electronic device includes circuitry. The circuitry is communicatively coupled to an imaging apparatus and a rendering device that plays content. The circuitry acquires, from the imaging apparatus, one or more images of a user of the electronic device and a physical space associated with the user. The circuitry detects a lip movement of the user based on the acquired one or more images. The circuitry determines whether the user is in a conversation based on the detected lip movement of the user. The circuitry controls playback of the content on the rendering device based on the determination.