Gesture-Controlled Screen Division for PIP Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current TV systems require complex remote control operations to access and adjust Picture In Picture (PIP) functions, making it inconvenient for users, and motion recognition through cameras is limited to basic functions like channel and volume control.

Innovation Solution

A display apparatus and method that uses a control unit to divide the screen into multiple sections based on user motion recognized by a depth or color camera, allowing users to control screen divisions and content display through intuitive gestures, enabling more complex operations like video calling and motion-learning modes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If remote control operations are used to access and adjust PIP functions, then the TV system can provide Picture In Picture functionality, but the operation procedure becomes complicated and time-consuming

Engineering Contradiction:
ImprovePIP function capabilityVSAvoidoperation convenience
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent replaces the mechanical remote control system with a gesture-based control system using a depth camera. Users perform gestures (e.g., waving hand, pointing) that are captured by the depth camera and translated into control commands, eliminating the need for physical remote control operations and significantly simplifying the user interface for PIP function access and adjustment.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The depth camera acts as an intermediary between the user and the TV system. It captures user gestures and converts them into control signals, serving as a natural interface that bridges physical user actions and digital control operations, thereby making PIP function access more intuitive and convenient.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If motion recognition through camera is implemented, then basic TV functions can be controlled through gestures, but complex operations like screen division remain limited

Engineering Contradiction:
Improvegesture control capabilityVSAvoidcontrol operation scope
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic screen division based on the direction of user gestures. When a user waves their hand horizontally, the screen divides vertically; when waved vertically, the screen divides horizontally. This dynamic response allows the system to adapt to different user intentions and perform complex operations beyond basic function control, significantly expanding the versatility of gesture-based control.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent segments the control functionality by associating different gesture directions with different screen division modes. Horizontal gestures trigger vertical screen segmentation, while vertical gestures trigger horizontal screen segmentation, enabling sophisticated control operations that go beyond basic TV functions and allow users to create multiple picture-in-picture displays with different orientations.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP2587830B1Display apparatus and display method thereof
Publication Date: 2018.01.24 SAMSUNG ELECTRONICS CO LTD
  • EP2587830B1 patent drawingFigure 1
  • EP2587830B1 patent drawingFigure 2A
  • EP2587830B1 patent drawingFigure 2B

AI summary

A display method is provided, which includes displaying content on a screen; and if a user motion having directivity is recognized, dividing the screen into plural screens according to the directions of the user motion.