Video Frame Panning and Zooming for Small Display Viewability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Portable electronic devices face challenges in providing effective movie viewing due to their small display size, which fails to meet user expectations set by larger screens, leading to decreased acceptability.

Innovation Solution

An electronic device with a controller that identifies movement within video frames and dynamically pans or zooms a sub-area to enhance viewability, focusing on speakers and adjusting display based on movement and voice characteristics to improve content visibility.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Weight of moving object

If movies are displayed on small portable electronic device screens, then device portability is improved, but viewability of video content deteriorates

Engineering Contradiction:
Improvedevice portabilityVSAvoidviewability of video content
Core Design Contradiction:
Weight of moving objectVSIllumination intensity

Solution Approach 1:

The patent applies dynamic pan-and-zoom functionality that automatically adjusts the displayed video frame based on detected movement. The system dynamically changes which portion of the video is displayed and at what zoom level, transforming the static display into a dynamic one that adapts to content changes. This allows the small screen to maintain effective viewability by focusing on relevant areas rather than displaying the entire frame.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes display parameters including the visible portion of the video frame and the zoom level based on movement detection. By adjusting these parameters in real-time, the system optimizes the display to match the viewer's attention and the important elements in the video, thereby improving viewability on small screens without requiring a larger physical display.

Inventive Principle:
Principle #35Parameter changes

2Area of stationary object

If the display shows the entire video frame, then the display area utilization is improved, but the detail visibility of important elements deteriorates

Engineering Contradiction:
Improvedisplay area utilizationVSAvoiddetail visibility of important elements
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent segments the video frame into multiple regions and dynamically selects which segment to display based on detected movement. Instead of showing the entire frame at once, the system divides the frame and focuses on the relevant portion where movement occurs, allowing detailed visibility of important elements while maintaining effective use of the display area.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies different display qualities to different parts of the video frame by focusing the display on the region with detected movement. This local quality enhancement ensures that important elements receive detailed display treatment while the rest of the frame is either excluded or displayed at lower detail, optimizing the overall display effectiveness.

Inventive Principle:
Principle #3Local quality

3Device complexity

If the display is static, then the device complexity is reduced, but the adaptability to movement in video content deteriorates

Engineering Contradiction:
Improvedisplay control complexityVSAvoidadaptability to movement in video content
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent implements self-service functionality where the system automatically detects movement and adjusts the display without user intervention. The movement detection algorithm and pan-zoom control operate autonomously, adapting the display to video content changes based on detected motion patterns. This self-service approach provides adaptability while keeping the user interface simple and the overall system manageable.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system uses feedback from movement detection to automatically adjust the displayed video region and zoom level. By continuously monitoring for movement and responding accordingly, the system creates a closed-loop control mechanism that adapts to content changes. This feedback mechanism provides adaptability while maintaining relatively simple control logic based on motion detection and automatic response.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS7952596B2Electronic devices that pan/zoom displayed sub-area within video frames in response to movement therein
Publication Date: 2011.05.31 SONY GROUP CORP
  • US7952596B2 patent drawing
  • US7952596B2 patent drawing
  • US7952596B2 patent drawing

AI summary

An electronic device can include a display and a controller. The controller identifies a location within a displayable area of video frames which has movement, and controls panning/zooming of a sub-area within the video frames that is displayed on the display in response to the identified location of the movement. Some configurations of the controller detect movement of a person's mouth within the video frames while the person is speaking, identifies the associated location of the person speaking, identifies characteristics of voice in the video frames that is concurrently occurring with the detected movement of the person's mouth, and correlates the identified voice characteristics with the identified location of the person speaking. The controller then detects subsequent occurrence of voice in the video frames having the identified voice characteristics of the person and, responsive thereto, pans a sub-area within the video frames displayed on the display toward the identified location of the person and/or zooms-in to increase size of the person speaking by decreasing size of a sub-area within the video frames at the location of the speaker that is fit to the display.