Multi-Dimensional Media ROI Detection on 2D Screens

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The limitation of two-dimensional screens in rendering multi-dimensional media, such as 360-degree videos, results in an unpleasant user experience due to restricted viewing areas and the need for manual navigation to identify regions of interest.

Innovation Solution

A mechanism is provided for an electronic device to receive and display multi-dimensional media, detect regions of interest (ROI) based on parameters like visual and audio attention models, and automatically display indications for secondary view ports containing these ROIs, enhancing user navigation and reducing manual effort.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multi-dimensional media is rendered on a 2D screen, then the viewing area is limited, but the user experience deteriorates

Engineering Contradiction:
Improveviewing areaVSAvoiduser experience
Core Design Contradiction:
Area of stationary objectVSEase of operation

Solution Approach 1:

The patent segments the multi-dimensional media into multiple view ports, each displaying a different region of interest. This allows the system to present multiple segments of the 360-degree video simultaneously on the 2D screen, effectively expanding the usable viewing area while maintaining good user experience through automatic ROI detection and display.

Inventive Principle:
Principle #1Segmentation

2Ease of operation

If manual swiping/scrolling is required to identify interested segments, then navigation control is improved, but user effort increases

Engineering Contradiction:
Improvenavigation controlVSAvoidmanual navigation time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system performs self-service by automatically detecting regions of interest in the multi-dimensional media and displaying them as view ports without requiring manual user intervention. The automatic ROI detection algorithm identifies interesting segments and presents them to the user, eliminating the need for manual swiping or scrolling while maintaining excellent navigation control.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary action by pre-detecting and marking regions of interest before user viewing. The ROI detection is performed in advance, and the identified segments are prepared as view ports ready for display, so users don't need to manually search through the content.

Inventive Principle:
Principle #10Preliminary action

3Extent of automation

If automatic ROI detection is implemented, then user navigation effort is reduced, but system complexity increases

Engineering Contradiction:
Improveautomatic navigationVSAvoiddetection system complexity
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary component - the ROI detection module - that acts as a mediator between the multi-dimensional media and the display system. This module automatically identifies regions of interest using various parameters (visual attention models, audio attention models, etc.) and translates them into displayable view ports, thereby achieving high automation while managing system complexity through modular design.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10339629B2Method for providing indication in multi-dimensional media in electronic device
Publication Date: 2019.07.02 SAMSUNG ELECTRONICS CO LTD
  • US10339629B2 patent drawing
  • US10339629B2 patent drawing
  • US10339629B2 patent drawing

AI summary

An electronic device and a method for automatically displaying an indication in a multi-dimensional media in the electronic device are provided. The method includes receiving the multi-dimensional media at the electronic device, displaying a first view port of the multi-dimensional media on a screen of the electronic device, detecting at least one region of interest (ROI) in the multi-dimensional media based on plurality of parameters, and displaying an indication indicating at least one second view port of the multi-dimensional media on the screen. The second view port includes at least one ROI.