360-Degree Image Object Tracking and Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users of electronic devices that display 360-degree omni-directional images face difficulties in recognizing events occurring outside their current field of view, requiring them to search manually for events happening in other parts of the image, which is cumbersome.

Innovation Solution

The electronic device includes a display, memory, and processor that allows users to designate objects within a partial image, store associated information, and switch the displayed image to include the designated object upon user input, providing notifications for events related to the object, thus enabling easier recognition of events occurring elsewhere in the image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a 360-degree omni-directional image is displayed to provide a wider field of view, then the user can view images captured in multiple directions, but the user cannot easily recognize events occurring outside the currently viewed portion and must manually search for them

Engineering Contradiction:
Improvefield of viewVSAvoidease of recognizing events
Core Design Contradiction:
Area of stationary objectVSEase of operation

Solution Approach 1:

The 360-degree image is divided into multiple partial images corresponding to different directions. The display shows only a selected partial image at a time, segmenting the overwhelming full view into manageable portions. This allows the user to focus on one direction while the system manages the complete omnidirectional content in the background.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A processor acts as an intermediary between the full 360-degree image data and the user's view. It selects and displays specific partial images based on user input or event detection, mediating the information flow so users don't need to manually search through all directions. The processor also generates indicators for events in non-viewed areas, serving as a mediator that alerts users to important occurrences outside their current field of view.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If the entire 360-degree image is displayed at once, then all events are visible, but the interface becomes complex and the user cannot focus on specific areas of interest

Engineering Contradiction:
Improvevisibility of eventsVSAvoidinterface complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system extracts and highlights only the relevant information (events) from the full 360-degree image data. Instead of displaying the entire complex scene, it selectively presents partial images and generates indicators for specific events, extracting the essential information while discarding unnecessary visual complexity.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system performs preliminary analysis of the 360-degree image to detect events in non-viewed areas before the user needs to see them. Indicators are generated in advance for events occurring in other directions, so when users switch views, they immediately see relevant event indicators without having to manually search or wait for events to occur in their current view.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If manual searching is required to find events in other parts of the image, then the user can explore all areas, but the time and effort required increases significantly

Engineering Contradiction:
Improveexploration capabilityVSAvoidtime to find events
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system provides feedback to users about events occurring in non-viewed areas through indicators. When an event is detected in a direction not currently being viewed, the system generates an indicator that feedbacks this information to the user, enabling them to quickly navigate to the relevant area without manual searching. This feedback mechanism preserves exploration capability while dramatically reducing the time needed to discover events.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3469787B1Electronic device and computer-readable recording medium for displaying images
Publication Date: 2023.08.02 SAMSUNG ELECTRONICS CO LTD
  • EP3469787B1 patent drawingFigure 1
  • EP3469787B1 patent drawingFigure 2
  • EP3469787B1 patent drawingFigure 3

AI summary

An electronic device for displaying images is provided. The electronic device includes a display displaying a first partial image of an image, a memory, and a processor. The processor is configured to designate a first object included in the first partial image if a first input for designating the first object is received, store first information associated with the first object in the memory, display, on the display, a first graphical object associated with the first object if the image displayed on the display is switched from the first partial image to a second partial image of the image, and switch the image displayed on the display from the second partial image to a third partial image of the image including the first object using the first information if a second input for selecting the first graphical object is received.