Mobile Device Video Tracking for Supplemental Content

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies face challenges in presenting supplemental content related to video content, such as audio, tactile, and olfactory data, in a way that allows individual viewers to access it without disturbing others, especially in multiplayer games and movie watching scenarios, as existing methods often require encoding on the same disc or are incompatible with common devices.

Innovation Solution

A mobile device with integrated video tracking capabilities captures markers in the video content to identify the video and its temporal position, allowing it to access and display supplemental content, including audio, tactile, and olfactory data, independently of the video source, enabling personalized experiences for viewers without cluttering the main display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If supplemental content is overlaid on the main video display, then all viewers can access the information, but the main picture quality is degraded and other viewers are disturbed

Engineering Contradiction:
Improveaccessibility of supplemental contentVSAvoidinterference with main picture
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The system divides the viewing experience into two separate displays: the main video display for the primary content and individual mobile devices for supplemental content. This segmentation allows each viewer to access supplemental information on their personal device without affecting the main picture quality for other viewers.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The solution transitions from a two-dimensional overlay approach to a multi-dimensional approach by utilizing separate physical devices. Supplemental content is delivered through mobile devices held by individual viewers, adding a spatial dimension that eliminates visual interference with the main display.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If non-video content is encoded on the same disc as the movie, then it can be accessed together, but the device complexity and compatibility requirements increase

Engineering Contradiction:
Improveintegration of non-video contentVSAvoidencoding and playback requirements
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

A separate mobile device acts as an intermediary between the video player and the supplemental content. The mobile device independently accesses and processes non-video content from separate sources, eliminating the need for complex encoding on the video disc and reducing compatibility requirements for the primary playback device.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system separates video content and non-video content into different delivery mechanisms. Video content is played through conventional players while supplemental content is delivered through mobile devices, allowing each to be optimized independently without increasing overall system complexity.

Inventive Principle:
Principle #1Segmentation

3Loss of information

If player-specific information is displayed on a shared screen, then all players can see it, but it cannot remain secret from other players

Engineering Contradiction:
Improvevisibility of player-specific dataVSAvoidsecrecy of information
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The system applies local quality by delivering customized supplemental content to each individual's mobile device. Each player sees only their own player-specific information on their personal device, maintaining secrecy while ensuring visibility for the intended recipient.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The viewing experience is segmented by device, with each mobile device receiving and displaying only the supplemental content relevant to its user. This segmentation ensures that player-specific information remains private to each player while still being visible where needed.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS9832441B2Supplemental content on a mobile device
Publication Date: 2017.11.28 SONY INTERACTIVE ENTERTAINMENT LLC
  • US9832441B2 patent drawing
  • US9832441B2 patent drawing
  • US9832441B2 patent drawing

AI summary

Methods, systems, devices, and software are described for providing supplemental content for presentation on a mobile device that identifies a video and a portion within the video. In one embodiment, a system includes a mobile device with an integrated video camera that tracks a display playing a movie. The mobile device automatically identifies the current scene in the movie and then accesses supplemental non-video content related to the identified scene. The accessed supplemental non-video content (e.g., audio, tactile, olfactory data) is then presented to the user at the same time the movie is played.