360-Degree Media Viewing Direction Control via Smartphone Motion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current social networking and television viewing experiences do not allow users to seamlessly control the viewing direction within 360-degree media content, limiting the interactive and immersive aspects of 360-degree videos and images on larger screens.

Innovation Solution

A method and system that enables users to control the viewing direction within 360-degree media content by using a smartphone to stream or cast 360-degree videos to a TV, allowing rotation and tilting to adjust the viewing angle, while using sensors to detect movements and relay instructions to the digital media player or TV for corresponding adjustments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If 360-degree media content is displayed on a TV screen, then the viewing experience becomes more immersive and engaging, but the user loses the ability to easily control the viewing direction

Engineering Contradiction:
Improveimmersive viewing experienceVSAvoidcontrol over viewing direction
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent uses a mobile device as an intermediary controller between the user and the TV display system. The mobile device captures motion data from the user's physical movements and transmits these as directional commands to adjust the viewing perspective of 360-degree media content on the TV, thereby maintaining ease of operation while enabling immersive viewing experience.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If a mobile device is used to control viewing direction, then ease of operation is maintained, but the display area is limited compared to TV screens

Engineering Contradiction:
Improvecontrol capabilityVSAvoiddisplay area
Core Design Contradiction:
Ease of operationVSArea of stationary object

Solution Approach 1:

The system segments the control and display functions into two separate devices: the mobile device handles control operations (detecting user input and generating directional commands), while the TV handles the high-resolution display of 360-degree content. This segmentation allows each device to optimize its specific function, combining the ease of mobile device operation with the large display area of the TV.

Inventive Principle:
Principle #1Segmentation

3Extent of automation

If sensors are used to detect device movements, then automatic viewing direction adjustment is achieved, but device complexity increases

Engineering Contradiction:
Improveautomatic viewing adjustmentVSAvoidsensor integration
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The mobile device uses its built-in motion sensors (accelerometer, gyroscope) to automatically detect the user's hand movements and orientation changes. The system processes this sensor data locally to determine viewing direction adjustments, eliminating the need for additional external sensors or complex processing infrastructure, thereby achieving automation without significantly increasing overall system complexity.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables users to maintain control over the viewing direction within 360-degree media content on a larger screen, enhancing the social networking and television viewing experience by providing immersive and interactive 360-degree video and image viewing capabilities.

Implementation Method 1

A mobile application running on the user's smartphone may cast or wirelessly stream a 360-degree video from a newsfeed of a user to a digital media player or smart TV for display on the TV. While the 360-degree video is being displayed on the TV, the user may utilize another client device to control the viewing direction within the 360-degree video.

Methodology Applied
Scientific EffectAccelerometer: Accelerometer

Data Source

PatentUS10664127B2Connected TV 360-degree media interactions
Publication Date: 2020.05.26 META PLATFORMS INC
  • US10664127B2 patent drawing
  • US10664127B2 patent drawing
  • US10664127B2 patent drawing

AI summary

In particular embodiments, a system includes a processor operable to receive, from a client device, a user selection of 360-degree media content to display on a display device that is separate from the client device. The processor is further operable to provide the selected 360-degree media content for display on the display device. The processor is further operable to receive motion data from the client device, the motion data indicating motion of the client device. The processor is further operable to provide instructions to adjust a viewing direction within the 360-degree media content displayed on the display device according to the received motion data from the client device.