Virtual Effects Application in Augmented Reality via Segmentation and Motion Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for interacting with augmented reality environments are cumbersome and inefficient, leading to increased energy usage and limited user interaction, particularly in battery-operated devices.
Innovation Solution
The development of computer systems with advanced methods and interfaces that intelligently detect and respond to physical objects and environments, applying virtual effects based on segmentation and motion tracking to enhance user interaction and reduce energy consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional methods are used to add virtual effects in augmented reality environments, then user interaction is provided, but the interaction is cumbersome and inefficient, and energy usage increases
Solution Approach 1:
The system automatically detects physical objects, segments them from the background, and tracks their movement without requiring manual user input. The virtual effects are applied automatically based on the detected object's characteristics and motion, allowing the system to serve itself rather than requiring continuous user commands
Solution Approach 2:
The system performs object detection, segmentation, and motion tracking in advance before applying virtual effects. By preparing the object data and determining effect parameters beforehand, the system reduces the computational burden during effect application and eliminates the need for cumbersome real-time user interaction
2Productivity
If conventional methods are used to display virtual effects, then virtual effects are produced, but the process takes longer than necessary, wasting energy and time
Solution Approach 1:
The system segments physical objects from the background and tracks their motion in advance, preparing all necessary data before virtual effect application. This preliminary processing enables rapid effect application without lengthy real-time computation, significantly improving productivity while reducing energy consumption
Solution Approach 2:
The system divides the visual field into segmented objects and background regions, allowing independent processing of each object. This segmentation enables parallel processing of multiple objects and their respective virtual effects, accelerating the overall application speed and reducing the time and energy required
3Adaptability or versatility
If conventional methods provide limited interactions with surfaces and objects, then some interaction is possible, but the extent and nature of interaction are restricted
Solution Approach 1:
The system applies virtual effects to multiple types of physical objects (people, animals, inanimate objects) using a unified detection and tracking framework. This multi-functional approach enables diverse interactions with various surfaces and objects without requiring separate specialized interfaces for each object type, enhancing versatility while maintaining interface simplicity
Data Source
AI summary
A computer system, in response to detecting the occurrence of a first event, applies a first virtual effect to the representation of the field of view of the one or more cameras, including: applying the first virtual effect with a first set of values for a first characteristic of the first virtual effect, wherein the first set of values for the first characteristic of the first virtual effect are selected in accordance with segmentation of the view of the first physical object from the view of the portion of the first physical environment; and applying the first virtual effect with a second set of values for a second characteristic of the first virtual effect, wherein the second set of values for the second characteristic of the first virtual effect are selected in accordance with tracking of movement of one or more portions of the first physical object.