AR Electronic Device Object Grouping via Spatial Gestures

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional augmented reality functions in electronic devices are limited in providing a wide user experience due to the complexity of interacting with both real and virtual objects in a 3D environment, requiring multiple handling procedures for object selection and function execution.

Innovation Solution

An electronic device equipped with a display, camera module, and processor, capable of displaying real and virtual objects, receiving user inputs for object selection and grouping, analyzing information about grouped objects, and offering functions extracted based on this analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional 2D interactive scheme is used in augmented reality environment, then object selection and function execution can be performed, but the complexity of 3D environment increases and many handling procedures are needed

Engineering Contradiction:
Improveobject selection and function executionVSAvoidhandling procedures
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent transitions from 2D interaction schemes to 3D spatial interaction by enabling users to select multiple objects through natural hand gestures in three-dimensional space. The system detects hand positions and movements in the AR environment, allowing users to grasp, lift, and manipulate virtual objects as if they were physical, thereby reducing the number of handling procedures while maintaining ease of operation.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system automatically analyzes information about grouped objects and extracts relevant functions without requiring users to navigate complex menus or perform multiple selection steps. Once objects are grouped through natural gestures, the system autonomously processes the grouped objects and presents relevant functions, reducing manual intervention and simplifying the interaction workflow.

Inventive Principle:
Principle #25Self-service

2Adaptability or versatility

If complex selection menu is used for selecting multiple objects, then all necessary functions can be accessed, but the number of handling procedures increases

Engineering Contradiction:
Improvefunction selectionVSAvoidhandling procedures
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent extracts the essential interaction elements from complex 2D menus and presents only the most relevant functions for the grouped objects. Instead of requiring users to navigate through comprehensive selection menus, the system identifies and extracts key functions based on the grouped objects' characteristics, presenting them in a simplified manner that reduces handling time while maintaining access to necessary functionality.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system performs preliminary analysis of grouped objects to pre-identify relevant functions before user interaction. By analyzing object properties, relationships, and contextual information in advance, the system prepares and presents only the most relevant functions, eliminating the need for users to search through extensive menu options and reducing the time required for function selection.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3905016B1Electronic device for performing various functions in augmented reality environment, and operation method for same
Publication Date: 2025.06.18 SAMSUNG ELECTRONICS CO LTD
  • EP3905016B1 patent drawingFigure 1
  • EP3905016B1 patent drawingFigure 2
  • EP3905016B1 patent drawingFigure 3

AI summary

An electronic device according to various embodiments includes a display, a camera module, and at least one processor, wherein the at least one processor may be set to: display one or more real objects and one or more virtual objects through the display; receive a first input for selecting any one object from among the objects, and then receive a second input related to the picked object; analyze information about grouped objects when a third input is received for grouping the objects selected by repeating the first input and the second input; and provide a function extracted on the basis of analyzing the information about the grouped objects, when a fourth input related to the grouped objects is received.