Gesture-Based Virtual Product Interaction for Real-Time AR Shopping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional online sales platforms for home appliances lack the ability to provide users with a realistic virtual interaction experience, as existing VR/AR technologies are inefficient and do not effectively integrate virtual products into virtual environments, making it difficult for users to intuitively interact with and understand the features of home appliances.
Innovation Solution
A system and method that utilize user devices with cameras and processors to render real-time 3D virtual environments, allowing users to interact with virtual products using hand gestures, providing virtual aids and templates to facilitate product assembly, troubleshooting, and virtual shopping experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional VR/AR technologies are used to create virtual product experiences, then users can view virtual products in a virtual environment, but the interaction is inefficient and not intuitive
Solution Approach 1:
The patent replaces conventional mechanical interaction methods (buttons, switches, physical controls) with gesture-based interaction. Users perform hand gestures in the air to interact with virtual appliances, and the system translates these gestures into corresponding operations on virtual controls, replacing traditional mechanical interfaces with optical and computational systems.
Solution Approach 2:
The patent introduces gesture recognition technology as an intermediary between the user and the virtual product interface. The system captures hand gestures via camera, translates them into digital commands, and executes corresponding actions on the virtual appliance, creating a natural mediation layer that bridges physical movement and digital interaction.
2Adaptability or versatility
If conventional online sales platforms are used, then product information can be displayed, but users cannot have virtual interaction experience with home appliances
Solution Approach 1:
The patent merges multiple functionalities into a single integrated system: the online sales platform, the virtual reality environment, the gesture recognition system, and the product interaction engine are combined into one unified application. This allows users to browse products, view them in virtual environments, and interact with them using gestures all within the same platform.
Solution Approach 2:
The patent creates a multi-functional system that serves multiple purposes: it acts as an online store, a virtual reality viewer, a gesture recognition interface, and a product demonstration platform simultaneously. The same virtual environment supports both product visualization and interactive demonstration capabilities.
3Stability of the object's composition
If conventional VR/AR technologies are used, then virtual products can be displayed, but they are not well integrated into the virtual environment
Solution Approach 1:
The patent creates a unified virtual environment where the boundary between virtual and physical spaces is blurred. Virtual appliances are rendered with realistic lighting, shadows, and spatial relationships that match the physical environment captured by the camera, making them appear as if they naturally belong in the space rather than being superimposed overlays.
Data Source
AI summary
A method for providing real-time virtual experience of user interactions includes rendering a 3-D virtual environment based on one or more images of a physical environment including one or more representations of physical objects, receiving a user input to place a first preset virtual object at a space in the 3-D virtual environment, rendering the first preset virtual object, detecting, by the one or more cameras, a user's hand gesture interacting with the first preset virtual object, translating the user's hand gesture into an interaction with the first preset virtual object, identifying a first part of the first preset virtual object that is subject to the interaction with the first preset virtual object, concurrently displaying in real time on the display a representation of the user's hand gesture and a movement of the first part of the first preset virtual object caused by the interaction in the 3-D virtual environment.