Smartwatch-Powered VR Grip Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current VR/AR systems lack flexibility in interactive controls, limiting developers' ability to utilize the full range of human abilities, as conventional controllers are inflexible and do not allow for personalized user experiences or integration of external sensors.

Innovation Solution

A low-power, personalized smart grip system that combines a user's smartwatch with inexpensive grips or sheaths, enabling two-way communication and feedback, using sensors like magnetometers and heart rate sensors, and powering mechanical elements via NFC, allowing for customizable and adaptable VR/AR interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If dedicated controllers are used for specific VR/AR systems, then system integration is improved, but developer flexibility and adaptability are reduced

Engineering Contradiction:
Improvesystem integrationVSAvoiddeveloper flexibility
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The controller is divided into two independent parts: a reusable mobile computing device (smartwatch) and a system-specific grip portion. This segmentation allows the computing device to be shared across multiple VR/AR systems while only the grip portion needs to be system-specific, thereby improving developer flexibility without compromising system integration reliability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The mobile computing device serves as a universal platform that can communicate with multiple different VR/AR systems through standardized protocols. This multi-functionality enables a single device to adapt to various systems, enhancing developer flexibility while maintaining reliable integration through the grip portion's system-specific design.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Device complexity

If conventional controllers are used, then device simplicity is maintained, but ability to utilize full range of human abilities is limited

Engineering Contradiction:
Improvecontroller simplicityVSAvoidrange of human abilities utilization
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The mobile computing device functions as a universal controller that can implement multiple input methods (touchscreen, sensors, actuators) to capture a wide range of human abilities. This universal platform maintains operational simplicity while enabling diverse interaction modes including touch, gesture, and physiological sensing.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The mobile computing device acts as an intermediary between the user's natural abilities and the VR/AR system. It translates various human inputs (touch, gesture, physiological signals) into system-compatible commands, thereby expanding the range of detectable human abilities without complicating the overall interaction model.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If separate power sources are integrated into controllers, then operational independence is improved, but device complexity and power consumption increase

Engineering Contradiction:
Improveoperational independenceVSAvoidpower source integration
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The power source is merged with the mobile computing device rather than being separate in the grip portion. Since mobile devices already contain batteries and power management systems, this eliminates the need for separate power sources in the grip, reducing overall device complexity while maintaining operational independence through the mobile device's existing power infrastructure.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The mobile computing device's existing power system serves multiple functions: it powers the grip portion through wireless or wired connection, runs the control software, and manages communication protocols. This multi-functional power management reduces the need for additional dedicated power sources, simplifying the overall system architecture.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Reliability

If dedicated controllers are designed for specific systems, then system optimization is improved, but ease of manufacture and customization are reduced

Engineering Contradiction:
Improvesystem optimizationVSAvoidcustomization flexibility
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

By separating the controller into a universal mobile device and a system-specific grip portion, manufacturing is simplified. The grip portion can be mass-produced for specific systems using optimized designs, while the mobile device is manufactured once and reused. This segmentation improves both system optimization through specialized grips and ease of manufacture through standardized components.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system allows for parameter changes in the grip portion's design (shape, size, magnetic properties) to optimize for specific VR/AR systems, while the mobile computing device remains standardized. This enables customization of critical interface parameters without requiring complete redesign of the entire controller, improving both system optimization and manufacturing efficiency.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution provides developers with the flexibility to create applications that utilize a wide range of human abilities, supports non-traditional user interactions, and eliminates the need for separate power sources, enabling personalized experiences and integration of external sensors, thus overcoming the limitations of conventional controllers.

Implementation Method 1

the least one sensor is a magnetometer configured to sense an activation of the magnetic trigger by the user

Methodology Applied
Scientific EffectMagnetic field sensing: Magnetometer

Implementation Method 2

the mobile computing device communicates with the at least one control component via a near field communication (NFC)

Methodology Applied
Scientific EffectNear field communication: Electromagnetic Induction

Implementation Method 3

the least one sensor is a heart rate sensor and wherein the input migration assembly is an optical fiber optically coupled to the heart rate sensor

Methodology Applied
Scientific EffectOptical coupling: Optical Fibre

Data Source

PatentUS10867448B2Low-power, personalized smart grips for VR/AR interaction
Publication Date: 2020.12.15 FUJIFILM BUSINESS INNOVATION CORP
  • US10867448B2 patent drawing
  • US10867448B2 patent drawing
  • US10867448B2 patent drawing

AI summary

Recent technical advances have expanded the breadth, scope, and affordability of virtual reality (VR) and augmented reality (AR) systems. More people can use VR and AR systems than ever before. However, hand-held physical controls for these systems have not made similar advances yet. For this reason, it remains difficult for developers to create applications that take advantage of the full range of human abilities. In this proposal, we describe a system and method for combining off-the-shelf smartwatches with a set of inexpensive grips or sheaths to control VR/AR systems. With our approach, all of the computation and power for the controller derive from the smartwatch unit, allowing the grips to take almost any form, and allowing developers and designers to integrate a much wider array of interaction styles into their applications.