Virtual Artifacts on Mobile Devices for Tactile Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

As mobile devices shrink in size, they often eliminate physical controls, leading to a lack of tactile feedback for users interacting with virtual interfaces, which can be inconvenient for eyes-free operation and may not provide the same user experience as physical controls.

Innovation Solution

Implementing virtual artifacts on mobile devices using a combination of motion and touch inputs, leveraging touchscreen and motion sensing technologies to mimic physical controls like buttons, dials, sliders, and switches, and providing feedback through visual, auditory, and haptic means to enhance user interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Volume of moving object

If mobile devices eliminate physical controls to shrink in size, then device compactness is improved, but tactile feedback for users is lost

Engineering Contradiction:
Improvedevice sizeVSAvoidtactile feedback
Core Design Contradiction:
Volume of moving objectVSEase of operation

Solution Approach 1:

The patent replaces physical mechanical controls with virtual controls on a touchscreen display. Motion sensors detect device movements and translate them into control inputs, substituting the mechanical interaction of physical buttons with a combination of visual display and inertial sensing. This allows the device to maintain compact size while providing control functionality through motion-based virtual artifacts.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent implements feedback mechanisms where the touchscreen display shows visual representation of virtual controls and their states. Motion sensor data provides feedback about device orientation and movement, allowing users to understand the state of virtual controls through visual and motion cues, compensating for the lack of tactile feedback from physical controls.

Inventive Principle:
Principle #23Feedback

2Device complexity

If physical controls are removed from mobile devices, then device simplicity is improved, but user interaction intuitiveness deteriorates

Engineering Contradiction:
Improvecontrol structureVSAvoidinteraction intuitiveness
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The patent creates virtual copies of physical controls (buttons, dials, sliders, switches) that are displayed on the touchscreen. These virtual artifacts replicate the appearance and functional behavior of their physical counterparts, allowing users to interact with familiar control types through touch and motion gestures, thereby maintaining interaction intuitiveness despite the removal of physical controls.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent makes the virtual controls dynamic by linking them to real-time motion sensor data. As the user moves or tilts the device, the virtual controls respond dynamically to reflect the current device state, creating an intuitive and responsive interaction experience that adapts to user actions without requiring physical components.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables effective eyes-free operation and improves user experience by providing tactile feedback, allowing users to interact with mobile devices more intuitively and efficiently, similar to physical controls, while maintaining a compact design.

Implementation Method 1

receiving a signal indicating user input to a touchscreen display of a mobile computing device

Methodology Applied
Scientific EffectCapacitive sensing: Capacitance

Implementation Method 2

detecting motion of the mobile computing device

Methodology Applied
Scientific EffectAccelerometer: Accelerometer

Data Source

PatentUS10031581B1Virtual artifacts using mobile devices
Publication Date: 2018.07.24 GOOGLE LLC
  • US10031581B1 patent drawing
  • US10031581B1 patent drawing
  • US10031581B1 patent drawing

AI summary

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing virtual artifacts using mobile devices. In one aspect, methods include receiving a signal indicating user input to a touchscreen display of a mobile computing device, detecting motion of the mobile computing device, the motion mimicking motion associated with a physical artifact, identifying a function based on the user input and the motion, the function corresponding to a function that can be physically performed using the physical artifact, executing the function on the mobile device, and generating feedback to a user of the mobile device, the feedback indicating execution of the function.