Epidermal Human-Drone Interface With Tactile and NMES Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing drone control systems face challenges with increased control complexity, prolonged training periods, high cognitive demand, and inadequate sensory feedback, particularly in dynamic environments, leading to potential collisions due to limited visibility and absence of critical sensory perceptions.
Innovation Solution
An epidermal multimodal human-drone interfacing system utilizing a flexible and stretchable electronic design that integrates tactile and neuromuscular electrical stimulation feedback, providing real-time tactile feedback on the user's fingers and muscle groups to mimic the human vestibular system, and detecting obstacles to prevent collisions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional control methods (joystick-based controllers or touch interfaces) are used, then basic drone control is achieved, but control complexity increases and training periods are prolonged
Solution Approach 1:
The patent replaces mechanical joystick-based control systems with a brain-computer interface (BCI) system that detects neural signals directly from the user's brain. This substitution eliminates the need for complex mechanical controllers and reduces the learning curve, as users can control the drone through natural thought processes rather than mastering intricate manual controls.
Solution Approach 2:
The patent introduces an intermediary BCI system that translates neural signals into drone control commands. This intermediary layer processes brain waves and converts them into actionable control signals, simplifying the interaction between the user and the drone while reducing the cognitive load and training requirements associated with traditional control methods.
2Loss of information
If visual feedback only is provided, then basic flight information is transmitted, but sensory information is insufficient leading to delayed responses
Solution Approach 1:
The patent implements a multimodal feedback system that provides tactile feedback in addition to visual feedback. The tactile feedback mechanism delivers haptic signals to the user's skin, enabling them to perceive drone movements, orientation, and environmental interactions through touch. This enhanced feedback loop reduces response time by providing intuitive sensory information that complements visual data.
Solution Approach 2:
The patent adds a tactile dimension to the feedback mechanism, transitioning from purely visual two-dimensional feedback to a multi-dimensional sensory experience. By incorporating haptic feedback through skin contact, the system provides spatial and textural information that enhances the user's perception of the drone's state and surroundings, enabling faster and more accurate responses.
3Ease of operation
If stretchable electronics are used, then wearability is improved, but device complexity and manufacturing challenges increase
Solution Approach 1:
The patent employs stretchable electronic components constructed from flexible substrates and thin film materials that can conform to the contours of the user's skin. These stretchable electronics maintain electrical functionality while accommodating skin movement and deformation, enabling comfortable and intuitive wearability for the BCI and tactile feedback systems.
Solution Approach 2:
The patent utilizes composite materials that combine conductive elements with elastomeric substrates to create stretchable electronic circuits. These composite structures integrate flexible conductors, adhesives, and encapsulants to form durable, stretchable components that can withstand repeated deformation while maintaining electrical connectivity and mechanical integrity.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables intuitive drone control with reduced training periods and enhanced awareness of the flying environment, improving flight stability and safety by integrating multimodal feedback, including tactile and force feedback, to enhance user interaction and prevent accidents.
Implementation Method 1
a tactile actuation module to deliver tactile feedback to a user's fingers
Implementation Method 2
a neuromuscular electrical stimulation module to deliver stimulation current to the user's muscle groups
Data Source
AI summary
The present invention provides an epidermal multimodal human-drone interfacing system which enable drone operation in dynamic and intricate environments. The interfacing system comprises: a base station configured to: receive hand orientation data of a user and obstacle data within a caution distance from a drone; and generate, on basis of a correlation of the hand orientation data and the obstacle data, respective control commands for providing tactile feedback to a user's fingers, stimulating multiple muscle groups of the user's arm and controlling the drone; a drone control tactile feedback (DCTF) module configured to: collect the hand orientation data of the user and deliver the tactile feedback to the user's fingers; and a neuromuscular electrical stimulation force feedback (NMESF) module configured to: collect obstacle data within the caution distance from the drone and deliver stimulation current to the multiple muscle groups of the user's arm.