Hearing Instrument Virtual Assistant LLM Integration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current hearing instruments lack the ability to provide users with a seamless and efficient personal assistant experience, particularly in assisting with daily tasks and environmental sound management.

Innovation Solution

The integration of a virtual personal assistant powered by artificial intelligence, which receives audio data from hearing instruments and generates output to assist the user, including reminders, environmental sound management, and interaction with external data services.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If hearing instruments integrate advanced audio processing and wireless communication features, then functionality and user assistance capability are improved, but device complexity increases

Engineering Contradiction:
ImprovefunctionalityVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent divides the hearing instrument system into multiple functional modules: audio processing module, wireless communication module, and control module. Each module handles specific tasks independently, allowing the system to achieve high functionality while managing complexity through modular architecture. The audio processing module handles sound amplification and environmental noise management, while the wireless communication module manages data transmission with external devices.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The hearing instruments are designed to perform multiple functions beyond basic audio amplification, including environmental sound management, wireless communication with external devices, and integration with virtual assistant systems. This multi-functionality approach allows a single device to serve various purposes, improving versatility without requiring separate dedicated devices for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If hearing instruments provide comprehensive personal assistant capabilities, then ease of operation for daily tasks is improved, but use of energy increases

Engineering Contradiction:
Improveease of operationVSAvoiduse of energy
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The virtual assistant system operates in periodic cycles rather than continuously. The hearing instruments periodically check for and process voice commands, retrieve relevant information, and provide responses. This periodic operation mode allows the system to maintain personal assistant capabilities while consuming energy only when needed, rather than continuously, thus improving ease of operation while managing energy consumption.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system automatically manages energy consumption by activating full personal assistant functionality only when triggered by user interaction (voice commands or gestures). Between activations, the system enters a low-power state, performing minimal monitoring functions. This self-service approach ensures the device provides comprehensive assistance when needed while automatically conserving energy during idle periods.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20250149035A1Personalized virtual assistance for hearing instrument users
Publication Date: 2025.05.08 STARKEY LABORATORIES INC
  • US20250149035A1 patent drawing
  • US20250149035A1 patent drawing
  • US20250149035A1 patent drawing

AI summary

A method comprising: receiving, by a computing system, audio data generated by one or more hearing instruments worn at or near one or more ears of a user; providing, by the computing system, a virtual personal assistant to the user, wherein the virtual personal assistant is configured to generate, based on the audio data, output to assist the user, wherein providing the virtual personal assistant comprises applying, by the computing system, a Large Language Model (LLM) to generate a response, and the output is based on the response; and providing, by the computing system, the output to the one or more hearing instruments, wherein the one or more hearing instruments are configured to generate auditory stimuli based on the output.