Zero UI Audio Privacy Routing via Server Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Zero user interface computing platforms face challenges in securely transmitting sensitive information without interception, as existing devices are not effective in maintaining privacy during voice-based interactions.

Innovation Solution

A system that uses a server computing device to analyze speech input from a zero user interface device, extract keywords, determine if the information is private, and securely route the response to a personal audio playback device for confidential playback, employing a neural network for classification and a text response generation module.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If zero user interface devices use voice-based interactions to communicate with users, then user interaction becomes more natural and efficient, but sensitive information may be overheard or intercepted by other parties

Engineering Contradiction:
Improveuser interaction naturalnessVSAvoidinformation security
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The system segments the audio output channel into public speaker output and private wired headphone output. By dividing the communication channel, sensitive information can be routed through the private channel while general information uses the public speaker, thus maintaining natural voice interaction while protecting sensitive data from being overheard.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces a server as an intermediary that receives the user's voice query, determines whether the response contains sensitive information, and then routes the audio output accordingly. The server acts as a mediator between the zero user interface device and the user, making security decisions based on content analysis without requiring complex local processing at the device.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If zero user interface devices read data out loud for user feedback, then information accessibility is improved, but privacy protection is compromised

Engineering Contradiction:
Improveinformation accessibilityVSAvoidprivacy exposure
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The system applies different quality characteristics to different portions of the audio output. Sensitive information is delivered through the private wired headphone channel with exclusive access, while non-sensitive information is delivered through the public speaker. This local differentiation of output quality ensures information accessibility while protecting privacy where needed.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system performs preliminary analysis of the response content before audio output to determine whether sensitive information is present. By pre-analyzing the content and pre-determining the appropriate output channel, the system ensures that sensitive information is protected before it reaches the user, rather than attempting to protect it during or after output.

Inventive Principle:
Principle #10Preliminary action

3Object-affected harmful factors

If a server analyzes user speech to determine sensitivity and routes audio output accordingly, then information security is enhanced, but system complexity increases

Engineering Contradiction:
Improveinformation securityVSAvoidsystem architecture
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The server acts as a simple intermediary that performs only the essential function of determining whether response content contains sensitive information and routing accordingly. By keeping the server's role focused and minimal rather than attempting complex local analysis at the zero user interface device, the system enhances security without excessively increasing complexity at the user-facing device.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The zero user interface device maintains its simple voice interaction capability while the server handles the security determination and routing decisions. The device serves itself by sending queries to the server and receiving audio responses, without requiring complex local security processing. This self-service approach allows the device to remain simple while still achieving secure communication through the server's assistance.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10628570B2Protection of data in a zero user interface environment
Publication Date: 2020.04.21 FMR CORP
  • US10628570B2 patent drawing
  • US10628570B2 patent drawing
  • US10628570B2 patent drawing

AI summary

Described herein are methods and systems for secure communication of private audio data in a zero user interface computing environment. A server receives text generated from a first digital audio bitstream, the digital audio bitstream corresponding to speech captured by a zero user interface computing device from a user. The server analyzes the text to extract a set of keywords from the text. The server determines whether information responsive to the keywords comprises private data related to the user. If the information responsive to the set of keywords comprises private data: the server generates a text response to the set of keywords that includes the private data relating to the user, determines a personal audio playback device associated with the user, and transmits the generated text response to the personal audio playback device for playback as a second digital audio bitstream.