Audio Data Security via Context-Aware Encryption Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Connected devices, equipped with microphones and speakers, are vulnerable to malicious attacks where attackers can compromise the devices to listen to in-room audio or transmit unauthorized commands, as existing security techniques fail to effectively restrict access to audio data and ensure secure voice command processing.

Innovation Solution

Implementing a processing module that encrypts audio data by default and controls access based on context, using tokens from trusted sources to authorize temporary access to unencrypted audio, while monitoring for hotwords to securely process voice commands and transition between encrypted and unencrypted modes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If audio data is encrypted by default to prevent unauthorized access, then security is improved, but the device cannot access audio data when legitimate need arises

Engineering Contradiction:
ImprovesecurityVSAvoidaudio access
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system dynamically switches between encrypted and unencrypted audio data transmission based on contextual conditions. The processing module monitors device context and automatically transitions audio data from encrypted state to unencrypted state when legitimate access conditions are met, and back to encrypted state when conditions are no longer satisfied. This dynamic adaptation resolves the contradiction by making the security state flexible rather than static.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The encryption parameter of audio data is changed based on contextual conditions. When the device context indicates legitimate need for audio access, the encryption parameter is switched from enabled to disabled, allowing unencrypted access. When conditions change, the parameter is switched back. This parameter change mechanism allows the system to adapt security levels according to operational context.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If audio data is made accessible to the device for processing, then functionality is improved, but vulnerability to malicious attacks increases

Engineering Contradiction:
ImprovefunctionalityVSAvoidvulnerability
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The processing module acts as an intermediary between the audio data and the device. It receives audio data from the microphone, processes it according to contextual conditions, and selectively provides unencrypted audio data to the device only when legitimate access conditions are satisfied. This intermediary layer filters and controls access, preventing direct exposure of audio data to potentially malicious device processes while still enabling necessary functionality.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system applies preliminary security measures by encrypting audio data before it reaches the device. The encryption is applied in advance as a protective action against potential malicious access. Only after contextual verification confirms legitimate need does the system remove encryption, thereby preventing unauthorized access while allowing necessary functionality.

Inventive Principle:
Principle #9Preliminary anti-action

3Speed

If the device continuously monitors audio data for commands, then responsiveness is improved, but security is compromised due to constant access

Engineering Contradiction:
ImproveresponsivenessVSAvoidsecurity
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

Instead of continuous monitoring, the system implements periodic or event-triggered monitoring of audio data. The processing module monitors audio data in real-time for hotwords or specific patterns, and only when such patterns are detected does it transition to providing unencrypted audio data to the device. This periodic action maintains security by default while enabling rapid response when commands are actually present.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system performs preliminary monitoring of audio data for specific trigger patterns (hotwords) before granting access to unencrypted audio data. This preliminary detection phase maintains encrypted state for security, and only when a command pattern is preliminarily identified does the system transition to unencrypted mode, thereby maintaining both security and responsiveness.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3533196B1Securing audio data
Publication Date: 2020.05.27 GOOGLE LLC
  • EP3533196B1 patent drawingFigure 1
  • EP3533196B1 patent drawingFigure 2
  • EP3533196B1 patent drawingFigure 3

AI summary

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for securing audio data. In one aspect, a method includes restricting access by the device (100, 220) to audio information detected by a microphone (115, 210), receiving data indicating that the device (100, 220) is authorized to access audio information detected by the microphone (115, 210) during a limited period of time, and in response to receiving data indicating that the device (100, 220) is authorized to access audio information detected by the microphone (115, 210) during the limited period of time, providing audio information to the device (100, 220). The method also includes monitoring audio information detected by the microphone (115, 210) during the limited period of time for the presence of a hotword and after the end of the limited period of time, restricting access by the device (100, 220) to audio information detected by the microphone (115, 210).