Covert Audio Augmentation for Mobile Voice Calls

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

There is a need for mobile devices to facilitate supplemental forms of communication during voice calls, as users often interact with applications during calls and require ways to convey information covertly without disrupting the conversation or exposing sensitive information to others.

Innovation Solution

A method that allows for the augmentation of voice calls with supplemental audio by sending predetermined audio segments or indications from one mobile device to another over a communications network, enabling pre-recorded or synthesized audio to be played on the recipient's device without being audible on the sender's device, using inputs like key combinations, gestures, or GUI selections.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If users interact with applications during voice calls using traditional audio communication, then communication capability is improved, but privacy and security are worsened as sensitive information may be exposed to others hearing the call

Engineering Contradiction:
Improvecommunication capabilityVSAvoidprivacy and security
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The communication channel is segmented into two independent parts: the primary voice call channel for audible conversation and the supplemental audio channel for covert information transfer. This allows users to maintain verbal communication while simultaneously conveying sensitive information through separate audio segments that are not audible to third parties listening to the call.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

An intermediary system is introduced between the sender and receiver to transfer audio segments covertly. The system receives audio segments from the sender, transmits them through the network, and delivers them to the receiver's device for playback, enabling private communication during public voice calls without requiring direct verbal exchange.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Object-affected harmful factors

If supplemental audio is transmitted during voice calls, then covert communication is improved, but device complexity is worsened due to additional audio processing and network transmission requirements

Engineering Contradiction:
Improvecovert communication capabilityVSAvoiddevice complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The mobile device is designed to perform multiple functions using existing hardware components. The same microphone, audio processor, and network interface used for standard voice calls are also utilized to capture, process, and transmit supplemental audio segments. This multi-functionality approach enables covert communication without requiring dedicated hardware, thereby limiting the increase in device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Loss of information

If audio segments are played on the recipient's device during the call, then information conveyance is improved, but disruption to the conversation flow is worsened

Engineering Contradiction:
Improveinformation conveyanceVSAvoidconversation flow
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The supplemental audio segments are transmitted and played periodically rather than continuously. The system captures audio segments at specific intervals when the user provides input (such as pressing a button or using a gesture), transmits them during appropriate gaps in the conversation, and plays them at convenient moments for the receiver. This periodic operation minimizes disruption to the natural flow of conversation while ensuring information is conveyed effectively.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentEP3355559B1Method of augmenting a voice call with supplemental audio
Publication Date: 2019.11.13 BLACKBERRY LTD
  • EP3355559B1 patent drawingFigure 1
  • EP3355559B1 patent drawingFigure 2
  • EP3355559B1 patent drawingFigure 3

AI summary

The present disclosure relates to a method of augmenting a voice call with supplemental audio. In one example, the method comprises: receiving predetermined input on a first mobile device during a voice call established between the first mobile device and a second mobile device; determining an audio segment corresponding to the predetermined input; and sending the audio segment from the first mobile device to the second mobile device over a communications network during the voice call.