Continuous Multimodal Communication System with Adaptive Content Routing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current mobile messaging applications have limitations in voice messaging features, including manual session connections, lack of clear group voice messaging visualization, limited replay capabilities, and sub-standard features like voice duplication when users are in close proximity, leading to an inadequate single messaging space for multimedia communications.

Innovation Solution

A continuous multimodal communication system that connects users for real-time audio and multimedia sharing, using a predictive algorithm to optimize connections based on metadata, allowing seamless distribution of content like text, images, and audio, with visual indications of temporal relationships and adaptive content delivery according to user device and preferences, and incorporating features like voice commands and audio emojis for efficient communication.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual session connection is used for voice messaging, then connection control is simple, but communication time loss increases and user convenience deteriorates

Engineering Contradiction:
Improveuser convenienceVSAvoidcommunication time loss
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system establishes a persistent communication channel between users before actual voice messaging occurs. The server maintains ready-state connections and pre-configures routing paths, so when a user initiates voice messaging, the channel is already prepared and can be activated instantly without manual connection setup or waiting for call establishment.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements continuous audio streaming through the messaging channel rather than discrete call sessions. The communication channel remains active and continuous, allowing audio data to flow uninterrupted between users without requiring manual connection/disconnection cycles, thereby eliminating communication time loss while maintaining simple operation.

Inventive Principle:
Principle #20Continuity of useful action

2Adaptability or versatility

If basic messaging features are provided, then system complexity is low, but functionality is insufficient for modern communication needs

Engineering Contradiction:
Improvecommunication functionalityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The messaging application integrates multiple communication functions within a single unified system: text messaging, voice messaging with continuous audio streaming, video calling, file sharing, and real-time collaboration tools. The server infrastructure supports all these functions through a common architecture, allowing users to switch between modes without leaving the application, thereby achieving high versatility without proportionally increasing complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines previously separate communication systems (messaging, voicemail, video conferencing, file transfer) into a single integrated platform. The server consolidates routing, media streaming, and data management functions, while the client application merges multiple interfaces into one unified experience, reducing overall system complexity while expanding functionality.

Inventive Principle:
Principle #5Merging (Combining)

3Measurement precision

If voice duplication feature is implemented for proximity detection, then communication accuracy improves, but user confusion increases and ease of operation deteriorates

Engineering Contradiction:
Improvecommunication accuracyVSAvoiduser confusion
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system continuously monitors audio inputs from multiple users and provides real-time feedback through the messaging interface. When a user speaks, the system visually indicates their presence and speech activity in the conversation thread, allowing other users to understand who is speaking without confusion. This feedback mechanism eliminates ambiguity while maintaining simple operation.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent segments the audio stream into distinct user contributions and presents them as separate, identifiable messages in the conversation history. Each user's speech is associated with their identifier and timestamp, allowing clear differentiation between speakers even when multiple users are present. This segmentation eliminates voice duplication confusion while maintaining accurate communication.

Inventive Principle:
Principle #1Segmentation

4Adaptability or versatility

If limited replay capability is provided, then system simplicity is maintained, but information loss increases and functionality is insufficient

Engineering Contradiction:
Improvereplay functionalityVSAvoidconversation history preservation
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system continuously records and preserves all audio, video, and data exchanges in the messaging channel, creating an unbroken history of the entire conversation. This continuous recording enables complete replay of past interactions at any time, ensuring no information is lost while maintaining simple access through the messaging interface.

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The server automatically stores all communication data in real-time as it occurs, preparing a complete record before the user needs to review it. This preliminary storage action ensures that when users request replay or review of past conversations, the full history is already available without requiring additional processing or data retrieval operations.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10680995B1Continuous multimodal communication and recording system with automatic transmutation of audio and textual content
Publication Date: 2020.06.09 RACKET INC
  • US10680995B1 patent drawing
  • US10680995B1 patent drawing
  • US10680995B1 patent drawing

AI summary

Providing interactive communication between a plurality of members includes providing a routing and redistribution module that communicatively connects each of the members with each of the other members and allows the members to receive at least real-time audio data from other ones of the members. Providing the interactive communication also includes receiving content from at least one of the members, selectively distributing the content to at least some of the members in real-time, selectively storing at least some of the content, and visually indicating temporal relationships between different types of the content to at least one of the members. The content includes text messages, images, documents, graphical emojis, stickers, animated gifs, audio emojis, recorded audio, recorded video, real-time audio, and/or real-time video. Distribution of the content to a particular one of the members varies according to a listening state of the particular one of the members.