Multi-User Multimodal Request Fusion for Coordinated Commands
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current digital services struggle to manage multimodal interactions from multiple users simultaneously, particularly when users are distributed across different sites, leading to complex and inefficient command processing.
Innovation Solution
A method and system for generating an enriched request based on the interpretation of multimodal human-machine interactions from multiple users, utilizing user identification, contextual information, and temporal coordination to synchronize and merge signals from different users, enabling the formulation of explicit and inclusive commands.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If separate interpretation modules are used for each user, then user-specific interaction accuracy is improved, but system complexity and processing overhead increase significantly
Solution Approach 1:
The patent merges multiple user-specific interpretation modules into a single centralized interpretation module that processes interactions from multiple users. This consolidation reduces system complexity while maintaining the ability to accurately interpret user-specific interactions through contextual information and user identification mechanisms.
Solution Approach 2:
The centralized interpretation module is designed to handle interactions from multiple users universally, adapting its interpretation based on user identification and contextual information. This multi-functional approach allows a single module to replace multiple specialized modules, reducing complexity while preserving user-specific accuracy.
2Measurement precision
If multiple separate interpretation modules are deployed for multi-user support, then user-specific command accuracy is improved, but processing time and computational resources increase
Solution Approach 1:
By combining multiple interpretation functions into a single centralized module, the system processes multiple users' interactions simultaneously rather than sequentially through separate modules, reducing overall processing time while maintaining accuracy through user-specific contextual handling.
Solution Approach 2:
The system performs preliminary user identification and contextual information retrieval before interpretation, allowing the centralized module to quickly adapt its processing to each user's specific needs without requiring separate pre-processing pipelines for each user.
3Adaptability or versatility
If the system processes multimodal interactions from multiple users simultaneously, then collaborative interaction capability is improved, but system complexity and synchronization requirements increase
Solution Approach 1:
The centralized interpretation module acts as an intermediary that receives, coordinates, and synthesizes multimodal interactions from multiple users. It manages the complexity of synchronization and coordination internally, presenting a simplified interface for collaborative interaction processing while maintaining accuracy through user-specific contextual information.
4Measurement precision
If user-specific interpretation modules are used, then personalized command accuracy is improved, but scalability to additional users deteriorates
Solution Approach 1:
The centralized interpretation module is designed with universal capabilities to handle interactions from any number of users through user identification and contextual information retrieval. This architecture allows the system to scale to additional users without requiring deployment of new specialized modules, maintaining personalized accuracy through adaptive processing.
Data Source
Figure 1~2
Figure 3~4
Figure 5
AI summary
A method for processing a request from a digital service in an interactive environment, the method comprising: generating an enriched request based on an interpretation of signals received from a multimodal set of human-machine interactions resulting from human-machine interactions (300, 310, 320, 330, 340, 350, 360, 370) arising from coordinated actions of a plurality of distinct users in the interactive environment, each human-machine interaction, considered individually, being indicative only of a simple request, the enriched request triggering the emission of at least one command (700, 710).