Multimodal Input Segmentation for CG View and Creation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current user input devices, such as keyboards and mice, limit the accurate and efficient generation of control commands in computer-graphics (CG) environments, necessitating improved systems and methods for user interaction to enhance effectiveness, accuracy, intuitiveness, user-friendliness, and efficiency.

Innovation Solution

A method and system that utilize a touch-enabled input device for view adjustments and a separate input device for CG creation/editing actions, processing these commands independently to avoid conflicts and enable simultaneous view adjustments and object creation/editing within a CG environment, employing a touch-enabled input device for gestures and another device, like a mouse, to generate commands in different protocols.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If standard user input devices (keyboard and mouse) are used for CG creation, then device simplicity is maintained, but command generation accuracy and efficiency deteriorate

Engineering Contradiction:
Improvecommand generation accuracyVSAvoidinput device complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the input device functionality by assigning different devices for different purposes: touch-enabled device for view adjustments and traditional device (mouse/keyboard) for CG creation/editing actions. This segmentation allows each device to optimize for its specific function, improving overall command generation accuracy without requiring a single complex device to handle all tasks

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system implements multi-functionality by enabling the computer system to process commands from multiple types of input devices simultaneously. The touch-enabled device and traditional device both interface with the same CG software environment, allowing the system to adapt to different input modalities while maintaining a unified processing framework

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Productivity

If multiple input devices are used simultaneously, then interaction efficiency is improved, but command processing conflicts increase

Engineering Contradiction:
Improveinteraction efficiencyVSAvoidcommand processing reliability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system segments command processing by device type, creating distinct processing pathways: touch-enabled device commands are routed to view adjustment functions, while traditional device commands are routed to CG creation/editing functions. This segmentation prevents command conflicts by ensuring each device type operates in its designated functional domain

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary command processing layer that receives commands from multiple input devices and routes them to appropriate processing queues. This intermediary layer acts as a mediator that prevents direct conflicts between simultaneous commands by managing the flow and prioritization of different command types

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If touch-enabled input device is used for view adjustments, then view control accuracy is improved, but device compatibility complexity increases

Engineering Contradiction:
Improveview control accuracyVSAvoiddevice compatibility
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system maintains device compatibility by implementing a universal command processing framework that accepts input from both touch-enabled devices and traditional devices. The framework translates diverse input modalities into standardized command structures that the CG software can process uniformly, ensuring broad compatibility while supporting advanced touch-based view control

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11537218B2System and method for processing commands in a computer-graphics software environment
Publication Date: 2022.12.27 CAO XINLIN
  • US11537218B2 patent drawing
  • US11537218B2 patent drawing
  • US11537218B2 patent drawing

AI summary

A method and system for processing control commands in a computer-graphics (CG) environment includes displaying a CG environment according to a current view setting. A first user command generated from user interaction with a touch-enabled first input device is received. The command defines an adjustment to the current view setting. The displaying of the CG environment is adjusted in accordance with the view adjustment defined by the first user command. A second user command generated from user interaction with a second input device other than the touch-enabled first input device is received. The second user command defines a CG creation/editing action within the CG environment. The application of the CG creation/editing action defined by the second user command is then displayed. The first and second input devices may be physically separate and the first and second user commands may be logically separate.