Sparse Motion Rendering with Predicted Trajectories

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional human-machine dialogue systems are limited in their ability to adapt to dynamic conversations, fail to recognize emotional cues, and lack context awareness, leading to inefficient and unengaging interactions, particularly in applications like education where continuous monitoring and adaptation are crucial.

Innovation Solution

A computerized intelligent agent system that utilizes a user interaction engine to monitor multimodal data, estimate the mindset and intent of participants, and adaptively adjust conversation strategies based on real-time observations, incorporating features like object detection and motion prediction to enhance engagement and user experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional pre-programmed dialogue patterns are used, then the system structure is simple and easy to implement, but the system cannot adapt to unpredictable human conversations and loses engagement

Engineering Contradiction:
Improveadaptability to dynamic conversationsVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements dynamic dialogue management by transitioning from static pre-programmed patterns to adaptive conversation flow that responds to real-time user emotions and context. The system dynamically adjusts dialogue strategies based on detected user states, making the conversation structure flexible and responsive rather than rigid and predetermined.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system incorporates continuous feedback loops where user emotional states and contextual information are detected in real-time and fed back to adjust the dialogue pattern. This feedback mechanism enables the system to adapt its conversation strategy based on user responses, maintaining engagement through responsive rather than fixed interaction patterns.

Inventive Principle:
Principle #23Feedback

2Productivity

If the system continuously monitors and adapts to user emotions and context, then user engagement is maintained, but computational resources and processing time increase

Engineering Contradiction:
Improveuser engagement effectivenessVSAvoidcomputational resource consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The system applies partial monitoring by selectively focusing computational resources on detecting emotionally salient moments and key contextual cues rather than continuously analyzing all conversation data. This approach maintains engagement effectiveness by concentrating processing power on critical interaction points rather than uniform continuous monitoring.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system performs preliminary processing of user inputs to quickly assess emotional tone and contextual relevance before triggering full dialogue adaptation. By pre-processing and filtering inputs, the system reduces the computational burden of continuous full-scale analysis while maintaining the ability to respond effectively to engagement-critical moments.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If sparse motion samples are used for rendering, then computational load is reduced, but motion accuracy and smoothness deteriorate

Engineering Contradiction:
Improverendering efficiencyVSAvoidmotion rendering accuracy
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The system performs preliminary motion prediction by analyzing sparse motion samples and forecasting intermediate positions before actual rendering occurs. This pre-computation of motion trajectories allows the system to maintain visual smoothness and accuracy without requiring dense real-time motion data, thereby reducing computational load while preserving rendering quality.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates interpolated motion copies between sparse sampled positions by generating virtual intermediate frames that replicate the appearance and motion characteristics of actual motion. These synthesized copies fill gaps between real motion samples, maintaining visual continuity and accuracy without requiring proportional computational resources for capturing and processing every motion detail.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS10785489B2System and method for visual rendering based on sparse samples with predicted motion
Publication Date: 2020.09.22 DMAI (GUANGZHOU) CO LTD
  • US10785489B2 patent drawing
  • US10785489B2 patent drawing
  • US10785489B2 patent drawing

AI summary

The present teaching relates to method, system, medium, and implementations for rendering a moving object. An object data package related to a moving object appearing in a monitored scene with respect to a first time instance is first received and features characterizing the moving object at the first time instance are extracted from the package, that are estimated at a monitoring rate and include a current position of the object and a current motion vector at the first time instance. Information associated with a previously rendered object at a previously rendered position at a previous time instance is retrieved and a next rendering position of the object is determined based on the current position, the current motion vector, and a rendering rate lower than the monitoring rate. The object is rendered at the next rendering position based on a motion vector and the information associated with the previously rendered object.