Virtual Avatar Limb Movement Control for Privacy Protection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies for motion sensing games and online teaching/live streaming expose user privacy and security concerns, as they often require users to wear motion sensing devices, and privacy shielding methods like mosaicing can affect video quality.

Innovation Solution

An image processing method that detects keypoint positions of limbs in images to determine movement information, allowing for the control of a controlled model to simulate user movements without exposing the user's identity, thereby enhancing privacy and security while maintaining video quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If mosaic or shielding modes are used to protect user privacy, then user privacy and security are improved, but video quality is degraded

Engineering Contradiction:
Improveuser privacy protectionVSAvoidvideo quality
Core Design Contradiction:
ReliabilityVSManufacturing precision

Solution Approach 1:

The patent creates a virtual avatar that copies and simulates the user's movements, gestures, and postures without exposing the actual user image. The avatar serves as a digital replica that preserves video quality while protecting privacy, replacing traditional mosaic shielding methods.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces physical motion sensing devices with image processing technology. By using keypoint detection and pose estimation algorithms on regular video feeds, the system eliminates the need for specialized hardware while achieving accurate movement capture for privacy protection.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If motion sensing devices are worn to detect body activities, then movement detection accuracy is improved, but device complexity and user convenience are worsened

Engineering Contradiction:
Improvemovement detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system uses the user's own video feed as the input source, eliminating the need for external motion sensing devices. The regular camera captures the user's movements, and image processing algorithms automatically extract movement information, making the system self-sufficient and reducing hardware complexity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent makes the video camera serve multiple functions: it both captures the user image for display and simultaneously provides the data source for movement detection. This multi-functionality eliminates the need for separate motion sensing devices and reduces overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Loss of information

If face and body images are exposed in online teaching or live streaming, then video communication quality is improved, but user privacy and security are worsened

Engineering Contradiction:
Improvevideo communication qualityVSAvoiduser privacy protection
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The patent creates a virtual avatar that copies the user's appearance, clothing, and movements to maintain authentic video communication. The avatar serves as a privacy-protecting intermediary that preserves communication quality by showing a realistic representation without exposing the actual user's identity.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The virtual avatar acts as an intermediary between the user and the online audience. It mediates the video communication by displaying a realistic representation of the user while protecting their actual identity, allowing privacy-safe participation in online teaching and live streaming.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11741629B2Controlling display of model derived from captured image
Publication Date: 2023.08.29 BEIJING SENSETIME TECH DEV CO LTD
  • US11741629B2 patent drawing
  • US11741629B2 patent drawing
  • US11741629B2 patent drawing

AI summary

Embodiments of the present disclosure disclose image processing methods and apparatuses, image devices, and storage media. The image processing method includes: obtaining an image; obtaining the feature of the limb of the body based on the image, where the limb includes the upper limb and/or the lower limb; determining first-type movement information of the limb based on the feature; and controlling the movement of the limb of a controlled model according to the first-type movement information.