基于草图引导的人体动作编辑方法、装置、终端及介质

By combining motion autoencoders and diffusion generation models, two-dimensional sketch data is aligned with three-dimensional human motion sequences in the latent feature space, and text prompt data is used for editing. This solves the problem of unstable sketch correspondence and improves the controllability and robustness of human motion editing.

CN122244401BActive Publication Date: 2026-07-17PEKING UNIV SHENZHEN GRADUATE SCHOOL

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
PEKING UNIV SHENZHEN GRADUATE SCHOOL
Filing Date
2026-05-22
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

In existing technologies, sketches cannot establish a stable correspondence with 3D human joint data, making it difficult to introduce sketch information into human motion editing models, which affects controllability and robustness.

Method used

A trained motion autoencoder is used to align the 2D sketch data and the initial 3D human motion sequence in the latent feature space to determine the latent features of the sketch. A trained diffusion generation model is then used to add noise and perform inverse denoising on the initial 3D human motion sequence based on guiding conditions. Combined with text prompt data, the sequence is decoded and reconstructed to determine the 3D human motion editing image.

Benefits of technology

It improves the controllability and robustness of human motion editing, achieves stable correspondence of sketch information in the 3D human motion editing model, and improves interaction efficiency and editing accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122244401B_ABST
    Figure CN122244401B_ABST
Patent Text Reader

Abstract

本发明公开了基于草图引导的人体动作编辑方法、装置、终端及介质,涉及图像编辑技术领域,所述方法通过采用已训练的运动自编码器将二维草图数据和初始三维人体运动序列在潜在特征空间对齐,确定草图潜在特征;将草图潜在特征作为引导条件,利用已训练的扩散生成模型基于引导条件对初始三维人体运动序列进行加噪与逆向去噪,确定目标图像特征,引导条件还包括文本提示数据和初始三维人体运动序列;对目标图像特征进行解码重构,确定三维人体运动编辑图像。因此可以有效地解决现有技术中草图无法与三维人体关节数据建立稳定的对应关系,导致难以在人体运动编辑模型中引入草图信息,以提升对人体运动编辑的可控性和鲁棒性的问题。
Need to check novelty before this filing date? Find Prior Art