Generative AI model real-time rendering engine construction method and related equipment thereof

By constructing a real-time rendering engine for generative AI models, utilizing the CLIP model to parse multimodal semantic information and generate lightweight intermediate representations, and combining rasterization acceleration and ray stepping technology, the problems of long rendering time and poor consistency in generating 3D content by generative AI models are solved, achieving efficient real-time rendering and interaction, and is suitable for multiple platforms.

CN120953465AActive Publication Date: 2025-11-14SHANGHAI YINGZHONG INFORMATION TECH CO LTD
6 Cites 2 Cited by

Patent Information

Application Number
CN202511478233.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-10-16
Publication Date
2025-11-14
Estimated Expiration
2045-10-16

AI Technical Summary

Technical Problem

In existing technologies, generative AI models generate 3D content that needs to be exported to an independent rendering engine for processing, which results in excessive time consumption. Furthermore, the generated content exhibits randomness, inter-frame flickering, and poor spatial consistency, affecting the visual experience.

Method used

We build a real-time rendering engine for generative AI models. By parsing multimodal semantic information through CLIP models, we generate lightweight intermediate representations. Combined with rasterization acceleration and ray stepping technology, we capture user operations in real time and optimize performance by using hybrid rendering strategies and spatiotemporal constraint technology.

Benefits of technology

It achieves deep integration of generation and rendering, compressing end-to-end latency from seconds to milliseconds, improving generation efficiency and visual consistency, supporting real-time interactive operation, adapting to different hardware platforms, and enhancing the visual experience.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention discloses a generative AI model real-time rendering engine construction method and related equipment thereof, and relates to the technical field of man-machine interaction, and the method comprises the steps: obtaining multi-modal semantic information input by a user, and converting the multi-modal semantic information into a patent vector and a constraint parameter; constructing a lightweight generation model, and directly generating a renderable intermediate representation by adopting the lightweight generation model; constructing a rendering pipeline based on the generated intermediate representation, and converting the intermediate representation into a visual image; capturing user operation in real time, dynamically updating constraint conditions of a generated model, triggering increment generation, and optimizing system performance by adopting a model lightweight, hardware acceleration and hybrid rendering strategy; through the time filtering and space constraint technology, the generated content is consistent in time and space. According to the method, the problems of low generation speed and low rendering efficiency in the fusion process of the generative AI model and the real-time rendering engine are solved, and the efficiency and quality of visual image generation and rendering are improved.
Need to check novelty before this filing date? Find Prior Art