LLM-Based 3D Scene Generation Automating Asset Retrieval
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for generating three-dimensional scenes are inefficient and inaccurate, as they require manual creation by designers within rendering engines.
Innovation Solution
A method utilizing a large language model (LLM) to process description information, extract label information, generate query prompts, and acquire a target asset set including assets, material information, and scene attributes, thereby automating the generation of three-dimensional scenes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If manual creation by designers in rendering engine is used, then scene generation accuracy can be maintained, but generation efficiency deteriorates
Solution Approach 1:
The patent replaces the manual mechanical process of designers creating 3D scenes with an automated system using large language models and rendering engines. The LLM automatically generates scene descriptions, asset lists, and configuration parameters from user input, eliminating the need for manual designer intervention in routine scene creation tasks while maintaining quality through automated rendering.
2Productivity
If automated generation is implemented, then generation efficiency improves, but generation accuracy deteriorates
Solution Approach 1:
The patent introduces large language models as an intermediary between user input and the rendering engine. The LLM processes user descriptions, generates detailed scene configurations, and translates them into parameters the rendering engine can execute. This intermediary layer enables automated generation while maintaining accuracy by ensuring proper interpretation and translation of creative intent into technical specifications.
3Ease of manufacture
If manual design process is used, then scene quality can be controlled, but process complexity increases
Solution Approach 1:
The patent merges multiple discrete steps of the scene creation process (conceptualization, asset selection, parameter configuration, and rendering) into a single automated workflow driven by the large language model. Instead of requiring separate manual operations for each step, the system combines them into an integrated process that takes user input and automatically produces the final scene, significantly simplifying the overall process.
4Extent of automation
If LLM-based automated generation is used, then user intervention is reduced, but information processing requirements increase
Solution Approach 1:
The patent employs large language models that have been pre-trained on extensive datasets of scene descriptions, asset libraries, and rendering parameters. This preliminary training and preparation of the LLM enables it to efficiently process user inputs and generate accurate scene configurations without requiring excessive computational resources during actual scene generation, as the heavy lifting of learning patterns and relationships has already been completed in advance.
Data Source
AI summary
The present disclosure provides method and apparatus for generating 3D scene based on large language model, electronic device, and storage medium, which relates to the field of artificial intelligence technologies, particularly the fields of three-dimensional modeling technologies, large language model technologies, or the like. The three-dimensional scene generating method based on a large language model includes: processing description information of a target three-dimensional scene to obtain label information in the description information; generating query operation prompt of the LLM based on the label information, and acquiring a target asset set matched with the label information by the LLM based on the query operation prompt, the target asset set including a target asset in the target three-dimensional scene, target material information of the target asset and target scene attribute information of the target asset; and generating the target three-dimensional scene based on the target asset set.


