LLM-Based 3D Scene Generation Automating Asset Retrieval

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for generating three-dimensional scenes are inefficient and inaccurate, as they require manual creation by designers within rendering engines.

Innovation Solution

A method utilizing a large language model (LLM) to process description information, extract label information, generate query prompts, and acquire a target asset set including assets, material information, and scene attributes, thereby automating the generation of three-dimensional scenes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual creation by designers in rendering engine is used, then scene generation accuracy can be maintained, but generation efficiency deteriorates

Engineering Contradiction:
Improvescene generation efficiencyVSAvoidtime consumption
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent replaces the manual mechanical process of designers creating 3D scenes with an automated system using large language models and rendering engines. The LLM automatically generates scene descriptions, asset lists, and configuration parameters from user input, eliminating the need for manual designer intervention in routine scene creation tasks while maintaining quality through automated rendering.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If automated generation is implemented, then generation efficiency improves, but generation accuracy deteriorates

Engineering Contradiction:
Improvescene generation efficiencyVSAvoidscene generation accuracy
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent introduces large language models as an intermediary between user input and the rendering engine. The LLM processes user descriptions, generates detailed scene configurations, and translates them into parameters the rendering engine can execute. This intermediary layer enables automated generation while maintaining accuracy by ensuring proper interpretation and translation of creative intent into technical specifications.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of manufacture

If manual design process is used, then scene quality can be controlled, but process complexity increases

Engineering Contradiction:
Improveprocess simplicityVSAvoidprocess complexity
Core Design Contradiction:
Ease of manufactureVSDevice complexity

Solution Approach 1:

The patent merges multiple discrete steps of the scene creation process (conceptualization, asset selection, parameter configuration, and rendering) into a single automated workflow driven by the large language model. Instead of requiring separate manual operations for each step, the system combines them into an integrated process that takes user input and automatically produces the final scene, significantly simplifying the overall process.

Inventive Principle:
Principle #5Merging (Combining)

4Extent of automation

If LLM-based automated generation is used, then user intervention is reduced, but information processing requirements increase

Engineering Contradiction:
Improveautomation levelVSAvoidcomputational resource consumption
Core Design Contradiction:
Extent of automationVSUse of energy by moving object

Solution Approach 1:

The patent employs large language models that have been pre-trained on extensive datasets of scene descriptions, asset libraries, and rendering parameters. This preliminary training and preparation of the LLM enables it to efficiently process user inputs and generate accurate scene configurations without requiring excessive computational resources during actual scene generation, as the heavy lifting of learning patterns and relationships has already been completed in advance.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250124651A1Method and apparatus for generating 3D scene based on large language model, electronic device, and storage medium
Publication Date: 2025.04.17 BEIJING BAIDU NETCOM SCI & TECH CO LTD
  • US20250124651A1 patent drawing
  • US20250124651A1 patent drawing
  • US20250124651A1 patent drawing

AI summary

The present disclosure provides method and apparatus for generating 3D scene based on large language model, electronic device, and storage medium, which relates to the field of artificial intelligence technologies, particularly the fields of three-dimensional modeling technologies, large language model technologies, or the like. The three-dimensional scene generating method based on a large language model includes: processing description information of a target three-dimensional scene to obtain label information in the description information; generating query operation prompt of the LLM based on the label information, and acquiring a target asset set matched with the label information by the LLM based on the query operation prompt, the target asset set including a target asset in the target three-dimensional scene, target material information of the target asset and target scene attribute information of the target asset; and generating the target three-dimensional scene based on the target asset set.