MR Path Guidance Using Tiled 3D Building Textures
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3D maps generated through digital twinning lack accurate textures for building surfaces, leading to a gap between the digital twin map and the real world, which hinders precise mixed reality-based path guidance for vehicles.
Innovation Solution
A display device and path guiding system that uses sensors to detect building profiles, tiles different areas with tiles from a database, and performs texturing on virtual objects to create a digital twin map with realistic textures, synchronized through a cloud server, allowing for updates based on real-world changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Shape
If satellite or aerial photos are used for building modeling, then 3D mapping can be provided, but accurate textures of building lateral surfaces cannot be obtained
Solution Approach 1:
The patent introduces building profiles as an intermediary data structure that stores tile information for different areas of building surfaces. This profile acts as a mediator between the limited satellite/aerial photo data and the requirement for accurate building textures, enabling the system to retrieve and apply appropriate tiles to reconstruct realistic building appearances without needing direct high-resolution images of all surfaces.
Solution Approach 2:
The patent segments building surfaces into different areas (front, back, left, right sides) and assigns specific tiles to each area through building profiles. This segmentation allows the system to handle different building surfaces independently, applying appropriate textures to each segment based on available data, thereby achieving comprehensive building texturing despite limitations in source image coverage.
2Shape
If polygon data with floor footprint and height is used for 3D mapping, then building location and volume can be shown, but realistic textures are missing
Solution Approach 1:
The patent uses tile images as copies of building surface textures. Instead of requiring original high-resolution photographs of every building surface, the system stores tile copies in a database and applies them through building profiles. This copying approach preserves the visual appearance of buildings while using more manageable and storable data representations.
Solution Approach 2:
The patent performs preliminary action by pre-storing tile information and building profile data in databases before actual building rendering is needed. The building profiles are created in advance with tile assignments for different building areas, so that when 3D buildings need to be rendered, the texture information is already prepared and can be quickly applied without real-time processing delays.
3Measurement precision
If digital twin map is to match real world accurately, then high matching rate is required, but current methods create gap between map and reality
Solution Approach 1:
The patent applies local quality by assigning different tile characteristics to different areas of building surfaces through building profiles. Each building area (front, back, left, right sides) can have locally optimized texture properties that match the actual building appearance in that specific location. This local customization ensures high matching rates between the digital twin map and the real world for each building area without requiring uniform high-resolution data for all surfaces.
Data Source
AI summary
The present invention comprises an interface unit for receiving sensing information collected from a sensor, a tile database including tiles corresponding to at least one of an image and a shape of a part of a building, a memory for storing map information including virtual objects corresponding to buildings, and building profiles of the buildings corresponding to the virtual objects included in the map information, and a processor for performing control to: when a driving path of a vehicle is determined, detect building profiles corresponding to buildings around the vehicle on the basis of the driving path; on the basis of tile information for each area of the building profiles corresponding to virtual objects of the respective buildings around the vehicle, tile different areas of the respective virtual objects by using different tiles of the tile database; combine each tiled area; and display, on a display unit of the vehicle, MR information obtained by performing texturing on each virtual object.