System and method for integrating 3D virtual tours with a contextual ai assistant

Abstract

This invention provides a comprehensive platform that integrates 3D virtual tours with a multi-agent Al-driven system for enhanced user engagement, scalability, and autonomous management. The platform includes a 3D Virtual Tour Generator that captures and renders physical spaces into interactive, high-resolution 3D environments. A network of specialized Al agents - including a Platform Guide Agent, Customer-Specific Agents, Visitor Assistant Agents, Compliance Agents, and Engagement and Marketing Agents - drives the platform's interactive capabilities. These agents are powered by distributed knowledge bases, enabling them to provide context-aware assistance, real-time responses, and proactive user guidance. The platform supports self-management, allowing businesses to create and control their digital presence, including configuring Customer-Specific Agents. Additionally, agent-to-agent interactions facilitate continuous learning, platform maintenance, and improvement. The invention is designed for various applications, including real estate, education, tourism, and retail, offering a human-centric, scalable solution that enhances virtual tours and provides autonomous, high-quality information 24 / 7, reducing reliance on human guides.

Description

[0001] System and Method for Integrating 3D Virtual Tours with Contextual Al Assistants

[0002] Technical Field

[0003] The present invention pertains to the field of interactive digital platforms that combine virtual reality, artificial intelligence, and digital mapping. Specifically, it involves a system for enhancing user engagement and business interaction by integrating 3D virtual tours, intelligent Al-driven agents, and a self-service management interface, creating a scalable, adaptive, and immersive digital experience.

[0004] Background of the Invention

[0005] Conventional virtual tour and map-based platforms lack flexible, adaptive interactions and often rely on impersonal, technically-focused interfaces. These systems primarily provide limited engagement, placing emphasis on functionality rather than an enriching, humancentered experience. Additionally, such platforms generally require considerable manual processes for expansion and maintenance, restricting scalability. This invention addresses these shortcomings by creating a platform that seamlessly integrates interactive maps, immersive 3D virtual spaces, and intelligent Al agents, enabling enhanced, context-aware user interactions with automated management features.

[0006] Summary of the Invention

[0007] The invention provides a platform that combines interactive maps, 3D virtual tours, and Al agents to deliver a highly personalized, scalable, and immersive user experience. A core innovation is the platform’s network of Contextual Intelligent Virtual Agents (CIVAs) that perform a variety of roles to support platform functionality. These agents are driven by distributed knowledge bases, which may include web content, unstructured files, semistructured data, and structured databases. Agents can dynamically access and interpret this information, enhancing their responses and interactions.

[0008] Additionally, the platform is designed to be largely self-maintaining and evolving, with Al agents overseeing various functions of platform maintenance, development, and moderation. These agents, which may or may not be explicitly listed, can autonomously update and improve the platform by learning from user interactions, identifying areas for enhancement, and implementing adjustments as needed.

[0009] This invention also supports agent-to-agent interactions, allowing agents to communicate with both internal and external agents. This interaction enables agents to share knowledge, answer complex queries, and enhance user guidance or business support through a collaborative Al network. Key components include:

[0010] • Self-Management Module: Enables businesses to autonomously create and manage their digital presence, including configuring customer-specific agents that represent their brand and services.

[0011] • Compliance Agent: An Al-powered content moderation agent that maintains a clean and secure environment by ensuring platform compliance. • Multi-Agent System: A collaborative ecosystem of specialized Al agents fulfilling diverse platform needs, such as visitor support, content moderation, and marketing, creating a seamless and adaptive user experience.

[0012] This invention is designed to scale globally, providing quality, compliance, and engagement for diverse user needs.

[0013] Detailed Description of the Invention

[0014] The invention combines several technological innovations to form a comprehensive, interactive platform. Each component and its function within the system are outlined below:

[0015] 1. 3D Virtual Tour Module (Immersive Virtual Space)

[0016] • Role: Provides realistic, high-resolution representations of physical spaces, allowing users to explore virtually. This module supports technologies like 360-degree cameras, drones, and 3D scanning, creating immersive experiences enriched by interactive elements such as hotspots.

[0017] 2. Map-Based Platform

[0018] • Role: Acts as the main navigation interface, displaying points of interest (POIs) with clickable icons that guide users into immersive virtual spaces or external websites. This feature allows businesses to maintain a presence on the platform without requiring a full virtual tour.

[0019] 3. Al Agents (Nervous System of the Platform)

[0020] The platform’s Al agents operate as its “nervous system,” powered by distributed knowledge bases and agent-to-agent interactions to perform key functions that ensure the platform remains functional, compliant, and engaging. Importantly, the platform is designed to leverage these agents not only for user-facing roles but also for ongoing maintenance, optimization, and development.

[0021] • Platform Guide Agent: The platform-wide guide that welcomes users, remembers interactions, and offers personalized recommendations, enhancing user engagement and assisting with platform navigation. Powered by knowledge from diverse data sources, it adapts its guidance based on real-time interactions and context.

[0022] • Customer-Specific Agent: Configured for each POI by the business, this agent embodies the brand’s personality and provides tailored information, acting as a knowledgeable representative or host. It uses relevant knowledge bases to deliver accurate information and coordinates with other agents as needed.

[0023] • Visitor Assistant Agent: Personalized for each visitor, this agent proactively searches for relevant offers, tracks product availability, and delivers notifications tailored to the user’s interests. Its recommendations are strengthened through dynamic data access and coordination with other agents.

[0024] • Compliance Agent: A dedicated moderation agent that maintains content standards by overseeing interactions and automating moderation processes, ensuring a safe and appropriate environment. It collaborates with both internal and external agents to ensure a thorough moderation process. • Engagement and Marketing Agents: Designed to generate demand and support business growth, these agents manage marketing campaigns, customer engagement, and service promotion by leveraging distributed knowledge and engaging in agent-to- agent communication for real-time insights.

[0025] Key Features and User Processes

[0026] Visitor Experience:

[0027] Visitors interact with the Platform Guide Agent for platform navigation and recommendations, engage with Customer-Specific Agents within POIs for detailed information, and benefit from the Visitor Assistant Agent for proactive support. This multi-agent system ensures a personalized and engaging user experience by dynamically drawing on distributed knowledge and leveraging inter-agent interactions.

[0028] Customer Experience:

[0029] The Self-Management Module enables businesses to manage their digital presence and configure Customer-Specific Agents fortailored visitor interaction. The platform’s Reporting Module collects data on user interactions, helping businesses refine content and engagement strategies based on analytics.

[0030] System Components and Their Roles

[0031] • 3D Virtual Tour Module (Immersive Virtual Space): High-resolution, interactive representations of physical spaces.

[0032] • Map-Based Platform: Central interface for selecting and exploring points of interest.

[0033] • Platform Guide Agent: Platform-wide Al guide that provides user assistance.

[0034] • Customer-Specific Agent: Configurable Al representative for each POI, providing tailored information and guidance.

[0035] • Visitor Assistant Agent: Personal Al assistant forvisitors, delivering real-time support and notifications.

[0036] • Compliance Agent: Automated Al guardian for content moderation and compliance.

[0037] • Engagement and Marketing Agents: Al agents dedicated to business growth and user engagement.

[0038] • Self-Management Module: Self-service portal for business content management.

[0039] • Reporting Module: Data collection and analytics tool for business insights.

[0040] • Database for Content Storage and Retrieval: Repository for multimedia and interaction data.

[0041] User Devices (Laptops, Mobile Phones, VR Headsets): Cross-device compatibility for accessibility.

Claims

AMENDED CLAIMS received by the International Bureau on 09 October 2025 (09.10.2025)1. A computer-implemented system for integrating and displaying real and virtual information streams within an interactive 3D environment, comprising: a) a content integration module configured to collect and synchronize data from multiple physical and online sources, including media streams, APIs, and local feeds; b) a synchronization engine configured to maintain real-time consistency between content displayed in a physical venue and its corresponding virtual representation; c) a scene manager configured to render said synchronized information within a 3D virtual environment; d) a context engine determining which information stream is relevant to the user based on position, orientation, or interaction; and e) (e) an Al moderation and compliance module ensuring that displayed information meets predefined content and safety policies by automatically detecting and filtering out non-compliant or redundant content prior to rendering.

2. A computer-implemented method for maintaining synchronized and compliant presentation of physical and virtual information within an interactive 3D environment, comprising: a) receiving content from one or more real-world or online sources; b) mapping said content to corresponding virtual display elements; c) detecting updates to the one or more physical sources; d) automatically updating the corresponding virtual representations in real time; and e) validating and moderating the updates through Al-based rules to ensure compliance with predefined policies.

3. A non-transitory computer-readable medium storing instructions which, when executed by one or more processors, cause the processors to perform the method of claim 2.

4. The system of claim 1, wherein synchronization includes automatic reflection of playlist or media stream updates from physical displays into the virtual environment.

5. The system of claim 1, wherein synchronization is bidirectional, enabling control commands from the virtual environment to modify content on corresponding physical displays.

6. The system of claim 1 , wherein user interaction triggers on-demand updates of linked real-world sources.

7. The system of claim 1, wherein the context engine prioritizes content based on user focus, proximity, or engagement metrics.

8. The system of claim 1, further comprising a self-service management interface allowing a business entity to define and update its associated content streams through a controlled process verified by an Al moderation module before publication.

9. The system of claim 1, wherein each business or organization is represented by a dynamic virtual identity that evolves automatically by processing real-world data streams reflecting operational or environmental changes.

10. The system of claim 9, wherein Al moderation agents analyze proposed changes to the virtual identity before applying them to ensure policy and branding compliance.

11. The system of claim 1 , wherein synchronization performance metrics and moderation results are stored in a traceable audit log for transparency and monitoring.

12. The method of claim 2, wherein updates are performed continuously or periodically according to network latency and content change frequency.

13. The computer program of claim 3, wherein execution further generates alerts when a synchronized data source changes in real time.

Images