Multi-level interaction system fusing space-time constraints

Abstract

The invention belongs to the cross technical field of a computer technology and a geographic information system (GIS), and particularly relates to a multi-level interaction system fusing space-time constraints, which comprises a user management module used for identity authentication, authority distribution and operation auditing; the virtual earth module is used for constructing a virtual space and superposing multiple layers; the multi-dimensional event modeling module is used for standardizing multi-modal event data; the multi-timeline space-time synchronization engine module is used for managing timelines and event synchronization; the intelligent space-time publishing module is used for dynamically distributing event data; the space-time constraint interaction engine is used for checking the space-time compliance of user operation; the instant messaging module is used for supporting multi-mode instant messaging; and the interactive visualization module is used for rendering spatio-temporal data and user interaction.

Description

Technical Field

[0001] The present invention belongs to the cross - technical field of computer technology and Geographic Information System (GIS), and particularly relates to a multi - level interaction system integrating spatio - temporal constraints. Background Art

[0002] In recent years, with the integrated application of Internet of Things (IoT), Augmented Reality (AR) and Geographic Information System (GIS) technologies, the demand for cross - level and multi - modal real - time interaction has grown rapidly. However, the existing technologies still face significant challenges in dealing with complex spatio - temporal data management, dynamic protocol adaptation and multi - timeline coordination.

[0003] Traditional GIS systems usually adopt a layer architecture of independent single - building modeling, resulting in the fragmentation of same - floor data across regions and buildings. For example, when a user is navigating in a shopping mall, the second floors of Building A and Building B cannot be automatically associated as a continuous space, and manual annotation or repeated data loading is required.

[0004] In scenarios such as industrial control and content management, existing systems often adopt a single physical timeline, making it difficult to support the logical isolation of historical correction and future deduction. For example: In the industrial scenario, manual intervention is required for the rollback of equipment historical status, and future maintenance plans cannot be dynamically corrected; In content management, the release time and display time of multiple versions of content are coupled, resulting in version conflicts and permission out - of - control. Traditional spatio - temporal indexing technologies, such as R - trees and time - series databases, separate the time and space dimensions, resulting in low efficiency of four - dimensional range queries.

[0005] Existing instant messaging systems adopt a static protocol framework and lack the ability to adapt to spatial levels (building level, equipment level, sensor level), resulting in low cross - level communication efficiency. Taking the industrial Internet of Things as an example, high - priority device alarms need to be pushed in real - time at the millisecond level, but traditional solutions cannot dynamically adjust the transmission mode due to protocol solidification. In addition, existing technologies do not integrate a spatio - temporal validity verification mechanism, and continue to send control instructions when the target device is offline or moves out of the geographical fence, causing invalid network load and potential security risks, such as accidentally triggering high - risk devices. This defect is particularly prominent in high - dynamic scenarios such as distributed digital twins and autonomous driving. Summary of the Invention

[0006] In order to overcome the problems in the existing technology, the present invention proposes a multi - level interaction system integrating spatio - temporal constraints.

[0007] The technical solution of the present invention to solve the above - mentioned technical problems is as follows:

[0008] In a first aspect, the present invention provides a multi - level interaction system integrating spatio - temporal constraints, including:

[0009] A user management module for identity authentication, permission allocation and operation auditing;

[0010] Virtual Earth Module, used to construct a virtual space with multi-layer overlay;

[0011] Multi-dimensional Event Modeling Module, used to standardize multi-modal event data;

[0012] Multi-time-line Spatio-temporal Synchronization Engine Module, used to manage time lines and event synchronization;

[0013] Intelligent Spatio-temporal Publishing Module, used to dynamically distribute event data;

[0014] Spatio-temporal Constraint Interaction Engine, used to verify the spatio-temporal compliance of user operations;

[0015] Instant Messaging Module, used to support multi-modal instant messaging;

[0016] Interactive Visualization Module, used to render spatio-temporal data and for user interaction.

[0017] Furthermore, the user management module includes a user identity authentication unit, a static role permission unit, a data security protection unit, a spatio-temporal awareness permission control unit, and an operation auditing unit;

[0018] The user identity authentication unit is used to support multiple identity authentication methods to verify the user's identity; and manage the user session state;

[0019] The static role permission unit is used to define user roles and their corresponding operation permissions, isolated from the spatio-temporal awareness permission control logic;

[0020] The data security protection unit is used to protect user sensitive information using encryption technology and achieve data encryption during transmission through a secure transmission protocol;

[0021] The spatio-temporal awareness permission control unit is used to generate access policies based on time, geography, and event types; work in coordination with the intelligent spatio-temporal publishing module, spatio-temporal rule manager, and multi-time-line spatio-temporal synchronization engine to achieve dynamic and flexible permission management;

[0022] The operation auditing unit is used to record the user behavior trajectory and interaction record operation logs, where the trajectory includes the geographical location at login and the real-time location of event interaction. The geographical location at login is the initial geographical location when the user logs in through the identity authentication unit; the real-time location of event interaction is the real-time location when the user interacts with the event entity in the multi-dimensional event modeling module.

[0023] Further, the spatio-temporal perception permission control unit is also used to define spatio-temporal filtering rules, which include time window filtering and geographical fence filtering. Time window filtering only retains the location data within a preset time window before and after an event interaction or the location data within a preset time window; geographical fence filtering means that when the user's location exceeds the geographical fence associated with the event, recording stops.

[0024] Further, the virtual earth module includes a multi-layer integration unit and a dynamic scheduling controller;

[0025] The multi-layer integration unit is used to dynamically overlay multiple digital map services, select or combine different layers according to requirements; it is also used to trigger the multi-dimensional event modeling module to recalculate the coordinate mapping when the geographical fence range changes; the tile alignment accuracy data is input to the intelligent spatio-temporal publishing module to assist in spatio-temporal consistency verification;

[0026] The dynamic scheduling controller is used to real-time schedule tile data according to the user's viewpoint position; adjust the tile accuracy according to the verification result of the spatio-temporal rule engine.

[0027] Further, the multi-dimensional event modeling module includes an event entity integration unit, an event meta-model unit, a dynamic identifier generator, a spatio-temporal reference service interface, a spatial projection and rendering engine, and an interaction protocol binder;

[0028] The event entity integration unit is used for accessing multiple-modal event entities; standardizing the multi-modal event data format into structured data containing time, space, and event type information, for realizing cross-module spatio-temporal consistency verification and dynamic interaction control;

[0029] The event meta-model unit is used to define a unified metadata model and send the output metadata to the dynamic identifier generator and the multi-timeline spatio-temporal synchronization engine;

[0030] The dynamic identifier generator is used to generate a unique event identifier carrying spatio-temporal information according to the metadata provided by the event meta-model unit; the generated identifier also carries the permission label of the user management module, and the permission label is directly parsed and verified by the multi-timeline engine; the AR effect type is driven by the timeline type of the multi-timeline engine and is rendered through the interactive visualization module;

[0031] The spatio-temporal reference service interface is used to call the coordinate transformation service provided by the virtual earth module; realize the time synchronization calibration of the event identifier; the calibrated spatio-temporal reference data is output to the intelligent spatio-temporal publishing module for collaborative verification; when the time synchronization deviation exceeds the threshold, trigger the user management module to update the geographical fence policy;

[0032] The spatial projection and rendering engine is used to perform coordinate mapping for event identification; the coordinate conversion result is fed back to the virtual earth module to correct the tile alignment error, forming a coordinate conversion - map update closed loop;

[0033] The interaction protocol binder is used to bind cross - level operation protocols to event identifications.

[0034] Further, the multi - timeline spatio - temporal synchronization engine module includes a timeline generation unit and a spatio - temporal rule verification unit;

[0035] The timeline generation unit is used to dynamically generate at least two logical timelines, and the timeline data is synchronized to the interactive visualization module to distinguish rendering modes;

[0036] The spatio - temporal rule verification unit is used to verify the validity of timestamps and the matching of spatial permissions for cross - timeline operations; when and only when the verification is successful, the user is allowed to perform the target operation, and the interactive visualization module is triggered to update dynamic annotations; among them, the allowed operations include at least one of releasing the interface interaction lock and activating the data writing permission.

[0037] Further, the intelligent spatio - temporal publishing module includes a multi - dimensional rule unit and a collaborative verification unit;

[0038] The multi - dimensional rule unit is used to define composite trigger conditions for timestamps, time windows, and geographical fences; and is synchronized to the user management module through the spatio - temporal rule manager;

[0039] The collaborative verification unit is used to call the spatio - temporal reference interface to implement spatio - temporal consistency verification; the verification result is real - time transmitted back to the user management module to dynamically adjust the permission policy.

[0040] Further, the intelligent spatio - temporal publishing module includes a multi - dimensional rule unit and a collaborative verification unit;

[0041] The multi - dimensional rule unit is used to define composite trigger conditions for timestamps, time windows, and geographical fences; and is synchronized to the user management module through the spatio - temporal rule manager;

[0042] The collaborative verification unit is used to call the spatio - temporal reference interface to implement spatio - temporal consistency verification; the verification result is real - time transmitted back to the user management module to dynamically adjust the permission policy.

[0043] Further, the instant messaging module includes a real - time message transmission unit and a social network enhancement unit;

[0044] The real - time message transmission unit is used to achieve real - time cross - terminal synchronization of message status; the synchronization logic is driven by the timeline types of the multi - timeline engine, and the real - time stream timeline enforces strong consistency; file transfer uses the encrypted link of the user management module;

[0045] The social network enhancement unit is used to support user relationship chain management, dynamic comments and forwards; the event entities of the dynamic content association multi-dimensional event modeling module, such as comments, are bound to specific AR identifiers; the change of the relationship chain triggers the intelligent spatio-temporal publishing module to update the geofence whitelist.

[0046] Furthermore, the interactive visualization module includes a dynamic annotation generation unit and a rendering optimization engine;

[0047] The dynamic annotation generation unit is used for rendering, and the priority is jointly determined by the tile data of the virtual earth module and the behavior records of the user management module; the change of the annotation status triggers the intelligent spatio-temporal publishing module to update the conditions;

[0048] The rendering optimization engine is used to instantiate the merged result and feedback it to the multi-dimensional event modeling module to optimize the spatial projection calculation.

[0049] Compared with the prior art, the present invention has the following technical effects:

[0050] Through the global same-floor virtualization architecture, the same physical floors across buildings are aggregated into a continuous spatial layer to achieve cross-regional same-level data linkage; design a four-dimensional spatio-temporal joint indexing method, combine the R* tree and the time wheel to construct a hybrid index structure, and reduce the spatio-temporal range query complexity of hundreds of millions of data to O(log n); adopt a historical / future timeline isolation mechanism, and achieve time-sequence operation safety control through version number rollback and dynamic deduction model; based on the dynamic protocol switching and spatio-temporal validity verification of the spatial hierarchy, achieve high-priority message delivery. The present invention is applicable to industrial Internet of Things, AR navigation, metaverse social and multi-version content management scenarios, and significantly improves the cross-level interaction efficiency and security. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] In order to more clearly illustrate the technical solutions and advantages in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required to be used in the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0052] Figure 1 It is a schematic diagram of the overall structure of the system of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0053] To further elaborate on the technical means and effects adopted by the present invention to achieve the intended invention purpose, the following, in conjunction with the accompanying drawings and preferred embodiments, details the specific implementation manners, structures, features and their effects of the technical solutions proposed according to the present invention. The specific features, structures or characteristics in one or more embodiments can be combined in any suitable form. Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the technical field to which the present invention belongs.

[0054] In one embodiment of the present invention, referring to Figure 1 , a multi-level interactive system integrating spatio-temporal constraints is provided, which includes three levels: a data layer, an engine layer, and an application layer, as well as five closed-loop control mechanisms: policy execution, data rendering, security control, resource scheduling, and cross-chain collaboration, to achieve efficient management and real-time interaction of cross-level spatio-temporal data.

[0055] The data layer includes a user management module, a virtual earth module, and a multi-dimensional event modeling module. The user management module is used for identity authentication, permission allocation, and operation auditing; the virtual earth module is used for constructing a virtual space with multi-layer superposition; the multi-dimensional event modeling module is used for standardizing multi-modal event data.

[0056] The engine layer includes a multi-timeline spatio-temporal synchronization engine module, an intelligent spatio-temporal publishing module, and a spatio-temporal constraint interaction engine. The multi-timeline spatio-temporal synchronization engine module is used for managing timeline and event synchronization; the intelligent spatio-temporal publishing module is used for dynamically distributing event data; the spatio-temporal constraint interaction engine is used for verifying the spatio-temporal compliance of user operations.

[0057] The application layer includes an instant messaging module and an interactive visualization module. The instant messaging module is used for supporting multi-modal instant messaging; the interactive visualization module is used for rendering spatio-temporal data and user interaction.

[0058] The five-ring closed-loop control mechanism includes a policy execution loop, a data rendering loop, a security control loop, a resource scheduling loop, and a cross-chain collaboration loop.

[0059] The modules collaborating in the policy execution loop include the user management module, the intelligent spatio-temporal publishing module, the multi-timeline spatio-temporal synchronization engine module, and the instant messaging module, which are used for generating dynamic permission policies, issuing rules, cross-timeline verification, and violation interception to ensure operation compliance.

[0060] The modules collaborating in the data rendering loop include the multi-dimensional event modeling module, the virtual earth module, the interactive visualization module, and the intelligent spatio-temporal publishing module, which are used for event coordinate projection, tile alignment, dynamic annotation generation, spatio-temporal consistency verification, with an error ≤ 0.5 meters.

[0061] The modules for security control loop collaboration include a multi-timeline spatio-temporal synchronization engine, a user management module, a virtual earth module, and an interactive visualization module, which are used for illegal operation, privilege downgrading, map detail hiding, interface simplification, and the risk of sensitive data leakage is reduced by 90%.

[0062] The modules for resource scheduling loop collaboration include a virtual earth module, a spatio-temporal constraint interaction engine, an interactive visualization module, and an intelligent spatio-temporal publishing module, which are used to dynamically adjust the rendering mode (4K / low precision) according to device performance (such as GPU load) to ensure a smooth experience of 30fps.

[0063] The modules for cross-chain collaboration loop include a multi-timeline spatio-temporal synchronization engine, a multi-dimensional event modeling module, an instant messaging module, and an interactive visualization module, which are used to correct and trigger future deduction updates according to historical events, and the cross-chain synchronization delay of data is ≤200ms to avoid spatio-temporal paradoxes.

[0064] In this embodiment, the user management module includes a user identity authentication unit, a static role permission unit, a data security protection unit, a spatio-temporal awareness permission control unit, and an operation audit unit.

[0065] The user identity authentication unit is used to support multiple identity authentication methods, such as username / password, biometric recognition, etc., to verify the user's identity; and manage the user session state, including the creation, maintenance, and termination of the session, to ensure that the user's operations during the session are continuous and secure. The user identity authentication unit is the first line of defense for users to access the system, effectively preventing unauthorized users from accessing system resources.

[0066] The static role permission unit is used to define user roles and their corresponding operation permissions, such as administrator, ordinary user, etc., and each role has a clear permission scope; it is isolated from the spatio-temporal awareness permission control logic to ensure the stability and independence of static permission management. It simplifies the permission management process, enabling system administrators to more easily allocate and manage user permissions.

[0067] The data security protection unit is used to protect user sensitive information, such as passwords, personal information, etc., using encryption technology; and implement data encryption during transmission through secure transmission protocols (such as HTTPS, SSL / TLS) to prevent data from being stolen or tampered with.

[0068] The spatio-temporal awareness permission control unit is used to generate access policies based on time, geography, and event types to achieve finer-grained permission control; it works in collaboration with the intelligent spatio-temporal publishing module, the spatio-temporal rule manager, and the multi-timeline spatio-temporal synchronization engine to achieve dynamic and flexible permission management.

[0069] The operation audit unit is used to record the user behavior trajectory and interaction record operation logs, including user login, operation time, operation type, operation result, etc. It provides traceability for the system, facilitating investigation and analysis in case of security incidents, and is also an important part of compliance requirements.

[0070] Specifically, recording the user behavior trajectory includes collecting the geographical location at login and the real-time location of event interaction. The geographical location at login is the initial geographical location when the user logs in through the identity authentication unit; the real-time location of event interaction is the real-time location when the user interacts with event entities (AR identifier, virtual device) in the multi-dimensional event modeling module, and does not record location update data generated by non-interactive behaviors such as page refresh and map panning. Dynamically filter data through spatio-temporal rules, and use differential coding for compression storage, reducing the data volume to 30% of the traditional solution.

[0071] The spatio-temporal awareness permission control unit also defines spatio-temporal filtering rules, which include time window filtering and geographical fence filtering. Time window filtering only retains location data within a preset time window before and after event interaction, such as 5 minutes before to 10 minutes after interaction, or location data within a preset time window, such as 8:00 - 10:00 every day, or 17:00 - 19:00 from Monday to Friday every week. All location data within this time period is retained. Geographical fence filtering means that recording stops when the user's location exceeds the event-associated geographical fence. Data compression storage: Use differential coding (Delta Encoding) to compress continuous location points, reducing the storage space by 60% - 80%.

[0072] Through selective collection and dynamic filtering, the user trajectory data volume is reduced to 30% of the traditional solution, while maintaining the accuracy of key behavior analysis; support real-time trajectory prediction: Based on the event interaction location and time window, predict the user's next-stage behavior (such as the triggering probability of AR identifier).

[0073] The specific steps of the user management module include: The user logs in through the identity authentication unit, providing a username and password or other authentication methods; the identity authentication unit verifies the user information, generates a session token, and records the user session status; the static role permission unit assigns corresponding operation permissions according to the user role; the spatio-temporal awareness permission control unit generates an access policy based on the current time and location; the data security protection unit encrypts the user's sensitive information to ensure transmission security; the operation audit unit records the user's login behavior and generates operation logs.

[0074] In this embodiment, the virtual earth module includes a multi-layer integration unit and a dynamic scheduling controller.

[0075] The multi-layer integration unit is used to dynamically overlay multiple digital map services, such as satellite maps, topographic maps, POI (Point of Interest) layers, etc., providing users with rich map information display methods. Users can select or combine different layers according to their needs to meet different application scenarios and user requirements. It is also used to trigger the multi-dimensional event modeling module to recalculate the coordinate mapping when the geographical fence range changes. That is, when a user demarcates or adjusts a geographical fence area on the map, the coordinate mapping relationship of relevant geographical entities is recalculated according to the new fence range to ensure the accuracy and consistency of map information. The tile alignment accuracy data is input into the intelligent spatio-temporal publishing module to assist in spatio-temporal consistency verification. Tiles are a form of organizing map data. By cutting map data into small pieces (tiles) for storage and transmission, the efficiency of map loading and rendering can be improved. The tile alignment accuracy data is crucial for ensuring the accuracy and consistency of map data. The intelligent spatio-temporal publishing module will use this data for spatio-temporal consistency verification to provide high-quality map services.

[0076] The dynamic scheduling controller real-time schedules tile data according to the user's viewpoint position and adjusts the tile accuracy according to the verification results of the spatio-temporal rule engine. The dynamic scheduling controller can real-time schedule tile data according to the user's viewpoint position. This means that when a user moves or zooms the view on the map, the system will dynamically load and display the corresponding tile data according to the user's current viewpoint position to improve the map loading speed and user experience. The dynamic scheduling controller will also adjust the tile accuracy according to the verification results of the spatio-temporal rule engine. The spatio-temporal rule engine is a complex system that formulates a series of rules based on time, space, and other relevant factors to control the display accuracy and loading strategy of map data. By working in cooperation with the spatio-temporal rule engine, the dynamic scheduling controller can ensure the display accuracy and loading efficiency of map data under different time and space conditions.

[0077] In this embodiment, the multi-dimensional event modeling module includes an event entity integration unit, an event meta-model unit, a dynamic identifier generator, a spatio-temporal reference service interface, a spatial projection and rendering engine, and an interaction protocol binder.

[0078] The event entity integration unit is used for accessing multi-modal event entities, including but not limited to text, audio, image, video, live broadcast, virtual devices, emails, red envelopes, digital humans, etc.; standardizing the multi-modal event data format into structured data containing time, space, and event type information for realizing cross-module spatio-temporal consistency verification and dynamic interaction control.

[0079] The event meta-model unit is used to define a unified meta-data model containing elements such as timestamps, spatial coordinates, event types, interaction permissions, etc., and send the output meta-data to the dynamic identifier generator and the multi-timeline spatio-temporal synchronization engine.

[0080] The dynamic identifier generator is used to generate a unique event identifier carrying spatio-temporal information according to the metadata provided by the event meta-model unit. The identifier can be in the form of an icon, AR effect, etc., and is used to uniquely identify an event in the system. The generated identifier also carries the permission tags of the user management module, and the permission tags are directly parsed and verified by the multi-timeline engine. The AR effect type is driven by the timeline type of the multi-timeline engine and is rendered through the interactive visualization module.

[0081] The multi-dimensional event modeling module also includes the functions of hidden event publishing and dynamic trigger management: the event metadata (time, location, permission tags) is associated with the composite trigger conditions of the intelligent spatio-temporal publishing module; the event visibility needs to satisfy both spatio-temporal constraints (time window and geographical fence) and interaction constraints (preset operations).

[0082] The spatio-temporal reference service interface is used to call the coordinate conversion service provided by the virtual earth module (such as WGS84→GCJ-02); to achieve the time synchronization and calibration of the event identifier (the mapping between UTC time and the user's local time zone). The calibrated spatio-temporal reference data is output to the intelligent spatio-temporal publishing module for collaborative verification; when the time synchronization deviation exceeds the threshold, the user management module is triggered to update the geographical fence policy.

[0083] The spatial projection and rendering engine is used to perform the coordinate mapping of the event identifier (WGS84→screen coordinates); the coordinate conversion result is fed back to the virtual earth module to correct the tile alignment error, forming a closed loop of coordinate conversion→map update.

[0084] The interaction protocol binder is used to bind cross-level operation protocols (double-click to view, long-press to edit) to the event identifier; the protocol status change logic: is dynamically controlled by the timeline logic of the multi-timeline engine, and when it changes, it triggers the re-binding of the event identifier.

[0085] In this embodiment, the multi-timeline spatio-temporal synchronization engine module includes a timeline generation unit and a spatio-temporal rule verification unit.

[0086] The timeline generation unit is used to dynamically generate at least two logical timelines, and the timeline data is synchronized to the interactive visualization module to distinguish the rendering modes. Specifically, the logical timelines can be defined according to different requirements and application scenarios. For example, the full-temporal timeline is used to record the complete historical state of the system, while the real-time stream timeline is used to reflect the current real-time data changes. Other possible timelines also include the display timeline (for user interface display), the release timeline (recording the time points of information release), the creation timeline (tracking the creation moments of data or objects), etc. By generating multiple logical timelines, it is possible to handle data in different time dimensions more flexibly, supporting functions such as complex time travel, historical backtracking, and real-time monitoring. The logical timeline data will be synchronized to the interactive visualization module to display the corresponding data states according to the currently selected rendering mode (such as the historical mode, real-time mode, etc.).

[0087] The spatio-temporal rule verification unit is used to verify the validity of timestamps and the matching of spatial permissions for cross-timeline operations; only when the verification is successful, the user is allowed to perform the target operation, and the interactive visualization module is triggered to update the dynamic annotations; among them, the allowed operations include at least one of releasing the interface interaction lock and activating the data writing permission.

[0088] This means that when the user attempts to perform certain operations (such as data modification, status switching, etc.) between timelines, it is necessary to check whether these operations comply with the preset time logic and spatial access control rules. Through a strict verification mechanism, the spatio-temporal rule verification unit ensures the consistency and security of the system data. Only when the timestamp of the operation is valid and the user has the corresponding spatial permissions, the operation will be allowed to be executed. Once the verification is successful, the system will release the interface interaction lock, activate the data writing permission, etc., and at the same time trigger the interactive visualization module to update the dynamic annotations to reflect the results of the operation and the latest state of the system.

[0089] In this embodiment, the intelligent spatio-temporal release module includes a multi-dimensional rule unit and a collaborative verification unit.

[0090] The multi-dimensional rule unit is used to define the composite trigger conditions of timestamps, time windows, and geofences; it is synchronized to the user management module through the spatio-temporal rule manager. Specifically, the timestamp is used to specify a specific moment or time period, the time window defines a time range within which certain operations or events may be triggered. The geofence is a virtual boundary used to limit activities or access permissions within a geographical space. By defining the composite trigger conditions, the multi-dimensional rule unit provides a flexible and powerful rule basis for intelligent spatio-temporal release. These rules are synchronized to the user management module through the spatio-temporal rule manager, enabling the user management module to manage the access permissions and operation permissions of users according to these rules.

[0091] The collaborative verification unit is used to call the spatio-temporal reference interface to implement spatio-temporal consistency verification; the verification result is transmitted back to the user management module in real time to dynamically adjust the permission policy. When a user attempts to perform certain operations (such as data modification, status switching, etc.) between timelines, the system needs to check whether these operations comply with the preset time logic and spatial access control rules. Through a strict verification mechanism, the spatio-temporal rule verification unit ensures the consistency and security of system data. Only when the timestamp of the operation is valid and the user has the corresponding spatial permissions will the operation be allowed to execute. Once the verification is successful, the system will release the interface interaction lock, activate the data writing permission, etc., and at the same time trigger the interactive visualization module to update the dynamic annotation to reflect the result of the operation and the latest state of the system.

[0092] In this embodiment, the spatio-temporal constraint interaction engine includes an event interaction system and a spatio-temporal rule manager.

[0093] The event interaction system is used to process user operations, such as leaving messages, liking, etc., and generates a unique event identifier for these operations through a dynamic identifier generator. The event identifier is bound to a specific event to ensure the uniqueness and traceability of the event; it is also used for real-time synchronization across devices, which means that user operations on different platforms such as mobile phones, PCs, AR devices, etc. can be synchronized in real time, and the synchronization delay is controlled within 200 ms. This real-time synchronization ability enhances the user experience and enables users to seamlessly switch between different devices and continue their interaction activities. Before the event identifier is transmitted, the multi-timeline engine will verify the validity of the timestamp to ensure the chronological order and accuracy of the event, which helps to prevent chaos or conflicts caused by incorrect timestamps. The cross-device synchronization signal will trigger the update of the interactive visualization module, and the annotation display status will change accordingly, which enables users to intuitively see the status and progress of the event and enhances the intuitiveness and real-time nature of the interaction.

[0094] The spatio-temporal rule manager is used to define the spatio-temporal constraints of interaction behaviors, such as triggering within a geofence. The constraint rules determine which interaction behaviors are allowed or triggered under specific time and space conditions; the constraint rules are synchronized to the multi-timeline engine through the intelligent spatio-temporal publishing module, which ensures the consistency and real-time nature of the rules and enables the same constraint rules to be applied on different devices and timelines.

[0095] In this embodiment, the instant messaging module includes a real-time message transmission unit and a social network enhancement unit.

[0096] The real-time message transmission unit is used to achieve real-time synchronization of message status (read / unread) across terminals; the synchronization logic is driven by the timeline types of the multi-timeline engine, and the real-time stream timeline enforces strong consistency; file transfer uses the encrypted link of the user management module, ensuring the security of files during transmission. This encryption mechanism prevents unauthorized access and data leakage, protecting the privacy of users.

[0097] The social network enhancement unit is used to support user relationship chain management, including functions such as following and blocking. Users can manage their relationship chains with other users according to their own needs and interests, establishing or disconnecting connections. This unit also supports dynamic comment and forwarding functions. Users can comment on or forward the published dynamics, increasing the diversity and fun of interactions. Dynamic content can be associated with the event entities of the multi-dimensional event modeling module. For example, comments can be bound to specific AR (augmented reality) identifiers, making the comments closely related to AR content and enhancing the user's immersion and engagement. This association method makes the dynamic content more rich and diverse, meeting the different needs of users. When the user's relationship chain changes (such as following or blocking a user), the social network enhancement unit triggers the intelligent spatio-temporal publishing module to update the geofence whitelist. This means that changes in the relationship chain will affect the geofence information that users can receive, enabling users to obtain more relevant and useful information based on their relationship chains.

[0098] In this embodiment, the interactive visualization module includes a dynamic annotation generation unit and a rendering optimization engine.

[0099] The rendering priority of the dynamic annotation generation unit is jointly determined by the tile data of the virtual earth module and the behavior records of the user management module; changes in annotation status (such as hiding / displaying) trigger the update conditions of the intelligent spatio-temporal publishing module. Specifically, the virtual earth module provides tile data of the geospatial area, determining which areas are currently in the user's view and the level of detail of these areas; the user management module records the user's behaviors, such as zooming, panning, clicking, etc. These behaviors reflect the user's interests and focus on the current view; the dynamic annotation generation unit combines this information from both aspects to calculate the rendering priority of each annotation, ensuring that the annotations that the user cares most about can be displayed first. When the status of an annotation changes (such as changing from hidden to displayed, or from displayed to hidden), the dynamic annotation generation unit will trigger the intelligent spatio-temporal publishing module to update the conditions. This means that changes in the annotation status will affect the update and presentation of the entire visualization environment, ensuring that the information seen by the user is always up-to-date and accurate.

[0100] The rendering optimization engine is used to instantiate the merged results and feedback them to the multi-dimensional event modeling module to optimize the spatial projection calculation. Specifically, during the rendering process, the rendering optimization engine merges similar or adjacent graphic elements, reducing the complexity and overhead of rendering. Instantiating the merged results means that for a large number of similar graphic elements, the rendering optimization engine only renders one representative element and simulates the positions and forms of other elements through transformations. These merged results are fed back to the multi-dimensional event modeling module for optimizing the spatial projection calculation. The multi-dimensional event modeling module adjusts the parameters and algorithms of the spatial projection based on these feedbacks to further improve the accuracy and efficiency of rendering.

[0101] In an embodiment of the present invention, a method for generating a three-dimensional virtual earth is proposed, including the following steps:

[0102] Step S11: Define the three-dimensional virtual earth hierarchical structure.

[0103] Set the integer layer "Layer 0" as the completely virtual layer, and the completely virtual layer allows users to freely publish identifiers. Users can add various custom geographical identifiers or information on the virtual earth according to their own needs and creativity, such as points of interest (POIs), event markers, personal notes, etc.

[0104] Credit verification is triggered when publishing information on non-zero layers: When publishing information on non-zero layers, a credit verification mechanism is triggered to ensure the identity of the publisher and the authenticity of the information, preventing the spread of false or misleading information.

[0105] A confirmation prompt pops up when switching from a high-privilege floor to a low-privilege floor: When a user switches from a high-privilege floor to a low-privilege floor, the system pops up a confirmation prompt to prevent the user from accidentally leaking sensitive information or reducing privileges due to misoperation. The design of the confirmation prompt should be concise and clear to ensure that the user can quickly understand and make the correct choice, while avoiding unnecessary interference to the user.

[0106] Step S12: Dynamically generate virtual layers and overlay the basic geographical data layer.

[0107] Based on Layer 0, other virtual layers are dynamically generated and overlaid on the basic geographical data layer. The virtual layers can be customized according to the user's needs and preferences, such as adding specific geographical information, thematic data, etc. The generated virtual layers are overlaid on the basic geographical data layer (such as terrain, landform, water system, etc.). This step ensures the authenticity and accuracy of the virtual earth, providing the user with a rich and reliable geographical information platform.

[0108] Step S13: Aggregate the data of the same physical floor of buildings worldwide to the same virtual layer.

[0109] Aggregate building data globally by physical floors to form a continuous three-dimensional virtual Earth space. This step enables users to intuitively browse information on different floors in the virtual Earth.

[0110] Through data aggregation, users can intuitively browse information on different floors in the virtual Earth. This browsing method not only facilitates users' access to and analysis of building information, but also enhances the practicality and interactivity of the virtual Earth.

[0111] It also includes: users switch floors by entering a floor number or clicking a navigation control, and the system provides a floor inquiry mechanism to prevent misoperations. The mechanism includes:

[0112] Credit verification process: When a user attempts to publish custom information on a non-zero floor, the credit verification process is triggered;

[0113] Confirmation prompt: When a user switches from a high-privilege floor to a low-privilege floor, a confirmation prompt pops up;

[0114] Publication event inquiry: When a user publishes an event for the first time, the system asks the user whether to confirm the publication;

[0115] Default confirmation mechanism: After the user confirms, it is not asked by default, but when the user changes the floor and publishes an event again, the system triggers the inquiry process again.

[0116] In an embodiment of the present invention, a virtual Earth visualization method is proposed, including the following steps:

[0117] Step S21: Construct a multi-layer rendering framework.

[0118] The multi-layer rendering framework includes single-layer, multi-layer, and hybrid schemes. This step provides a flexible rendering framework for the visualization of the virtual Earth, and a suitable rendering scheme can be selected according to different requirements.

[0119] In the single-layer scheme, all layers share the same graphics rendering context, such as a single Canvas or WebGL context. The layer stacking manager is responsible for controlling the stacking order and rendering order of the layers to ensure that each layer is rendered at the correct position and time.

[0120] In the multi-layer scheme, each layer is assigned to an independent graphics rendering container, such as multiple Canvas or WebGL contexts. The view synchronization controller is responsible for keeping the view parameters of each container consistent to ensure that all layers are correctly aligned during rendering.

[0121] The hybrid solution combines the advantages of single-layer and multi-layer solutions, and selects the optimal rendering container according to the layer type. For example, raster layers may be suitable for efficient rendering using the single-layer solution, while vector layers and dynamic annotation layers may be more suitable for the multi-layer solution to achieve more flexible rendering and interaction.

[0122] Step S22: Use dynamic projection correction technology to map the layers on the two-dimensional plane into a three-dimensional sphere visual effect.

[0123] Convert the layers on the two-dimensional plane (such as map tiles, vector data, etc.) into a visual effect on the three-dimensional sphere. Ensure that when users browse the virtual earth, they can feel the real three-dimensional spatial relationship, such as the undulation of the terrain, the three-dimensional effect of buildings, etc.

[0124] Support a variety of three-dimensional perception enhancement means, including but not limited to: perspective projection and mouse drag rotation, off-screen multi-layer composition, path animation and gradient filling.

[0125] Perspective projection, using CSS 3D transformation technology, maps the map tiles on the two-dimensional plane into the three-dimensional space to form a part of the sphere surface. Perspective projection can simulate the natural effect of the human eye observing objects and enhance the three-dimensional perception. Mouse drag rotation allows users to rotate the virtual earth by dragging the mouse, so as to observe the information on the earth's surface from different angles. This interaction method is intuitive and easy to use, greatly improving the user experience.

[0126] Off-screen multi-layer composition, through WebGL multi-Pass rendering and FrameBuffer to achieve complex three-dimensional effects. Through the WebGL multi-Pass rendering technology, different shaders and effects can be applied in different rendering stages, so as to achieve complex three-dimensional visual effects. Using the FrameBuffer object for off-screen rendering, multiple layers or effects can be synthesized into a final rendering result, which is particularly useful for achieving complex lighting, shadow and texture effects.

[0127] Path animation and gradient filling, combined with SVG vector overlay to simulate elevation changes. Through animation technology, the movement trajectories of objects in the three-dimensional space can be simulated, such as the flight of an airplane, the driving of a vehicle, etc. Path animation can enhance the dynamic sense and realism of the virtual earth. Combined with SVG vector graphics, the elevation changes of the terrain or other continuously changing data can be simulated. Through gradient filling, two-dimensional vector data can be converted into graphics with three-dimensional perception effects.

[0128] Step S23: Achieve layer alignment and dynamic loading through spatial indexing technology.

[0129] Use spatial indexing technology to achieve alignment and dynamic loading between layers, improving the loading speed and browsing experience of the virtual earth.

[0130] In a virtual Earth system, layer alignment is crucial to ensure that various layers (such as map tiles, annotations, building outlines, etc.) can be accurately superimposed. Spatial indexing techniques, such as quadtrees, R-trees, etc., can effectively manage the position information of these layers.

[0131] Principle of spatial indexing techniques: These techniques divide the spatial area, establish an index for each area, and thus quickly locate the elements in the layer. For example, the R-tree is a hierarchical structure that recursively divides the dataset space with the minimum bounding rectangle (MBR), enabling the rapid finding of relevant layer elements when querying a specific area.

[0132] Implementation of layer alignment: Using spatial indexing techniques, layers from different sources and with different resolutions can be precisely aligned. When the user moves the viewing angle in the virtual Earth, the system can quickly retrieve and display the layers in the corresponding area, achieving seamless stitching and alignment.

[0133] Dynamic loading refers to the real-time loading and display of layer data according to the user's operations and requirements. This can not only improve the system's response speed but also reduce memory and bandwidth occupancy.

[0134] Application of spatial indexing in dynamic loading: Spatial indexing techniques can help the system quickly determine which layer elements are within the current viewing range, thus preferentially loading these elements. At the same time, for layer elements far from the current viewing angle, loading can be delayed or not done at all to improve system performance.

[0135] For example, in a virtual Earth system, the LOD (Level of Detail) technology can be combined with spatial indexing techniques to achieve dynamic loading. According to the user's zoom level and viewing position, layer data with the corresponding resolution is dynamically loaded. This can improve the system's loading speed and browsing experience while ensuring the visual effect.

[0136] The pseudo-3D effect refers to creating a three-dimensional sense of space on a two-dimensional plane through visual effects and technical means. In a virtual Earth system, this effect can be achieved by displaying the current floor and adjacent floors on the screen in layers. The current floor and adjacent floors are displayed on the screen simultaneously, and the adjacent floors are displayed at a reduced scale of 80% and with an opacity of 0.3. This can create a sense of hierarchy visually and enhance the pseudo-3D effect. The CSS transform property can be used to adjust the size and position of the adjacent floors, and the opacity property can be used to set the transparency. At the same time, JavaScript can be used to listen for the user's click events to achieve switching between floors.

[0137] Cross-building linkage means that in a virtual earth system, when a user operates within a building, it can instantaneously affect the data and display of other buildings on the same floor. When the user clicks on the upper or lower floor area, the system can directly jump to the adjacent floor and synchronously update the virtual layer data of the same floor globally. This can be achieved through global state management (such as Redux, Vuex, etc.) or an event bus. When the floor is switched, the system sends an event to notify all relevant components to update the data. In the front-end implementation, technologies such as WebSocket can be used to achieve real-time communication to ensure that the virtual layer data of the same floor globally can be synchronously updated. Meanwhile, map tile services (such as OpenStreetMap, Google Maps, etc.) can be utilized to provide underlying map data support.

[0138] Through spatial indexing technology, layer alignment and dynamic loading are realized, improving the loading speed and browsing experience of the virtual earth. At the same time, through the generation of pseudo-3D effects and cross-building linkage functions, the user's immersion and interactivity are enhanced. The application of these technologies enables the virtual earth system to operate more efficiently and smoothly, providing users with a richer and more realistic virtual earth experience.

[0139] In this implementation, it also includes a method for generating pseudo-3D effects, which realizes the pseudo-3D effect of screen hierarchical display and provides functions of fast interaction on the same floor and cross-building linkage.

[0140] The screen hierarchical display includes central area display and upper and lower area rendering. The central area display occupies 60% of the screen height and shows the information of the current floor, which is the area that users mainly focus on and interact with. The upper and lower area renderings each occupy 20% of the screen height. The information of adjacent floors is rendered and displayed at a reduced scale of 80% and a transparency of 0.3. Creating a pseudo-3D sense of hierarchy enables users to intuitively perceive the spatial relationship between floors.

[0141] Fast interaction on the same floor includes: when the user clicks on the upper or lower floor area, directly jump to the adjacent floor and update the content displayed in the central area, providing an intuitive and fast floor switching experience and improving the user's operation efficiency. When the user switches floors between different buildings, the virtual layer data of the same floor globally is synchronously updated. Example: When jumping from the second floor of Building A to the second floor of Building B, the user can see the real-time update of the information on the same floor of the two buildings. Achieving seamless switching and information synchronization between buildings enhances the interactivity and practicality of the virtual earth.

[0142] In an embodiment of the present invention, a four-dimensional spatio-temporal joint indexing method is proposed, including the following steps:

[0143] Step 41: Construction of a hybrid indexing structure; including:

[0144] Step 411: Spatial Dimension Indexing;

[0145] To efficiently retrieve three-dimensional spatial data, the R*-tree is used as the indexing structure. The R*-tree is a balanced tree specifically designed for handling multi-dimensional spatial data. In this application, the x (longitude), y (latitude), and z (floor) are used as the three-dimensional spatial coordinates to construct the R*-tree index.

[0146] For full-floor queries, the R*-tree can handle three-dimensional queries that include the z value, i.e., searches that consider longitude, latitude, and floor simultaneously. This enables efficient retrieval of all relevant data within an entire building or area. For single-floor queries, the R*-tree also supports two-dimensional queries that only include x / y, i.e., searches with a fixed floor (z value). This is very useful for application scenarios that require data for a specific floor, such as building management and indoor navigation.

[0147] Suppose there is a three-dimensional spatial data set of a building with multiple floors, and each data point contains longitude, latitude, and floor information. Full-floor query: It is possible to query the temperature and humidity data of all floors within a certain building. The R*-tree will traverse all relevant nodes and return the data points that meet the conditions. Single-floor query: It is possible to query the usage of meeting rooms on a specific floor within a certain building. The dynamic pruning mechanism will automatically skip the nodes that do not contain that floor, thereby only traversing the nodes related to the target floor. This will significantly improve the query efficiency, especially when dealing with a large amount of data.

[0148] To further optimize the query performance, a dynamic pruning mechanism is introduced. When the user specifies a floor (z value is fixed), the R*-tree can automatically skip the node branches that do not contain the target z value, thereby reducing the three-dimensional spatial search to a two-dimensional (x / y) projection.

[0149] Pruning principle: In the R*-tree, each node corresponds to a spatial range (minimum bounding rectangle, MBR). When the user specifies a floor, the nodes that do not contain the z value range of that floor can be filtered based on the z value range of that floor. In this way, the search range is restricted to the nodes related to the target floor, thereby reducing the query complexity. The dynamic pruning mechanism significantly reduces the number of nodes that need to be traversed, thereby improving the query efficiency. Especially when dealing with large-scale three-dimensional spatial data, this optimization is particularly important.

[0150] Using the R*-tree to index three-dimensional spatial coordinates and combining it with the dynamic pruning mechanism can efficiently retrieve three-dimensional spatial data and support full-floor or single-floor query requirements. This indexing structure performs well when dealing with large-scale three-dimensional spatial data and provides powerful data retrieval capabilities for various application scenarios.

[0151] Step 412: Temporal Dimension Indexing;

[0152] To efficiently manage and quickly locate data in the time dimension, a hierarchical time wheel (TimeWheel) is adopted as the indexing structure for the time dimension, which includes time slice division, hierarchical structure, and data block location.

[0153] Time slice division: Historical data and real-time data streams are divided by time slices. Each time slice represents a fixed time period, such as 1 hour, 1 day, etc. This division method enables us to easily retrieve data by time window.

[0154] Hierarchical structure: The time wheel adopts a hierarchical structure to support time window queries with different granularities. For example, the outer time wheel can be divided by day, and the inner time wheel can be divided by hour. In this way, when performing cross-day queries, we can first locate the target day in the outer time wheel and then further locate the specific hour in the inner time wheel.

[0155] Data block location: Each time slice corresponds to a data block, which stores all the data within that time period. Through the time wheel, we can quickly locate the data block within the target time window, thus avoiding scanning the entire dataset.

[0156] To ensure low latency for the insertion and query of new data, real-time optimization is performed on the time wheel, including:

[0157] Sliding window mechanism: The time wheel adopts a sliding window mechanism to dynamically update real-time data slots. When new data arrives, it is inserted into the real-time data slot corresponding to the current time slice. As time goes by, the current time slice slides to the next time slice, and the old time slice is archived into historical data.

[0158] Low-latency insertion and query: Since the time wheel has pre-divided time slices and the real-time data slots are dynamically updated, the insertion and query of new data can be completed in constant time. This enables the indexing structure to efficiently process real-time data streams and meet the requirements of real-time queries.

[0159] Suppose there is a system that contains sensor data, and each sensor uploads its measurement results regularly.

[0160] Historical data query: The time wheel can be used to query sensor data within a specific time period. For example, query the average temperature for each day in the past week.

[0161] Real-time data query: Sensor data within the current time window can be queried in real time. For example, query the latest measurement results of all sensors within the current hour.

[0162] New data insertion: When new sensor data arrives, it is immediately inserted into the real-time data slot corresponding to the current time slice. This ensures that new data can be retrieved in a timely manner and meets the requirements of real-time performance.

[0163] Step 413: Spatio-temporal binding;

[0164] To tightly combine the two dimensions of space and time, a SpatioTemporal Key is introduced. This key directly associates R* tree nodes with time wheel slots, forming a four-dimensional (time + space) index structure.

[0165] The SpatioTemporal Key consists of two parts: a spatial part and a time part. The spatial part is represented by the coordinate range (Minimum Bounding Rectangle, MBR) of the R* tree node, which is used to describe the spatial distribution of the data. The time part is represented by the time wheel slot, which is used to describe the temporal distribution of the data.

[0166] Construction of the index structure: First, an R* tree index is constructed to handle spatial data. Then, the time wheel slots are associated with the R* tree nodes to form SpatioTemporal Keys. In this way, each R* tree node corresponds to a specific time and space range.

[0167] To manage SpatioTemporal Keys more efficiently, a hierarchical mapping rule is formulated.

[0168] Correspondence between time slices and R-tree nodes: Each time slice corresponds to a group of R* tree nodes. The spatial ranges of these nodes are strongly correlated with the geographical distribution of the data within the time slice. This means that when querying data within a certain time slice, only the R* tree nodes corresponding to that time slice need to be considered, thus greatly reducing the search scope.

[0169] Reverse time range filtering of R-tree nodes: Each R* tree node records a list of associated time slices. This list contains all the time slices covered by the node. When performing a time range query, this list can be used to quickly filter out the nodes that do not contain the target time slice, thereby further improving the query efficiency.

[0170] Suppose there is a dataset containing traffic flow, and each data point includes longitude, latitude, time, and flow value.

[0171] Spatio-temporal joint query: It is possible to query the traffic flow within a specific time period and geographical area. Through the SpatioTemporal Key, the R* tree nodes within the target time and space range can be quickly located, and the relevant data can be retrieved.

[0172] Real-time data update: When new traffic flow data arrives, it can be inserted into the corresponding R*-tree nodes and time wheel slots according to its real-time timestamp and geographical coordinates. This ensures that the index structure can reflect the latest state of the data in real time.

[0173] Historical data analysis: The hierarchical mapping rules can be used to analyze the historical traffic flow data within a certain past time period. By filtering out irrelevant time slices and R*-tree nodes, the historical data can be retrieved and analyzed more efficiently.

[0174] In summary, by introducing the spatio-temporal joint key and formulating the hierarchical mapping rules, the two dimensions of space and time are successfully and tightly combined to form a four-dimensional index structure.

[0175] Step 42: Query optimization mechanism;

[0176] To improve the query efficiency of the dataset containing spatio-temporal dimensions, the following query optimization mechanism is designed, which mainly includes two parts: dynamic pruning under dimension constraints and complexity analysis.

[0177] Step 421: Dynamic pruning under dimension constraints;

[0178] Dynamic pruning is a method that gradually reduces the search space according to the given constraint conditions during the query process. In the query optimization mechanism, dynamic pruning is performed for both the time and space dimensions.

[0179] Time slice positioning: According to the time window specified in the query, the associated time wheel slots are first filtered. Through the fast positioning ability of the time wheel, the search range of the time dimension can be quickly narrowed.

[0180] Spatial node filtering: After determining the target time slice, the R*-tree index is used to quickly locate the nodes that match the x / y / z constraints. The efficient spatial indexing ability of the R*-tree enables the rapid finding of the spatial nodes that match the query conditions.

[0181] Direct data block access: Once the target time and space nodes are located, the smallest data unit bound by the spatio-temporal joint key is directly read. By avoiding full-scale scanning, the data reading efficiency is significantly improved.

[0182] Step 422: Complexity analysis;

[0183] To understand the performance of the query optimization mechanism more deeply, complexity analysis is carried out.

[0184] Four-dimensional query: In general, it is necessary to consider four dimensions of time and space (x, y, z, t) simultaneously. The query complexity is O(log T + log S_xyz), where T is the total number of time slices and S_xyz is the number of three-dimensional space nodes. This complexity benefits from the efficiency of the time wheel and the R* tree index, enabling us to complete the query in a short time.

[0185] Three-dimensional query: In some specific scenarios, it may only be necessary to consider three dimensions, such as a fixed z floor. In this case, the query complexity is optimized to O(log T + log S_xy), where S_xy is the number of two-dimensional space nodes. Due to the fixation of the z dimension, the search range of the spatial dimension is reduced, further optimizing the query performance.

[0186] Through dynamic pruning and complexity analysis under dimensional constraints, the query efficiency of datasets containing spatio-temporal dimensions is effectively improved. This query optimization mechanism not only reduces the search space but also avoids unnecessary full-scale scans, providing strong support for efficient data retrieval in practical applications.

[0187] In traditional methods, the time and space indexes are independent. When performing a four-dimensional query (considering four dimensions of time, x, y, and z simultaneously), it needs to be processed in two steps: first, locate the relevant time period through the time index, and then find the matching spatial location within the located time period through the space index. This step-by-step processing method results in a query complexity close to O(log T + K), where T is the total number of time slices and K is the complexity of the space index. In extreme scenarios, if the space index needs to traverse a large amount of data, the complexity may degrade to O(n), where n is the total amount of data. When querying data for a specific floor and time period, the traditional method needs to first extract all the data on the entire floor within the specified time window and then filter out the data in the target time period from it. This method leads to a large amount of ineffective calculations because a lot of the extracted data is not within the target time period but still needs to be loaded and processed. This not only wastes computing resources but also increases the query latency.

[0188] The four-dimensional joint index directly associates the target data block through the spatio-temporal key, enabling the query process to skip irrelevant spatio-temporal regions. This direct association method greatly reduces the generation of intermediate results, avoiding unnecessary calculations and data transmissions. During the query process, only the data blocks related to the target spatio-temporal region are loaded and processed, thus significantly improving the query efficiency. In the scenario of hundreds of millions of data, the four-dimensional joint index can ensure that the query latency is reduced from the second level to the millisecond level, which benefits from the efficient index structure and query optimization mechanism of the four-dimensional joint index. By reducing unnecessary calculations and data transmissions, the four-dimensional joint index can process a large amount of data in a short time and quickly return the query results. This is crucial for application scenarios that require real-time responses.

[0189] For example, in large buildings, a large number of sensors are deployed to monitor various environmental parameters such as temperature, humidity, light intensity, etc. These sensor data have obvious spatio-temporal characteristics, that is, each data point is associated with a specific timestamp and location (floor, room, etc.).

[0190] Query example: Retrieve the temperature and humidity data of the meeting room on the 3rd floor during 10:00 - 10:30.

[0191] Traditional method: First, filter the data of the whole building for 1 hour. Suppose there are 100,000 records; then traverse the R-tree index to filter out the data of the meeting room on the 3rd floor. The whole process takes about 100 ms. Due to the need to process a large amount of irrelevant data, the efficiency is low.

[0192] Four-dimensional index method: Directly locate the R*-tree nodes bound to z = 3 (3rd floor) within the time slice of 10:00 - 10:30, and only scan 100 records that match the query conditions. The whole process takes less than 5 ms, and the query efficiency is significantly improved. By directly associating spatio-temporal keys, the four-dimensional index avoids processing a large amount of irrelevant data, thus significantly improving the query efficiency.

[0193] For example, in a traffic management system, it is necessary to analyze the driving trajectories and traffic flow densities of vehicles on highway sections. These data also have spatio-temporal characteristics, that is, each data point is associated with a specific timestamp and location (x / y coordinates).

[0194] Query example: Statistically analyze the traffic flow density of a certain highway section (fixed x / y range) during the peak period (time window).

[0195] Traditional method: It is necessary to traverse the entire data set to filter out the data points that meet the x / y range and time window. Due to the large data set, the calculation process takes a long time.

[0196] Four-dimensional index method: Directly skip the data of non-highway sections and non-peak periods through spatio-temporal keys. Only process the data points that match the query conditions. The calculation efficiency is increased by more than 20 times. Through an efficient index structure and query optimization mechanism, the four-dimensional index significantly improves the efficiency of traffic trajectory analysis. By skipping irrelevant data, the amount of calculation is reduced, thus achieving a faster query speed.

[0197] The four-dimensional spatio-temporal joint index method solves the defects of traditional spatio-temporal separation index technologies through innovation points such as spatio-temporal binding mechanism, dynamic pruning optimization, and hierarchical time wheel design. This method performs excellently in improving query efficiency, reducing complexity, and meeting real-time requirements, providing strong support for the efficient retrieval and processing of spatio-temporal data.

[0198] In this embodiment, a multi-timeline event processing system is proposed, which includes a full-time timeline processing unit and a real-time stream timeline processing unit.

[0199] The full-time timeline processing unit supports event operations at any time point from history to the future, ensuring the accuracy and compatibility of time calculations.

[0200] Specific implementation: For time points after 1970: Call the built-in time function of the computer system for date calculation, and utilize the clock and date processing functions of modern computer systems to ensure accurate processing of recent and future time points.

[0201] For the time period from 1582 to 1970: Adopt the Gregorian leap year rule for date verification. The Gregorian leap year rule is that a year that is divisible by 4 and not a century year, or a year that is divisible by 400 is a leap year. This rule ensures the accuracy of date calculations within this time period.

[0202] For time points before 1582: Provide at least one calendar compatibility mode to meet the date calculation requirements of different historical periods. This includes the Julian calendar rule, the rule assuming every year is a leap year, or the rule assuming 31 days per month, etc. These modes allow users to select a suitable calendar for calculation according to specific needs.

[0203] The real-time stream timeline processing unit is used to process real-time event streams with physical timestamps, ensuring the sequentiality and timeliness of events through a hybrid clock protocol. The hybrid clock protocol adopts a hybrid method of physical clocks and logical counters to ensure the accuracy of event order. The physical clock provides the actual time information of event occurrence, while the logical counter is used to sort events sequentially when the physical clock accuracy is insufficient or there are synchronization problems.

[0204] The spatio-temporal alignment interface provides a unified geographical location tag and time reference conversion rule for the full-time timeline and the real-time stream timeline, ensuring the consistency and comparability of spatio-temporal data. Use a unified geographical location tag (such as WGS-84 coordinates) to identify the geographical location where an event occurs, ensuring that events in different timelines can be spatially aligned and compared. Provide a time reference conversion rule to convert the time information in different timelines into a unified reference for spatio-temporal data analysis across timelines.

[0205] The cross - timeline feedback channel writes the predicted events or historical correction events generated by the full - time timeline into the processing queue of the real - time stream timeline, realizing the information interaction and update between timelines. The full - time timeline generates future predicted events based on historical data and trend analysis. These predicted events are written into the processing queue of the real - time stream timeline through the cross - timeline feedback channel for monitoring and verification in the real - time event stream. When the historical data in the full - time timeline is corrected or updated, historical correction events are generated. These correction events are also written into the processing queue of the real - time stream timeline through the cross - timeline feedback channel to ensure that the historical data in the real - time event stream is consistent with the full - time timeline.

[0206] Furthermore, the system also includes:

[0207] The publishing timeline is responsible for recording the physical timestamp of the actual storage of events, using UTC (Coordinated Universal Time) standard time to ensure the accuracy and consistency of timestamps. Each event is assigned a physical timestamp in UTC standard time when stored, which is the actual time of the event occurrence and is not affected by the user - defined logical time. The publishing timeline serves as the time benchmark for events, providing accurate time information for subsequent timeline mapping, event query, and data analysis.

[0208] The display timeline allows users to customize logical time points and dynamically adjust the display order of events. It supports event operations at any time point from history to the future, providing users with a flexible way to view and analyze events. Users can customize logical time points according to their needs, such as arranging events according to the importance, urgency, or other custom rules of the events. The display timeline can dynamically adjust the display order of events to meet different viewing needs of users. It supports event operations at any time point from history to the future, and users can view past events, current events, and future planned events at any time.

[0209] The cross - timeline feedback controller is used to implement the mapping and synchronization between the display timeline and the publishing timeline, ensuring the consistency between the user - defined time logic and the physical timestamp, and triggering the operations of the corresponding real - time processing modules. Specifically, it maps the user - defined time logic in the display timeline to the physical timestamp of the publishing timeline to ensure that the events viewed by users are based on accurate time information. When a user inserts a future event (such as a plan for 2030) in the display timeline, the cross - timeline feedback controller triggers the pre - loading operation of the real - time processing module to prepare relevant resources and data in advance so that it can respond quickly when the future event occurs. When a user modifies a historical event in the display timeline, the cross - timeline feedback controller synchronously updates the event - related data in the publishing timeline to ensure that the event information in the publishing timeline is consistent with the display timeline.

[0210] The event processing module dynamically corrects the event processing strategy according to the feedback results of the publishing timeline and the display timeline to adapt to the changing event environment and user needs. The event processing module continuously monitors the feedback results of the publishing timeline and the display timeline, promptly discovers and handles anomalies or changes in events. According to the feedback results, it dynamically adjusts the event processing strategy, such as giving priority to handling urgent events, delaying non-urgent events, or merging similar events. The event processing module can also customize personalized event processing processes according to user needs and preferences to improve the efficiency and satisfaction of event processing.

[0211] The publishing timeline, the display timeline, the cross-timeline feedback controller, and the event processing module together constitute an important part of the four-dimensional space-time joint indexing method, providing strong support for the efficient processing and analysis of events. Through the collaborative work of these components, users can view and manage events more flexibly while ensuring the accuracy and timeliness of event processing.

[0212] In an embodiment of the present invention, a space-time constraint enhancement module for an instant messaging system is proposed, including: a logical timestamp dynamic injection unit, a space hierarchy topology management unit, a protocol adaptive switching engine, and a space-time validity checker.

[0213] The logical timestamp dynamic injection unit aims to embed the logical timestamp field into the message header, decouple it from the physical clock, and support operations such as historical backtracking and future presetting. The following is a detailed elaboration of the functions of this unit:

[0214] Logical timestamp embedding: Embed the logical timestamp field in the message header, such as {"logical_time":"2030-05-01T00:00:00"}. This logical timestamp is independent of the physical clock, allowing users to customize the time attributes of messages according to business requirements.

[0215] Historical backtracking support: It can insert newly generated messages into the historical timeline, such as inserting messages into the message queue in 2020. This provides users with the ability to view and analyze historical data.

[0216] Future presetting support: Allows users to set future instructions, such as setting a device self-check task in 2050. This helps users plan and manage future events and tasks in advance.

[0217] The space hierarchy topology management unit is a hierarchical structure used to manage and organize space information and its related devices and functions. The following is a detailed elaboration of the definition of this unit, including the hierarchical structure and message processing rules.

[0218] Definition of the hierarchical structure:

[0219] Building Layer: Manages the entire building globally, including global functions and events such as security alarms and energy control. The building layer is the highest layer in the hierarchical structure and is responsible for coordinating and managing all activities and resources within the entire building.

[0220] Floor Layer: Manages the single - floor space, including floor - specific functions and activities such as temperature, lighting, and personnel flow. The floor layer is between the building layer and the device layer, and it needs to coordinate with the building layer and specifically manage the device layer.

[0221] Device Layer: Manages specific devices such as sensors, cameras, air conditioners, etc., ensuring the normal operation of the devices and the accurate collection of data. The device layer is the bottom layer of the hierarchical structure, directly responsible for the management and maintenance of the devices, and is the basis for data collection and processing.

[0222] The message - handling rules include the sender marking the target - layer encoding and the receiver intercepting cross - layer messages.

[0223] Sender Marks Target - Layer Encoding: The sender marks the target - layer encoding in the message metadata to indicate the target layer of the message. For example, space_level = 3 indicates that the target layer of the message is the device layer. By marking the target - layer encoding, the sender can ensure that the message is correctly sent to the target layer, avoiding the processing and transmission of cross - layer messages.

[0224] Receiver Intercepts Cross - Layer Messages: The receiver intercepts cross - layer messages through a layer filter (such as the SQL statement WHERE target_level≥3). Through the layer filter, the receiver can ensure that it only receives and processes messages at the target layer or lower layers, avoiding processing messages that are irrelevant to its own layer, and improving the efficiency and accuracy of message processing.

[0225] The protocol adaptive switching engine is a system that can dynamically switch communication protocols according to the current network environment and business requirements. The following is a detailed analysis of the dynamic switching rules, switching mechanism, and specific implementation of this engine:

[0226] Dynamic Switching Rules:

[0227] Building Layer / Floor Layer: Adopts the WebSocket protocol. The WebSocket protocol supports full - duplex communication, can maintain long - term connections, and is suitable for scenarios that require real - time broadcasting, such as the second - level push of emergency events like fire alarms. The WebSocket protocol reduces the overhead of HTTP requests, improves the efficiency of data transmission, and ensures the real - time nature and accuracy of information.

[0228] Device layer: Switch to the MQTT protocol. The MQTT protocol is a lightweight message transmission protocol based on the publish / subscribe model, designed specifically for the Internet of Things (IoT) and remote communication. It is suitable for scenarios with small data volumes and low-frequency transmissions such as sensor data. Through the publish / subscribe model, the MQTT protocol can reduce bandwidth consumption and achieve on-demand distribution of sensor data. At the same time, the MQTT protocol supports multiple message quality levels and can adapt to different network environments to ensure reliable data transmission.

[0229] Switching mechanism. When switching protocols, to ensure the continuous transmission of real-time data such as voice / video streams, it is necessary to synchronize the user state and message sequence number. This is usually achieved through a session token (such as session_token = xxxx). The session token is a unique identifier used to identify the user's session. During the protocol switching process, the sender and receiver can use the session token to synchronize the user state and message sequence number.

[0230] Before protocol switching, the sender sends the current user state and message sequence number to the receiver together with the session token. After receiving the session token and user state information, the receiver re-establishes the connection based on this information and continues to receive and send messages. By optimizing the data processing and transmission process during protocol switching, ensure that the latency of the voice / video stream is controlled within 50ms to meet the real-time requirements.

[0231] In practical applications, the protocol adaptive switching engine can dynamically select the communication protocol according to business requirements and network environment. For example, in the building layer or floor, when real-time broadcasting of emergency events is required, the WebSocket protocol can be selected; while in the device layer, when transmitting sensor data, the MQTT protocol can be selected.

[0232] Spatio-temporal validity checker is a mechanism that verifies the spatio-temporal validity of a message before message delivery. The following is a detailed elaboration on the function, verification rules, and failure handling process of this mechanism:

[0233] The spatio-temporal validity checker verifies the message before message delivery to ensure that the message is valid both in terms of time and space. This helps to avoid the delivery of invalid messages and improve the stability and security of the system.

[0234] Verification before message delivery:

[0235] Time Window Matching: Verify whether the instruction timestamp is within the device active period to ensure the temporal validity of the message. For devices with specific active periods (e.g., air conditioning devices only receive temperature instructions in summer), the system maintains a device active period table. Before message delivery, the validator checks whether the instruction timestamp falls within the active period of the target device. If the timestamp is not within the active period, the message is considered temporally invalid.

[0236] Spatial Permission Verification: Check whether the sender level has the operation permission to ensure the spatial validity of the message. The system maintains a hierarchical permission table that records the operation permission relationships between levels. Before message delivery, the validator checks whether the sender's level has the operation permission for the target device or target level. If the sender does not have the corresponding permission, the message is considered spatially invalid.

[0237] Invalidation Handling Process: When a message fails the time window matching or spatial permission verification, the validator transfers the message to a read-only archival database. During the transfer, the validator adds an invalidation status flag to the message (e.g., status = expired). Messages in the read-only archival database are set to read-only status, prohibiting any form of secondary editing or forwarding. The system ensures that only authorized users can access the messages in the read-only archival database through a permission control mechanism.

Claims

1. A multi-level interaction system integrating spatio-temporal constraints, characterized in that, It includes: A user management module for identity authentication, permission allocation, and operation auditing; A virtual earth module for constructing a virtual space with multi-layer superposition; A multi-dimensional event modeling module for standardizing multi-modal event data; A multi-timeline spatio-temporal synchronization engine module for managing timelines and event synchronization; An intelligent spatio-temporal publishing module for dynamically distributing event data; A spatio-temporal constraint interaction engine for verifying the spatio-temporal compliance of user operations; An instant messaging module for supporting multi-modal instant messaging; An interactive visualization module for rendering spatio-temporal data and user interaction.

2. The multi-level interaction system integrating spatio-temporal constraints according to claim 1, wherein The user management module includes a user identity authentication unit, a static role permission unit, a data security protection unit, a spatio-temporal awareness permission control unit, and an operation auditing unit; The user identity authentication unit is used to support multiple identity authentication methods to verify the user's identity and manage the user session state; The static role permission unit is used to define user roles and their corresponding operation permissions, isolated from the spatio-temporal awareness permission control logic; The data security protection unit is used to protect user sensitive information using encryption technology and implement data encryption during transmission through a secure transmission protocol; The spatio-temporal awareness permission control unit is used to generate access policies based on time, geography, and event type; Work in cooperation with the intelligent spatio-temporal publishing module, spatio-temporal rule manager, and multi-timeline spatio-temporal synchronization engine to achieve dynamic and flexible permission management; The operation auditing unit is used to record user behavior trajectories and interaction record operation logs. Among them, the trajectory includes the geographical location at the time of login and the real-time location of event interaction. The geographical location at the time of login is the initial geographical location when the user logs in through the identity authentication unit; The real-time location of event interaction is the real-time location when the user interacts with the event entity in the multi-dimensional event modeling module.

3. The multi - level interaction system integrating spatio - temporal constraints according to claim 2, wherein, The spatio-temporal awareness permission control unit is also used to define spatio-temporal filtering rules. The spatio-temporal filtering rules include time window filtering and geographical fence filtering. Time window filtering only retains the location data within a preset time window before and after event interaction, or the location data within a preset time window; Geographical fence filtering means that when the user's location exceeds the event-associated geographical fence, recording stops.

4. A multi-level interaction system integrating spatio-temporal constraints according to claim 1, characterized in that, The virtual earth module includes a multi-layer integration unit and a dynamic scheduling controller; The multi-layer integration unit is used to dynamically superimpose multiple digital map services, select or combine different layers according to requirements; it is also used to trigger the multi-dimensional event modeling module to recalculate coordinate mapping when the geographical fence range changes; the tile alignment accuracy data will be input to the intelligent spatio-temporal publishing module to assist in spatio-temporal consistency verification; The dynamic scheduling controller is used to real-time schedule tile data according to the user's viewpoint position; adjust the tile accuracy according to the verification result of the spatio-temporal rule engine.

5. A multi-level interaction system integrating spatio-temporal constraints according to claim 1, characterized in that, The multi-dimensional event modeling module includes an event entity integration unit, an event meta-model unit, a dynamic identifier generator, a spatio-temporal reference service interface, a spatial projection and rendering engine, and an interaction protocol binder; The event entity integration unit is used for accessing multi-modal event entities; standardizing the multi-modal event data format into structured data containing time, space and event type information, so as to realize cross-module spatiotemporal consistency verification and dynamic interactive control; The event metamodel unit is used to define a unified metadata model and send the output metadata to the dynamic identifier generator and the multi-timeline spatiotemporal synchronization engine; The dynamic identifier generator is used to generate a unique identifier of an event carrying temporal and spatial information according to the metadata provided by the event metamodel unit; The generated identifier also carries the permission tag of the user management module, and the permission tag is directly parsed and verified by the multi-timeline engine; The AR effect type is driven by the timeline type of the multi-timeline engine and rendered through the interactive visualization module; The space-time reference service interface is used to call the coordinate system conversion service provided by the virtual earth module; to achieve time synchronization calibration of event identifiers; The calibrated spatiotemporal benchmark data is output to the intelligent spatiotemporal publishing module for collaborative verification; when the time synchronization deviation exceeds the threshold, the user management module is triggered to update the geo-fence strategy; The spatial projection and rendering engine is used to perform coordinate mapping of event identifiers; the coordinate transformation results are fed back to the virtual earth module to correct tile alignment errors, forming a coordinate transformation-map update closed loop; The interaction protocol binder is used to bind the cross-level operation protocol to the event identifier.

6. The multi-level interaction system integrating spatio-temporal constraints according to claim 1, characterized in that The multi-timeline spatiotemporal synchronization engine module includes a timeline generation unit and a spatiotemporal rule verification unit; The timeline generation unit is used to dynamically generate at least two logical timelines, and the timeline data is synchronized to the interactive visualization module to distinguish the rendering mode; The spatiotemporal rule verification unit is used to verify the timestamp validity and spatial permission matching of cross-timeline operations; if and only if the verification is successful, the user is allowed to perform the target operation and trigger the interactive visualization module to update the dynamic annotation; wherein, the allowed operation includes releasing the interface interaction lock and activating at least one of the data writing permissions.

7. A multi-level interaction system integrating spatio-temporal constraints according to claim 1, characterized in that, The intelligent spatiotemporal publishing module includes a multidimensional rule unit and a collaborative verification unit; The multidimensional rule unit is used to define the composite triggering conditions of timestamp, time window and geographic fence; it is synchronized to the user management module through the spatiotemporal rule manager; The collaborative verification unit is used to call the space-time benchmark interface to implement space-time consistency verification; the verification result is transmitted back to the user management module in real time to dynamically adjust the authority policy.

8. The multi-level interaction system integrating spatio-temporal constraints according to claim 1, characterized in that The intelligent spatiotemporal publishing module includes a multidimensional rule unit and a collaborative verification unit; The multidimensional rule unit is used to define the composite triggering conditions of timestamp, time window and geographic fence; it is synchronized to the user management module through the spatiotemporal rule manager; The collaborative verification unit is used to call the space-time benchmark interface to implement space-time consistency verification; the verification result is transmitted back to the user management module in real time to dynamically adjust the authority policy.

9. The multi-level interaction system integrating spatio-temporal constraints according to claim 1, wherein The instant messaging module includes a real-time message transmission unit and a social network enhancement unit; The real-time message transmission unit is used to achieve real-time synchronization of message status across terminals; the synchronization logic is driven by the timeline type of the multi-timeline engine, and the real-time stream timeline enforces strong consistency; File transfer uses the encrypted link of the user management module; The social network enhancement unit is used to support user relationship chain management, dynamic comments and forwarding; the event entities of the dynamic content association multi-dimensional event modeling module, such as comments, are bound to specific AR identifiers; the change of the relationship chain triggers the intelligent spatio-temporal publishing module to update the geofence whitelist.

10. A multi-level interaction system integrating spatio-temporal constraints according to claim 1, characterized in that, The interactive visualization module includes a dynamic annotation generation unit and a rendering optimization engine; The dynamic annotation generation unit is used for rendering, and the priority is jointly determined by the tile data of the virtual earth module and the behavior records of the user management module; The change of the annotation status triggers the intelligent spatio-temporal publishing module to update the conditions; The rendering optimization engine is used to instantiate the merged result and feedback it to the multi-dimensional event modeling module to optimize the spatial projection calculation.

Images