Digital twinning scene adaptive roaming display method and device and storage medium

Abstract

The invention provides a digital twinning scene adaptive roaming display method and device and a storage medium, and belongs to the cross technical field of computer graphics, three-dimensional GIS, VR and the like, and the method comprises the following steps: S1, recording objects in a digital twinning scene, and configuring display information of each object; s2, configuring a series of key frames with a sequence for each object; s3, according to the display information of the objects, performing screening, thematic grouping and sorting on the objects; s4, extracting all key frames of the objects in the thematic groups according to a principle of considering object connection smoothness and compactness, and arranging the key frames; and S5, performing digital twinning scene roaming display according to the arranged key frame sequence, and playing and displaying the display information of the corresponding object. According to the principle of considering smoothness and compactness of object connection, all key frames of objects in thematic groups are extracted and arranged, so that'turn-back abrupt change 'is effectively avoided; and intelligent synchronization of audio-visual information is realized.

Description

Technical Field

[0001] This invention belongs to the interdisciplinary fields of computer graphics, 3D GIS, VR, etc. More specifically, it relates to a method, device and storage medium for adaptive roaming display of digital twin scenes. Background Technology

[0002] Currently, the technology for generating roaming paths in digital twin scenarios is relatively mature, mainly divided into two types: manual and semi-automatic. The manual method includes keyframe-based camera animation technology and path constraint-based roaming technology.

[0003] Keyframe-based camera animation is the most classic and fundamental technique. Users set a series of keyframes (including camera position, pose, and field of view) within a digital twin scene, and the system generates smooth camera motion trajectories using interpolation algorithms (such as linear interpolation, B-splines, and Catmull-Rom splines). Almost all 3D modeling and animation software (such as Autodesk 3ds Max and Blender), game engines (such as Unity's Cinemachine and Unreal Engine's Sequencer), and professional GIS platforms (such as Esri's ArcGIS Pro and CesiumJS) provide this functionality. For example, Google Earth's "Tour" feature allows users to record or define a series of placemarks using KML (Keyhole Markup Language) files to create flight walks.

[0004] Path-constrained roaming technology: Users predefine a 3D spatial curve as a path, and then move the camera along that path. Users can control the camera's speed and orientation on the path (e.g., always facing the tangent of the path, or always looking at a target object). This technology is also widely used in game development and film and animation production, and is the standard method for achieving "track-based camera" effects.

[0005] Semi-automation technology involves semi-automatically controlling camera movement, typically based on path planning algorithms. There are many path planning algorithms, which can be broadly categorized into two types based on their understanding of environmental information: The first type is global path planning algorithms based on complete prior environmental information, also known as static planning, such as the IDA* algorithm, the visibility chart method, and the grid method. The second type is local path planning algorithms based on local environmental information, also known as dynamic path planning, such as the artificial potential field method, particle swarm optimization, and genetic algorithms. Both types of algorithms have their own advantages and disadvantages, usually focusing on global or local path optimization rather than combining pre-defined local animation segments.

[0006] The problems and drawbacks of these existing technologies are as follows: 1) Low automation and high production costs: Traditional keyframe methods require artists or technicians to manually set a large number of keyframes, which is cumbersome and time-consuming, making it difficult to quickly generate a large amount of diverse thematic walkthrough content. 2) "Information silos" and "disjointed experiences": Existing technologies often treat "path walking" and "information display" as two independent processes. When it is necessary to string together multiple independent, pre-set object walkthrough animations (such as the wraparound animation of object A and the passing animation of object B) into a single theme, the following core problems will be encountered: Abrupt transitions: Directly splicing two independent roaming sequences can cause a "teleportation" of camera position or a "sudden turn" of orientation at the object switching point (from the last keyframe of A to the first keyframe of B), resulting in the so-called "reverse abrupt change" phenomenon, which seriously damages the user's immersion and visual experience.

[0007] Therefore, in existing digital twin scene roaming technologies, the core problem that needs to be solved is how to automatically and smoothly connect preset roaming segments of multiple independent objects into a thematic roaming path with logical coherence and a good visual experience. Summary of the Invention

[0008] The purpose of this invention is to provide a digital twin scene adaptive roaming display method, device, and storage medium to solve the technical problem in existing digital twin scene roaming technologies of how to automatically and smoothly connect preset roaming segments of multiple independent objects into a thematic roaming path with logical coherence and a good visual experience. Specifically, it aims to address the following core pain points: This addresses the issue of abrupt path changes and visual jumps caused by improper keyframe sequence connections between adjacent objects in thematic walkthroughs, thereby improving the smoothness and naturalness of the walkthrough.

[0009] To achieve the above objectives, a first aspect of the present invention provides a digital twin scene adaptive roaming display method, comprising the following steps: S1. Record the objects in the digital twin scenario and configure the display information of each object, including name, coordinates, description, document audio-visual materials, and keywords; S2. Configure a series of keyframes with a sequential order for each object; S3. Based on the displayed information of the objects, filter, group, and sort the objects. S4. Based on the principle of balancing the smoothness and compactness of the object connections, extract all the keyframes of the objects in the topic group and arrange them; S5. Perform a digital twin scene roaming display according to the arranged keyframe order, and play and display the display information corresponding to the object.

[0010] Furthermore, the object type is at least one of point object, line object, and area object; the data format presented by the object is at least one of GIS terrain, vector layer, icon, text annotation, and 3D model.

[0011] Furthermore, when the object is a point object, a short line object, or a surface object, the coordinate points of its keyframes are arranged in a circular order around the object; when the object is a long line object, the coordinate points of its keyframes are arranged in a straight line parallel to the line object.

[0012] Furthermore, the keyframe includes the coordinates and attitude angles of the roaming camera in the digital twin scene.

[0013] Furthermore, the selection, thematic grouping, and sorting of the objects are completed manually or automatically by intelligent algorithms; the thematic grouping is divided according to any one of the following characteristic dimensions: type, investment, region, data format, and time; and the sorting is performed according to any one of the following: richness of information, popularity, and spatial distribution pattern.

[0014] Furthermore, the arrangement is performed according to the following rules: By default, the keyframe order belonging to a certain object follows the initial setting in step S2, and the keyframe order between different objects follows the order of the objects within the topic group in step S3; When the keyframes of two adjacent objects within the topic group are not smoothly connected, the order of the keyframes is adjusted based on the default settings, as follows: (1) When the object is the first object in the topic group, extract keyframes according to the initial order of the objects; (2) For the connection method between the extracted previous object and the next object, calculate the following two transition costs: The cost of transitioning from "the last keyframe of the previous object" to "the first keyframe of the next object". ; The cost of transitioning from "the last keyframe of the previous object" to "the last keyframe of the next object". ; (3) If If so, then extract keyframes in reverse order of the initial order of the next object; if Extract keyframes according to the initial order of the next object; (4) Iteratively execute (2)-(3) to extract keyframes of subsequent objects in the topic group in sequence until all keyframes of objects in the topic group have been extracted.

[0015] Furthermore, both transition costs are calculated using the following formula: ; In the formula, C is or ; This is the cost of path cornering, with a value ranging from 0 to 180 degrees; for , The angle between the vector connecting the last keyframe coordinates of the previous object to the first keyframe coordinates of the next object, and the vector connecting the first keyframe coordinates of the next object to its second keyframe coordinates; for , The angle between the vector connecting the last keyframe coordinates of the previous object to the last keyframe coordinates of the next object and the vector connecting the last keyframe coordinates of the next object to its second-to-last keyframe coordinates. This is the cost of the camera's attitude rotation angle, ranging from 0 to 180 degrees; for , The angular distance between the last keyframe of the previous object and the first keyframe of the next object, representing the camera pose; for , The angular distance of the camera pose from the last keyframe of the previous object to the last keyframe of the next object; It is the cost of rotating the camera. ; For the actual camera distance, , The straight-line distance from the last keyframe of the previous object to the camera position of the first keyframe of the next object; for , Let be the straight-line distance from the last keyframe of the previous object to the camera position of the last keyframe of the next object; in all thematic groups, for all adjacent objects, calculate the distance from the last keyframe of the previous object to the first and last keyframes of the next object, and denot the maximum and minimum values ​​of these distances as follows: , ; It is the weighting coefficient.

[0016] Further, step S5 includes the following steps: The final digital twin scene roaming trajectory and camera pose animation are generated by using a cubic interpolation algorithm, forming a smooth and natural transition arc; The digital twin scene roaming display is controlled through an interactive interface, which includes a timeline whose progress corresponds to the progress of the roaming path.

[0017] A second aspect of the present invention provides a display device, comprising: The display information configuration module is used to record objects in the digital twin scenario and configure the display information of each object. The display information includes name, coordinates, description, document audio-visual materials, and keywords. The keyframe configuration module is used to configure a series of keyframes with a sequential order for each of the objects. The sorting module is used to filter, group, and sort the objects based on the displayed information of the objects; An arrangement module is used to extract all keyframes of the objects in the thematic group and arrange them according to the principle of balancing the smoothness and compactness of the object connections; and, The roaming display module is used to perform a digital twin scene roaming display according to the arranged keyframe order, and play and display the display information corresponding to the object.

[0018] A third aspect of the present invention provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the demonstration method as described above.

[0019] Compared with the prior art, the present invention has the following technical effects: The present invention provides a digital twin scene adaptive roaming display method that extracts all key frames of objects in a thematic group and arranges them according to the principle of balancing the smoothness and compactness of object connections. This effectively avoids "retrograde abrupt changes" and balances the smoothness and compactness of transitions between objects, which is a significant improvement over existing splicing roaming technology. The method of the present invention performs digital twin scene roaming display according to the order of the arranged key frames and plays and displays the display information of the corresponding objects, realizing intelligent synchronization of audiovisual information. It can generate a large amount of smooth, natural and information-synchronized automated thematic roaming content at low cost and high efficiency.

[0020] The display device and computer-readable storage medium of the present invention also have the above-mentioned advantages, which will not be repeated here. Attached Figure Description

[0021] To more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0022] Figure 1 A flowchart of a digital twin scene adaptive roaming display method provided in an embodiment of the present invention; Figure 2 A schematic diagram of the structure of a display device provided in an embodiment of the present invention; Figure 3 A top view showing the spatial location and keyframe distribution of an object provided in an embodiment of the present invention; Figure 4 The thematic grouping and keyframe sequence containing objects 1, 3, and 4 provided in the embodiments of the present invention do not have the case of "retrograde mutation"; Figure 5 The keyframe sequences of the thematic groups including objects 4, 2, and 5 provided in the embodiments of the present invention exhibit a "retrograde mutation" situation by default; Figure 6 The effect of rearranging the keyframe sequences of objects 4, 2, and 5 provided in the embodiments of the present invention; Figure 7 The roaming objects and thematic groups in the three-dimensional display system provided in the embodiments of the present invention; Figure 8 Screenshot of the roaming object display interface in the thematic group of the 3D display system provided for the implementation of this invention. Detailed Implementation

[0023] To make the technical problem to be solved, the technical solution, and the beneficial effects of the present invention clearer, the present invention will be further described in detail below with reference to embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present invention and are not intended to limit the present invention.

[0024] The terminology used in the embodiments of this invention is for the purpose of describing particular embodiments only and is not intended to limit the invention. The singular forms “a,” “the,” and “the” as used in the embodiments of this invention and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise.

[0025] This invention provides a method for adaptive roaming display of digital twin scenes, the process of which is as follows: Figure 1 As shown, it includes the following steps: S1. Record objects in the digital twin scenario and configure the display information of each object, including name, coordinates, description, document audio-visual materials, keywords, etc. S2. Configure a series of keyframes with a specific order for each object; S3. Display information based on the object's name, description, keywords, etc., and filter, group, and sort the objects. S4. Following the principle of balancing the smoothness and compactness of object connections, extract all keyframes of objects in the thematic group and arrange them. S5. Based on the keyframe order of each object in the thematic group, perform a digital twin scene roaming display, and play and display the description of the corresponding object and the audio-visual materials of the document.

[0026] In step S1 above, for example, the object That is, representing the first in the digital twin scenario One object, If the total number of objects is... "Description" refers to a written description or summary. "Document / Audio-visual materials" refers to documents, images, audio, and video. "Keywords" refers to one or a group of words.

[0027] For objects in a digital twin scenario, the object type can be a point object (such as place name, building), a line object (such as river, road) or a surface object (such as scenic spot, lake). The data form of the object can be GIS terrain, vector layer, icon, text annotation, 3D model (such as BIM, 3DMax, laser point cloud) and combination thereof.

[0028] Keywords for an object can be filled in manually, or they can be automatically extracted and configured using intelligent algorithms based on the object's description, document audio-visual materials, and other displayed information.

[0029] In step S2 above, for example, keyframes This represents the first in the digital twin scenario. The first object 1 keyframe, of which , For the first The total number of keyframes for each object. Each keyframe of an object contains the coordinates of the roaming camera within the digital twin scene. and attitude angle Information, among which, These represent the roll angle, pitch angle, and yaw angle, respectively. For point objects, shorter line objects, and area objects, the keyframe coordinates can be arranged in a circular order around the object; for longer line objects, the keyframe coordinates can be arranged in a straight line parallel to the line object.

[0030] In this embodiment, the definitions of shorter and longer line objects are as follows: Construct the minimum bounding rectangle (MBR) of the line object, calculate the length and width of the bounding rectangle, and if the length is three times or more than the width, it is a longer line object; if the length is less than three times the width, it is a shorter line object.

[0031] In step S3 above, based on the displayed information such as the object's "name, coordinates, description, document / audio-visual materials, and keywords," the objects are filtered, grouped, and sorted. This can be done manually or automatically by an intelligent algorithm, so that objects matching a certain characteristic are arranged together in order. Specifically, manual processing means manually grouping the objects. The intelligent algorithm can use any of the following methods: (1) Coordinate-based method: Spatial analysis is performed based on coordinate information, and those belonging to a specific region (such as an administrative region) are grouped together.

[0032] (2) Keyword matching method: Based on keyword information, objects marked with the same keyword are grouped together.

[0033] (3) Natural Language Processing Method: Based on the display information such as name, description, keywords, and document, these text information are converted into numerical vectors, the vector similarity is calculated, and a clustering algorithm is used to group objects with similarity into a group.

[0034] (4) Multimedia method: Based on audio-visual data, use pre-trained deep learning models (such as VGG, ResNet, CLIP, or other self-supervised models) to extract their visual feature vectors or audio feature vectors, and use clustering algorithms to group objects with similarity into a group.

[0035] (5) Comprehensive method: Taking into account the coordinate distance, keyword overlap, and vector similarity of text, video and audio in (1)-(4), a comprehensive weighted algorithm is used to calculate the overall similarity and perform clustering.

[0036] Thematic groups of objects can be divided according to characteristics such as type, investment, region, data format, and time. The sorting of objects can be considered from the perspectives of data richness, popularity, and spatial distribution patterns.

[0037] In step S4 above, all keyframes of objects in the thematic group are extracted and arranged according to the following rules: 1) By default, the keyframe order of a given object follows the initial settings in step S2: for point objects, shorter line objects, and polygon objects, the coordinates of their keyframes can be arranged in a circular order around the object; for longer line objects, the coordinates of their keyframes can be arranged in a straight line parallel to the line object. The keyframe order between different objects follows the order of the objects within the topic group in step S3.

[0038] 2) The keyframe transitions between adjacent objects within a thematic group may not be smooth enough, resulting in abrupt navigation between the two objects, creating a visually abrupt reversal effect where the viewer appears to have just navigated past an object and then immediately reverts to its previous state; or, if the connections are too far apart and appear not compact enough, affecting the user experience, the order of the keyframes needs to be adjusted based on the default settings. The specific adjustment method is as follows: (1) When the object is the first object in the topic group, extract keyframes according to the initial order of the objects.

[0039] (2) For the connection method between the extracted previous object and the next object, calculate the two transition costs: Method 1 (Sequential Join): Cost of transitioning from "the last keyframe of the extracted previous object" to "the first keyframe of the next object" ; Method 2 (Reverse Join): Cost of transitioning from "the last keyframe of the extracted previous object" to "the last keyframe of the next object" .

[0040] Two types of transition costs and All can be calculated using the following formula:

[0041] Where: C is or ; This refers to the cost of turning points on the path, calculated using the dot product of vectors. The larger the angle, the higher the cost. More specifically: for ,That This is the angle between the vector connecting the last keyframe coordinates of the previous object to the first keyframe coordinates of the next object, and the vector connecting the first keyframe coordinates of the next object to its second keyframe coordinates. For ,That It is the angle between the vector connecting the last keyframe coordinates of the previous object to the last keyframe coordinates of the next object and the vector connecting the last keyframe coordinates of the next object to its second-to-last keyframe coordinates.

[0042] This is the cost of camera pose rotation angular distance, which is the cost of calculating the angular distance of the camera pose between two keyframes (obtainable through quaternion operations). The greater the pose change, the higher the cost. More specifically: for ,That This is the angular distance of the camera pose from the last keyframe of the previous object to the first keyframe of the next object. ,That The angular distance between the camera pose of the last keyframe of the previous object and the last keyframe of the next object.

[0043] It is the cost of rotating the camera. Because... and The angle is between 0 and 180 degrees. To ensure... Its units are consistent, facilitating calculation and comparison. The calculation method is as follows: First, in all thematic groups, for all adjacent objects, calculate the distance from the last keyframe of the previous object to the first keyframe and the last keyframe of the next object. Find the maximum and minimum values ​​of these distances, and denot them as follows: and Calculate the actual camera distance ,for This distance is the straight-line distance from the camera position of "the last keyframe of the previous object" to "the first keyframe of the next object". This distance is the straight-line distance between the camera position of "the last keyframe of the previous extracted object" and "the last keyframe of the next object" (which can be calculated using the 3D coordinate point distance formula); finally, we get:

[0044] The greater the camera movement distance, the higher the cost; the smaller the camera movement distance, the lower the cost, indicating that the adjacent objects are more closely spaced.

[0045] It is an adjustable weighting coefficient that can be flexibly configured according to actual needs, with a default value of 1 / 3. Substituting formula (2) into formula (1), we obtain the transition cost calculation formula as follows:

[0046] (3) If If so, then extract keyframes in reverse order of the initial order of the next object; if Extract keyframes according to the initial order of the next object. Combining formula (3), it can be seen that whether to connect in sequence or in reverse order depends on the combined effect of three factors: path turning angle, camera posture rotation angle, and camera movement distance. By unifying the dimensions and weighted summing and comparing formula (3), a solution with smaller path turning and camera posture rotation and smaller connection distance can be found, which also takes into account the smoothness of the visual transition of the object and the compactness of the connection between objects.

[0047] (4) Iteratively execute steps (2)-(3) to extract keyframes of subsequent objects in the topic group in sequence until all keyframes of objects in the topic group have been extracted.

[0048] Step S5 above specifically includes the following steps: 1) Based on all keyframe sequences extracted in step S4, the final digital twin scene roaming trajectory and camera pose animation are generated using cubic Bézier / Hermit / Catmull-Rom / B-spline interpolation algorithms, forming smooth and natural transition arcs. This is existing technology and will not be described in detail here.

[0049] 2) The digital twin scene walkthrough is controlled via an interactive interface. The interface includes buttons for play, pause, previous, and next, as well as pop-up elements displaying document and audio-visual materials. This controls the walkthrough progress and simultaneously displays object descriptions and document / audio-visual materials. The interface includes a timeline, whose progress corresponds to the walkthrough path; the timeline's progress controls the walkthrough's progress accordingly. The digital twin scene walkthrough offers both manual and automatic control modes.

[0050] In manual mode: Clicking the play / pause button controls the 3D roaming display progress of the object, using the default speed; clicking the previous / next button switches the roaming object. Simultaneously, clicking play displays a pop-up window showing the corresponding object's description and accompanying audio-visual materials. Text descriptions or document pop-ups provide a play button, which, when clicked, provides text-to-speech playback based on speech synthesis technology; image pop-ups use a carousel format for switching display; audio-visual pop-ups provide a play / pause and progress control interface.

[0051] In automatic mode: After clicking play, all objects will be automatically displayed from beginning to end. During the process, pop-up windows will automatically display the corresponding object's image, document, and video information. Simultaneously, the system will automatically read out the object's description information using speech synthesis technology. Based on the length of each object's description text, the system estimates the speech playback duration at a normal speaking speed and automatically adjusts the time interval between keyframes for that object to ensure the object's walkthrough duration is longer than the text-to-speech playback duration, ensuring the integrity of information delivery. For example, if the normal speaking speed is 180 words per minute and the description text contains 36 characters, the speech playback duration will be 0.2 minutes, or 12 seconds. If an object has 13 keyframes with a total of 12 keyframe intervals, the keyframe interval should not be less than 1 second.

[0052] The digital twin scene adaptive roaming display method of this invention has the following advantages: 1) Improved the automation and intelligence of walkthrough generation: By intelligently grouping and sorting objects and automatically handling keyframe connections, the workload of manually editing and debugging walkthrough paths is greatly reduced, realizing the automated generation from "object collection" to "thematic storyline".

[0053] 2) Significantly improves the user's visual experience: Its core "keyframe sequence direction adaptive adjustment" mechanism (step S4) intelligently and adaptively selects to play the keyframe sequence of the next object in forward or reverse order by calculating the connection angle, posture angle and distance, effectively avoiding "returning abrupt change" and taking into account the smoothness and compactness of the transition between objects. This is a major improvement over the existing splicing roaming technology.

[0054] 3) Intelligent synchronization of audiovisual information is achieved: The roaming speed is dynamically linked to the duration of the description information broadcast of the object (step S5) to ensure that users can receive the voice information completely while watching the roaming. Combined with the synchronous display of other graphic and audio-visual materials, the synergy between visual path and information depth is achieved, which enhances the sense of immersion and knowledge transfer efficiency.

[0055] 4) Combining modularity and flexibility: The walkthrough (keyframe sequence) of each object is designed as an independent "module," which can be easily reorganized and reused. Through different thematic grouping rules, walkthroughs with different themes and narrative logics can be quickly generated from the same batch of 3D object data using intelligent algorithms, which has high flexibility and scalability.

[0056] Based on the above-described display method, this embodiment of the invention also provides a display device, the structure of which is as follows: Figure 2 As shown, it includes: The display information configuration module 1 is used to record objects in the digital twin scenario and configure the display information of each object. The display information includes name, coordinates, description, document audio-visual materials, keywords, etc. Keyframe configuration module 2 is used to configure a series of keyframes with a sequential order for each object; Sorting module 3 is used to filter, group, and sort objects based on information such as object name, coordinates, description, document audio-visual materials, and keywords. Arrangement module 4 is used to extract all keyframes of objects in thematic groups and arrange them according to the principle of balancing the smoothness and compactness of object connections; and, The roaming display module 5 is used to perform a roaming display of the digital twin scene according to the arranged keyframe order, and to play and display the display information of the corresponding objects.

[0057] Based on the above embodiments, this invention also provides a computer-readable storage medium storing a computer program executable by a processor. When the program runs on the processor, it enables the processor to execute the steps of the aforementioned digital twin scene adaptive roaming display method.

[0058] Since the principle of the above-mentioned display device and computer-readable storage medium in solving the problem is the same as the display method provided in the embodiments of the present invention, the implementation of the above-mentioned display device and computer-readable storage medium can be referred to the embodiments of the method, and repeated parts will not be described again.

[0059] The following specific embodiment illustrates a digital twin scene adaptive roaming display method according to an embodiment of the present invention, including the following steps: Step 1: As Figure 3 As shown, Figure 3 The top-down view shows the spatial distribution of five objects in a digital twin scenario. Objects 1, 4, and 5 are point elements, object 3 is a polygon element, and object 2 is a line element. Descriptions of each object, documents, audio-visual materials, keywords, and other display information are omitted.

[0060] Step 2: Figure 3 In the process, each object has a series of keyframes around it or along its line, and the initial order of the keyframes is indicated by the index of the keyframe numbers.

[0061] Step 3: As Figure 4 As shown, objects are manually filtered, grouped, and sorted based on their names, descriptions, keywords, and other displayed information. In this example, three objects are extracted as a single topic and arranged in descending order of spatial distribution as 1, 3, and 4.

[0062] Step 4: Extract all keyframes of the objects in the topic group and arrange them.

[0063] like Figure 4As shown in the default settings, all keyframes initially follow the order of objects within the topic groupings, and internally follow the initial keyframe settings. In this case, the overall keyframe transitions are relatively smooth, without any abrupt "reversals".

[0064] like Figure 5 The anomaly shown occurs when objects 4, 2, and 5 are extracted into a single topic in chronological order, but the keyframes are sorted according to the default settings. as well as There are two "reverse mutation" scenarios, and the first connection also suffers from a loose connection issue due to keyframes being "rounded up" (i.e., not closely aligned). Adjustments are needed, and the cost of sequential versus reverse connections needs to be calculated. For both "reverse mutation" points, reverse connections are cheaper, and at the first connection point, the camera distance is closer, resulting in a more compact reverse connection. Detailed calculations are omitted. Therefore, reverse connections are used instead. See [link to specific connection effects] for details. Figure 6 .

[0065] Step 5: Figure 7 The distribution of five thematic areas, including "Danjiangkou-Wudang Mountain", "Relics and Sites", and "Ancient Plank Road Project in the Hanjiang River Basin", and more than 100 thematic objects created by the display system developed based on the display methods in steps 1-4 above, is shown in the 3D map. Figure 8 The system showcases two thematic objects within the "Danjiangkou-Wudang Mountain" section: the Danjiangkou Reservoir Project and the Wudang Mountain architectural complex. Based on extracted keyframes, the system performs interpolation and 3D walkthroughs. The digital twin scene displays the 3D appearance of the Danjiangkou Reservoir Project (including terrain, BIM model, and tilted model), while the right side simultaneously displays descriptions and images of the project. In automatic walkthrough mode, upon entering a theme, the system automatically navigates through thematic objects in sequence, providing voice narration and image slideshows. In manual mode, users can click the control buttons at the bottom of the interface to pause, play, and skip to the next element.

[0066] Any aspects of the embodiments of the present invention that are not detailed herein are existing technologies.

[0067] The above embodiments merely illustrate several implementation methods of the present invention, and their descriptions are relatively specific and detailed, but they should not be construed as limiting the scope of the present invention. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of the present invention, and these all fall within the protection scope of the present invention. Therefore, the protection scope of this patent should be determined by the appended claims.

Claims

1. A method for adaptive roaming display of digital twin scenes, characterized in that, Includes the following steps: S1. Record the objects in the digital twin scenario and configure the display information of each object, including name, coordinates, description, document audio-visual materials, and keywords; S2. Configure a series of keyframes with a sequential order for each object; S3. Based on the displayed information of the objects, filter, group, and sort the objects. S4. Based on the principle of balancing the smoothness and compactness of the object connections, extract all the keyframes of the objects in the topic group and arrange them; S5. Perform a digital twin scene roaming display according to the arranged keyframe order, and play and display the display information corresponding to the object.

2. The digital twin scene adaptive roaming display method as described in claim 1, characterized in that, The object is of at least one type: point object, line object, or area object; the data format presented by the object is at least one type: GIS terrain, vector layer, icon, text annotation, or 3D model.

3. The digital twin scene adaptive roaming display method as described in claim 2, characterized in that, When the object is a point object, a short line object, or a surface object, the coordinate points of its keyframes are arranged in a circular order around the object; when the object is a long line object, the coordinate points of its keyframes are arranged in a straight line parallel to the line object.

4. The digital twin scene adaptive roaming display method as described in claim 1, characterized in that, The keyframes include the coordinates and attitude angles of the roaming camera in the digital twin scene.

5. The digital twin scene adaptive roaming display method as described in claim 1, characterized in that, The selection, thematic grouping, and sorting of the objects are completed manually or automatically by intelligent algorithms; the thematic grouping is divided according to any one of the following feature dimensions: type, investment, region, data format, and time; and the sorting is performed according to any one of the following: richness of information, popularity, and spatial distribution pattern.

6. The digital twin scene adaptive roaming display method as described in claim 1, characterized in that, The arrangement is performed according to the following rules: By default, the keyframe order belonging to a certain object follows the initial setting in step S2, and the keyframe order between different objects follows the order of the objects within the topic group in step S3; When the keyframes of two adjacent objects within the topic group are not smoothly connected, the order of the keyframes is adjusted based on the default settings, as follows: (1) When the object is the first object in the topic group, extract keyframes according to the initial order of the objects; (2) For the connection method between the extracted previous object and the next object, calculate the following two transition costs: The cost of transitioning from "the last keyframe of the previous object" to "the first keyframe of the next object". ; The cost of transitioning from "the last keyframe of the previous object" to "the last keyframe of the next object". ; (3) If If so, then extract keyframes in reverse order of the initial order of the next object; if Extract keyframes according to the initial order of the next object; (4) Iteratively execute (2)-(3) to extract keyframes of subsequent objects in the topic group in sequence until all keyframes of objects in the topic group have been extracted.

7. The digital twin scene adaptive roaming display method as described in claim 6, characterized in that, Both types of transition costs are calculated using the following formula: ； In the formula, C is or ; This is the cost of path cornering, with a value ranging from 0 to 180 degrees; for , The angle between the vector connecting the last keyframe coordinates of the previous object to the first keyframe coordinates of the next object, and the vector connecting the first keyframe coordinates of the next object to its second keyframe coordinates; for , The angle between the vector connecting the last keyframe coordinates of the previous object to the last keyframe coordinates of the next object and the vector connecting the last keyframe coordinates of the next object to its second-to-last keyframe coordinates. This is the cost of the camera's attitude rotation angle, ranging from 0 to 180 degrees; for , The angular distance between the last keyframe of the previous object and the first keyframe of the next object, representing the camera pose; for , The angular distance of the camera pose from the last keyframe of the previous object to the last keyframe of the next object; It is the cost of rotating the camera. ; For the actual camera distance, , The straight-line distance from the last keyframe of the previous object to the camera position of the first keyframe of the next object; for , Let be the straight-line distance from the last keyframe of the previous object to the camera position of the last keyframe of the next object; in all thematic groups, for all adjacent objects, calculate the distance from the last keyframe of the previous object to the first and last keyframes of the next object, and denot the maximum and minimum values ​​of these distances as follows: , ; It is the weighting coefficient.

8. The digital twin scene adaptive roaming display method as described in claim 1, characterized in that, Step S5 includes the following steps: The final digital twin scene roaming trajectory and camera pose animation are generated by using a cubic interpolation algorithm, forming a smooth and natural transition arc; The digital twin scene roaming display is controlled through an interactive interface, which includes a timeline whose progress corresponds to the progress of the roaming path.

9. A display device employing the display method according to any one of claims 1-8, characterized in that, include: The display information configuration module is used to record objects in the digital twin scenario and configure the display information of each object. The display information includes name, coordinates, description, document audio-visual materials, and keywords. The keyframe configuration module is used to configure a series of keyframes with a sequential order for each of the objects. The sorting module is used to filter, group, and sort the objects based on the displayed information of the objects; The arrangement module is used to extract all the keyframes of the objects in the topic group and arrange them according to the principle of balancing the smoothness and compactness of the object connections. as well as, The roaming display module is used to perform a digital twin scene roaming display according to the arranged keyframe order, and play and display the display information corresponding to the object.

10. A computer-readable storage medium, characterized in that, It stores a computer program that, when executed by a processor, implements the display method as described in any one of claims 1-8.

Images