A cluster-driven immersive virtual large screen construction method

Abstract

The present invention discloses a cluster-driven immersive virtual large screen construction method, comprising the following steps: displaying traditional clusters through a single surround screen; displaying origin-destination (OD) clusters through a bilateral layout; and displaying clusters output by a hierarchical clustering algorithm through a hierarchical layout. The present invention can improve the analysis efficiency of scientific data, the readability and integrity of the analysis results. The integrity of the extraction results is mainly reflected in the cluster analysis of different semantics and topological structures, and the final results can be searched, analyzed and explored, which can greatly reduce visual confusion, remove data noise, and clarify the logical structure of scientific data.

Description

Technical Field

[0001] The present invention relates to the technical field of immersive visualization of time-varying scientific data, and in particular to a cluster-driven immersive virtual large-screen construction method. Background Art

[0002] Large-screen splicing display wall is a centralized display terminal for various signals such as computers, videos, and networks. The traditional large-screen splicing display wall is composed of multiple monitors and is the current mainstream display device. These monitors share the same coordinate space and have the ability to expand and display large images. By quickly acquiring various dynamic image signals, they provide auxiliary functions for leadership decision-making and command. With the recent breakthroughs in virtual reality (VR) technology, the immersive industry provides users with reasonably priced high-quality hardware and software for data exploration and analysis. By combining immersive with physical large-screen splicing display walls for data exploration and analysis, users can more intuitively observe and understand the logical structure of data.

[0003] Traditional physical large-screen splicing display walls do not have good scalability. They have a series of problems, such as high cost, complex maintenance, and difficulty in carrying and moving. These problems have greatly limited the popularity of large-screen splicing display walls. More importantly, the results obtained by traditional clustering algorithms cannot intuitively display topological information on traditional large-screen splicing display walls. This makes it impossible for users to intuitively understand the hierarchical structure of data when observing the screen content, especially in the process of scientific data animation, which makes it difficult for users to understand the content displayed on the screen.

[0004] In general, there are still many limitations in using large-screen splicing display walls to explore time-varying scientific data, such as low work efficiency, visual confusion caused by complex data, and data display methods that are not conducive to understanding. This is mainly due to the lack of scalability of traditional large-screen splicing display walls, namely: high cost, complex maintenance, and difficulty in transportation and movement. Summary of the invention

[0005] Purpose of the invention: In order to overcome the deficiencies in the prior art, an immersive virtual large-screen construction method based on clustering drive is provided, which can improve the analysis efficiency of scientific data, the readability and integrity of the analysis results. The integrity of the extracted results is mainly reflected in the cluster analysis of different semantics and topological structures, and the final results can be searched, analyzed and explored, which can greatly reduce visual confusion, remove data noise, and clarify the logical structure of scientific data.

[0006] Technical solution: To achieve the above purpose, the present invention provides an immersive virtual large screen construction method based on clustering drive, comprising the following steps:

[0007] S1: Traditional cluster display via a single surround screen;

[0008] S2: Displaying origin-destination clusters through bilateral layout;

[0009] S3: Displays the clusters output by the hierarchical clustering algorithm through a hierarchical layout.

[0010] Furthermore, the step S1 is specifically as follows:

[0011] A1: Create an immersive environment with a single surround screen rendered for the user's position;

[0012] A2: Load time-varying data presented in the form of traditional clusters;

[0013] A3: Integrate all data of traditional clusters on a single screen

[0014] A4: The data changes are animated in the center of the surround screen;

[0015] A5: Filter time by using high-resolution animation;

[0016] A6: Displays conventional cluster data on the surround screen.

[0017] Furthermore, the step A6 is specifically as follows:

[0018] The user approaches the screen by touching the handle to observe the detailed data of each continent;

[0019] The user moves the position of each land by touching the handle to distinguish the clustering information of each area.

[0020] Furthermore, the step S2 is specifically as follows:

[0021] B1: Select a part of the vector field ocean data that is representative of the region;

[0022] B2: A preview of the overall effect of rendering ocean currents in the Earth model in the center of the screen;

[0023] B3: Generate screen layout, that is, generate several sub-screens distributed around the central sphere. The central sphere displays the overview query results, and the top and bottom screens display the detailed query results.

[0024] B4: The top screens are loaded with cluster data of each cluster of origin clustering;

[0025] B5: The bottom screens are loaded with the cluster data of each cluster of destination clusters;

[0026] B6: Use the DBSCAN clustering algorithm to track each cluster of ocean data and display it on the sphere and screen with a time-varying animation effect;

[0027] B7: A closer look at the sub-screen details.

[0028] Furthermore, the step B7 specifically includes:

[0029] Freely customizable sub-screens allow users to freely control the number of sub-screens and adjust the position of any sub-screen through the handle to facilitate browsing or animation demonstration;

[0030] To enlarge the sub-screen, you just need to select any sub-screen by the button on the handle. By clicking it, the selected sub-screen will appear in the center of the screen and be enlarged, making it easier to observe the details.

[0031] Furthermore, the step S3 is specifically as follows:

[0032] C1: select some points in the path that represent the main clusters of the region;

[0033] C2: Hierarchical clustering of all loading paths is obtained through hierarchical clustering, and the number of screens in the large-screen spliced ​​display wall is equal to the number of clusters;

[0034] C3: assigning virtual camera lenses to screens to track corresponding time-varying path clusters;

[0035] C4: Observe updates of every ocean on Earth by mapping onto a clustered generation screen;

[0036] C5: Display all animation demonstrations of time-varying data types in an immersive virtual big screen.

[0037] Beneficial effects: Compared with the prior art, the present invention has the following advantages:

[0038] 1. The present invention designs three layouts to explore clusters with different semantics and topological structures to better present scientific data that changes over time. The cluster-driven large-screen splicing display wall presentation provides an exploration strategy from overview to detail. Compared with the traditional physical large-screen splicing display wall, the layout in the virtual space can be flexibly changed according to the semantic information of the cluster.

[0039] 2. The present invention operates based on an immersive environment and uses immersive virtual reality technology to construct a data display layout. By combining immersiveness with a physical large-screen splicing display wall to perform data exploration and analysis, it can help users explore data immersive visualization analysis results more intuitively.

[0040] 3. The interactivity of the present invention enables users to intuitively understand the hierarchical structure of data when observing screen content, especially scientific data animation, and strengthens users' understanding of the mathematical logic of screen display content. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 A schematic diagram showing a bilateral layout of origin-destination (OD) clustering for the present invention;

[0042] Figure 2 A schematic diagram showing a hierarchical layout of a hierarchical clustering algorithm according to the present invention;

[0043] Figure 3 A schematic diagram of data exploration by a user of the present invention using a bilateral layout display effect;

[0044] Figure 4 A schematic diagram of the present invention that allows the user to zoom in on the bilateral layout sub-screen to observe clustering information;

[0045] Figure 5 The user of the present invention can zoom in on the overall clustering results to conduct detailed data exploration and observe the clustering information schematic diagram;

[0046] Figure 6 This is a schematic diagram of the origin (O) clustered large screen splicing display wall of the present invention;

[0047] Figure 7 The schematic diagram of the clustered large screen splicing display wall of the present invention (D) is as follows;

[0048] Figure 8 A schematic diagram of data exploration by users of the present invention using a hierarchical layout display effect;

[0049] Fig. 9 According to the present invention, the user can zoom in on the hierarchical layout sub-screen to observe the clustering information schematic diagram. DETAILED DESCRIPTION

[0050] The present invention is further explained below in conjunction with the accompanying drawings and specific embodiments. It should be understood that these embodiments are only used to illustrate the present invention and are not used to limit the scope of the present invention. After reading the present invention, various equivalent forms of modifications to the present invention by those skilled in the art all fall within the scope defined by the claims attached to this application.

[0051] The present invention provides a cluster-driven immersive virtual large-screen construction method, comprising the following steps:

[0052] S1: Traditional cluster display with a single surround screen, including:

[0053] A1: Create an immersive environment with a single surround screen rendered for the user's position;

[0054] A2: Load time-varying data presented in the form of traditional clusters;

[0055] A3: Integrate all data of traditional clusters on a single screen

[0056] A4: The data changes are animated in the center of the surround screen;

[0057] A5: Filter time by using high-resolution animation;

[0058] A6: Displays traditional cluster data on surround screens;

[0059] A7: Users can approach the screen by touching the handle to observe the detailed data of each continent;

[0060] A8: The user moves the position of each land by touching the handle to distinguish the clustering information of each area.

[0061] In this embodiment, a global carbon emission data set with a resolution of 960×1920 and a time step of 24 observed by the satellite of the Institute of Atmospheric Sciences of the Chinese Academy of Sciences is used as an application example. From the layout, it can be seen that the changes in carbon emission data are animated in the center of the surround screen, and users can explore and analyze data without moving the space. In this embodiment, all regions in the climate model and the monthly changes in carbon emissions in all regions of the world can be seen; by using high-resolution animation to filter time, users can see the long-term carbon emission trends of global carbon emissions.

[0062] S2: Display origin-destination (OD) clusters through bilateral layout, refer to Figure 1 , which are specifically:

[0063] B1: Select a part of the vector field ocean data that is representative of the region;

[0064] B2: A preview of the overall effect of rendering ocean currents in the Earth model in the center of the screen;

[0065] B3: Generate screen layout, that is, generate several sub-screens distributed around the central sphere. The central sphere displays the overview query results, and the top and bottom screens display the detailed query results.

[0066] B4: The top screens are loaded with cluster data of each cluster of origin clustering, such as Figure 6 Shown is a schematic diagram of a large-screen spliced ​​display wall with clustering at the origin (O);

[0067] B5: The bottom screens load the cluster data of each cluster of destination clusters, such as Figure 7 Shown is a schematic diagram of a destination (D) clustered large screen splicing display wall;

[0068] B6: Use the DBSCAN clustering algorithm to track each cluster of ocean data and display it on the sphere and screen with a time-varying animation effect;

[0069] B7: A closer look at the sub-screen details.

[0070] B8: Freely customizable sub-screens allow users to freely control the number of sub-screens and adjust the position of any sub-screen through the handle to facilitate browsing or animation demonstration;

[0071] B9: To enlarge the sub-screen, select any sub-screen by using the button on the handle. By clicking, the selected sub-screen will appear in the center of the screen and be enlarged, making it easier to observe details.

[0072] In this layout, the user can select a part of the vector field ocean data and place it on the earth model as an overview map; the immersive virtual big screen will automatically generate a screen layout that is suitable for origin-destination (OD) clustering queries based on the origin-destination (OD) clustering drive, that is, the top screen displays the origin (O) query results and the bottom screen displays the destination (D) query results; in addition, the user can also observe the detailed information of each sub-screen up close by moving the joystick of the touch handle; similarly, the tools in the system allow users to freely customize sub-screens in an immersive environment; users can select the sub-screen to be enlarged in order to observe the details on the screen more clearly; users can also drag the sub-screen up and down to place the screen at a visually suitable angle and position for users to browse the demonstration animation.

[0073] Based on the above steps, in this embodiment Figure 3 A schematic diagram for users to explore data using the bilateral layout display effect; Figure 4 A schematic diagram showing that the user can zoom in on the bilateral layout sub-screen to observe clustering information; Figure 5 Users can zoom in on the overall clustering results to conduct detailed data exploration and observe the clustering information diagram.

[0074] S3: Displays the clusters output by the hierarchical clustering algorithm through a hierarchical layout, see Figure 2 , which are specifically:

[0075] C1: select some points in the path that represent the main clusters of the region;

[0076] C2: Hierarchical clustering of all loading paths is obtained through hierarchical clustering, and the number of screens in the large-screen spliced ​​display wall is equal to the number of clusters;

[0077] C3: assigning virtual camera lenses to screens to track corresponding time-varying path clusters;

[0078] C4: Observe updates of every ocean on Earth by mapping onto a clustered generation screen;

[0079] C5: Display all animation demonstrations of time-varying data types in an immersive virtual big screen.

[0080] In this layout, users can obtain time-varying clustering results and predict data change trends by observing the animation effect of data changing over time;

[0081] Based on the above steps, Figure 8 Provides a schematic diagram for users to explore data using a hierarchical layout display effect; Fig. 9 A schematic diagram showing that users can zoom in on the hierarchical layout sub-screen to observe clustering information.

[0082] The specific process of step S1 in this embodiment is as follows: First, the changes in carbon emission data are animated in the center of the surrounding screen, and data exploration and analysis can be performed without spatial movement. By using high-resolution animation to filter time, users can see the long-term trend of global carbon emissions on the surround screen. Carbon emissions in all regions in the climate model and all regions in the world change every month. Users approach the screen by touching the handle to observe the details of carbon emissions on each continent. The immersive virtual large screen allows users to move the position of each land by touching the handle, clearly distinguishing the clustering information of each region.

[0083] The specific process of step S2 in this embodiment is as follows: First, after selecting a part of the vector field ocean data, a preview of the overall effect of the ocean current will appear in the earth model in the center of the screen. Then a screen layout will be generated, that is, a number of sub-screens will be generated and distributed around the central sphere, the top screen will display the overview query effect, and the bottom screen will display the detailed query results. The user can observe the detailed information of the sub-screen at close range by freely adjusting the observation position and angle through the remote sensing of the handle to achieve the purpose of close observation. The user can also freely customize the sub-screen to allow the user to freely control the number of sub-screens and adjust the position of any sub-screen through the handle, which is convenient for browsing or demonstrating animations. To enlarge the sub-screen is to select any sub-screen through the button of the handle. By clicking, the selected sub-screen will appear in the center of the screen and be enlarged, which is convenient for observing details.

[0084] The specific process of step S3 in this embodiment is as follows: first, some specific points are selected in the path, and then the hierarchical clustering of all loading paths is obtained through hierarchical clustering. The number of screens in the large-screen spliced ​​display wall is equal to the number of clusters. A virtual camera lens is assigned to a screen (mapped to a cluster) to track the corresponding time-varying path cluster. In this layout, several specific points in the path line are selected, and the user can simultaneously observe the update of each ocean on the earth on the generated screen mapped to the cluster. At the same time, all animation demonstrations of time-varying data types can be displayed in an immersive virtual large screen. Users can obtain time-varying clustering results and predict data change trends by observing the animation effects of data changing over time.

[0085] This embodiment also provides an immersive virtual large-screen construction system based on clustering drive, which includes a network interface, a memory and a processor; wherein the network interface is used to realize the reception and transmission of signals in the process of sending and receiving information between other external network elements; the memory is used to store computer program instructions that can be run on the processor; the processor is used to execute the steps of the above-mentioned consensus method when running the computer program instructions.

[0086] The present embodiment also provides a computer storage medium, which stores a computer program, and the method described above can be implemented when the processor executes the computer program. The computer readable medium can be considered to be tangible and non-temporary. Non-limiting examples of non-temporary tangible computer-readable media include non-volatile memory circuits (such as flash memory circuits, erasable programmable read-only memory circuits or mask read-only memory circuits), volatile memory circuits (such as static random access memory circuits or dynamic random access memory circuits), magnetic storage media (such as analog or digital tapes or hard drives) and optical storage media (such as CDs, DVDs or Blu-ray discs), etc. The computer program includes processor executable instructions stored on at least one non-temporary tangible computer-readable medium. The computer program may also include or rely on stored data. The computer program may include a basic input / output system (BIOS) that interacts with the hardware of a special-purpose computer, a device driver that interacts with a specific device of a special-purpose computer, one or more operating systems, user applications, background services, background applications, etc.

[0087] Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0088] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0089] These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0090] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

Claims

1. A cluster-driven immersive virtual large screen construction method, characterized in that: The steps include: S1: Traditional cluster display via a single surround screen; S2: Displaying origin-destination clusters through bilateral layout; S3: Displays the clusters output by the hierarchical clustering algorithm through a hierarchical layout; Step S1 is specifically as follows: A1: Create an immersive environment with a single surround screen rendered for the user's position; A2: Load time-varying data presented in the form of traditional clusters; A3: Integrate all data of traditional clusters on a single screen A4: The data changes are animated in the center of the surround screen; A5: Filter time by using high-resolution animation; A6: Displays traditional cluster data on surround screens; Step S2 is specifically as follows: B1: Select a part of the vector field ocean data that is representative of the region; B2: A preview of the overall effect of rendering ocean currents in the Earth model in the center of the screen; B3: Generate screen layout, that is, generate several sub-screens distributed around the central sphere. The central sphere displays the overview query results, and the top and bottom screens display the detailed query results. B4: The top screens are loaded with cluster data of each cluster of origin clustering; B5: The bottom screens are loaded with the cluster data of each cluster of destination clusters; B6: Use the DBSCAN clustering algorithm to track each cluster of ocean data and display it on the sphere and screen with a time-varying animation effect; B7: Closer look at the details of the subscreen; Step S3 is specifically as follows: C1: select some points in the path that represent the main clusters of the region; C2: Hierarchical clustering of all loading paths is obtained through hierarchical clustering, and the number of screens in the large-screen spliced ​​display wall is equal to the number of clusters; C3: assigning virtual camera lenses to screens to track corresponding time-varying path clusters; C4: Observe updates of every ocean on Earth by mapping onto a clustered generation screen; C5: Display all animation demonstrations of time-varying data types in an immersive virtual big screen.

2. The cluster-driven immersive virtual large screen construction method according to claim 1, characterized in that: The step A6 is specifically as follows: The user approaches the screen by touching the handle to observe the detailed data of each continent; The user moves the position of each land by touching the handle to distinguish the clustering information of each area.

3. The cluster-driven immersive virtual large screen construction method according to claim 1, characterized in that: The step B7 specifically includes: Freely customizable sub-screens allow users to freely control the number of sub-screens and adjust the position of any sub-screen through the handle to facilitate browsing or animation demonstration; To enlarge the sub-screen, you just need to select any sub-screen by the button on the handle. By clicking it, the selected sub-screen will appear in the center of the screen and be enlarged, making it easier to observe the details.

Images