Visual sand table interaction method for basic platform business data

Abstract

The invention discloses a visual sand table interaction method for basic platform business data, and relates to the field of electronic sand tables. The sand table analyzes position information and view angle information of the demonstrated user according to the position of the demonstrating user; acquiring a data stream according to the currently demonstrated sand table content; projecting a scene graph of the data stream of the sand table content, and adjusting the scene graph to the position and visual angle information of a demonstrated user; sending visual angle information about the demonstrated user to the demonstration user; capturing a gesture motion signal of the demonstration user; and analyzing the gesture motion trail and a data stream of the currently demonstrated sand table content, and loading the data stream to the sand table. According to the invention, through authority verification and parameter correction, a better visual field content is provided for a user, and the user experience is improved.

Description

Technical Field

[0001] The present invention relates to the field of electronic sandboxes, and in particular to a visualized sandbox interaction method for basic platform business data. Background Art

[0002] In terms of simulation engineering display, during the construction of large-scale highway facilities, there are many different basic platform systems, using a variety of two-dimensional plane display methods, and including a variety of data forms to display the completion status of bridges, roads, etc., but it is not as obvious and concrete as the results seen directly. However, due to the large-scale highway design projects, when they are processed as traditional sand table displays, the progress cannot be synchronized in real time, and the details of the terrain display are highly blurred, which is inconvenient to understand; Electronic sand table, also known as digital sand table, refers to the use of multi-channel projection image splicing and intelligent media device control technologies to add multimedia display and interactive functions on the basis of traditional physical sand table. Currently, most electronic sand tables are suitable for multi-user interaction, and their recognition sequence is staggered, which is easy to cause confusion and jamming, resulting in poor user experience.

[0003] Therefore, there is an urgent need for a visual sandbox interaction method for basic platform business data. Summary of the invention

[0004] The present invention provides a visualized sandbox interaction method for basic platform business data, which solves the problems of the prior art.

[0005] In a first aspect, the present invention provides a method for visualizing sandbox interaction of basic platform business data, comprising: Interactive permission verification; The sandbox analyzes the location information and viewing angle information of the demonstrated user based on the location of the demonstrating user; Get the data stream based on the current sandbox content; Projecting a scene graph of the data stream obtained from the sandbox content, and adjusting it to the position and viewing angle information of the user being demonstrated; Send to the demo user the viewpoint information of the demo user; Capturing gesture motion signals of the demonstration user; Analyze the data stream of the gesture motion trajectory and the currently demonstrated sandbox content and load the execution data stream into the sandbox.

[0006] Furthermore, the interactive authority verification includes: The sandbox system analyzes the current user's permission level based on the data captured by the sensors; Image recognition and classification of permission data for multiple users wearing VR glasses; Adjust the viewing angle settings for the demonstration user and the demonstrated user based on the image classification authority; Providing the demonstrator with dynamic real-time attention data of the demonstrated user, wherein the attention data is the focus position data of the demonstrated user under the visual angle based on the iris tracking of the VR glasses; The demonstration user's VR glasses display the movement trajectory of the demonstrated user's attention data.

[0007] Furthermore, the sandbox system analyzes the authority level of the current user based on the data captured by the sensor, and by setting a motion trajectory verification method, after the user wearing VR glasses demonstrates a preset gesture movement in a designated area, the sandbox system verifies that the gesture motion trajectory meets the preset motion trajectory, and provides demonstration user authority to the current user who meets the gesture motion trajectory verification, and provides demonstrated user authority to other users.

[0008] Furthermore, the sandbox analyzes the position information and viewing angle information of the demonstrated user according to the position of the demonstrating user, including: Real-time collection of the real-time locations of multiple demonstrated users who have completed the authority verification; When the number of demonstrated users is two, the wide angle size of the sandbox model corresponding to the displayed data stream information is adjusted according to the angle of the triangle formed from the center of the electronic screen of the sandbox to the demonstrated users, wherein the angle from the center of the electronic screen to the two demonstrated users is the two sides of the angle respectively; When the number of demonstrated users is three or more, the users are sorted according to the angle of the triangle formed by the center position of the electronic screen of the sandbox to every two adjacent demonstrated users, and a preset angle threshold is added to the angle size sorting. When the number of angles larger than the preset angle threshold is greater than the number of angles smaller than the preset angle threshold, the wide-angle gear of the sandbox model corresponding to the displayed data stream information is adjusted to the fourth gear or the fifth gear, wherein the preset wide-angle gear is five gears. When the number of angles larger than the preset angle threshold is less than the number of angles smaller than the preset angle threshold, the wide-angle gear of the sandbox model corresponding to the displayed data stream information is adjusted to the first gear or the second gear. Among them, when the number of demonstrated users is one, the displayed data stream information corresponds to the third wide-angle size level of the sandbox model.

[0009] Furthermore, according to the wide-angle size, the parameters in the sandbox content are adjusted, the two-dimensional coordinates of the three-dimensional model pre-displayed on the sandbox are pre-processed, the elevation values ​​of the VR glasses of each demonstrated user are counted, and the projection factor for converting the two-dimensional coordinates into three-dimensional coordinates is adjusted according to the mean elevation. According to the calculated projection factor and the pre-processed two-dimensional coordinates, the coordinate values ​​converted into the three-dimensional model are generated, and the coordinate values ​​of the three-dimensional model are used to project the corresponding data stream into the sandbox scene to generate a sandbox model.

[0010] Furthermore, the elevation values ​​of the VR glasses of each demonstrated user are counted, and the projection factor of converting the two-dimensional coordinates into the three-dimensional coordinates is adjusted according to the average elevation value. The specific processing includes: Call sensor data to obtain the elevation of multiple VR glasses; Load the preset function according to the elevation value to calculate the eye height position corresponding to the VR glasses; Based on the human eye height position data, the expected data of the human eye height corresponding to the VR glasses is statistically analyzed, where the expectation is the mean value; Calculate the perspective coefficient of converting two-dimensional coordinates to three-dimensional coordinates based on the expected data of human eye height; The projection factor used to calculate the coordinates of the three-dimensional model is converted based on the perspective coefficient.

[0011] Furthermore, the projector obtains the scene graph of the data stream of the sandbox content and adjusts it to the position and viewing angle information of the user being demonstrated, including: Based on the perspective coefficient and wide-angle gear corresponding to the projection factor, the corresponding area and intensity that need to be compensated for lumen are calculated.

[0012] Furthermore, the relative distance between the central axis plane of the angle and different light source modules is calculated, and the light source module adjusts the light beam obliquely to the corresponding central axis plane according to the distance, and the luminance density matrix A; the light intensity emitted by the light source modules at different positions entering the VR glasses is calculated according to the perspective coefficient, and the luminance intensity matrix B of the output light on the light source module is calculated according to the setting of the light source module; Load the luminance density matrix A and luminance strength matrix B into the light source module to apply light emission; The element values ​​in the lumen density matrix A and the lumen strength matrix B correspond to the output parameters of the dot matrix light-emitting units on the light source module.

[0013] Furthermore, the perspective information about the demonstrated user sent to the demonstration user includes: The VR glasses monitor the iris information of the demonstrated user based on permission verification, analyze the demonstrated user's focus area based on the position movement of the pupil, and send the focus area information to the demonstrating user.

[0014] Furthermore, the analysis of the gesture movement trajectory and the data stream of the currently demonstrated sandbox content and the execution of loading the data stream into the sandbox specifically includes: while issuing instructions for demonstrating the user's gesture movement, loading the pre-output data stream with the same data hyperparameters as the currently loaded content, the data hyperparameters include the wide-angle gear and projection factor at the current moment.

[0015] The present invention provides a visualized sandbox interaction method for basic platform business data, which provides users with better visual content and improves user experience through authority verification and parameter correction.

[0016] The technical solution of the present invention enables the electronic sandbox to be adjusted with higher precision and display effect to be better and more accurate.

[0017] The technical solution of the present invention changes projection parameters by changing the viewing angle, and has better adaptability and clarity. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The drawings described herein are used to provide a further understanding of the embodiments of the present invention, constitute a part of the present invention, and do not constitute a limitation of the embodiments of the present invention. In the drawings: Figure 1 A flow chart of a method for visualizing sandbox interaction of basic platform business data provided by an exemplary embodiment of the present invention.

[0019] Figure 2 A flowchart for calculating and analyzing elevation projection factors in a visualization sandbox interaction method for basic platform business data provided by an exemplary embodiment of the present invention. DETAILED DESCRIPTION

[0020] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of systems and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0021] The present invention provides a visualization sandbox interaction method for basic platform business data, aiming to solve the above technical problems in the prior art.

[0022] The technical solution of the present invention and how the technical solution of the present invention solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present invention will be described below in conjunction with the accompanying drawings.

[0023] Embodiment 1: This embodiment provides a visualization sandbox interaction method for basic platform business data, such as Figure 1 As shown, the following steps are included: S1, interactive authority verification; The sandbox system analyzes the current user's permission level based on the data captured by the sensors; the sandbox system analyzes the current user's permission level based on the data captured by the sensors, and by setting the motion trajectory verification method, after the user wearing VR glasses shows the preset gesture movement in the designated area, the sandbox system verifies that the gesture motion trajectory meets the preset motion trajectory, and provides demonstration user permissions to the current user who meets the gesture motion trajectory verification, and provides demonstrated user permissions to other users.

[0024] Image recognition and classification of permission data for multiple users wearing VR glasses; Adjust the viewing angle settings for the demonstration user and the demonstrated user based on the image classification authority; Provide the demo user with dynamic real-time attention data of the demo user. The attention data is the focus position data of the demo user under the perspective of the iris tracked by VR glasses; The demonstration user's VR glasses display the movement trajectory of the demonstrated user's attention data.

[0025] S2, the sandbox analyzes the location information and viewing angle information of the demonstrated user based on the location of the demonstrating user; Real-time collection of the real-time locations of multiple demonstrated users who have completed the authority verification; When the number of demonstrated users is two, the wide angle size of the sandbox model corresponding to the displayed data stream information is adjusted according to the angle of the triangle formed from the center of the electronic screen of the sandbox to the demonstrated users, wherein the angle from the center of the electronic screen to the two demonstrated users is the two sides of the angle respectively; When the number of demonstrated users is three or more, the users are sorted according to the angle of the triangle formed by the center position of the electronic screen of the sandbox to every two adjacent demonstrated users, and a preset angle threshold is added to the angle size sorting. When the number of angles larger than the preset angle threshold is greater than the number of angles smaller than the preset angle threshold, the wide-angle gear of the sandbox model corresponding to the displayed data stream information is adjusted to the fourth gear or the fifth gear, wherein the preset wide-angle gear is five gears. When the number of angles larger than the preset angle threshold is less than the number of angles smaller than the preset angle threshold, the wide-angle gear of the sandbox model corresponding to the displayed data stream information is adjusted to the first gear or the second gear. Among them, when the number of demonstrated users is one, the displayed data stream information corresponds to the third wide-angle size level of the sandbox model.

[0026] S3, obtaining a data stream based on the sandbox content currently being demonstrated; S4, projecting a scene graph of the data stream obtained from the sandbox content, and adjusting it to the position and viewing angle information of the user being demonstrated; Based on the perspective coefficient and wide-angle gear corresponding to the projection factor, the corresponding area and intensity of the lumen compensation that needs to be calculated include: calculating the relative distance between the central axis plane of the flare angle and different light source modules, and the light source module adjusts the light beam obliquely projected to the corresponding central axis plane according to the distance. Lumen density matrix A; based on the perspective coefficient, the light intensity emitted by the light source modules at different positions entering the VR glasses is calculated, and the lumen intensity matrix B of the output light on the light source module is calculated according to the setting of the light source module; Load the luminance density matrix A and luminance strength matrix B into the light source module to apply light emission; The element values ​​in the lumen density matrix A and the lumen strength matrix B correspond to the output parameters of the dot matrix light-emitting units on the light source module.

[0027] S5, sending to the demonstration user the viewing angle information of the demonstrated user; Among them, the VR glasses monitor the iris information of the demonstrated user based on permission verification, analyze the focus area of ​​the demonstrated user based on the position movement of the pupil, and send the focus area information to the demonstration user.

[0028] S6, capturing the gesture motion signal of the demonstration user; S7, analyzing the data stream of the gesture motion trajectory and the currently demonstrated sandbox content and loading the data stream into the sandbox.

[0029] While demonstrating the user's gesture movement and issuing instructions, the pre-output data stream is loaded with the same data hyperparameters as the currently loaded content, and the data hyperparameters include the wide-angle gear and projection factor at the current moment.

[0030] Among them, according to the wide-angle size gear, adjust the parameters in the sandbox content, pre-process the two-dimensional coordinates of the three-dimensional model pre-displayed on the sandbox, count the elevation values ​​of the VR glasses of each demonstrated user, adjust the projection factor of the two-dimensional coordinates to three-dimensional coordinates according to the elevation mean, generate the coordinate value converted to the three-dimensional model according to the calculated projection factor and the pre-processed two-dimensional coordinates, and use the coordinate value of the three-dimensional model to project the corresponding data stream into the sandbox scene to generate a sandbox model. Among them, the calculation and analysis of the elevation projection factor specifically includes the following steps, such as Figure 2 As shown: A1. Call sensor data to obtain the elevation of multiple VR glasses; A2. Load the preset function according to the elevation value to calculate the eye height position corresponding to the VR glasses; A3. Statistically analyzing the expected data of human eye height corresponding to VR glasses based on the human eye height position data, where the expectation is the mean value; A4. Calculate the perspective coefficient of converting two-dimensional coordinates to three-dimensional coordinates based on the expected data of human eye height; A5. Convert the perspective coefficient into the projection factor used to calculate the coordinates of the three-dimensional model.

[0031] In the several embodiments provided by the present invention, it should be understood that the disclosed systems and methods can be implemented in other ways. For example, the system embodiments described above are only schematic, for example, the division of modules is only a logical function division, and there may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed.

[0032] In addition, each functional module in each embodiment of the present invention may be integrated into one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of hardware plus software functional modules.

[0033] It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

[0034] Those skilled in the art will appreciate that the embodiments of the present invention may be provided as methods or systems. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects.

[0035] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0036] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. The present invention is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art that are not disclosed by the present invention. The description and examples are to be considered exemplary only, and the true scope and spirit of the present invention is indicated by the claims above.

Claims

1. A visualization sandbox interaction method for basic platform business data, characterized in that: include: Interactive permission verification; The sandbox analyzes the location information and viewing angle information of the demonstrated user based on the location of the demonstrating user; Get the data stream based on the current sandbox content; Projecting a scene graph of the data stream obtained from the sandbox content, and adjusting it to the position and viewing angle information of the user being demonstrated; Send to the demo user the viewpoint information of the demo user; Capturing gesture motion signals of the demonstration user; Analyze the data stream of the gesture motion trajectory and the currently demonstrated sandbox content and load the execution data stream into the sandbox.

2. A visualization sandbox interaction method for basic platform business data according to claim 1, characterized in that: The interactive authority verification includes: The sandbox system analyzes the current user's permission level based on the data captured by the sensors; Image recognition and classification of permission data for multiple users wearing VR glasses; Adjust the viewing angle settings for the demonstration user and the demonstrated user based on the image classification authority; Providing the demonstrator with dynamic real-time attention data of the demonstrated user, wherein the attention data is the focus position data of the demonstrated user under the visual angle based on the iris tracking of the VR glasses; The demonstration user's VR glasses display the movement trajectory of the demonstrated user's attention data.

3. A visualization sandbox interaction method for basic platform business data according to claim 2, characterized in that: The sandbox system analyzes the current user's authority level based on the sensor captured data, and by setting a motion trajectory verification method, after the user wearing VR glasses demonstrates a preset gesture movement in a designated area, the sandbox system verifies that the gesture motion trajectory meets the preset motion trajectory, and provides demonstration user authority to the current user who meets the gesture motion trajectory verification, and provides demonstrated user authority to other users.

4. A visualization sandbox interaction method for basic platform business data according to claim 3, characterized in that: The sandbox analyzes the position information and viewing angle information of the demonstrated user according to the position of the demonstrating user, including: Real-time collection of the real-time locations of multiple demonstrated users who have completed the authority verification; When the number of demonstrated users is two, the wide angle size of the sandbox model corresponding to the displayed data stream information is adjusted according to the angle of the triangle formed from the center of the electronic screen of the sandbox to the demonstrated users, wherein the angle from the center of the electronic screen to the two demonstrated users is the two sides of the angle respectively; When the number of demonstrated users is three or more, the users are sorted according to the angle of the triangle formed by the center position of the electronic screen of the sandbox to every two adjacent demonstrated users, and a preset angle threshold is added to the angle size sorting. When the number of angles larger than the preset angle threshold is greater than the number of angles smaller than the preset angle threshold, the wide-angle gear of the sandbox model corresponding to the displayed data stream information is adjusted to the fourth gear or the fifth gear, wherein the preset wide-angle gear is five gears. When the number of angles larger than the preset angle threshold is less than the number of angles smaller than the preset angle threshold, the wide-angle gear of the sandbox model corresponding to the displayed data stream information is adjusted to the first gear or the second gear. Among them, when the number of demonstrated users is one, the displayed data stream information corresponds to the third wide-angle size level of the sandbox model.

5. A visualization sandbox interaction method for basic platform business data according to claim 4, characterized in that: According to the wide-angle size, the parameters in the sandbox content are adjusted, the two-dimensional coordinates of the three-dimensional model pre-displayed on the sandbox are pre-processed, the elevation values ​​of the VR glasses of each demonstrated user are counted, and the projection factor of the two-dimensional coordinates converted into three-dimensional coordinates is adjusted according to the mean elevation. According to the calculated projection factor and the pre-processed two-dimensional coordinates, the coordinate values ​​converted into the three-dimensional model are generated, and the coordinate values ​​of the three-dimensional model are used to project the corresponding data stream into the sandbox scene to generate a sandbox model.

6. A visualization sandbox interaction method for basic platform business data according to claim 5, characterized in that: The method of counting the elevation values ​​of the VR glasses of each demonstrated user and adjusting the projection factor of converting the two-dimensional coordinates into the three-dimensional coordinates according to the average elevation value includes: Call sensor data to obtain the elevation of multiple VR glasses; Load the preset function according to the elevation value to calculate the eye height position corresponding to the VR glasses; Based on the human eye height position data, the expected data of the human eye height corresponding to the VR glasses is statistically analyzed, where the expectation is the mean value; Calculate the perspective coefficient of converting two-dimensional coordinates to three-dimensional coordinates based on the expected data of human eye height; The projection factor used to calculate the coordinates of the three-dimensional model is converted based on the perspective coefficient.

7. A visualization sandbox interaction method for basic platform business data according to claim 6, characterized in that: The projector obtains the scene graph of the data stream of the sandbox content and adjusts it to the position and viewing angle information of the user being demonstrated, including: Based on the perspective coefficient and wide-angle gear corresponding to the projection factor, the corresponding area and intensity that need to be compensated for lumen are calculated.

8. A visualization sandbox interaction method for basic platform business data according to claim 7, characterized in that: in, Calculate the relative distance between the central axis plane of the angle and different light source modules. The light source module adjusts the light beam obliquely to the corresponding central axis plane according to the distance to obtain the lumen density matrix A. Calculate the light intensity of the light emitted by the light source modules at different positions into the VR glasses according to the perspective coefficient. Calculate the lumen intensity matrix B of the output light on the light source module according to the setting of the light source module. Load the luminance density matrix A and luminance strength matrix B into the light source module to apply light emission; The element values ​​in the lumen density matrix A and the lumen strength matrix B correspond to the output parameters of the dot matrix light-emitting units on the light source module.

9. A visualization sandbox interaction method for basic platform business data according to claim 8, characterized in that: The viewing angle information about the demonstrated user sent to the demonstration user includes: The VR glasses monitor the iris information of the demonstrated user based on permission verification, analyze the demonstrated user's focus area based on the position movement of the pupil, and send the focus area information to the demonstrating user.

10. A visualization sandbox interaction method for basic platform business data according to claim 9, characterized in that: The method of analyzing the data stream of the gesture motion trajectory and the currently demonstrated sandbox content and executing the loading of the data stream into the sandbox specifically includes: while issuing instructions for demonstrating the user's gesture motion, loading the pre-output data stream with the same data hyperparameters as the currently loaded content, the data hyperparameters including the wide-angle gear and projection factor at the current moment.

Images