A visual sandbox interaction method for basic platform business data

Abstract

The present invention discloses a visualized sandbox interaction method for basic platform business data, which relates to the field of electronic sandbox. The present invention includes: interactive authority verification; the sandbox analyzes the position information and viewing angle information of the demonstrated user according to the position of the demonstrating user; obtains the data stream according to the currently demonstrated sandbox content; projects the scene graph of the data stream obtained from the sandbox content, and adjusts it to the position and viewing angle information of the demonstrated user; sends the viewing angle information about the demonstrated user to the demonstrating user; captures the gesture motion signal of the demonstrating user; analyzes the gesture motion trajectory and the data stream of the currently demonstrated sandbox content and executes the data stream loading to the sandbox. The present invention provides users with better visual content and improves the user experience through authority verification and parameter correction.

Description

Technical Field

[0001] The present invention relates to the field of electronic sand tables, and particularly to a visual sand table interaction method for basic platform service data. Background Art

[0002] In the simulation engineering display method, for the construction process of large-scale highway facilities, there are different basic platform systems with various settings, and multiple two-dimensional plane display methods are adopted, including various data forms for displaying the completion status of bridges, roads, etc. However, it is not as obvious and concrete as the directly visible results. Due to the large scale of highway design projects, when processed for traditional sand table display, it is impossible to synchronize the progress in real time, and the degree of terrain display details is highly blurred, which is inconvenient for understanding.

[0003] An electronic sand table, also known as a digital sand table, refers to a technology that uses multi-channel projection image splicing and intelligent media device control, etc., to add multimedia display and interaction functions on the basis of a traditional physical sand table. Currently, most electronic sand tables are suitable for multi-user interaction, but their recognition time sequences are interleaved, which is prone to confusion and lag, resulting in a poor user experience.

[0004] Therefore, there is an urgent need for a visual sand table interaction method for basic platform service data. Summary of the Invention

[0005] A visual sand table interaction method for basic platform service data according to the present invention solves the problems of the prior art.

[0006] In a first aspect, the present invention provides a visual sand table interaction method for basic platform service data, including:

[0007] Interaction permission verification;

[0008] The sand table analyzes the location information and viewing angle information of the demonstrated user based on the location of the demonstrating user.

[0009] Obtain the data stream of the sand table content currently being demonstrated.

[0010] Project the scene graph of the data stream of the sand table content obtained, and adjust it to the location and viewing angle information of the demonstrated user.

[0011] Send the viewing angle information of the demonstrated user to the demonstrating user.

[0012] Capture the gesture motion signal of the demonstrating user.

[0013] Analyze the gesture motion trajectory and the data stream of the sand table content currently being demonstrated, and execute the loading of the data stream to the sand table.

[0014] Further, the interaction permission verification includes:

[0015] The sand table system analyzes the permission level of the current user based on the data captured by the sensor;

[0016] Image recognition classifies the permission data of multiple users wearing VR glasses;

[0017] Adjust the demonstration user and the demonstrated user according to the image classification permission under the perspective setting;

[0018] Provide the demonstration user with the dynamic real-time attention data of the demonstrated user, and the attention data is the focused position data of the demonstrated user based on the iris tracked by the VR glasses under the perspective;

[0019] The attention data movement trajectory of the demonstrated user is displayed in the VR glasses of the demonstration user.

[0020] Furthermore, the sand table system analyzes the permission level of the current user based on the data captured by the sensor. By setting the method of motion trajectory verification, after the user wearing the VR glasses shows the preset gesture motion in the specified area, the sand table system verifies that the gesture motion trajectory meets the preset motion trajectory, provides the demonstration user permission for the current user who meets the gesture motion trajectory verification, and provides the demonstrated user permission for other users.

[0021] Furthermore, the sand table analyzes the position information and perspective information of the demonstrated user based on the position of the demonstration user, including:

[0022] Real-time collect the real-time positions of multiple demonstrated users after permission verification;

[0023] When the number of demonstrated users is two, adjust the wide-angle size of the data stream information displayed corresponding to the sand table model according to the size of the triangular opening angle formed from the center position of the electronic screen of the sand table to the demonstrated users, where the two sides of the opening angle are from the center position of the electronic screen to the two demonstrated users respectively;

[0024] When the number of demonstrated users is three or more, sort according to the size of the triangular opening angle formed from the center position of the electronic screen of the sand table to every two adjacent demonstrated users, and add the preset angle threshold to the sorting of the opening angle size. When the number of opening angles larger than the preset angle threshold is more than the number of opening angles smaller than the preset angle threshold, increase the wide-angle gear of the data stream information displayed corresponding to the sand table model to the fourth gear or the fifth gear. Among them, the preset wide-angle gear has five gears. When the number of opening angles larger than the preset angle threshold is less than the number of opening angles smaller than the preset angle threshold, decrease the wide-angle gear of the data stream information displayed corresponding to the sand table model to the first gear or the second gear;

[0025] Among them, when the number of demonstrated users is one, the wide-angle size gear of the data stream information displayed corresponding to the sand table model is the third gear.

[0026] Further, according to the wide-angle size level, adjust the parameters in the sand table content, preprocess the two-dimensional coordinates of the three-dimensional model pre-displayed on the sand table, count the elevation values of the VR glasses of each demonstrated user, adjust the projection factor for converting two-dimensional coordinates to three-dimensional coordinates according to the average elevation, generate the coordinate values converted into a three-dimensional model based on the calculated projection factor and the preprocessed two-dimensional coordinates, and project the corresponding data stream onto the sand table scene using the coordinate values of the three-dimensional model to generate a sand table model.

[0027] Further, the process of counting the elevation values of the VR glasses of each demonstrated user and adjusting the projection factor for converting two-dimensional coordinates to three-dimensional coordinates according to the average elevation specifically includes:

[0028] Call the sensor data to obtain the elevations where multiple VR glasses are located;

[0029] Load a preset function according to the elevation value to calculate the eye height position of the corresponding VR glasses;

[0030] Statistically analyze the expected eye height data corresponding to the VR glasses based on the eye height position data, where the expectation is the average value;

[0031] Calculate the perspective coefficient for converting two-dimensional coordinates to three-dimensional coordinates based on the expected eye height data;

[0032] Convert the perspective coefficient into a projection factor for calculating the coordinates of the three-dimensional model.

[0033] Further, the process of adjusting the scene graph of the data stream of the sand table content obtained by the projection to the position and perspective information of the demonstrated user includes:

[0034] Calculate the corresponding area and intensity for compensating the lightness based on the perspective coefficient corresponding to the projection factor and the wide-angle level.

[0035] Further, calculate the relative distance between the central axis plane of the opening angle and different light source modules, and the light source module adjusts the lightness density matrix A of the light beam obliquely projected onto the corresponding central axis plane according to the distance; calculate the light intensity of the light emitted by different light source modules into the VR glasses according to the perspective coefficient, and calculate the lightness strength matrix B of the output light on the light source module according to the settings of the light source module;

[0036] Load the lightness density matrix A and the lightness strength matrix B into the light source module for light emission application;

[0037] Among them, the element values in the lightness density matrix A and the lightness strength matrix B both correspond to the output parameters of the dot matrix light-emitting units on the light source module.

[0038] Further, the process of sending the perspective information of the demonstrated user to the demonstration user includes:

[0039] The VR glasses monitor the iris information of the demonstrated user based on permission verification, analyze the area of concern of the demonstrated user by moving according to the position of the pupil, and send the information of the concerned area to the demonstrating user.

[0040] Furthermore, analyzing the gesture movement trajectory and the data stream of the current sand table content being demonstrated and loading the data stream into the sand table specifically includes: while the demonstrating user issues an instruction with a gesture movement, loading the same data hyperparameters of the currently loaded content for the pre-output data stream, and the data hyperparameters include the wide-angle gear and the projection factor at the current moment.

[0041] A visualization sand table interaction method for basic platform service data provided by the present invention provides better visual content for users through permission verification and parameter correction, improving the user experience.

[0042] The technical solution of the present invention enables higher precision adjustment of the electronic sand table, with better and more accurate display effects.

[0043] The technical solution of the present invention changes the projection parameters according to the viewing angle change, with better adaptability and clearer display. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The drawings described herein are used to provide a further understanding of the embodiments of the present invention, form a part of the present invention, and do not limit the embodiments of the present invention. In the drawings:

[0045] Figure 1 It is a flowchart of a visualization sand table interaction method for basic platform service data provided by an exemplary embodiment of the present invention.

[0046] Figure 2 It is a flowchart of the calculation and analysis of the elevation projection factor in a visualization sand table interaction method for basic platform service data provided by an exemplary embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0047] Here, the exemplary embodiments will be described in detail, and the examples are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. On the contrary, they are merely examples of systems and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0048] A visualization sand table interaction method for basic platform service data provided by the present invention aims to solve the above technical problems of the prior art.

[0049] The following uses specific embodiments to elaborate in detail on the technical solution of the present invention and how the technical solution of the present invention solves the above technical problems. The following several specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present invention will be described below in conjunction with the accompanying drawings.

[0050] Embodiment 1: This embodiment provides a visualization sand table interaction method for basic platform service data. As Figure 1 shown, it includes the following steps:

[0051] S1. Interaction permission verification;

[0052] The sand table system analyzes the permission level of the current user based on the data captured by the sensor. Among them, the sand table system analyzes the permission level of the current user based on the data captured by the sensor. By setting the method of motion trajectory verification, after the user wearing the VR glasses shows a preset gesture motion in the specified area, the sand table system verifies that the gesture motion trajectory meets the preset motion trajectory, provides the demonstration user permission for the current user who meets the gesture motion trajectory verification, and provides the demonstrated user permission for other users.

[0053] Image recognition obtains the classification permission data of multiple users wearing VR glasses;

[0054] Adjust the demonstration user and the demonstrated user according to the image classification permission under the perspective setting;

[0055] Provide the dynamic real-time attention data of the demonstrated user to the demonstration user. The attention data is the focus position data of the demonstrated user tracked by the iris in the perspective based on the VR glasses;

[0056] The attention data motion trajectory of the demonstrated user is displayed in the VR glasses of the demonstration user.

[0057] S2. The sand table analyzes the position information and perspective information of the demonstrated user based on the position of the demonstration user;

[0058] Real-time collect the real-time positions of multiple demonstrated users after the permission is verified;

[0059] When the number of demonstrated users is two, adjust the wide-angle size of the data stream information displayed corresponding to the sand table model according to the size of the triangular opening angle formed from the center position of the electronic screen of the sand table to the demonstrated users. Among them, from the center position of the electronic screen to the two demonstrated users are the two sides of the opening angle;

[0060] When the number of demonstrated users is three or more, sort according to the size of the angular opening formed by the center position of the electronic screen of the sand table to every two adjacent demonstrated users, and add a preset angle threshold to the sorting of the angular opening size. When the number of angular openings larger than the preset angle threshold is more than the number of angular openings smaller than the preset angle threshold, increase the wide-angle gear corresponding to the sand table model of the displayed data stream information to the fourth gear or the fifth gear. Among them, the preset wide-angle gear has five gears. When the number of angular openings larger than the preset angle threshold is less than the number of angular openings smaller than the preset angle threshold, decrease the wide-angle gear corresponding to the sand table model of the displayed data stream information to the first gear or the second gear;

[0061] Among them, when the number of demonstrated users is one, the wide-angle size gear corresponding to the sand table model of the displayed data stream information is the third gear.

[0062] S3. Obtain the data stream based on the current demonstrated sand table content;

[0063] S4. Project the scene graph of the data stream of the obtained sand table content and adjust it to the position and perspective information of the demonstrated user;

[0064] Based on the perspective coefficient corresponding to the projection factor and the wide-angle gear, calculate the corresponding area and intensity that need to compensate the luminous intensity, specifically including: calculating the relative distance between the central axis plane of the angular opening and different light source modules, and the light source module adjusts the density matrix A of the luminous intensity of the light beam obliquely projected onto the corresponding central axis plane according to the distance; according to the calculation of the perspective coefficient, the light intensity of different light source modules emitted into the VR glasses is calculated, and the density matrix B of the luminous intensity of the output light on the light source module is calculated according to the setting of the light source module;

[0065] Load the density matrix A of the luminous intensity and the density matrix B of the luminous intensity into the light source module for light emission;

[0066] Among them, the element values in the density matrix A of the luminous intensity and the density matrix B of the luminous intensity both correspond to the output parameters of the dot matrix light-emitting units on the light source module.

[0067] S5. Send the perspective information of the demonstrated user to the demonstrating user;

[0068] Among them, the VR glasses monitor the iris information of the demonstrated user according to the permission verification, analyze the attention area of the demonstrated user according to the movement of the pupil position, and send the information of the concerned area to the demonstrating user.

[0069] S6. Capture the gesture motion signal of the demonstrating user;

[0070] S7. Analyze the gesture motion trajectory and the data stream of the current demonstrated sand table content and execute the data stream loading to the sand table.

[0071] While demonstrating the instructions issued by the user's gesture movement, load the same data hyperparameters of the currently loaded content into the pre-output data stream. The data hyperparameters include the wide-angle gear and the projection factor at the current moment.

[0072] Among them, according to the wide-angle size gear, adjust the parameters in the sand table content, preprocess the two-dimensional coordinates of the three-dimensional model pre-displayed on the sand table, count the elevation values of the VR glasses of each demonstrated user, and adjust the projection factor for converting the two-dimensional coordinates to three-dimensional coordinates according to the elevation mean value. According to the calculated projection factor and the preprocessed two-dimensional coordinates, generate the coordinate values converted into a three-dimensional model, and project the corresponding data stream onto the sand table scene using the coordinate values of the three-dimensional model to generate a sand table model. Among them, the calculation and analysis of the elevation projection factor specifically include the following steps, as Figure 2 shown:

[0073] A1. Call the sensor data to obtain the elevations where multiple VR glasses are located;

[0074] A2. Load the preset function according to the elevation value to calculate the eye height position of the corresponding VR glasses;

[0075] A3. Statistically analyze the expected eye height data corresponding to the VR glasses based on the eye height position data, where the expectation is the mean value;

[0076] A4. Calculate the perspective coefficient for converting two-dimensional coordinates to three-dimensional coordinates according to the expected eye height data;

[0077] A5. Convert the perspective coefficient into the projection factor for calculating the coordinates of the three-dimensional model.

[0078] In several embodiments provided by the present invention, it should be understood that the disclosed systems and methods can be implemented in other ways. For example, the system embodiments described above are only illustrative. For example, the division of modules is only a logical function division. In actual implementation, there can be other division methods. For example, multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed.

[0079] In addition, each functional module in various embodiments of the present invention can be integrated in a processing module, or each module can exist physically alone, or two or more modules can be integrated in one module. The above integrated modules can be implemented in the form of hardware or in the form of a hardware plus software functional module.

[0080] It should be understood that the present invention is not limited to the exact structure described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present invention is only limited by the appended claims.

[0081] Those skilled in the art should understand that the embodiments of the present invention can be provided as a method or a system. Therefore, the present invention can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects.

[0082] It should also be noted that the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, such that a process, method, article or apparatus comprising a series of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article or apparatus. Without further limitation, an element defined by the statement "comprising a..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising the element.

[0083] After considering the specification and practicing the invention disclosed herein, those skilled in the art will readily conceive of other embodiments of the present invention. The present invention is intended to cover any variations, uses or adaptations of the present invention, which follow the general principles of the present invention and include common general knowledge or conventional technical means in the technical field not disclosed by the present invention. The specification and examples are only illustrative, and the true scope and spirit of the present invention are pointed out by the claims above.

Claims

1. A visualization sandbox interaction method for basic platform business data, characterized in that: include: Interactive permission verification; The sandbox analyzes the location information and viewing angle information of the demonstrated user based on the location of the demonstrating user; including: Real-time collection of the real-time locations of multiple demonstrated users who have completed the authority verification; When the number of demonstrated users is two, the wide-angle size of the sandbox model corresponding to the displayed data stream information is adjusted according to the size of the triangle angle formed from the center position of the electronic screen of the sandbox to the demonstrated users, wherein the two sides of the angle are respectively from the center position of the electronic screen to the two demonstrated users; when the number of demonstrated users is three or more, the data stream information is sorted according to the size of the triangle angle formed from the center position of the electronic screen of the sandbox to every two adjacent demonstrated users, and a preset angle threshold is added to the sorting of the angle size. When the number of angles larger than the preset angle threshold is greater than the number of angles smaller than the preset angle threshold, the wide-angle gear of the sandbox model corresponding to the displayed data stream information is increased to the fourth gear or the fifth gear, wherein the preset wide-angle gear is five gears, and when the number of angles larger than the preset angle threshold is less than the number of angles smaller than the preset angle threshold, the wide-angle gear of the sandbox model corresponding to the displayed data stream information is reduced to the first gear or the second gear; wherein, when the number of demonstrated users is one, the wide-angle size gear of the sandbox model corresponding to the displayed data stream information is the third gear; Get the data stream based on the current sandbox content; Projecting a scene graph of the data stream obtained from the sandbox content, and adjusting it to the position and viewing angle information of the user being demonstrated; Send to the demo user the viewpoint information of the demo user; Capturing gesture motion signals of the demonstration user; Analyze the data stream of the gesture motion trajectory and the currently demonstrated sandbox content and load the execution data stream into the sandbox.

2. A visualization sandbox interaction method for basic platform business data according to claim 1, characterized in that: The interactive authority verification includes: The sandbox system analyzes the current user's permission level based on the data captured by the sensors; Image recognition and classification of permission data for multiple users wearing VR glasses; Adjust the viewing angle settings for the demonstration user and the demonstrated user based on the image classification authority; Providing the demonstrator with dynamic real-time attention data of the demonstrated user, wherein the attention data is the focus position data of the demonstrated user under the visual angle based on the iris tracking of the VR glasses; The demonstration user's VR glasses display the movement trajectory of the demonstrated user's attention data.

3. A visualization sandbox interaction method for basic platform business data according to claim 2, characterized in that: The sandbox system analyzes the current user's authority level based on the sensor captured data, and by setting a motion trajectory verification method, after the user wearing VR glasses demonstrates a preset gesture movement in a designated area, the sandbox system verifies that the gesture motion trajectory meets the preset motion trajectory, and provides demonstration user authority to the current user who meets the gesture motion trajectory verification, and provides demonstrated user authority to other users.

4. A visualization sandbox interaction method for basic platform business data according to claim 3, characterized in that: According to the wide-angle size, the parameters in the sandbox content are adjusted, the two-dimensional coordinates of the three-dimensional model pre-displayed on the sandbox are pre-processed, the elevation values ​​of the VR glasses of each demonstrated user are counted, and the projection factor of the two-dimensional coordinates converted into three-dimensional coordinates is adjusted according to the mean elevation. According to the calculated projection factor and the pre-processed two-dimensional coordinates, the coordinate values ​​converted into the three-dimensional model are generated, and the coordinate values ​​of the three-dimensional model are used to project the corresponding data stream into the sandbox scene to generate a sandbox model.

5. A visualization sandbox interaction method for basic platform business data according to claim 4, characterized in that: The method of counting the elevation values ​​of the VR glasses of each demonstrated user and adjusting the projection factor of converting the two-dimensional coordinates into the three-dimensional coordinates according to the average elevation value includes: Call sensor data to obtain the elevation of multiple VR glasses; Load the preset function according to the elevation value to calculate the eye height position corresponding to the VR glasses; Based on the human eye height position data, the expected data of the human eye height corresponding to the VR glasses is statistically analyzed, where the expectation is the mean value; Calculate the perspective coefficient of converting two-dimensional coordinates to three-dimensional coordinates based on the expected data of human eye height; The projection factor used to calculate the coordinates of the three-dimensional model is converted based on the perspective coefficient.

6. A visualization sandbox interaction method for basic platform business data according to claim 5, characterized in that: The projector obtains the scene graph of the data stream of the sandbox content and adjusts it to the position and viewing angle information of the user being demonstrated, including: Based on the perspective coefficient and wide-angle gear corresponding to the projection factor, the corresponding area and intensity that need to be compensated for lumen are calculated.

7. A visualization sandbox interaction method for basic platform business data according to claim 6, characterized in that: in, Calculate the relative distance between the central axis plane of the angle and different light source modules. The light source module adjusts the light beam obliquely to the corresponding central axis plane according to the distance to obtain the lumen density matrix A. Calculate the light intensity of the light emitted by the light source modules at different positions into the VR glasses according to the perspective coefficient. Calculate the lumen intensity matrix B of the output light on the light source module according to the setting of the light source module. Load the luminance density matrix A and luminance strength matrix B into the light source module to apply light emission; The element values ​​in the lumen density matrix A and the lumen strength matrix B correspond to the output parameters of the dot matrix light-emitting units on the light source module.

8. A visualization sandbox interaction method for basic platform business data according to claim 7, characterized in that: The viewing angle information about the demonstrated user sent to the demonstration user includes: The VR glasses monitor the iris information of the demonstrated user based on permission verification, analyze the demonstrated user's focus area based on the position movement of the pupil, and send the focus area information to the demonstrating user.

9. A visualization sandbox interaction method for basic platform business data according to claim 8, characterized in that: The method of analyzing the data stream of the gesture motion trajectory and the currently demonstrated sandbox content and executing the loading of the data stream into the sandbox specifically includes: while issuing instructions for demonstrating the user's gesture motion, loading the pre-output data stream with the same data hyperparameters as the currently loaded content, the data hyperparameters including the wide-angle gear and projection factor at the current moment.

Images