A virtual reality-based data visualization method, device, system and apparatus

Abstract

The present specification relates to the technical field of virtual reality, and provides a data visualization method, device, system and equipment based on virtual reality. The method comprises: receiving a data visualization request and user login information sent by a user terminal virtual reality device; determining a data center scene and a data page corresponding to the data visualization request and the user login information; sending the data center scene and the data page to the virtual reality device, so that the virtual reality device displays the data center scene and the data page to the user in a virtual reality manner. Through the embodiment of the present specification, the data understanding threshold can be reduced, and it is of great significance in data education.

Description

Technical Field

[0001] This specification relates to the field of virtual reality technology, and in particular to a data visualization method, apparatus, system and device based on virtual reality. Background Technology

[0002] Digital data reflects the quantitative characteristics of things. For example, production data refers to data on production progress, equipment, materials, energy, quality, and safety, reflecting production consumption, progress, and efficiency. Financial data refers to data generated in various financial activities. To enhance understanding of production and financial data and better grasp the trends of production activities within the industry, the understanding and control of traditional data requires the use of 2D charts for visualization. However, for some non-industry personnel, understanding the changes, characteristics, and consequences of changes in production and financial data over time through traditional 2D charts is difficult and tedious. The initial learning curve is steep, and even for industry professionals, a certain level of mathematical knowledge and business experience is required to fully understand the meaning and potential consequences of long-term data changes. Therefore, there is an urgent need for a virtual reality-based data visualization method to provide users with a data analysis experience with virtual reality interactive capabilities, intuitively obtaining data fluctuations and their consequences, lowering the data understanding threshold, and having significant implications for data education. Summary of the Invention

[0003] Given that current data visualization methods are difficult for some non-industry personnel to understand and learn, and the process is tedious, and can only show data fluctuations from a two-dimensional perspective, this solution is proposed to overcome the above problems or at least partially solve them.

[0004] On the one hand, the purpose of some embodiments of this specification is to provide a data visualization method based on virtual reality, executed by a virtual reality data center system, the method comprising:

[0005] Receive data visualization requests and user login information sent by the user's virtual reality device;

[0006] Determine the data center scenario and data page corresponding to the data visualization request and the user login information;

[0007] The data center scene and the data page are sent to the virtual reality device so that the virtual reality device can display the data center scene and the data page to the user in a virtual reality manner.

[0008] Further, determining the data page corresponding to the data visualization request and the user login information includes:

[0009] The preset data page library is invoked according to the data visualization request;

[0010] Match the data page from the data page library that corresponds to the user profile in the user login information.

[0011] Furthermore, after matching the data page corresponding to the user profile in the user login information from the data page library, the process further includes:

[0012] Receive data page switching requests sent by the user's virtual reality device;

[0013] The user's attention level is calculated based on the user's gaze time, viewing frequency, and action amplitude data of the data pages already viewed, as well as the user profile.

[0014] The data pages viewed by the user are sorted in descending order of their level of attention.

[0015] Determine the data tags for data pages whose attention level is greater than a first threshold;

[0016] The target data page with the data tag is retrieved from the data page library;

[0017] The target data page is the data page displayed to the user after the data page is switched.

[0018] Furthermore, after sending the data center scene and the data page to the virtual reality device, the process further includes:

[0019] Obtain the visual information selected by the user sent by the virtual reality device;

[0020] Determine the visualization data corresponding to the visualization information;

[0021] The visualization data is divided to obtain multiple corresponding visualization sub-intervals;

[0022] Calculate the feature value corresponding to each visualized sub-interval;

[0023] The corresponding scene interaction model is determined by using the feature values ​​of each visualized sub-interval.

[0024] Receive visual experience requests sent by user-side virtual reality devices;

[0025] Based on the visualization experience request, the correspondence between each visualization sub-section and the scene interaction model, along with the scene interaction model, is sent to the virtual reality device, so that the virtual reality device can display the visualization information to the user in a virtual reality manner.

[0026] Furthermore, the process of dividing the visualization data to obtain multiple corresponding visualization sub-intervals includes:

[0027] Calculate the total number of visualization sub-intervals based on the visualization duration in the visualization information;

[0028] The visualized data is divided into multiple visualized sub-intervals corresponding to the total number of visualized sub-intervals.

[0029] Furthermore, the step of determining the corresponding scene interaction model using the feature values ​​of each visualization sub-interval includes:

[0030] If the feature value is greater than the second threshold, then the first scene interaction model is matched for the sub-interval;

[0031] If the feature value is less than the third threshold, then the second scene interaction model is matched for that sub-interval;

[0032] If the feature value is not greater than the second threshold and not less than the third threshold, then the sub-interval is matched with the third scene interaction model.

[0033] Furthermore, after determining the corresponding scene interaction model using the feature values ​​of each visualization sub-interval, the process further includes:

[0034] Obtain the historical impact time points corresponding to the data identifier and the selected time in the visualized data;

[0035] Determine whether the time corresponding to each visualized sub-interval includes the historical impact time point;

[0036] If so, then the fourth scene interaction model is matched for that sub-interval.

[0037] Furthermore, the step of displaying the visualized information to the user via virtual reality further includes:

[0038] The final data result is calculated based on the data identifier, selection time, and initial data value in the visualization information.

[0039] Subtract the initial data value from the final data result to obtain the difference;

[0040] If the difference is greater than the fourth threshold, then the final data result matches the first scene model;

[0041] If the difference is less than the fifth threshold, then the final data result matches the second scene model;

[0042] If the difference is not greater than the fourth threshold and not less than the fifth threshold, then the final data result matches the third scene model.

[0043] On the other hand, some embodiments of this specification also provide a data visualization device based on virtual reality, the device comprising:

[0044] The receiving module is used to receive data visualization requests and user login information sent by the user-end virtual reality device;

[0045] The determination module is used to determine the data center scene and data page corresponding to the data visualization request and the user login information;

[0046] The display module is used to send the data center scene and the data page to the virtual reality device, so that the virtual reality device can display the data center scene and the data page to the user in a virtual reality manner.

[0047] Based on the same inventive concept, embodiments of this specification also provide a data visualization method based on virtual reality, executed by a user-end virtual reality device, the method comprising:

[0048] Retrieve data visualization requests and user login information sent by users;

[0049] The data visualization request and the user login information are sent to the virtual reality data center system, so that the virtual reality data center system can determine the data center scene and data page corresponding to the data visualization request and the user login information, and send the data center scene and the data page to the virtual reality device.

[0050] On the other hand, embodiments of this specification also provide a data visualization device based on virtual reality, including:

[0051] The acquisition module is used to acquire data visualization requests and user login information sent by users.

[0052] The transmission module is used to send the data visualization request and the user login information to the virtual reality data center system, so that the virtual reality data center system can determine the data center scene and data page corresponding to the data visualization request and the user login information, and send the data center scene and the data page to the virtual reality device.

[0053] On the other hand, some embodiments of this specification also provide a computer device, including a memory, a processor, and a computer program stored in the memory, which, when run by the processor, executes instructions for the methods described above.

[0054] On the other hand, some embodiments of this specification also provide a computer storage medium having a computer program stored thereon, which, when run by the processor of a computer device, executes instructions for the methods described above.

[0055] On the other hand, some embodiments of this specification also provide a computer program product, which includes a computer program that, when run by the processor of a computer device, executes instructions for the methods described above.

[0056] Some embodiments of this specification provide one or more technical solutions, which have at least the following technical effects:

[0057] The embodiments of this specification automatically receive data visualization requests and user login information sent by the user's virtual reality device, and determine the data center scene and data page based on the data visualization request and user login information, thereby displaying the data center scene and data page to the user in a virtual reality manner to improve the user experience of data visualization and reduce the difficulty of data understanding.

[0058] The above description is merely an overview of some embodiments of the technical solutions in this specification. In order to better understand the technical means of some embodiments of this specification and to implement them in accordance with the content of the specification, and to make the above and other objects, features and advantages of some embodiments of this specification more apparent and understandable, specific implementation methods of some embodiments of this specification are given below. Attached Figure Description

[0059] To more clearly illustrate some embodiments or technical solutions in the prior art of this specification, the accompanying drawings used in the description of the embodiments or prior art will be briefly introduced below. Obviously, the drawings described below are merely some embodiments recorded in this specification. For those skilled in the art, other drawings can be obtained based on these drawings without any creative effort. In the drawings:

[0060] Figure 1 The following are schematic diagrams illustrating implementation systems of the virtual reality-based data visualization method in some embodiments of this specification;

[0061] Figure 2 A flowchart of a virtual reality-based data visualization method is shown in some embodiments of this specification;

[0062] Figure 3 This is a schematic diagram illustrating the steps involved in determining the data page to be displayed to the user in some embodiments of this specification;

[0063] Figure 4 These are schematic diagrams illustrating the steps involved in the data visualization experience in some embodiments of this specification;

[0064] Figure 5 This is a schematic diagram illustrating the scene model matching steps in some embodiments of this specification;

[0065] Figure 6 This is a schematic diagram of the structure of a virtual reality-based data visualization device in some embodiments of this specification;

[0066] Figure 7 This is a flowchart of a virtual reality-based data visualization method in some embodiments of this specification;

[0067] Figure 8 This is a schematic diagram of the structure of a virtual reality-based data visualization device in some embodiments of this specification;

[0068] Figure 9 This is a schematic diagram of the computer device structure provided in some embodiments of this specification.

[0069] [Explanation of Labels in the Attached Image]

[0070] 1. A data visualization system based on virtual reality;

[0071] 101. User-end virtual reality devices;

[0072] 102. Virtual Reality Data Center System;

[0073] 601. Receiving module;

[0074] 602. Determine the module;

[0075] 603. Display Module;

[0076] 801. Acquisition Module;

[0077] 802. Transmission module;

[0078] 902. Computer equipment;

[0079] 904, Processor;

[0080] 906. Memory;

[0081] 908. Drive mechanism;

[0082] 910. Input / output interfaces;

[0083] 912. Input devices;

[0084] 914. Output devices;

[0085] 916. Presentation equipment;

[0086] 918. Graphical User Interface;

[0087] 920. Network interface;

[0088] 922. Communication link;

[0089] 924. Communication bus. Detailed Implementation

[0090] To enable those skilled in the art to better understand the technical solutions in this specification, the technical solutions in some embodiments of this specification will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this specification, and not all embodiments. Based on some embodiments of this specification, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of this specification.

[0091] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings herein are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that the embodiments described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, apparatus, product, or device that includes a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or devices. It should be noted that the acquisition, storage, use, and processing of data in the technical solutions of this application comply with the relevant provisions of national laws and regulations.

[0092] like Figure 1The diagram illustrates an implementation system for a virtual reality-based data visualization method according to an embodiment of the present invention. The system may include a user-end virtual reality device 101 and a virtual reality data center system 102. The user-end virtual reality device 101 and the virtual reality data center system 102 communicate via a network, which may include a local area network (LAN), a wide area network (WAN), the Internet, or a combination thereof, and is connected to a website, user equipment (e.g., a computing device), and a backend system. The user can send a data visualization request to the virtual reality data center system 102 through the user-end virtual reality device 101. Upon receiving the request, the virtual reality data center system 102 further retrieves data from its database (this data can be production data from actual production operations or data artificially constructed based on actual production operations; this is not limited herein) based on the user's login information, performs calculations, and obtains the corresponding data center scene and data page. The corresponding data center scene and data page are then sent back to the user-end virtual reality device 101, allowing the user to understand the data changes and their characteristics based on the corresponding data center scene and data page.

[0093] In the embodiments of this specification, the virtual reality data center system 102 may be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDN), and big data and artificial intelligence platforms.

[0094] In an optional embodiment, the user-end virtual reality device 101 may be, but is not limited to, electronic devices such as self-service terminal devices and smart wearable devices. Optionally, the operating system running on the electronic device may include, but is not limited to, Android, iOS, Linux, Windows, etc. Of course, the user-end virtual reality device 101 is not limited to the above-mentioned physical electronic devices; it may also be software running on the above-mentioned electronic devices.

[0095] In addition, it should be noted that, Figure 1 The example shown is merely one application environment provided by this disclosure. In practical applications, it may also include multiple user-end virtual reality devices 101, and this specification does not impose any limitations.

[0096] Figure 2This is a flowchart illustrating a data visualization method based on virtual reality provided in an embodiment of the present invention. This specification provides the operational steps of the method described in the embodiments or flowchart, but based on conventional or non-inventive labor, more or fewer operational steps may be included. The order of steps listed in the embodiments is merely one possible execution order among many and does not represent the only possible execution order. In actual system or device products, the methods shown in the embodiments or accompanying drawings can be executed sequentially or in parallel. Specifically, as shown... Figure 1 As shown, the method, executed by a virtual reality data center system, may include:

[0097] S201: Receive data visualization requests and user login information sent by the user's virtual reality device;

[0098] S202: Determine the data center scene and data page corresponding to the data visualization request and the user login information;

[0099] S203: Send the data center scene and the data page to the virtual reality device so that the virtual reality device can display the data center scene and the data page to the user in a virtual reality manner.

[0100] The embodiments of this specification automatically receive data visualization requests and user login information sent by the user's virtual reality device, and determine the data center scene and data page based on the data visualization request and user login information, thereby displaying the data center scene and data page to the user in a virtual reality manner to improve the user experience of data visualization and reduce the difficulty of data understanding.

[0101] Specifically, in some embodiments, Virtual Reality (VR), also known as virtual reality or virtual reality technology, is a new and practical technology that emerged in the 20th century. Virtual Reality encompasses computer science, electronic information, and simulation technology. Its basic implementation relies primarily on computer technology, utilizing and integrating the latest advancements in 3D graphics, multimedia, simulation, display, and server technologies to create a realistic 3D virtual world with multiple sensory experiences, including visual, tactile, and olfactory sensations. This allows users to feel as if they are actually in the virtual world. Commonly used virtual reality devices include virtual reality glasses, virtual reality headsets, and all-in-one virtual reality machines. After entering login information and completing authentication, users can log in to the virtual reality device and issue data visualization requests. User login information identifies the user and creates a user profile. A user profile is an effective tool reflecting user needs and design direction. After the user-side virtual reality device issues a data visualization request, the virtual reality data center system determines the corresponding data center scene and data page based on the data visualization request and user login information. The data scene is a multi-dimensional virtual simulation environment. The data page is embedded in the data center scene to represent data changes. It should be noted that the data page can present different screen sizes, distances, brightness, etc., according to the user's operation. Since data is a quantity that changes with time or progress, functions can be constructed to represent the mapping relationship of data changes with independent variables (such as time or progress). The data page can also use a three-dimensional perspective to measure the degree of data change. For example, the data page can display bar charts in a three-dimensional way. In some embodiments, when displaying the population density of multiple cities in the form of bar charts, only the city name and population density can be obtained from the bar chart. However, the data page can add coordinate axes on the basis of two-dimensional display, showing the population density of multiple cities changing with time and / or longitude and / or latitude in a multi-dimensional way, with richer information. Users can observe the various data characteristics presented in the data page from around the screen through virtual reality devices.

[0102] In some embodiments, determining the data page corresponding to the data visualization request and the user login information may include:

[0103] The preset data page library is invoked according to the data visualization request;

[0104] Match the data page from the data page library that corresponds to the user profile in the user login information.

[0105] Specifically, in some embodiments, when the virtual reality data center system determines the corresponding data center scene and data page based on the data visualization request and user login information, it first calls a preset data page library according to the data visualization request. The preset data page library includes multiple data pages, and each data page has a page tag associated with the user profile. Therefore, the corresponding data page can be determined by matching the data page tags according to regular expressions, etc., based on the user profile. In some embodiments, considering that the number of user profile categories is large, in order to reduce the computational pressure and allocate computing resources reasonably during the actual development process, the developers may also first preset the user characteristics corresponding to the user profile, and then formulate the corresponding data page based on the user characteristics.

[0106] Further, refer to the appendix Figure 3 In some embodiments, after matching the data page corresponding to the user profile in the user login information from the data page library, the process may include:

[0107] S301: Receives a data page switching request sent by the user's virtual reality device;

[0108] S302: Calculate the data page attention level based on the user's gaze time, viewing frequency, and action amplitude data of the data pages already viewed by the user, as well as the user profile;

[0109] S303: Sort the data pages that the user has viewed in descending order of their level of attention;

[0110] S304: Determine the data tags of the data pages whose attention level is greater than the first threshold;

[0111] S305: Retrieve the target data page with the data tag from the data page library;

[0112] S306: The target data page is used as the data page displayed to the user after the data page is switched.

[0113] In some embodiments, the data page switching request is issued after the user has viewed the data page displayed to the user after logging in. The user sends a data page switching request to view more new data pages. For example, in a financial teaching scenario, students can view some fund data pages that are displayed to the user after logging in, showing how the data changes over time. Or, in a factory production planning scenario, planners can view data pages that show how the production efficiency of some products changes over time in the past. If they want to know more about the data pages of funds or products and the corresponding data changes, they can send a data page switching request. Specifically, when displaying a new data page, the user's attention level can be calculated based on the user's gaze time, viewing frequency, and motion amplitude data of the data pages already viewed, as well as the user profile. This calculation is used to display the new data page to the user. The user gaze time is the time the user spends looking at each data page, obtained using eye-tracking technology. The viewing frequency is the ratio of the number of times the user views each data page to the total number of times all data pages are viewed, used to measure the number of times the user views the data pages. The motion amplitude data are parameters measuring the magnitude of the user's motion amplitude when viewing each data page, obtained using a triaxial accelerometer or similar sensor. The user profile is one or more normalized feature vectors reflecting user characteristics. In some embodiments, the data page attention level can be calculated using the following formula:

[0114]

[0115] Where, r i Let α1 be the attention level of the i-th data page, α1 be the first attention parameter, S be the total number of user gazes, and z be the number of times the user gazes. si Let t be the weight of the s-th view of the i-th data page. si Let α be the time for the s-th view of the i-th data page, α2 be the second attention parameter, p be the adjustment weight, and f be the time for the s-th view of the i-th data page. i Let α be the viewing frequency of the i-th data page, α3 be the third attention parameter, V be the total number of motion amplitude data types, and q be the frequency of viewing the i-th data page. v U represents the weight of the v-th type of motion amplitude data. v Let m be the data volume of the v-th type of motion amplitude data. uv Let be the u-th data point of the v-th type of action amplitude data, α4 be the fourth attention parameter, and W be the total number of normalized feature vectors in the user profile. Let be the weight vector of the w-th normalized eigenvector, and · be the dot product. Let w be the w-th normalized eigenvector.

[0116] In some embodiments, after calculating the attention level, data pages with attention levels greater than a first threshold are filtered. Based on the data tags of the filtered data pages, target data pages with the data tags are retrieved from the data page library. These target data pages have data tags that the user may be interested in. The target data pages are then used as the data pages displayed to the user after data page switching. In some embodiments, considering that the number of target data pages is large, directly using matching to obtain target data pages with the data tags would consume a lot of computing resources. Therefore, a target data page generation algorithm can be pre-built, and the data tags can be input into the target data page generation algorithm to generate the target data pages.

[0117] Further, refer to the appendix Figure 4 In some embodiments, after sending the data center scene and the data page to the virtual reality device, the process may further include:

[0118] S401: Obtain the visualization information selected by the user sent by the virtual reality device;

[0119] S402: Determine the visualization data corresponding to the visualization information;

[0120] S403: Divide the visualization data to obtain multiple corresponding visualization sub-intervals;

[0121] S404: Calculate the feature value corresponding to each visualized sub-interval;

[0122] S405: Determine the corresponding scene interaction model using the feature values ​​of each visualized sub-interval;

[0123] S406: Receive a visualization experience request sent by the user's virtual reality device;

[0124] S407: Based on the visualization experience request, the correspondence between each visualization sub-interval and the scene interaction model and the scene interaction model are sent to the virtual reality device, so that the virtual reality device can display the visualization information to the user in a virtual reality manner.

[0125] Specifically, in some embodiments, the visualization information selected by the user may include a data identifier, a selection time, and a visualization duration. The data identifier is a symbol that identifies different data. The selection time includes the start and end times of the data selected by the user. The visualization duration refers to the total duration of the visualization experience corresponding to the user's selection time. The visualization experience is a data visualization process that matches different scene effects to data fluctuations within a simulation environment implemented using virtual reality devices. The corresponding target data can be determined based on the data identifier in the visualization information, and the time corresponding to the target data can be determined based on the selection time in the visualization information, thus obtaining the visualization data used for the data visualization experience. Since each data point in the visualization data is related to factors such as time or efficiency (collectively referred to as independent variables), the visualization data can be divided into multiple visualization sub-intervals based on the independent variables. Each visualization sub-interval includes a portion of the visualization data. Then, the feature value of each visualization sub-interval is calculated. The feature value is used to measure the fluctuation of the visualization data within the visualization sub-interval. The larger the feature value, the more significant the data fluctuation; the smaller the feature value, the smaller the data fluctuation. In some embodiments, the feature value corresponding to each visualization sub-interval can be calculated using the following formula:

[0126]

[0127] Among them, l j Let ω1 be the feature value of the j-th visualized sub-interval, and n be the first parameter. j Let x be the total number of data points contained in the j-th visualization sub-interval. kj For the k-th data point in the j-th visualization sub-interval, Let x' be the mean of the data in the j-th visualization sub-interval, ω2 be the second parameter, H(·) be the counting function used to count the number of non-zero values ​​in the binarized data, and x' be the mean of the data in the j-th visualization sub-interval. j For the binarized data of the j-th visualization sub-interval, For the XOR operation, x′ j-1 The binarized data for the (j-1)th visualization sub-interval, ω3 is the third parameter, K j Let be the slope of the fitted line corresponding to the data in the j-th visualization sub-interval.

[0128] It should be noted that the values ​​in each visualization sub-interval can also be sampled, and the corresponding feature values ​​can be calculated based on the sampled values ​​in the visualization sub-interval. In some embodiments, after calculating the feature values ​​corresponding to the visualization sub-interval, different scene interaction models are matched to the visualization sub-interval based on the feature values. After receiving the visualization experience request sent by the user's virtual reality device, the correspondence between each visualization sub-interval and the scene interaction model and the scene interaction model are sent to the virtual reality device. It should be noted that in some embodiments, when sending the correspondence between each visualization sub-interval and the scene interaction model and the scene interaction model, the corresponding data is sent. Then, the preset code or algorithm can display the scene interaction model to the user based on the corresponding data, providing the user with a virtual reality-based visualization experience of data fluctuations.

[0129] In some embodiments, dividing the visualization data to obtain multiple corresponding visualization sub-intervals includes:

[0130] Calculate the total number of visualization sub-intervals based on the visualization duration in the visualization information;

[0131] The visualized data is divided into multiple visualized sub-intervals corresponding to the total number of visualized sub-intervals.

[0132] In some embodiments, visualization duration can be understood as the length of time during which a user experiences the changes in visualized data within a short period of time. For example, visualization duration can be 3 minutes, or 180 seconds, while the time span for the data selected by the user is relatively long, such as 1 year. In other words, the visualization experience needs to allow the user to experience the changes and fluctuations in data over a year within 3 minutes. Based on this, 180 seconds can be divided into 60 3-second intervals, which means dividing the data of a year into 60 sub-intervals. An average division method can be used, and the specific division method is not limited in this article.

[0133] In some embodiments, determining the corresponding scene interaction model using the feature values ​​of each visualization sub-interval may include:

[0134] If the feature value is greater than the second threshold, then the first scene interaction model is matched for the sub-interval;

[0135] If the feature value is less than the third threshold, then the second scene interaction model is matched for that sub-interval;

[0136] If the feature value is not greater than the second threshold and not less than the third threshold, then the sub-interval is matched with the third scene interaction model.

[0137] In some embodiments, the feature value can reflect the changes in the data of a sub-interval. Therefore, different scene interaction models can be matched according to the size of the feature value. For example, when the feature value reflects the degree of data fluctuation, if the feature value is greater than the second threshold, it means that the data corresponding to the sub-interval fluctuates violently and is generally on an upward trend. The first scene interaction model can include positive scene effects such as flowers and gold coins. If the feature value is less than the third threshold, it means that the data corresponding to the sub-interval fluctuates violently and is generally on a downward trend. The second scene interaction model can include negative scene effects such as falling leaves and bombs. If the feature value is not greater than the second threshold and not less than the third threshold, it means that the data fluctuation in the sub-interval is relatively gentle. The third scene interaction model can include gentle scene effects such as green leaves and sunlight.

[0138] In some embodiments, after determining the corresponding scene interaction model using the feature values ​​of each visualization sub-interval, the method further includes:

[0139] Obtain the historical impact time points corresponding to the data identifier and the selected time in the visualized data;

[0140] Determine whether the time corresponding to each visualized sub-interval includes the historical impact time point;

[0141] If so, then the fourth scene interaction model is matched for that sub-interval.

[0142] In some embodiments, the historical impact time point can be understood as the time point of an event that has a significant impact on data fluctuations. For example, in a production scenario, the historical impact time point could be the time point when a new production tool is started. In a financial business scenario, the historical impact time point could be the time point of a black swan event (a highly unpredictable and unusual event that usually causes a chain reaction of negative market reactions or even disruption). The selected time corresponding to the data selected by the user may contain such historical impact time points, which will significantly change the data. The fourth scenario interaction model is matched to the sub-interval containing historical impact time points. For example, it could be a semi-transparent wall to enrich the data visualization experience, improve the user experience, and help users understand the data.

[0143] See attached document Figure 5 In some embodiments, displaying the visualized information to the user via virtual reality may further include:

[0144] S501: Calculate the final data result based on the data identifier, selection time, and initial data value in the visualization information;

[0145] S502: Subtract the initial data value from the final data result to obtain the difference;

[0146] S503: If the difference is greater than the fourth threshold, then the final data result matches the first scene model;

[0147] S504: If the difference is less than the fifth threshold, then the final data result matches the second scene model;

[0148] S505: If the difference is not greater than the fourth threshold and not less than the fifth threshold, then the final data result is matched with the third scene model.

[0149] In some embodiments, fluctuations in data can be reflected by the difference in data changes. This difference is calculated by subtracting the initial data value from the final data result. Different scene models are matched based on the magnitude of this difference. If the difference is greater than a fourth threshold, it indicates a significant increase in the final data result relative to the initial data value, and the first matching scene model may include positive scene effects such as applause or fireworks. If the difference is less than a fifth threshold, it indicates a significant decrease in the final data result relative to the initial data value, and the second matching scene model may include negative scene effects such as dust. If the difference is neither greater than the fourth threshold nor less than the fifth threshold, it indicates no significant change in the final data result relative to the initial data value, and the third matching scene model may include gentle scene effects. It should be noted that the scene models in the embodiments of this specification may also include different sound effects and vibrations to enhance the user experience and help users understand data changes.

[0150] It should be noted that although the operation of the method of the present invention has been described in a specific order in the above embodiments and figures, this does not require or imply that the operations must be performed in that specific order, or that all the operations shown must be performed to achieve the desired result. Additionally or alternatively, certain steps may be omitted, multiple steps may be combined into one step, and / or one step may be broken down into multiple steps.

[0151] Corresponding to the methods described above, some embodiments of this specification also provide a data visualization device based on virtual reality, which executes the methods performed by the user-end virtual reality device in the embodiments of this specification. (Refer to...) Figure 6 As shown, in some embodiments, the apparatus may include:

[0152] The receiving module 601 is used to receive data visualization requests and user login information sent by the user terminal virtual reality device;

[0153] The determining module 602 is used to determine the data center scene and data page corresponding to the data visualization request and the user login information;

[0154] The display module 603 is used to send the data center scene and the data page to the virtual reality device, so that the virtual reality device can display the data center scene and the data page to the user in a virtual reality manner.

[0155] Since the principle of the above-mentioned device in solving the problem is similar to that of the above-mentioned method, the implementation of the above-mentioned device can refer to the implementation of the above-mentioned method, and the repeated parts will not be described again.

[0156] Based on the same inventive concept, embodiments of this specification also provide a data visualization method based on virtual reality, executed by a user-end virtual reality device, as shown in the appendix. Figure 7 The method may include:

[0157] S701: Obtain data visualization requests and user login information sent by the user;

[0158] S702: The data visualization request and the user login information are sent to the virtual reality data center system, so that the virtual reality data center system determines the data center scene and data page corresponding to the data visualization request and the user login information, and sends the data center scene and the data page to the virtual reality device.

[0159] Correspondingly, some embodiments of this specification also provide a data visualization device based on virtual reality, which executes the methods performed by the user-end virtual reality device in the embodiments of this specification, with reference to... Figure 8 As shown, in some embodiments, the apparatus may include:

[0160] Module 801 is used to acquire data visualization requests and user login information sent by the user.

[0161] The transmission module 802 is used to send the data visualization request and the user login information to the virtual reality data center system, so that the virtual reality data center system determines the data center scene and data page corresponding to the data visualization request and the user login information, and sends the data center scene and the data page to the virtual reality device.

[0162] Based on the same inventive concept, embodiments of this specification also provide a data visualization system based on virtual reality, including a virtual reality data center system and a user-end virtual reality device;

[0163] When processing a user's data visualization request, the virtual reality data center system executes the method described in any of the foregoing embodiments;

[0164] When providing a data visualization experience to the user, the user-end virtual reality device executes the method described in any of the foregoing embodiments.

[0165] For ease of description, the above devices are described in terms of function, divided into various units. Of course, in implementing this specification, the functions of each unit can be implemented in one or more software and / or hardware components.

[0166] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in the embodiments of this specification are all information and data authorized and agreed upon by the user and fully authorized by all parties.

[0167] Embodiments of this specification also provide a computer device. For example... Figure 9 As shown, in some embodiments of this specification, the computer device 902 may include one or more processors 904, such as one or more central processing units (CPUs) or graphics processing units (GPUs), each processing unit implementing one or more hardware threads. The computer device 902 may also include any memory 906 for storing information of any kind, such as code, settings, data, etc. In one specific embodiment, a computer program is stored on the memory 906 and can run on the processor 904. When the computer program is run by the processor 904, it can execute instructions described in any of the above embodiments. Without limitation, for example, the memory 906 may include any type of RAM, any type of ROM, flash memory, hard disk, optical disk, etc. More generally, any memory can use any technology to store information. Further, any memory can provide volatile or non-volatile retention of information. Further, any memory can represent a fixed or removable component of the computer device 902. In one case, when the processor 904 executes associated instructions stored in any memory or combination of memories, the computer device 902 can perform any operation of the associated instructions. The computer device 902 also includes one or more drive mechanisms 908 for interacting with any memory, such as a hard disk drive mechanism, an optical disk drive mechanism, etc.

[0168] Computer device 902 may also include an input / output interface 910 (I / O) for receiving various inputs (via input device 912) and providing various outputs (via output device 914). A specific output mechanism may include a presentation device 916 and an associated graphical user interface 918 (GUI). In other embodiments, the input / output interface 910 (I / O), input device 912, and output device 914 may be omitted, and the device may function solely as a computer device within a network. Computer device 902 may also include one or more network interfaces 920 for exchanging data with other devices via one or more communication links 922. One or more communication buses 924 couple the components described above together.

[0169] Communication link 922 can be implemented in any way, such as via a local area network (LAN), a wide area network (WAN) (e.g., the Internet), a point-to-point connection, or any combination thereof. Communication link 922 may include any combination of hardwired links, wireless links, routers, gateway functions, name servers, etc., governed by any protocol or combination of protocols.

[0170] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), computer-readable storage media, and computer program products according to some embodiments of this specification. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processor to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processor, create a mechanism for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0171] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processor to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0172] These computer program instructions may also be loaded onto a computer or other programmable data processor, causing a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable device for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0173] In a typical configuration, a computer device includes one or more graphics processing units (GPUs), one or more central processing units (CPUs), input / output interfaces, network interfaces, and memory.

[0174] Memory may include non-persistent storage in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0175] Computer-readable media, including both permanent and non-permanent, removable and non-removable media, can store information using any method or technology. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by computer equipment. As defined in this specification, computer-readable media does not include transient media, such as modulated data signals and carrier waves.

[0176] Those skilled in the art will understand that the embodiments of this specification can be provided as methods, systems, or computer program products. Therefore, the embodiments of this specification can take the form of entirely hardware embodiments, entirely software embodiments, or embodiments combining software and hardware aspects. Furthermore, the embodiments of this specification can take the form of computer program products implemented on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0177] The embodiments described in this specification can be described in the general context of computer-executable instructions, such as program modules, that are executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform a specific task or implement a specific abstract data type. The embodiments of this specification can also be practiced in distributed computing environments where tasks are performed by remote processors connected via a communication network. In distributed computing environments, program modules can reside in local and remote computer storage media, including storage devices.

[0178] It should also be understood that, in the embodiments of this specification, the term "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Additionally, the character " / " in this document generally indicates that the preceding and following related objects have an "or" relationship.

[0179] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to interchangeably. Each embodiment focuses on describing the differences from other embodiments. In particular, the system embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions in the method embodiments.

[0180] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., refer to specific features, structures, materials, or characteristics described in connection with that embodiment or example, which are included in at least one embodiment or example of the embodiments of this specification. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.

[0181] The above description is merely an embodiment of this application and is not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A data visualization method based on virtual reality, characterized in that, Performed by a virtual reality data center system, the method includes: Receive data visualization requests and user login information sent by the user's virtual reality device; Determine the data center scenario and data page corresponding to the data visualization request and the user login information; The data center scene and the data page are sent to the virtual reality device, so that the virtual reality device can display the data center scene and the data page to the user in a virtual reality manner; Determining the data page corresponding to the data visualization request and the user login information includes: The preset data page library is invoked according to the data visualization request; Match the data page corresponding to the user profile in the user login information from the data page library; After matching the data page from the data page library that corresponds to the user profile in the user login information, the process further includes: Receive data page switching requests sent by the user's virtual reality device; The user's attention level is calculated based on the user's gaze time, viewing frequency, and action amplitude data of the data pages already viewed, as well as the user profile. The data pages viewed by the user are sorted in descending order of their level of attention. Determine the data tags for data pages whose attention level is greater than a first threshold; The target data page with the data tag is retrieved from the data page library; The target data page is the data page displayed to the user after the data page is switched.

2. The method according to claim 1, characterized in that, After sending the data center scene and the data page to the virtual reality device, the process further includes: Obtain the visual information selected by the user sent by the virtual reality device; Determine the visualization data corresponding to the visualization information; The visualization data is divided to obtain multiple corresponding visualization sub-intervals; Calculate the feature value corresponding to each visualized sub-interval; The corresponding scene interaction model is determined using the feature values ​​of each of the visualized sub-intervals; Receive visual experience requests sent by user-side virtual reality devices; Based on the visualization experience request, the correspondence between each visualization sub-section and the scene interaction model, along with the scene interaction model, is sent to the virtual reality device, so that the virtual reality device can display the visualization information to the user in a virtual reality manner.

3. The method according to claim 2, characterized in that, The visualization data is divided to obtain multiple corresponding visualization sub-intervals, including: Calculate the total number of visualization sub-intervals based on the visualization duration in the visualization information; The visualized data is divided into multiple visualized sub-intervals corresponding to the total number of visualized sub-intervals.

4. The method according to claim 2, characterized in that, The step of determining the corresponding scene interaction model using the feature values ​​of each visualized sub-interval includes: If the feature value is greater than the second threshold, then the first scene interaction model is matched for the sub-interval; If the feature value is less than the third threshold, then the second scene interaction model is matched for that sub-interval; If the feature value is not greater than the second threshold and not less than the third threshold, then the sub-interval is matched with the third scene interaction model.

5. The method according to claim 2, characterized in that, After determining the corresponding scene interaction model using the feature values ​​of each visualization sub-interval, the process further includes: Obtain the historical impact time points corresponding to the data identifier and the selected time in the visualized data; Determine whether the time corresponding to each visualized sub-interval includes the historical impact time point; If so, then the fourth scene interaction model is matched for that sub-interval.

6. The method according to claim 2, characterized in that, The step of displaying the visualized information to the user via virtual reality further includes: The final data result is calculated based on the data identifier, selection time, and initial data value in the visualization information. Subtract the initial data value from the final data result to obtain the difference; If the difference is greater than the fourth threshold, then the final data result matches the first scene model; If the difference is less than the fifth threshold, then the final data result matches the second scene model; If the difference is not greater than the fourth threshold and not less than the fifth threshold, then the final data result matches the third scene model.

7. A data visualization device based on virtual reality, characterized in that, The device includes: The receiving module is used to receive data visualization requests and user login information sent by the user-end virtual reality device; The determination module is used to determine the data center scene and data page corresponding to the data visualization request and the user login information; The display module is used to send the data center scene and the data page to the virtual reality device, so that the virtual reality device can display the data center scene and the data page to the user in a virtual reality manner; The determining module is further configured to: invoke a preset data page library according to the data visualization request; match data pages from the data page library that correspond to the user profile in the user login information; receive a data page switching request sent by the user's virtual reality device; calculate the data page attention based on the user's gaze time, viewing frequency, and motion amplitude data of the data pages already viewed by the user and the user profile; sort the data pages already viewed by the user in descending order of attention; determine the data tags of the data pages whose attention is greater than a first threshold; retrieve the target data page with the data tag from the data page library; and display the target data page as the data page to the user after data page switching.

8. A data visualization method based on virtual reality, characterized in that, The method, executed by a user-side virtual reality device, includes: Retrieve data visualization requests and user login information sent by users; The data visualization request and the user login information are sent to the virtual reality data center system, enabling the virtual reality data center system to determine the data center scene and data page corresponding to the data visualization request and the user login information. Specifically, the virtual reality data center system calls a preset data page library based on the data visualization request; matches the data page from the data page library with the data page corresponding to the user profile in the user login information; calculates the data page attention score based on the user's gaze time, viewing frequency, and motion amplitude data of the data pages already viewed by the user, and the user profile, according to the data page switching request sent by the user's virtual reality device. The user-viewed data pages are then sorted in descending order of attention score, and data tags are determined for data pages with attention scores greater than a first threshold. A target data page with the data tag is retrieved from the data page library and used as the data page displayed to the user after data page switching. Finally, the data center scene and the data page are sent to the virtual reality device.

9. A data visualization device based on virtual reality, characterized in that, The device includes: The acquisition module is used to acquire data visualization requests and user login information sent by users. A transmission module is used to send the data visualization request and the user login information to a virtual reality data center system, so that the virtual reality data center system can determine the data center scene and data page corresponding to the data visualization request and the user login information. Specifically, the virtual reality data center system calls a preset data page library according to the data visualization request; matches a data page from the data page library that corresponds to the user profile in the user login information; calculates the data page attention based on the user's gaze time, viewing frequency, and motion amplitude data of the data pages already viewed by the user, and the user profile, according to the data page switching request sent by the user's virtual reality device; sorts the data pages already viewed by the user in descending order of attention; determines the data tag of the data page with an attention greater than a first threshold; retrieves the target data page with the data tag from the data page library; uses the target data page as the data page displayed to the user after data page switching; and sends the data center scene and the data page to the virtual reality device.

10. A data visualization system based on virtual reality, characterized in that, This includes virtual reality data center systems and user-end virtual reality devices; When processing a user's data visualization request, the virtual reality data center system performs the method as described in any one of claims 1 to 6; When the user-end virtual reality device provides a data visualization experience to the user, it performs the method as described in claim 8.

11. A computer device comprising a memory, a processor, and a computer program stored in the memory, characterized in that, When the computer program is run by the processor, it executes the instructions of the method according to any one of claims 1-6 and 8.

12. A computer storage medium having a computer program stored thereon, characterized in that, When the computer program is run by the processor of the computer device, it executes the instructions of the method according to any one of claims 1-6 and 8.

13. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, performs instructions for the method according to any one of claims 1-6 and 8.

Images