Method and System for Immersive Interaction of Spatiotemporal Data Based on Video Structuring Technology
The method and system for immersive spatiotemporal data interaction using video structuring technology address the limitations of existing methods by enabling smooth transitions and clear spatial-temporal visualization, allowing users to quickly locate relevant data points.
Patent Information
- Application Number
- CN202210676652.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-06-15
- Publication Date
- 2025-07-15
- Estimated Expiration
- 2042-06-15
AI Technical Summary
The existing video structured spatiotemporal data visual interaction methods cannot effectively express spatial information, especially in the case of data paging, browsing and analyzing data ideas are easily interrupted, and cannot meet the needs of video structured object subscription and lightweight web application systems with clear spatial destinations.
The immersive interaction method of spatiotemporal data based on video structure technology is adopted. By selecting the historical time points and spatial locations of attention, combining segmented functions and Pier growth model to calculate the step size of the data object, using the rendering component for interactive display, and monitoring the mouse wheel event for immersive interaction.
It realizes a smooth transition between rendered objects under high-dimensional spatiotemporal data. Users can quickly locate the spatial points and time points of interest, improve user experience, quickly lock in related structured objects, solve the spatial chaos in the display of large data volumes, has good visual effects, and supports users' personalized needs.
Smart Images

Figure CN115048550B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of data visualization, and particularly relates to a method and system for immersive interaction of spatio-temporal data based on video structuring technology. Background Art
[0002] With the development of data analysis and visualization technologies, various visualization display and interaction methods are now commonly applied in fields such as data analysis, data statistics, and data mining. For the data obtained through structuring in videos, which has characteristics such as being massive, spatio-temporal, and having a tight correlation between objects, it is a type of spatio-temporal data. The use of front-end visualization and interaction technologies can help users efficiently view and analyze such data. Currently, visualization and interaction methods for spatio-temporal data include web visualization technologies such as Chart chart technology and map GIS visualization technology, as well as interaction methods that combine multi-field technologies such as virtual reality technology and multi-dimensional models.
[0003] A relatively typical video structured object visualization interaction method is to visually display spatio-temporal data through a list. This method can express the continuity and complete attributes of object data, but spatial information cannot be intuitively expressed. Especially when the data is paged, the thinking of browsing and analyzing data is more likely to be interrupted.
[0004] The spatio-temporal data interaction technology based on map GIS can better express geographical spatial information. The spatio-temporal data visualization method based on multi-dimensional models has powerful computing capabilities and is used for statistical analysis of a large number of point data. Both of these methods are applicable to the large-scale overview of video structuring and the display of data volume distribution, and are not applicable to video structured object subscriptions with clear spatial destinations and web application systems with lightweight requirements.
[0005] Charts such as relationship diagrams, line charts, and pie charts are suitable for visualizing a certain type of data attribute or data statistical results, and cannot express the complete attributes of spatio-temporal data. Moreover, they focus on visual effects and lack spatial interaction.
[0006] In view of this, it is very meaningful to propose a method and system for immersive interaction of spatio-temporal data based on video structuring technology. Summary of the Invention
[0007] In order to solve the problem of existing deficiencies in the visualization and interaction of video structured spatio-temporal data, the present invention provides a method and system for immersive interaction of spatio-temporal data based on video structuring technology to solve the above-mentioned technical defect problems.
[0008] In a first aspect, the present invention proposes a method for immersive interaction of spatio-temporal data based on video structuring technology, and the method includes the following steps:
[0009] S1. Select the historical time point and spatial location of interest;
[0010] S2. Initiate a request to obtain the video structured spatio-temporal data source for the time periods before and after the said time point;
[0011] S3. Determine whether the data of the video structured spatio-temporal data source returned by the request is empty. If so, execute S4; otherwise, execute S5;
[0012] S4. Determine whether the total number of requests is greater than N. If so, expand the time range of the request and execute S2; otherwise, end;
[0013] S5. Obtain the step size of the data object by calculating the time difference between spatio-temporal data, and establish a data model with time anchor point attributes;
[0014] S6. Further define the background of the page;
[0015] S7. Render the structured data of the current time point in proportion to the said spatial location, and bind rendering components with interactive functions as needed to interactively display the specific attributes of this piece of data;
[0016] S8. Calculate the transparency and scaling ratio of the current rendering object according to the obtained step size;
[0017] S9. Globally add a DOMMousescroll event listener for mouse wheel scrolling and set the initial anchor point value to 0;
[0018] S10. Listen for whether the scroll wheel is scrolled. If so, execute S11; otherwise, end;
[0019] S11. When the scroll wheel scrolls down, subtract 1 from the current anchor point value; when the scroll wheel scrolls up, add 1 to the current anchor point value, and execute S7;
[0020] S12. Determine whether the value obtained by subtracting the current anchor point value from the anchor point value of the last piece of spatio-temporal data is less than M. If so, execute S2; otherwise, end.
[0021] Preferably, S4 further includes otherwise end and prompt the user that there is no structured spatio-temporal data in this time period, where N is the maximum number of allowed repeated requests.
[0022] More preferably, the value of N is set to 30.
[0023] Preferably, in S5, the step size of the data object is calculated by using a piecewise function and the Pearson model with the time difference between spatio-temporal data as a factor for transition during object rendering;
[0024] The calculation formula is as follows:
[0025]
[0026] Among them, t is the absolute value of the time difference between two adjacent spatio-temporal data, with the unit of seconds, s is the step size, and a, b, c, and K are the parameters of the Pearl model.
[0027] Further preferably, the value of a is 0.25; the value of b is 1; the value of c is 5; the value of K is 3.
[0028] Preferably, in S6, the resolution is defined as the resolution of the video, and the page background is defined as the real background photo with Gaussian blur.
[0029] Preferably, in S7, the rendering component includes hover and click interaction events.
[0030] In a second aspect, the present invention proposes a system for immersive interaction of spatio-temporal data based on video structuring technology, including:
[0031] A selection module: used to select the historical time points and spatial positions of interest;
[0032] A data request module: used to initiate a request to obtain the video-structured spatio-temporal data sources in the time periods before and after the time point;
[0033] A judgment module: used to judge whether the data returned by the request module is empty; judge whether the value obtained by subtracting the current anchor value from the anchor value of the last spatio-temporal data is less than M;
[0034] A calculation module: used to calculate the step size of the data object, the transparency and scaling ratio of the current rendering object, and the current anchor value;
[0035] An interaction module: used to interactively display the specific attributes of this piece of data;
[0036] A monitoring module: used to monitor the mouse wheel scrolling event.
[0037] In a third aspect, an embodiment of the present invention provides an electronic device, including: one or more processors; a storage device for storing one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the method described in any implementation manner in the first aspect.
[0038] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the method described in any implementation manner in the first aspect is implemented.
[0039] Compared with the prior art, the beneficial effects of the present invention are as follows:
[0040] (1) By applying web technology, the present invention clearly displays the spatial positions and temporal sequences of structured objects, combines piecewise functions and the Pearl growth model to calculate the interaction transition factors between data, enables smooth transitions between rendered objects in high-dimensional space-time, allows users to quickly immerse themselves in the actual scenario, interact, and can quickly locate the spatial positions and time points of interest to users, capture key structured objects through rapid browsing in a short time, skip invalid time periods, save time costs, quickly lock associated structured objects under the same space-time conditions, and improve the user experience.
[0041] (2) The present invention uses piecewise functions and the Pearl growth model to calculate the interaction transition factors between data, enabling smooth transitions between rendered objects in high-dimensional space-time. Its visual perception conforms to the principle of objects being larger when closer and smaller when farther away, and time being slow or urgent, in line with the habits and laws of humans perceiving time and space. This kind of transition enables users to be on the scene and quickly immerse themselves.
[0042] (3) The present invention can conveniently integrate and display the temporal and spatial attributes of data, and to a certain extent solves the problem of spatial chaos in the display of structured objects with a large amount of data, with good visual effects.
[0043] (4) The present invention can quickly and conveniently overview the video structured objects within a historical time period, and quickly discover the time, location, and associated objects of interest (such as fires, dangers, etc.).
[0044] (5) The present invention can conveniently overlay and render all the attributes of data on structured objects, improving the user experience; the present invention can configure and change calculation parameters in real time to meet the personalized needs of users, such as speed requirements.
[0045] (7) The present invention has made interaction optimizations for video structured spatio-temporal data, but does not limit the data types. Any data with spatio-temporal attributes can be used as the input of this method, with strong scalability. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] The accompanying drawings are included to provide a further understanding of the embodiments and are incorporated into and constitute a part of this specification. The accompanying drawings illustrate the embodiments and, together with the description, are used to explain the principles of the present invention. Other embodiments and many of the intended advantages of the embodiments will be readily apparent as they become better understood by reference to the following detailed description. The elements of the accompanying drawings are not necessarily drawn to scale. The same reference numerals refer to corresponding like parts.
[0047] Figure 1 is an exemplary device architecture diagram to which an embodiment of the present invention can be applied;
[0048] Figure 2Schematic flowchart of the method for spatio-temporal data immersive interaction based on video structuring technology according to an embodiment of the present invention;
[0049] Figure 3 Overall flowchart of the method for spatio-temporal data immersive interaction based on video structuring technology according to an embodiment of the present invention;
[0050] Figure 4 Schematic diagram of the data model in the method for spatio-temporal data immersive interaction based on video structuring technology according to an embodiment of the present invention;
[0051] Figure 5 Schematic diagram of the structure of the system for spatio-temporal data immersive interaction based on video structuring technology according to an embodiment of the present invention;
[0052] Figure 6 Schematic diagram of the structure of the computer device of the electronic device suitable for implementing the embodiment of the present invention. Detailed implementation manners
[0053] In the following detailed description, reference is made to the accompanying drawings which form a part of the detailed description and in which are shown illustrative specific embodiments in which the invention may be practiced. To this end, directional terms, such as "top", "bottom", "left", "right", "up", "down", etc., are used with reference to the orientation of the described figures. Since the components of the embodiments may be positioned in several different orientations, directional terms are used for purposes of illustration and are in no way limiting. It should be understood that other embodiments may be utilized or logical changes may be made without departing from the scope of the present invention. Therefore, the following detailed description should not be taken in a limiting sense, and the scope of the present invention is defined by the appended claims.
[0054] It should be understood that Figure 1 the number of terminal devices, networks and servers in [[ ]] is merely illustrative. According to actual needs, there may be any number of terminal devices, networks and servers.
[0055] Figure 1 Exemplary system architecture 100 for a method for processing information or a device for processing information to which the embodiments of the present invention can be applied is shown.
[0056] As Figure 1 shown, system architecture 100 may include terminal devices 101, 102, 103, network 104 and server 105. Network 104 serves as a medium for providing a communication link between terminal devices 101, 102, 103 and server 105. Network 104 may include various connection types, such as wired, wireless communication links or fiber optic cables, etc.
[0057] Users can use terminal devices 101, 102, and 103 to interact with server 105 via network 104 to receive or send messages, etc. Various communication client applications can be installed on terminal devices 101, 102, and 103, such as web browser applications, shopping applications, search applications, instant messaging tools, email clients, social platform software, etc.
[0058] Terminal devices 101, 102, and 103 can be various electronic devices with communication functions, including but not limited to smartphones, tablets, laptop computers, desktop computers, and so on.
[0059] Server 105 can be a server that provides various services, such as a background information processing server that processes the verification request information sent by terminal devices 101, 102, and 103. The background information processing server can analyze and process the received verification request information and obtain a processing result (such as verification success information indicating that the verification request is a legal request).
[0060] It should be noted that the method for processing information provided by the embodiments of the present invention is generally executed by server 105. Correspondingly, the device for processing information is generally set in server 105. In addition, the method for sending information provided by the embodiments of the present invention is generally executed by terminal devices 101, 102, and 103. Correspondingly, the device for sending information is generally set in terminal devices 101, 102, and 103.
[0061] It should be noted that the server can be hardware or software. When the server is hardware, it can be implemented as a distributed server cluster composed of multiple servers or as a single server. When the server is software, it can be implemented as multiple software or software modules (such as those used to provide distributed services), or as a single software or multiple software modules, and specific limitations are not made here.
[0062] Figure 2 The embodiments of the present invention disclose a method for immersive interaction of spatio-temporal data based on video structuring technology, as Figure 2 and Figure 3 shown, the method includes the following steps:
[0063] S1. Select a historical time point and a spatial location of interest;
[0064] S2. Initiate a request to obtain video-structured spatio-temporal data sources for the time periods before and after the time point;
[0065] S3. Determine whether the data of the video-structured spatio-temporal data source returned by the request is empty. If so, execute S4; otherwise, execute S5;
[0066] S4. Determine whether the total number of requests is greater than N. If so, expand the time range of the request and execute S2; otherwise, end.
[0067] Specifically, in this embodiment, S4 further includes ending and prompting the user that there is no structured spatio-temporal data within this time period, where N is the maximum number of allowed repeated requests. Preferably, in this embodiment, the value of N is set to 30.
[0068] S5. Obtain the time difference between spatio-temporal data to calculate the step size of the data object, and establish a data model with time anchor point attributes.
[0069] Specifically, in S5, the step size of the data object is calculated through a piecewise function and the Pearl model using the time difference between spatio-temporal data, which is used as a factor for transition during object rendering.
[0070] The calculation formula is as follows:
[0071]
[0072] Where t is the absolute value of the time difference between two adjacent spatio-temporal data, in seconds, s is the step size, and a, b, c, and K are the parameters of the Pearl model. Preferably, in this embodiment, the value of a is 0.25; the value of b is 1; the value of c is 5; and the value of K is 3.
[0073] By using a piecewise function and the Pearl growth model to calculate the interactive transition factor between data, smooth transition between rendering objects in high-dimensional spatio-temporal space is achieved, and its visual perception conforms to the principle of objects being larger when closer and smaller when farther away, as well as the rhythm of time, which conforms to the habits and laws of humans perceiving time and space. This kind of transition enables users to be immersive and quickly immersed.
[0074] Specifically, as Figure 4 shown, the data model diagram includes point ID, point name, structured ID, photo, coordinates, time, time anchor point, longitude and latitude, and background photo, etc.
[0075] S6. Further define the background of the page.
[0076] Specifically, in this embodiment, the defined resolution is the resolution of the video, and the page background is a Gaussian-blurred real background photo.
[0077] S7. Render the structured data at the current time point in proportion to the spatial position, and bind rendering components with interactive functions as needed to interactively display the specific attributes of this piece of data.
[0078] Specifically, the rendering component includes hover and click interaction events. The hover event is to display the real-time background image at the current time point, and the click event is to request and display the structured attributes of the current object from the backend.
[0079] S8. Calculate the transparency opacity and scaling ratio transform of the current rendering object according to the obtained step size;
[0080] S9. Add a global listener for the mouse wheel scrolling event DOMMousescroll and set the initial anchor value to 0;
[0081] S10. Listen for whether the scroll wheel is scrolled. If so, execute S11; otherwise, end.
[0082] S11. When the scroll wheel scrolls down, subtract 1 from the current anchor value. When the scroll wheel scrolls up, add 1 to the current anchor value, and execute S7;
[0083] S12. Determine whether the value obtained by subtracting the current anchor value from the anchor value of the last spatio-temporal data is less than M. If so, execute S2; otherwise, end. Here, M is the range of data requested again specified by the user.
[0084] The present invention clearly displays the spatial positions and time sequences of structured objects by using web technology, combines piecewise functions and the Pearl growth model to calculate the interaction transition factors between data, enables smooth transitions between rendering objects in high-dimensional space-time, allows users to quickly immerse themselves in the actual scene for interaction, and can quickly locate the spatial points and time points of interest to users. By quickly browsing in a short time, key structured objects can be captured, invalid time periods can be skipped, time costs can be saved, and associated structured objects under the same spatio-temporal conditions can be quickly locked, improving the user experience.
[0085] Furthermore, the present invention can conveniently fuse and display the time attributes and spatial attributes of data, to a certain extent solve the spatial chaos phenomenon in the display of a large amount of structured objects, with good visual effects; can quickly and conveniently overview the video structured objects within a historical time period, quickly discover the time, location, and associated objects of interest (such as fires, dangers, etc.); can conveniently superimpose all attributes of the rendered data on the structured objects, improving the user experience; the present invention can configure and change calculation parameters in real time to meet the personalized needs of users, such as speed requirements; interactive optimization has been done for video structured spatio-temporal data, but the data type is not limited, and any data with spatio-temporal attributes can be used as the input of this method, with strong scalability.
[0086] In a second aspect, the present invention proposes a system for immersive interaction of spatio-temporal data based on video structuring technology, referring to Figure 5 , including:
[0087] Selection module 51: used to select the historical time points and spatial positions of interest;
[0088] Data request module 52: used to initiate a request to obtain video structured spatio-temporal data sources for the time periods before and after the time point;
[0089] Judgment module 53: used to judge whether the data returned by the request module is empty; judge whether the value obtained by subtracting the current anchor value from the anchor value of the last spatio-temporal data is less than M;
[0090] Calculation module 54: used to calculate the step size of the data object, the transparency and scaling ratio of the current rendering object, and the current anchor value;
[0091] Interaction module 55: used to interactively display the specific attributes of this piece of data;
[0092] Monitoring module 56: used to monitor the mouse wheel scrolling event.
[0093] The following refers to Figure 6 , which shows a schematic structural diagram of a computer device 600 suitable for implementing the embodiments of the present invention (such as Figure 1 the server or terminal device shown). Figure 6 The electronic device shown is only an example and should not impose any limitations on the functions and usage scope of the embodiments of the present invention.
[0094] As Figure 6 shown, the computer device 600 includes a central processing unit (CPU) 601 and a graphics processing unit (GPU) 602, which can perform various appropriate actions and processes according to the programs stored in the read-only memory (ROM) 603 or the programs loaded from the storage section 609 into the random access memory (RAM) 606. In the RAM 604, various programs and data required for the operation of the device 600 are also stored. The CPU 601, GPU 602, ROM 603, and RAM 604 are connected to each other through a bus 605. The input / output (I / O) interface 606 is also connected to the bus 605.
[0095] The following components are connected to the I / O interface 606: an input section 607 including a keyboard, a mouse, etc.; an output section 608 including a liquid crystal display (LCD) etc. and a speaker etc.; a storage section 609 including a hard disk etc.; and a communication section 610 including a network interface card such as a LAN card, a modem etc. The communication section 610 performs communication processing via a network such as the Internet. A drive 611 may also be connected to the I / O interface 606 as required. A removable medium 612 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc. is mounted on the drive 611 as required so that a computer program read therefrom is installed into the storage section 609 as required.
[0096] Specifically, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, an embodiment of the present disclosure includes a computer program product that includes a computer program carried on a computer-readable medium, the computer program including program code for performing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication section 610, and / or installed from the removable medium 612. When the computer program is executed by a central processing unit (CPU) 601 and a graphics processing unit (GPU) 602, the above functions defined in the method of the present invention are executed.
[0097] It should be noted that the computer-readable medium described in the present invention can be a computer-readable signal medium, a computer-readable medium, or any combination of the two. The computer-readable medium can be, for example, but not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor devices, apparatuses, or components, or any combination of the above. More specific examples of the computer-readable medium can include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, the computer-readable medium can be any tangible medium that contains or stores a program, and this program can be used by or in combination with an instruction execution device, apparatus, or component. In the present invention, the computer-readable signal medium can include a data signal propagated in a baseband or as part of a carrier wave, in which the computer-readable program code is carried. Such a propagated data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer-readable signal medium can also be any computer-readable medium other than the computer-readable medium, and this computer-readable medium can send, propagate, or transmit a program for use by or in combination with an instruction execution device, apparatus, or component. The program code contained on the computer-readable medium can be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical fiber cable, RF, etc., or any suitable combination of the above.
[0098] The computer program code for performing the operations of the present invention can be written in one or more programming languages or combinations thereof. The programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, executed as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, by using an Internet service provider to connect through the Internet).
[0099] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of devices, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagram may represent a module, a segment of a program, or a portion of code that contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions noted in the blocks may occur in a different order than that noted in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based device that performs the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.
[0100] The modules described in the embodiments of the present invention can be implemented in software or in hardware. The described modules can also be provided in a processor.
[0101] On the other hand, the present invention also provides a computer-readable medium, which may be included in the electronic device described in the above embodiments; or may exist separately without being assembled into the electronic device. The above computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device is caused to perform the method steps described in the first aspect of the present invention.
[0102] The above description is only a preferred embodiment of the present invention and an explanation of the technical principles applied. Those skilled in the art should understand that the scope of the invention involved in the present invention is not limited to the technical solution formed by the specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above inventive concept. For example, a technical solution formed by mutually replacing the above features with technical features having similar functions (but not limited to) disclosed in the present invention.
Claims
1. A method for immersive interaction of spatio-temporal data based on video structuring technology, characterized in that, The method includes the following steps: S1. Select a historical time point and a spatial location of interest; S2. Initiate a request to obtain video-structured spatio-temporal data sources for the time periods before and after the historical time point; S3. Determine whether the data of the video-structured spatio-temporal data source returned by the request is empty. If so, execute S4; otherwise, execute S5; S4. Determine whether the total number of requests is greater than N. If so, expand the time range of the request and execute S2; otherwise, end. Here, N is the maximum number of allowed repeated requests; S5. Obtain the step size of the data object by calculating the time difference between spatio-temporal data, and establish a data model with time anchor point attributes; S6. Further define the background of the page; S7. Render the structured data of the current time point proportionally according to the spatial location, and bind rendering components with interactive functions as needed to interactively display the attributes of the structured data; S8. Calculate the transparency and scaling ratio of the current rendering object according to the obtained step size; S9. Add a global listener for the DOMMousescroll event of mouse wheel scrolling and set the initial anchor point value to 0; S10. Listen for whether the wheel is scrolled. If so, execute S11; otherwise, end; S11. When the wheel scrolls down, subtract 1 from the current anchor point value; when the wheel scrolls up, add 1 to the current anchor point value, and execute S7; S12. Determine whether the value obtained by subtracting the current anchor point value from the anchor point value of the last spatio-temporal data is less than M. If so, execute S2; otherwise, end. Here, M is the range of data re-request specified by the user; Among them, in S5, through the piecewise function and the Pearl model, the time difference between spatio-temporal data is used to calculate the step length of the data object, which is used as a factor for transition during object rendering. The calculation formula is as follows: , where t is the absolute value of the time difference between two adjacent spatio-temporal data, with the unit of seconds, s is the step length, and a, b, c, and K are the parameters of the Pearl model.
2. The method for immersive interaction of spatio-temporal data based on video structuring technology according to claim 1, wherein, In S4, it also includes otherwise end and prompt the user that there is no structured spatio-temporal data in this time period.
3. The method for immersive interaction of spatio-temporal data based on video structuring technology according to claim 2, wherein, The value of N is set to 30.
4. The method for immersive interaction of spatio-temporal data based on video structuring technology according to claim 3, wherein, The value of a is 0.25; the value of b is 1; the value of c is 5; the value of K is 3.
5. The method for immersive interaction of spatio-temporal data based on video structuring technology according to claim 1, wherein, In S6, define the resolution as the resolution of the video, and define the page background as a real background photo with Gaussian blur.
6. The method for spatio-temporal data immersive interaction based on video structuring technology according to claim 1, characterized in that, In S7, the rendering components include hover and click interaction events.
7. A system for immersive interaction of spatio-temporal data based on video structuring technology, characterized in that, An apparatus for performing the method of immersive interaction of spatio-temporal data based on video structuring technology according to any one of claims 1-6, includes: A selection module: for selecting a historical time point and a spatial location of interest; A data request module: for initiating a request to obtain video-structured spatio-temporal data sources for the time periods before and after the historical time point; A judgment module: for judging whether the data returned by the request module is empty; judging whether the value obtained by subtracting the current anchor point value from the anchor point value of the last spatio-temporal data is less than M; A calculation module: for calculating the step size of the data object, the transparency and scaling ratio of the current rendering object, and the current anchor point value; An interaction module: for interactively displaying the attributes of the structured data; A listening module: for listening for mouse wheel scrolling events.
8. An electronic device, comprising: One or more processors; A storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, enabling the one or more processors to implement the method according to any one of claims 1-6.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by a processor, it implements the method described in any one of claims 1-6.
Citation Information
Patent Citations
Method and system for positioning anchor point in augmented reality video picture
CN110418185A