A method and system for adding direct interaction to static visualizations

Abstract

The application relates to a method and system for adding direct interaction to static visualization, belonging to the field of visualization, which decomposes the spatial layout of common visualization into atomic spatial constraints; takes an initial chart as input, infers the original spatial constraints from the existing visualization chart; calculates the spatial constraints after interaction according to the original spatial constraints of the inferred visualization layout and the received user interaction instruction, and drives the visualization elements to balance to a new spatial layout. The method disclosed in the application has strong practicability and lays a reliable foundation for the development of visualization by supporting the modeling of common visualization and supporting various types of interaction of the visualization through four basic spatial constraints to solve the problem that current visualization lacks interaction or is difficult to understand.

Description

Technical Field

[0001] This invention belongs to the field of visualization, specifically relating to a method and system for adding direct interaction to static visualization. Background Technology

[0002] Visualization is a crucial means of expressing data in the data age. Interactive elements in visualization allow users to customize it to accomplish different tasks. However, due to the technical complexity and time-consuming nature of implementing interactive visualizations for creators, and the difficulty users face in understanding these interactions, many visualizations lack interactivity or have interfaces that are unusable for users. Summary of the Invention

[0003] In view of the deficiencies in the existing technology, the purpose of this invention is to provide a method and system for adding direct interaction to static visualizations. For existing static or non-interactive visualizations, interaction is added while constructing an interactive mode that is easy for users to understand, so as to support a wider range of user tasks.

[0004] To achieve the above objectives, the technical solution adopted by the present invention is as follows: Firstly, a method for adding direct interaction to static visualizations, the method comprising the following steps:

[0005] S1. Deconstruct common visual spatial layouts into atomic spatial constraints;

[0006] S2. Using the initial chart as input, infer approximately 5 bundles of its original space from existing visualization charts;

[0007] S3. Based on the inferred original spatial constraints of the visual layout and the received user interaction instructions, calculate the spatial constraints after the interaction. The spatial constraints after the interaction drive the visual elements to balance to the new spatial layout.

[0008] Furthermore, the atomic spatial constraints in step S1 include support and attraction forces from the external environment of the element, collision forces between elements, and fixation forces within the element.

[0009] Furthermore, in step S2, the original spatial constraints are inferred based on the element types and spatial locations of the visualized chart. Step S2 includes the following sub-steps:

[0010] S21. Extract spatial constraint control points from existing visualization charts;

[0011] S22. Apply fixed constraints to the extracted spatial constraint control points;

[0012] 5S23. Determine where the baseline axis exists based on the spatial constraint control points;

[0013] S24. For the found baseline axis, apply support and attraction forces to the visualized elements based on the baseline axis;

[0014] S25. Determine if a collision relationship exists;

[0015] S26. If a collision relationship exists, apply a collision constraint.

[0016] Furthermore, the interactive instructions in step S3 include visual elements, visual axes, and visual...

[0017] Direct interaction of constraints.

[0018] Furthermore, for direct interaction with visual elements, different control points and constraint changes are set according to the signal commands received from the user for different drag directions and amplitudes. After the drag ends, the spatial constraints after the interaction drive the visual elements to balance into a new spatial layout.

[0019] Furthermore, for direct interaction with the visualization axis, the visualization constraints are adjusted based on the user's signal commands to scale or change the order of the axis. The spatial constraints after the interaction drive the visualization elements to balance into the new spatial layout.

[0020] Furthermore, for direct interaction with visual constraints, user commands are transformed into adjustments to the constraints of existing visual elements or the setting of new constraints for selected visual elements, with the new constraints driving the visual elements to a new spatial layout.

[0021] Furthermore, in step S1, the spatial constraints of the bar chart are deconstructed into having a baseline axis that serves as a support for the bars. All bars are subject to support and attraction constraints perpendicular to the axis, and all bars have fixed constraints in the same horizontal and vertical directions within their interiors.

[0022] Furthermore, in step S1, the spatial constraints of the area map are deconstructed into having a baseline axis that serves as a support for the area elements. All area elements come from the support constraints and attraction constraints on the axis, and there are fixed constraints between control points located at the same vertical position on the baseline axis.

[0023] Secondly, a system for adding direct interaction to static visualizations employs a method for adding direct interaction to static visualization charts as described in the first aspect of the present invention and any optional embodiment thereof.

[0024] The beneficial technical effects of the present invention are as follows: by adopting the method and system for adding direct interaction to static visualization disclosed in the present invention, the present invention addresses the problem that current visualizations lack interaction or are difficult to understand, and supports the modeling of common visualizations through four basic spatial constraints to support various types of visualization interaction. Attached Figure Description

[0025] Figure 1 This is a flowchart of a method for adding direct interaction to static visualization as described in Embodiment 1 of the present invention;

[0026] Figure 2 This is a schematic diagram illustrating four atomic space constraints and common visualization deconstruction effects in a method for adding direct interaction to static visualization as described in Embodiment 1 of the present invention.

[0027] Figure 3 This is a schematic diagram of the direct interaction supported by spatial constraints and its corresponding results in a method for adding direct interaction to static visualization as described in Embodiment 1 of the present invention.

[0028] Figure 4 This is a schematic diagram illustrating the process of constructing spatial constraints and adding direct interaction to a static stacked area map using the method for adding direct interaction to static visualization as described in Embodiment 1 of the present invention.

[0029] Figure 5 This is a schematic diagram illustrating the process of adding direct interaction to a bubble chart using the method for adding direct interaction to static visualization as described in Embodiment 1 of the present invention. Detailed Implementation

[0030] The present invention will now be further described with reference to the accompanying drawings and specific embodiments.

[0031] Example 1

[0032] like Figure 1 As shown, this embodiment of the invention provides a method for adding direct interaction to static visualizations, the method comprising the following steps:

[0033] S1. Deconstruct common visualized spatial layouts into atomic spatial constraints.

[0034] Elements in existing visualizations can be viewed as being subject to various types of spatial constraints (forces), including four types: support forces and gravitational forces from the external environment, collision forces between elements, and fixation forces within the elements. Support forces are commonly seen when axes are applied to elements, such as the support provided by axes in bar charts and area charts. Gravity exists in the attraction of axes to visualization elements and the attraction of values ​​on axes to visualization elements. Collision forces are forces that maintain relationships between elements, such as the stacking relationship between different elements in a stacked area chart. Fixation forces are forces that maintain the shape of visualization elements, such as the forces that maintain the shape of the inner edges of a rectangle in a bar chart. These four forces correspond to support constraints, gravitational constraints, collision constraints, and fixation constraints. These four constraints can be used to model common visualization elements and are therefore defined as atomic spatial constraints. The basic unit for modeling spatial constraints is the control point. A control point itself can represent a point-like element, its connection can represent a line-like element, and the area enclosed by them can represent a surface-like element.

[0035] The spatial constraints of a histogram can be deconstructed as follows: A baseline axis supports the histograms. All histograms are subject to support and attraction constraints perpendicular to this axis, and all histograms have fixed constraints in the same horizontal and vertical directions within their interiors. Specifically, in a stacked histogram, there are collision constraints within the stacked histograms; in a grouped histogram, there are collision constraints parallel to the baseline axis within the group of histograms.

[0036] The spatial constraints of an area map can be deconstructed as follows: a baseline axis serves to support the area elements. All area elements derive from support and attraction constraints along the axis, and there are fixed constraints between control points located perpendicular to the same baseline axis. Specifically, in a stacked area map, there are collision constraints between the control points of different visualization elements located perpendicular to the same baseline axis.

[0037] The spatial constraints in a bubble diagram can be decomposed as follows: there are collision constraints between bubbles to ensure that they do not overlap. In addition, there may also be supporting forces or attractive forces.

[0038] Scatter plots and line plots can be deconstructed as having attractive constraints in two directions at their original positions.

[0039] like Figure 2As shown, (a1) and (b1) demonstrate that within the bars, there are fixed constraints that guarantee their shape. (a2) shows that the stacked bar chart has collision constraints in the vertical position, ensuring that two elements do not overlap. Similarly, (c1) shows that the stacked area chart has collision constraints between the top and bottom elements, ensuring that they do not overlap vertically. The grouped bar charts, on the other hand, do not overlap horizontally (as shown in (b2)), and the bars in the same group have collision constraints in the horizontal direction. The stacked bar chart, grouped bar chart, and stacked area chart all have a baseline axis that supports and attracts the visualization elements, giving them attraction constraints (a3, b3, c3) and support constraints (a4, b4, c4).

[0040] S2. Using the initial chart as input, infer the original spatial constraints from the existing visualization chart.

[0041] From existing visualizations, the original spatial constraints can be inferred based on the type and spatial location of the visualization elements. The specific process includes:

[0042] S21. Extract spatial constraint control points from existing visualizations;

[0043] S22. Apply fixed constraints to the extracted spatial constraint control points;

[0044] S23. Determine where the baseline axis exists based on the spatial constraint control points;

[0045] S24. For the found baseline axis, apply support and attraction forces to the visualized elements based on the baseline axis;

[0046] S25. Determine if a collision relationship exists;

[0047] S26. If a collision relationship exists, apply a collision constraint.

[0048] S3. Based on the inferred original spatial constraints of the visual layout, calculate the post-interaction spatial constraints according to the received user interaction instructions. The post-interaction spatial constraints drive the visual elements to balance into the new spatial layout. For example... Figure 3 As shown, direct interaction includes direct interaction with visual elements, visual axes, and visual constraints.

[0049] For direct interaction with visual elements, users can drag and drop elements to change their position, and this change implies the user's intent. Different control points and constraints are set based on the different drag directions and amplitude signals received from the user. After dragging, the constraints will drive the visual elements to undergo physical force changes. Ultimately, the converged visual elements will achieve results such as changing the stacking direction, changing the stacking order, removing elements, and creating new canvases.

[0050] Direct interaction with the visualization axes. The constraints of the visualization elements represent the actual data meaning on the axes. Changing the mapping of the axes also adjusts the visualization constraints and guides the changes in the visualization elements. Users can zoom in and out on continuous axes and change the order of discrete axes.

[0051] Direct interaction with visual constraints. Visual constraints can be displayed as lines with handles and are interactive to users. Different visual symbols are set for attracting and supporting constraints. Users can directly adjust the constraints of existing visual elements or set new constraints for selected visual elements. The new constraints drive the visual elements to a new spatial layout.

[0052] After interaction, constraints will drive the visualization elements to be balanced into a new spatial layout, which supports a variety of visualization tasks including alignment, sorting, filtering, and deletion.

[0053] like Figure 4 As shown, spatial constraints are constructed on a static stacked area map. The result allows for direct interaction. Examples include (a), (b), and (c) setting support and attraction constraints to stack the map horizontally. Examples (d), (e), and (f) demonstrate changing the mapping in the vertical direction to enlarge the visualization elements. Examples (g), (h), and (i) show how to drag and drop the visualization elements to modify their order.

[0054] like Figure 5 As shown, starting from the original bubble chart, various interactions can be applied. For example, scaling the axes can be used for navigation (b). Selecting elements of interest (d) allows them to be rearranged vertically based on color (e). Alternatively, starting from the original image, rearranging them horizontally based on color (c) and eventually converging (g). Or, starting from the original image, sorting them vertically by size.

[0055] Example 2

[0056] This invention provides a system for adding direct interaction to static visualizations. The system uses a method for adding direct interaction to static visualizations as described in Embodiment 1 of this invention and any optional implementation thereof to add direct interaction to static visualization charts.

[0057] The system models existing visualized spatial layouts as spatial constraints, and supports adding force metaphors to existing visualizations for interactive purposes.

[0058] As can be seen from the above embodiments, the method and system for adding direct interaction to static visualizations disclosed in this invention deconstructs the spatial layout of common visualizations into atomic spatial constraints; using an initial chart as input, it infers the original spatial constraints from existing visualization charts; based on the inferred original spatial constraints of the visualization layout and the received user interaction commands, it calculates the spatial constraints after interaction, and the spatial constraints after interaction drive the visualization elements to balance to the new spatial layout. Using the method disclosed in this invention, the problem of current visualizations lacking interactivity or being difficult to understand is addressed. It supports the modeling of common visualizations through four basic spatial constraints to support various types of interaction in visualizations, demonstrating strong practicality and laying a reliable foundation for the development of visualization.

[0059] The methods and systems described in this invention are not limited to the embodiments described in the specific implementation. Other implementation methods derived by those skilled in the art based on the technical solutions of this invention also fall within the scope of technical innovation of this invention.

Claims

1. A method for adding direct interaction to static visualizations, the method comprising the following steps: S1. Deconstruct common visual spatial layouts into atomic spatial constraints; S2. Using the initial chart as input, infer its original spatial constraints from the existing visualization chart; S3. Based on the inferred original spatial constraints of the visual layout and the received user interaction instructions, calculate the spatial constraints after the interaction. The spatial constraints after the interaction drive the visual elements to balance to the new spatial layout. The atomic spatial constraints in step S1 include support and attraction forces from the external environment of the element, collision forces between elements, and fixing forces within the element. In step S2, the original spatial constraints are inferred based on the element types and spatial locations of the visualized chart. Step S2 includes the following sub-steps: S21. Extract spatial constraint control points from existing visualization charts; S22. Apply fixed constraints to the extracted spatial constraint control points; S23. Determine where the baseline axis exists based on the spatial constraint control points; S24. For the found baseline axis, apply support and attraction forces to the visualized elements based on the baseline axis; S25. Determine if a collision relationship exists; S26. If a collision relationship exists, apply a collision constraint.

2. A method of adding direct interaction to static visualizations as recited in claim 1, wherein: The interactive instructions in step S3 include direct interaction with visual elements, visual axes, and visual constraints.

3. The method for adding direct interaction to static visualization as described in claim 2, characterized in that: For direct interaction with visual elements, different control points and constraint changes are set according to the signal commands received from the user for different drag directions and amplitudes. After the drag ends, the spatial constraints after the interaction drive the visual elements to balance into a new spatial layout.

4. The method for adding direct interaction to static visualization as described in claim 2, characterized in that: For direct interaction with the visualization axis, the visualization constraints are adjusted based on the user's signal commands to scale or change the order of the axis. The spatial constraints after the interaction drive the visualization elements to balance into the new spatial layout.

5. A method for adding direct interaction to static visualization as described in claim 2, characterized in that: For direct interaction with visual constraints, user commands are translated into adjusting the constraints of existing visual elements or setting new constraints on selected visual elements. The new constraints drive the visual elements to a new spatial layout.

6. The method for adding direct interaction to static visualization as described in claim 1, characterized in that: In step S1, the spatial constraints of the bar chart are deconstructed into having a baseline axis that supports the bars. All bars are subject to support and attraction constraints perpendicular to the axis. All bars have fixed constraints in the same horizontal and vertical directions inside.

7. The method for adding direct interaction to static visualization as described in claim 1, characterized in that: In step S1, the spatial constraints of the area map are deconstructed into having a baseline axis that serves as a support for the area elements. All area elements come from the support and attraction constraints on the axis, and there are fixed constraints between control points located at the same vertical position on the baseline axis.

8. A system for adding direct interaction to static visualizations, characterized in that: The method for adding direct interaction to static visualizations, as described in any one of claims 1-7, is used to add direct interaction to static visualization charts.

Images