Data visualization method and device, equipment, storage medium and product
By defining message types for flight sensor data and standardizing them, and combining this with a layered layout based on human factors engineering, the problem of ground station instrument panels being unable to integrate and display different types of flight parameters was solved, improving the display effect of data visualization and the efficiency of information acquisition.
Patent Information
- Application Number
- CN202511510188.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-10-22
- Publication Date
- 2025-11-21
- Estimated Expiration
- 2045-10-22
Smart Images

Figure CN120994155A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of data processing technology, and in particular to data visualization methods, apparatus, devices, storage media, and products. Background Technology
[0002] Ground station instrument panels are primarily used to receive UAV flight data and display various key information through a graphical interface. Current data visualization methods for ground station instrument panels only display basic flight attitude parameters such as heading and roll angles, failing to integrate and display other key flight parameters of different types. Furthermore, when visualizing data, different flight data are randomly arranged on the interface, making it difficult for operators to quickly access important data, resulting in poor display quality from current data visualization methods. Summary of the Invention
[0003] The main objective of this application is to provide a data visualization method, apparatus, device, storage medium, and product, aiming to solve the technical problem of poor display effect in data visualization methods.
[0004] To achieve the above objectives, this application proposes a data visualization method, which includes: Acquire encoded flight sensor data, wherein the flight sensor data includes flight attitude data and flight performance data, and the flight attitude data and the flight performance data are defined with different message types during encoding; Based on the message type, the flight sensor data is standardized into a unified format of flight data; Based on the data type of the flight data and the preset ergonomic hierarchical layout, the flight data is visualized in the corresponding position on the visualization interface.
[0005] In one embodiment, the data type includes graphic-related data and regular text data, the visualization interface includes key visible areas and regular visible areas, and the step of visually displaying the flight data at the corresponding positions on the visualization interface based on the data type of the flight data and a preset ergonomically designed hierarchical layout includes: If the data type is graphic-related data, then based on the hierarchical layout method, determine the first display position of the graphic-related data in the key visible area, and the associated graphic of the graphic-related data; Based on the visualization rendering method corresponding to the data type, the graphic association data and the associated graphic are visualized at the first display position; If the data type is regular text data, then based on the hierarchical layout method, determine the second display position of the regular text data in the regular visible area; Based on the visualization rendering method corresponding to the data type, the conventional text data is visualized at the second display position.
[0006] In one embodiment, the key visible area includes a top visible area, a middle visible area, and two side visible areas. The graphic association data includes heading angle data, roll angle data, pitch angle data, and altitude data. If the data type is graphic association data, then the step of determining the first display position of the graphic association data in the key visible area and the associated graphic of the graphic association data based on the layered layout includes: If the graphic associated data is heading angle data, then determine the heading angle display position of the heading angle data in the top visible area, and determine that the associated graphic is a vertical bar scale; If the graphic association data is roll angle data, then determine the roll angle display position of the roll angle data in the middle layer visible area, and determine that the associated graphic is a circular dial; If the graphic association data is pitch angle data, then determine the pitch angle display position of the pitch angle data in the middle layer visible area, and determine that the associated graphic is a horizontal bar scale; If the graphic association data is height data, then the height display position of the height data in the visible areas on both sides is determined, and the associated graphic is determined to be a vertical bar chart.
[0007] In one embodiment, the step of visually displaying the graphic-related data and the related graphics at the first display position based on the visualization rendering method corresponding to the data type includes: Based on the data type, determine the scale spacing, text annotation spacing, background text contrast, and font size for visualization rendering; Based on the scale spacing, the text annotation spacing, the background text contrast, and the font size, the graphic association data and the associated graphics are visualized at the first display position.
[0008] In one embodiment, the step of standardizing the flight sensor data into a uniform format of flight data includes: Based on the message decoding method corresponding to the message type, the flight sensor data is decoded to obtain flight decoded data with data type as a structure. Based on a preset standardization processing method, the flight decoding data is subjected to numerical precision processing and filtering to obtain standardized flight data; The standardized flight data is formatted into a uniform string format to obtain the flight data in a uniform format.
[0009] In one embodiment, the step of performing numerical precision processing and filtering on the flight decoding data based on a preset standardization processing method to obtain standardized flight data includes: Based on a preset decimal processing standard, the number of decimal places in the flight decoding data is adjusted to obtain simplified flight data that retains the corresponding number of decimal places; Based on a preset filtering window, the average value of each simplified flight data in the filtering window is calculated to obtain the standardized flight data. The simplified flight data in the filtering window includes the simplified flight data at the current moment and the simplified flight data before the current moment.
[0010] Furthermore, to achieve the above objectives, this application also proposes a data visualization device, which includes: The data acquisition module is used to acquire encoded flight sensor data, wherein the flight sensor data includes flight attitude data and flight performance data, and the flight attitude data and the flight performance data are defined with different message types during encoding; A standardization module is used to standardize the flight sensor data into a unified format of flight data based on the message type. The visualization module is used to visualize the flight data in the corresponding positions of the visualization interface based on the data type of the flight data and a preset hierarchical layout that conforms to human factors engineering.
[0011] In addition, to achieve the above objectives, this application also proposes a data visualization device, the device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the data visualization method as described above.
[0012] In addition, to achieve the above objectives, this application also proposes a storage medium, which is a computer-readable storage medium, on which a computer program is stored, and which, when executed by a processor, implements the steps of the data visualization method described above.
[0013] In addition, to achieve the above objectives, this application also provides a computer program product, which includes a computer program that, when executed by a processor, implements the steps of the data visualization method described above.
[0014] One or more technical solutions proposed in this application have at least the following technical effects: This application acquires encoded flight sensor data, which includes flight attitude data and flight performance data. The flight attitude data and flight performance data are encoded with different message types. Based on the message types, the flight sensor data is standardized into a unified format of flight data. Based on the data type of the flight data and a preset ergonomic hierarchical layout, the flight data is visualized in the corresponding position of the visualization interface.
[0015] Current visualization methods cannot integrate and display other key flight parameters of different types, and the random arrangement of different flight data in the interface leads to low information display efficiency. This application first standardizes flight sensor data from different types of flight sensors, transforming it into a unified format for display in the visualization interface. Furthermore, instead of randomly arranging the acquired data, this application displays the data in appropriate positions within the visualization interface based on the type of data to be visualized and a ergonomically sound hierarchical layout, allowing for the highlighting of key data. Therefore, overall, this application improves the display effect of data visualization. Attached Figure Description
[0016] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.
[0017] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0018] Figure 1 This is a flowchart illustrating an embodiment of the data visualization method of this application. Figure 2 This is a schematic diagram of the first scenario provided in Embodiment 1 of the data visualization method of this application; Figure 3 This is a flowchart illustrating Embodiment 2 of the data visualization method of this application; Figure 4 This is a schematic diagram of the module structure of the data visualization device according to an embodiment of this application; Figure 5 This is a schematic diagram of the device structure of the hardware operating environment involved in the data visualization method in this application embodiment; Figure 6 This is a schematic diagram illustrating the data acquisition consent process involved in the data visualization method described in this application.
[0019] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation
[0020] It should be understood that the specific embodiments described herein are merely illustrative of the technical solutions of this application and are not intended to limit this application.
[0021] To better understand the technical solution of this application, a detailed description will be provided below in conjunction with the accompanying drawings and specific implementation methods.
[0022] It should be noted that the executing entity in this embodiment can be a computing service device with data processing, network communication, and program execution functions, such as a tablet computer, personal computer, or mobile phone, or an electronic device or data visualization device capable of performing the above functions. The following description uses a data visualization device as an example to illustrate this embodiment and the subsequent embodiments.
[0023] Currently, ground station instrument panel software mainly realizes the visualization of basic flight data. Its main method is to obtain attitude data such as heading angle, roll angle, and pitch angle through the communication interface, and map the data into charts or numbers in a fixed layout. That is, after the hardware device transmits sensor data to the ground station, it renders it to the interface according to the preset template.
[0024] However, current data visualization methods for ground station instrument panels only display basic flight attitude parameters such as heading angle and roll angle, and cannot integrate and display other key flight parameters of different types. Furthermore, when visualizing data, different flight data are randomly arranged in the interface, making it difficult for operators to quickly obtain important data, resulting in poor display effects of current data visualization methods.
[0025] Based on this, the embodiments of this application provide a data visualization method, referring to... Figure 1 , Figure 1 This is a flowchart illustrating the first embodiment of the data visualization method of this application.
[0026] In this embodiment, the data visualization method includes steps S10 to S30: Step S10: Obtain encoded flight sensor data, wherein the flight sensor data includes flight attitude data and flight performance data, wherein the flight attitude data and the flight performance data are defined with different message types during encoding; It should be noted that flight sensor data consists of raw or pre-processed data collected and output by various sensors on the aircraft, such as the IMU inertial measurement unit, GPS module, pitot tube, and altimeter.
[0027] Flight attitude data describes the orientation of an aircraft in three-dimensional space and typically includes data such as heading angle, pitch angle, and roll angle. Flight performance data reflects the dynamic operational capabilities of an aircraft and includes data such as airspeed, ground speed, vertical speed, G-forces, fuel reserves, and altitude, used to assess flight efficiency and safety boundaries.
[0028] Encoded data refers to sensor data that has been serialized and packaged according to a specific communication protocol, making it easier to transmit through a communication link. Different types of data are assigned independent message IDs or data structure identifiers in the communication protocol, so that the receiving end can distinguish and parse the corresponding data according to the type field.
[0029] Understandably, sensor data is often transmitted using a uniform or mixed message format without clearly classifying and labeling different types of data. This results in existing ground station instrument panel software only integrating basic attitude parameters such as heading angle and roll angle, but failing to effectively integrate flight performance data such as airspeed, ground speed, and overload.
[0030] This embodiment defines different message types for flight attitude data and flight performance data during the encoding stage, achieving semantic separation of data sources. This enables ground stations to quickly identify data categories upon receiving data, laying the foundation for subsequent multi-dimensional data aggregation and visualization processing.
[0031] Specifically, after the ground station receives the encoded data, this embodiment can quickly determine the data category based on the message type field, avoiding misinterpretation and improving the accuracy of data processing. Furthermore, by classifying data at the source of multi-dimensional data, it provides a structured input foundation for the unified visualization of heterogeneous data, enabling the system to extend and integrate key performance parameters such as airspeed and overload. Moreover, when adding new sensor data types, the definition methods for different message types only require extending the new message type for integration, without needing to reconstruct the data parsing logic.
[0032] Step S20: Based on the message type, standardize the flight sensor data into flight data in a unified format; It should be noted that the flight data in the unified format is data that has undergone standardized processing and consists of a consistent data structure, unified units, and fixed field naming rules.
[0033] Understandably, the inconsistent data formats of different sensors make it difficult for current ground station visualization methods to integrate key performance parameters such as airspeed, ground speed, and overload, allowing only limited attitude information to be displayed. Therefore, this embodiment uses standardized operations to transform the originally scattered and heterogeneous flight attitude and flight performance data into standardized flight data in a unified format.
[0034] By unifying data from different sensors with varying protocol formats and physical units into a consistent structure and unit within the system, data heterogeneity can be eliminated. This provides complete, structurally consistent source data, including parameters such as attitude, velocity, altitude, and overload, for subsequent visualization. Furthermore, the standardized data format can be shared by display, alarm, and storage modules within the system, avoiding redundant parsing of raw data, reducing coupling, and improving the clarity and scalability of the software architecture.
[0035] Step S30: Based on the data type of the flight data and the preset ergonomic hierarchical layout, the flight data is visualized in the corresponding position of the visualization interface.
[0036] It should be noted that the ergonomically designed layered layout is a pre-designed interface space organization model based on human visual perception patterns, cognitive load theory, and operational habits. It mainly includes: prioritizing the visual center, placing key parameters in the center of the screen or the golden ratio area; layering functional areas, with the top area for navigation information such as heading, the middle area for core flight status, and the bottom for auxiliary performance parameters; and hierarchical information weighting, displaying important data in large sizes and high contrast, while less important data is displayed in smaller font sizes and at the edges.
[0037] Understandably, current ground instrument station visualization methods do not prioritize data based on importance; parameters are distributed randomly with equal weights. This forces operators to frequently scan the interface to locate key information, severely impacting monitoring efficiency and emergency response speed. This embodiment addresses this by employing a ergonomically designed layered layout, combined with data type analysis, to automatically locate and display the data requiring visualization. This achieves intelligent and scientific information layout, improving the display effect of flight data.
[0038] In one feasible implementation, the data type includes graphic-related data and regular text data, and the visualization interface includes key visual areas and regular visual areas. A further implementation of visually displaying the flight data at corresponding positions on the visualization interface based on the data type of the flight data and a preset ergonomically designed hierarchical layout can also be: If the data type is graphic-related data, then based on the hierarchical layout method, the first display position of the graphic-related data in the key visible area and the associated graphic of the graphic-related data are determined. Based on the visualization rendering method corresponding to the data type, the graphic-related data and the associated graphic are visualized at the first display position. If the data type is regular text data, then based on the hierarchical layout method, the second display position of the regular text data in the regular visible area is determined. Based on the visualization rendering method corresponding to the data type, the regular text data is visualized at the second display position.
[0039] It should be noted that graphically correlated data not only needs to be presented in numerical form, but also requires the use of specific graphical elements such as dials, pointers, trend curves, and color gradient backgrounds to enhance readability and intuitiveness of flight parameters. Conventional text data refers to parameters whose meaning can be clearly expressed through pure numbers or simple labels, such as battery voltage, signal strength, and flight mode status.
[0040] The key visible area is the interface area where users' eyes are most easily focused and where information has the highest priority. It is usually located slightly above the center, at the golden ratio point, or within the coverage area of the main dashboard, and is used to display core parameters that directly affect flight safety. The regular visible area is the edge or auxiliary information area, such as the bottom of the interface or the sidebar, and is used to display non-urgent, auxiliary, or status information.
[0041] Related graphics are visual elements such as pointers, arc scales, background color blocks, and trend arrows used in conjunction with graphically related data to enhance the spatial perception and trend recognition capabilities of the data. Visualization rendering methods are graphic drawing strategies defined for different types of data, including font styles, graphic structures, color schemes, and animation effects.
[0042] By clearly defining key and regular visible areas, a clear information hierarchy is formed, preventing secondary information from overshadowing the visual focus and improving the overall information density and usability of the interface. Corresponding to the aforementioned visual area division, this embodiment further subdivides data types into graphic-related data and regular text data, mapping them to key and regular visible areas respectively. This achieves a precise match between information importance and display format. Furthermore, during visualization rendering, high-priority data is rendered with complex graphics, while low-priority data is rendered with lightweight text, ensuring the expressiveness of core functions while controlling system resource consumption.
[0043] In one embodiment, when performing data visualization, the ground instrument station can dynamically adjust the content composition of key visible areas according to different mission scenarios such as takeoff, cruise, and landing, thereby improving the system's adaptability and flexibility.
[0044] In one feasible implementation, the key visible area includes a top visible area, a middle visible area, and two side visible areas. The graphic association data includes heading angle data, roll angle data, pitch angle data, and altitude data. If the data type is graphic association data, then based on the layered layout, the first display position of the graphic association data in the key visible area is determined. The specific implementation of the associated graphic of the graphic association data can also be: If the associated graphic data is heading angle data, then the heading angle data is determined to be displayed at the heading angle in the top visible area, and the associated graphic is determined to be a vertical bar scale. If the associated graphic data is roll angle data, then the roll angle data is determined to be displayed at the roll angle in the middle visible area, and the associated graphic is determined to be a circular dial. If the associated graphic data is pitch angle data, then the pitch angle data is determined to be displayed at the pitch angle in the middle visible area, and the associated graphic is determined to be a horizontal bar scale. If the associated graphic data is altitude data, then the altitude data is determined to be displayed at the altitude in the visible areas on both sides, and the associated graphic is determined to be a vertical bar chart.
[0045] It should be noted that the top visible area is the horizontal strip area at the very top of the visual interface. It is usually the first area that users scan when their eyes enter the interface, and it is used to display navigation and directional parameters.
[0046] The central visible area is the core area of the interface, at the visual focal point, and is the main area continuously monitored by the operator, used to display key control parameters such as aircraft attitude and speed. The side visible areas are the vertical areas located at the left and right edges of the interface, used to display parameters that change significantly along the time axis or require vertical comparison, such as altitude, vertical speed, and battery level.
[0047] Vertical bar scales are linear scales arranged vertically, used with pointers or highlighted bars to display numerical values, and are used to show parameters with clear directionality and a limited range. Circular dials mimic the ring layout of traditional mechanical instruments, with a central pointer rotating with the value, conforming to human spatial intuition about changes in angle, and are used to display angular parameters. Horizontal bar scales are linear scales extending horizontally, used with left-right moving pointers or fill bars. Vertical bar charts are graphs where the height of vertical bars represents the magnitude of the value, intuitively reflecting the trend of height changes and the current value, facilitating quick assessment of whether the target is approaching a safety boundary.
[0048] Understandably, existing ground station instrument panels often mix key parameters such as heading angle and altitude with other non-key information, fail to classify them spatially according to their functional attributes and cognitive patterns, and fail to match visual information with movement patterns, causing operators to frequently adjust their focus.
[0049] This embodiment places the heading angle at the top layer and uses a vertical bar scale. The bar structure facilitates quick identification of heading change trends. Roll and pitch angles are concentrated in the middle main visual area, using a circular dial and a horizontal bar scale respectively, to reproduce the spatial perception of real flight attitude and improve the accuracy of attitude judgment. Altitude data is placed in the visible areas on both sides and displayed as a vertical bar chart, using vertical space to intuitively reflect altitude change trends and facilitate monitoring of critical values. The data visualization effect after rendering in this embodiment can be referenced. Figure 2 , Figure 2 It includes visual bar charts, circular dials, vertical column charts, and various parameters.
[0050] By accurately matching different graphic data to specific spatial areas and using graphic forms that conform to physical intuition, users can complete the monitoring of key parameters in a natural scanning sequence, avoiding eye jumps, significantly shortening information reading time, optimizing visual flow, and improving information acquisition efficiency.
[0051] In one feasible implementation, the specific implementation of visually displaying the graphic association data and the associated graphic at the first display position based on the visualization rendering method corresponding to the data type can also be: Based on the data type, the scale spacing, text annotation spacing, background text contrast, and font size are determined for visualization rendering. Based on the scale spacing, text annotation spacing, background text contrast, and font size, the graphic association data and the associated graphic are visualized at the first display position.
[0052] It should be noted that the scale spacing is the physical distance between two adjacent main scale lines. Text annotation spacing is the distance between the scale value label and the corresponding scale line, as well as the spacing between the labels. Background text contrast is the ratio of brightness or color difference between the text color and the background color. Visualization rendering method is the specific drawing strategy that transforms data into graphical interface elements. It includes the combination configuration of all the above visual parameters. Different data types can use different rendering templates.
[0053] Understandably, current visualization displays of ground instrument stations lack standardized and optimized control over rendering parameters. Most of them use default or fixed styles for rendering and fail to differentiate based on data importance, display area, or human visual perception characteristics. This results in problems such as excessively small fonts, dense scales, low contrast, and chaotic annotations.
[0054] This implementation improves the accuracy of interpreting continuous variables such as angle and height by setting key visualization rendering parameters based on data type and avoiding issues like pointer obscuring values and label overlap through reasonable scale and label spacing. It also employs a high-contrast color scheme (e.g., dark background + light text) that aligns with the human eye's sensitivity to differences in brightness, extending the effective monitoring duration. Furthermore, in this embodiment, the rendering operations are determined based on the mapping relationship between data type and rendering parameters, ensuring consistent display style across different ground station terminals and mission scenarios, thus improving the efficiency of transitioning operational habits.
[0055] Specifically, in this embodiment, the top layer occupies 25% of the area and displays the heading angle in the center. The upper layer contains Chinese directional indicators such as East, Northwest, and Northeast, with the font size set to 24px and the font weight set to bold. The lower layer contains angle scales with a scale line spacing of 10px and ±45° marked in red.
[0056] The middle area occupies 40% of the space, displaying the roll angle via a centered circular dial with a yellow pointer. Text is marked every 30°. The pitch angle is displayed via a bar scale, with text marked every 10°. The font size is set to 18px and bolded.
[0057] The two sides each account for 17.5%, and the height is displayed vertically on the left side, with markings every 10 meters. Critical values are marked with red triangles, and the acceleration is marked every 2 m / s. The font size is set to 20px and the font color is set to white. The airspeed, ground speed, and overload are displayed vertically on the right. The font size is set to 20px, the font color is set to white, the background is set to a black background frame, and the contrast is set to 5:1.
[0058] In one embodiment, the visualization rendering method further includes, during the visualization interface rendering process, dynamically adjusting the visual feedback characteristics of the corresponding parameter graphic elements according to the dynamic change rate of the flight data. When the change rate exceeds a preset threshold, a non-linear visual enhancement mechanism for the associated graphics is triggered, including: performing local magnification animation on the scale line area, applying motion blur effect to the pointer or fill bar, and simultaneously increasing the background brightness and contrast of the parameter area. The enhancement intensity of the visual feedback characteristics has a piecewise linear relationship with the change rate. The above rendering adjustments are only performed on the graphic associated data within the key visible area.
[0059] By introducing a nonlinear visual feedback enhancement mechanism based on the rate of data change, when flight parameters (such as pitch angle and overload) change rapidly within the key visual area most easily focused on by the operator, a composite visual effect is automatically triggered, including local scale magnification, motion blur, and enhanced background contrast. This allows sudden parameter changes to attract the operator's attention through visual effects before an audible alarm is issued, significantly improving the sensitivity to transient dangerous situations. By simulating the human eye's preferential capture characteristic of moving objects, local magnification and motion blur create a "visual focus pull," guiding attention to quickly locate abnormal parameters. Piecewise linear control ensures that the feedback intensity matches the severity of the change, avoiding excessive interference.
[0060] In one embodiment, the rate of change is divided into a steady-state interval, a transition interval, and an alarm lead interval. Correspondingly, the visual feedback enhancement intensity adopts a segmented mapping strategy, and no enhancement is enabled in the steady-state interval. In the transition interval, only the pointer motion ghosting effect is activated, and the ghosting length is proportional to the rate of change, displaying a maximum of 5 consecutive frames of historical position ghosting. In the alarm lead interval, in addition to the ghosting, a local magnification animation of the scale area and background contrast enhancement are triggered simultaneously, and the magnified area is always centered on the current value and dynamically shifts with the value. The local magnification animation is presented using a non-uniform time easing function, and the duration is controlled within a preset time threshold range to ensure visual prominence without interfering with continuous reading.
[0061] By dividing the parameter change rate into three intervals—steady state, transition, and alarm lead-in—the control ensures that the feedback intensity matches the severity of the change, avoiding excessive interference. Furthermore, by employing non-uniform, gradual local magnification animation and dynamic window panning centered on the current value, it ensures that operators can accurately read real-time values while their attention is effectively guided, avoiding the misleading risks of traditional full-screen flickering or fixed-area magnification.
[0062] In one embodiment, the dynamic window translation mechanism is activated in zoomed-in mode. Its translation speed is positively correlated with the rate of change of the current flight data, and a safety buffer is set at the window boundary. When parameters approach the edge of the scale display range, the window automatically initiates horizontal scrolling in advance, ensuring that key scales remain centered in the zoomed-in area and maintaining consistent spatial positioning for the operator. The graphic redrawing of the zoomed-in area employs a double-buffered rendering strategy. After completing the zoom and translation calculations in the background buffer, the graphics are composited onto the main interface in one go, avoiding screen tearing.
[0063] This embodiment employs a phased easing strategy, making the magnification process initially fast, then stable, and finally slow down. This quickly attracts attention while providing the operator with a stable reading window, avoiding misjudgments caused by instantaneous changes. The dynamic window panning automatically adjusts the display field of view according to the data change trend. Combined with a safety buffer design, this ensures that even during violent maneuvers, key values and their surrounding scales remain centered in the magnified area, maintaining the operator's continuous understanding of the spatial relationship between angles or speeds.
[0064] In summary, this embodiment acquires encoded flight sensor data, which includes flight attitude data and flight performance data. The flight attitude data and flight performance data are encoded with different message types. Based on the message types, the flight sensor data is standardized into a unified format of flight data. Based on the data type of the flight data and a preset hierarchical layout that conforms to human factors engineering, the flight data is visualized in the corresponding position of the visualization interface.
[0065] Current visualization methods cannot integrate and display other key flight parameters of different types, and the random arrangement of different flight data in the interface leads to low information display efficiency. This embodiment first standardizes flight sensor data from different types of flight sensors, transforming it into a unified format for display. Furthermore, instead of randomly arranging the acquired data, this embodiment displays the data in appropriate positions within the visualization interface based on the type of data to be visualized and a ergonomically sound hierarchical layout, allowing for focused display of key data. Therefore, overall, this embodiment improves the overall display effect of data visualization.
[0066] Based on the first embodiment of this application, in the second embodiment of this application, the content that is the same as or similar to that in Embodiment 1 above can be referred to the above description, and will not be repeated hereafter. Based on this, please refer to... Figure 3 Step 20 of the data visualization method further includes steps S21 to S23: Step S21: Based on the message decoding method corresponding to the message type, decode the flight sensor data to obtain flight decoded data with data type as a structure; It should be noted that message type is a field in the communication protocol used to identify the data category, distinguishing different types of information packets such as flight attitude data, flight performance data, and flight control commands. Message decoding method refers to the data parsing method used for a specific message type, including byte order processing, field offset positioning, data type conversion, checksum verification, and other operational processes. Different message types correspond to different decoding logic. Flight sensor data is the raw encoded data packet transmitted from the aircraft to the ground station via a wireless link. Its structure is a composite data type containing multiple fields with clearly defined names and types. Flight decoded data is the intermediate data form that has been converted from raw flight data into a semantically structured form after decoding processing. Its fields can be directly called by subsequent modules for data visualization.
[0067] It is understandable that flight attitude data, flight performance data, and flight control commands generated during flight are different types of data and cannot be integrated into a visualization interface. Therefore, this embodiment employs dedicated decoding logic for different message types to avoid field misalignment or type misjudgment due to protocol differences, ensuring the accuracy of key parameters such as attitude and speed restoration and improving the accuracy and flexibility of data parsing. Furthermore, the method of determining the decoding method based on message type in this embodiment only requires registering a new decoding function when new sensors or flight platforms are needed, without refactoring the main process, thus improving the compatibility of data visualization.
[0068] Step S22: Based on a preset standardization processing method, numerical precision processing and filtering operations are performed on the flight decoding data to obtain standardized flight data; It should be noted that numerical precision processing involves truncating or rounding floating-point numbers to avoid display redundancy, improve readability, and reduce the amount of data for subsequent rendering and transmission. Filtering, on the other hand, uses digital signal processing techniques to smooth the raw data, suppressing high-frequency fluctuations caused by sensor noise and communication jitter, thus improving the stability and accuracy of the displayed data.
[0069] Understandably, directly visualizing the high-precision floating-point numbers output by sensors would exceed the human eye's recognition capabilities, causing visual interference and wasting display resources. Furthermore, unfiltered sensor data would lead to frequent pointer jitter and rapid number jumps, affecting the operator's judgment of the actual flight status. Therefore, this embodiment uses numerical precision processing to remove redundant decimal places, making the data display concise and clear, conforming to the principle of appropriate information presentation in human factors engineering. Through filtering, data fluctuations are smoothed, instantaneous noise is eliminated, making pointer movement more stable and trend changes more realistic, improving visual comfort and judgment accuracy.
[0070] In one feasible implementation, the specific implementation of performing numerical precision processing and filtering operations on the flight decoding data based on a preset standardization processing method to obtain standardized flight data can also be: Based on a preset decimal processing standard, the number of decimal places in the flight decoding data is adjusted to obtain simplified flight data that retains the corresponding number of decimal places. Based on a preset filtering window, the average value of each simplified flight data in the filtering window is calculated to obtain the standardized flight data. The simplified flight data in the filtering window includes the simplified flight data at the current moment and the simplified flight data before the current moment.
[0071] It should be noted that the simplified flight data is a more concise intermediate data after decimal truncation. The simplified flight data at the current moment is the latest data value after decoding and decimal processing. The simplified flight data before the current moment are several previous data points that have been processed in the historical cache, which constitute the time series input of the filter window.
[0072] Understandably, this embodiment eliminates invalid precision interference by standardizing the number of decimal places, making the numbers on the interface neatly arranged and highlighting key points, thus making the data visualization method conform to human factors engineering. Furthermore, it utilizes a filtered window containing historical data for averaging calculations to smooth out instantaneous fluctuations caused by sensor noise and communication jitter, reducing the impact of individual outliers on the displayed results and improving the robustness of the display. Through the above data standardization processing, the output standardized flight data can possess reasonable accuracy and good stability, thereby improving the visualization effect of the data at the ground instrument station.
[0073] Step S23: Format the standardized flight data into a uniform string format to obtain the flight data in a uniform format.
[0074] It is understandable that different parameters use different textual expressions, making it impossible to integrate and display different types of parameters in the visualization interface. Therefore, this embodiment standardizes the expression of flight data by formatting the standardized flight data into a unified string format. This allows various flight parameters to be output with a consistent text structure, facilitating direct access and rendering by the visualization interface. This achieves the goal of integrating and visualizing different types of data within the visualization interface. Simultaneously, this unified string format is also compatible with other modules outside of data visualization, enhancing the data's versatility and reusability within the system.
[0075] In one embodiment, during the formatting of the flight data, semantic format modifiers related to the data type and display area are also embedded to generate an enhanced string with rendering instruction markers. The semantic format modifiers include font weight identifiers, scale dynamic range identifiers, and background color mapping identifiers.
[0076] After the enhanced string is passed to the visualization module, the rendering engine parses the modifiers in it and dynamically applies the corresponding visual styles. This mechanism only works for flight data that has been mapped to key visual areas and has associated graphics. Modifier embedding is not enabled for regular text data and parameters in unconventional visual areas.
[0077] By introducing semantic format modifiers during the string formatting stage of standardized data, data semantics and visual presentation instructions are deeply integrated into the same text stream. This allows the visualization module to automatically restore high-fidelity display styles without additional configuration table queries or conditional judgments. Unlike the traditional interface development model that separates logic and presentation, this approach utilizes string carriers to achieve lightweight and scalable rendering semantic transmission without increasing communication overhead, significantly improving system response efficiency and style consistency. The precise binding relationship established in this embodiment between data type, display area, and associated graphics provides contextual support for modifiers. Through deep coupling of data format and visualization interface architecture, low-latency, high-precision, and adaptive visualization rendering enhancements are achieved in specific flight monitoring scenarios.
[0078] In one embodiment, the semantic format modifier also carries a scale rendering priority instruction to control the display density and visual weight of scale lines within the specified interval. When flight parameters enter a high-stress interval, the rendering priority of the corresponding scale interval is automatically increased, and the scale segment is highlighted in the interface by bolding, elongating, or brightening, while the visual appearance of scales in non-sensitive areas is weakened. The degree of bolding, elongation, and highlighting is related to the data change rate. By carrying a scale rendering priority instruction in the semantic format modifier, a visualization interface is implemented using a string carrier without increasing communication overhead, achieving adaptive visualization rendering with different priorities and improving the visualization effect in different scenarios.
[0079] In summary, this embodiment decodes the flight sensor data based on the message decoding method corresponding to the message type, obtaining flight decoded data with a data type of structure. Based on a preset standardization processing method, the flight decoded data is subjected to numerical precision processing and filtering to obtain standardized flight data. The standardized flight data is then formatted into a uniform string format to obtain the flight data in a uniform format.
[0080] This embodiment performs targeted decoding based on message type, achieving accurate semantic reconstruction of flight sensor data and organizing the results into structured data, thus improving the accuracy of data parsing and system compatibility. Furthermore, by performing numerical precision processing and window-based filtering on the decoded data, numerical jumps caused by sensor noise and communication jitter are effectively suppressed, making the data more stable and smooth. Redundant decimal places are removed, enhancing readability. Finally, the processed standardized flight data is formatted into a unified string format, constructing a unified data output interface. This enables integrated visualization of different data types within the visualization interface and enhances the data's versatility and reusability within the system.
[0081] It should be noted that the above examples are only for understanding this application and do not constitute a limitation on the data visualization method of this application. Any simple modifications based on this technical concept are within the protection scope of this application.
[0082] This application also provides a data visualization device, please refer to... Figure 4 The data visualization device includes: The data acquisition module 10 is used to acquire encoded flight sensor data, wherein the flight sensor data includes flight attitude data and flight performance data, and the flight attitude data and the flight performance data are defined with different message types during encoding; Standardization module 20 is used to standardize the flight sensor data into flight data of a uniform format based on the message type; The visualization module 30 is used to visualize the flight data at the corresponding position on the visualization interface based on the data type of the flight data and a preset hierarchical layout that conforms to human factors engineering.
[0083] In one embodiment, the visualization module further includes: The first position determination submodule is used to determine the first display position of the graphic-related data in the key visible area and the associated graphic of the graphic-related data based on the hierarchical layout method if the data type is graphic-related data. The first visualization submodule is used to visualize the graphic-related data and the related graphics at the first display position based on the visualization rendering method corresponding to the data type. The second position determination submodule is used to determine the second display position of the regular text data in the regular visible area based on the hierarchical layout method if the data type is regular text data. The second visualization submodule is used to visualize the regular text data at the second display position based on the visualization rendering method corresponding to the data type.
[0084] In one embodiment, the first position determination submodule further includes: The first position determination unit is used to determine the heading angle display position of the heading angle data in the top visible area if the graphic associated data is heading angle data, and to determine that the associated graphic is a vertical bar scale. The second position determination unit is used to determine the roll angle display position of the roll angle data in the middle layer visible area if the graphic association data is roll angle data, and to determine that the associated graphic is a circular dial. The third position determination unit is used to determine the pitch angle display position of the pitch angle data in the middle layer visible area if the graphic association data is pitch angle data, and to determine that the associated graphic is a horizontal bar scale. The fourth position determination unit is used to determine the height display position of the height data in the visible areas on both sides if the graphic association data is height data, and to determine that the associated graphic is a vertical bar chart.
[0085] In one embodiment, the first visualization submodule further includes: The rendering method determination unit is used to determine the scale spacing, text annotation spacing, background text contrast, and font size for visualization rendering based on the data type. The visualization rendering unit is used to visualize the graphic association data and the associated graphic at the first display position based on the scale spacing, the text annotation spacing, the background text contrast, and the font size.
[0086] In one embodiment, the standardization module further includes: The message decoding submodule is used to decode the flight sensor data based on the message decoding method corresponding to the message type, so as to obtain flight decoded data with data type as a structure; The data standardization submodule is used to perform numerical precision processing and filtering on the flight decoding data based on a preset standardization processing method to obtain standardized flight data. The format unification submodule is used to format the standardized flight data into a unified string format to obtain the flight data in a unified format.
[0087] In one embodiment, the data standardization submodule further includes: The data simplification element is used to adjust the number of decimal places in the flight decoding data based on a preset decimal processing standard, so as to obtain simplified flight data that retains the corresponding number of decimal places; The data filtering unit is used to calculate the average value of each simplified flight data in the preset filtering window to obtain the standardized flight data. The simplified flight data in the filtering window includes the simplified flight data at the current moment and the simplified flight data before the current moment.
[0088] The data visualization device provided in this application, employing the data visualization method described in the above embodiments, can solve the technical problem of poor display effect in data visualization methods. Compared with the prior art, the beneficial effects of the data visualization device provided in this application are the same as those of the data visualization method provided in the above embodiments, and other technical features in the data visualization device are the same as those disclosed in the methods of the above embodiments, and will not be repeated here.
[0089] This application provides a data visualization device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, which are executed by the at least one processor to enable the at least one processor to perform the data visualization method in Embodiment 1 above.
[0090] The following is for reference. Figure 5 The diagram illustrates a structural schematic of a data visualization device suitable for implementing embodiments of this application. The data visualization device in the embodiments of this application may include, but is not limited to, mobile terminals such as mobile phones, tablets, laptops, digital broadcast receivers, PDAs (Personal Digital Assistants), PMPs (Portable Media Players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 5 The data visualization device shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of this application.
[0091] like Figure 5As shown, the data visualization device may include a processing unit 1001 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1003 into a random access memory (RAM) 1004. The RAM 1004 also stores various programs and data required for the operation of the data visualization device. The processing unit 1001, ROM 1002, and RAM 1004 are interconnected via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to the I / O interface 1006: input devices 1007 including, for example, a touchscreen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; output devices 1008 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 1003 including, for example, magnetic tape, hard disk, etc.; and communication devices 1009. Communication device 1009 allows the data visualization device to communicate wirelessly or wiredly with other devices to exchange data. While the figures show data visualization devices with various systems, it should be understood that implementing or having all of the systems shown is not required. More or fewer systems may be implemented alternatively.
[0092] Specifically, according to the embodiments disclosed in this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from storage device 1003, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of the embodiments disclosed in this application.
[0093] The data visualization device provided in this application, employing the data visualization method described in the above embodiments, can solve the technical problem of poor display effect in data visualization methods. Compared with the prior art, the beneficial effects of the data visualization device provided in this application are the same as those of the data visualization method provided in the above embodiments, and other technical features in this data visualization device are the same as those disclosed in the previous embodiment method, and will not be repeated here.
[0094] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples.
[0095] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
[0096] This application provides a computer-readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, the computer-readable program instructions being used to execute the data visualization method described in the above embodiments.
[0097] The computer-readable storage medium provided in this application may be, for example, a USB flash drive, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination thereof.
[0098] The aforementioned computer-readable storage medium may be included in the data visualization device; or it may exist independently and not be assembled into the data visualization device.
[0099] The aforementioned computer-readable storage medium carries one or more programs, which, when executed by a data visualization device, cause the data visualization device to perform the aforementioned data visualization method.
[0100] Computer program code for performing the operations of this application can be written in one or more programming languages or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, and C++, and conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0101] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.
[0102] The modules described in the embodiments of this application can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.
[0103] The readable storage medium provided in this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., a computer program) for executing the above-described data visualization method, thereby solving the technical problem of poor display effect in data visualization methods. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as the beneficial effects of the data visualization method provided in the above embodiments, and will not be repeated here.
[0104] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the data visualization method described above.
[0105] The computer program product provided in this application can solve the technical problem of poor display effect in data visualization methods. Compared with the prior art, the beneficial effects of the computer program product provided in this application are the same as the beneficial effects of the data visualization method provided in the above embodiments, and will not be repeated here.
[0106] The user-related data involved in this application (e.g., user attribute data, user behavior data, and user geographical location, etc.; please modify the data types here according to the adaptability of the solution content) were all obtained with the user's permission or consent; that is, when this application is applied to specific products or technologies, user permission is required to obtain and process the relevant data, and the processing of the relevant data must comply with the relevant laws, regulations, and regulatory standards of the relevant countries and regions. For example, refer to... Figure 6 When it is necessary to obtain a user's current geographical location, a location acquisition prompt can be displayed on the user's terminal. After receiving confirmation from the user regarding the location acquisition prompt, the terminal can obtain the user's current geographical location.
[0107] The above description is only a part of the embodiments of this application and does not limit the scope of protection of this application. All equivalent structural transformations made under the technical concept of this application and using the contents of the specification and drawings of this application, or direct / indirect applications in other related technical fields, are included in the patent protection scope of this application.
Claims
1. A data visualization method, characterized in that, The method includes: Acquire encoded flight sensor data, wherein the flight sensor data includes flight attitude data and flight performance data, and the flight attitude data and the flight performance data are defined with different message types during encoding; Based on the message type, the flight sensor data is standardized into a unified format of flight data; Based on the data type of the flight data and the preset ergonomic hierarchical layout, the flight data is visualized in the corresponding position on the visualization interface.
2. The method as described in claim 1, characterized in that, The data types include graphically related data and regular text data. The visualization interface includes key visual areas and regular visual areas. The steps of visually displaying the flight data in the corresponding positions of the visualization interface based on the data types of the flight data and a preset ergonomically designed hierarchical layout include: If the data type is graphic-related data, then based on the hierarchical layout method, determine the first display position of the graphic-related data in the key visible area, and the associated graphic of the graphic-related data; Based on the visualization rendering method corresponding to the data type, the graphic association data and the associated graphic are visualized at the first display position; If the data type is regular text data, then based on the hierarchical layout method, determine the second display position of the regular text data in the regular visible area; Based on the visualization rendering method corresponding to the data type, the conventional text data is visualized at the second display position.
3. The method as described in claim 2, characterized in that, The key visible area includes a top visible area, a middle visible area, and two side visible areas. The graphic association data includes heading angle data, roll angle data, pitch angle data, and altitude data. If the data type is graphic association data, then based on the layered layout method, the steps of determining the first display position of the graphic association data in the key visible area and the associated graphic of the graphic association data include: If the graphic associated data is heading angle data, then determine the heading angle display position of the heading angle data in the top visible area, and determine that the associated graphic is a vertical bar scale; If the graphic association data is roll angle data, then determine the roll angle display position of the roll angle data in the middle layer visible area, and determine that the associated graphic is a circular dial; If the graphic association data is pitch angle data, then determine the pitch angle display position of the pitch angle data in the middle layer visible area, and determine that the associated graphic is a horizontal bar scale; If the graphic association data is height data, then the height display position of the height data in the visible areas on both sides is determined, and the associated graphic is determined to be a vertical bar chart.
4. The method as described in claim 2, characterized in that, The step of visually displaying the graphic association data and the associated graphic at the first display position using the visualization rendering method corresponding to the data type includes: Based on the data type, determine the scale spacing, text annotation spacing, background text contrast, and font size for visualization rendering; Based on the scale spacing, the text annotation spacing, the background text contrast, and the font size, the graphic association data and the associated graphics are visualized at the first display position.
5. The method as described in claim 1, characterized in that, The step of standardizing the flight sensor data into a uniform format includes: Based on the message decoding method corresponding to the message type, the flight sensor data is decoded to obtain flight decoded data with data type as a structure. Based on a preset standardization processing method, the flight decoding data is subjected to numerical precision processing and filtering to obtain standardized flight data; The standardized flight data is formatted into a uniform string format to obtain the flight data in a uniform format.
6. The method as described in claim 5, characterized in that, The steps of performing numerical precision processing and filtering on the flight decoding data based on the preset standardization processing method to obtain standardized flight data include: Based on a preset decimal processing standard, the number of decimal places in the flight decoding data is adjusted to obtain simplified flight data that retains the corresponding number of decimal places; Based on a preset filtering window, the average value of each simplified flight data in the filtering window is calculated to obtain the standardized flight data. The simplified flight data in the filtering window includes the simplified flight data at the current moment and the simplified flight data before the current moment.
7. A data visualization device, characterized in that, The device includes: The data acquisition module is used to acquire encoded flight sensor data, wherein the flight sensor data includes flight attitude data and flight performance data, and the flight attitude data and the flight performance data are defined with different message types during encoding; A standardization module is used to standardize the flight sensor data into a unified format of flight data based on the message type. The visualization module is used to visualize the flight data in the corresponding positions of the visualization interface based on the data type of the flight data and a preset hierarchical layout that conforms to human factors engineering.
8. A data visualization device, characterized in that, The device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the data visualization method as described in any one of claims 1 to 6.
9. A storage medium, characterized in that, The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, it implements the steps of the data visualization method as described in any one of claims 1 to 6.
10. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the steps of the data visualization method as described in any one of claims 1 to 6.
Citation Information
Patent Citations
Visual flight management system and method of unmanned aerial vehicle (UAV) based on big data computing engine
CN110568855A
Unmanned aerial vehicle display and control integrated method, system and device and computer readable storage medium
CN113391649A
Unmanned aerial vehicle multi-element dynamic flight visualization method and device
CN115033007A
Universal storage system based on flight data of unmanned aerial vehicles of multiple manufacturers
CN119829582A
Digital twinning-based visual data comprehensive processing method for automobile industrial data
CN120596569A
Cited By
Cabin instrument reconstruction method for flight comment
CN121433801A