Visualization method and system for self-adaptive matching of display object resolution and fusion processing mode

Abstract

The invention provides a visualization method and system for self-adaptive matching of a display object resolution and a fusion processing mode. The method provided by the invention comprises the following steps: before to-be-displayed content reaches a video physical port of a visualization system, determining a display template according to a plurality of to-be-controlled visualization system display sizes; selecting a target visualization system according to the content density of the to-be-displayed content; determining a display object type in the to-be-displayed content, determining a fusion processing mode of the display object according to the display object type, determining a fused display position of each display object according to the display scene, supplementing a display template corresponding to the target visualization system, and obtaining a target display template; different types of display objects are obtained by utilizing a video physical port, each display object is processed by utilizing a video processor according to a fusion processing mode of each display object, and a plurality of processed to-be-fused display objects are displayed in the same canvas according to a fused display position in a target display template to obtain a fused canvas; and displaying in the target visualization system.

Description

Technical Field

[0001] This application relates to the field of data visualization technology, and in particular to a visualization method and system that adaptively matches the display object resolution and fusion processing method. Background Technology

[0002] In today's information age, with the widespread application of various sensors, social media, and IoT devices, the diversity of data sources and types is constantly increasing. Data is presented in various forms, including structured, semi-structured, and unstructured data, encompassing different types such as text, images, videos, and tables. Faced with such massive and complex datasets, traditional data analysis methods are insufficient to meet the demand for quickly and accurately gaining insights. Therefore, heterogeneous data visualization has emerged. It integrates data from different sources and types, presenting it graphically, enabling users to intuitively understand and analyze information. This not only improves the efficiency of data processing but also promotes cross-domain knowledge sharing and decision support, providing a powerful data-driven force for the development of various industries.

[0003] Current heterogeneous data visualization methods typically scale the output content after it's fed into the fusion system to adapt to different display devices and interface requirements. The source resolution is usually the resolution of the video interface, and to avoid image distortion, proportional scaling of rows and columns is often used. While this method is simple, it can lead to image blurring and loss of effective pixels during scaling, affecting visual quality. Especially for data requiring high resolution and precise presentation, such as tables and charts, simple scaling often fails to provide sufficient clarity and readability, limiting its applicability in these scenarios and making it more suitable for video or image-based content.

[0004] Therefore, there is an urgent need for a method to perform corresponding fusion processing for different types of data and different resolution requirements, so as to ensure the optimal display effect after fusion and to ensure that the effective pixels of important content are not lost. Summary of the Invention

[0005] In view of this, this application provides a visualization method and system that adaptively matches the display object resolution and the fusion processing method, so as to perform corresponding fusion processing for different types of data and different requirements for resolution, to ensure the optimal display effect after fusion, and to ensure that the effective pixels of important content are not lost.

[0006] Specifically, this application is implemented through the following technical solution:

[0007] The first aspect of this application provides a visualization method for adaptively matching the display object resolution and the blending processing method, the method comprising:

[0008] Before the content to be displayed reaches the video physical port of the visualization system, a display template is determined based on multiple display sizes of the visualization system to be controlled. The display template is used to constrain the size of the visualized content in the visualization system.

[0009] Select the target visualization system from multiple visualization systems to be controlled based on the content density of the content to be displayed;

[0010] The process involves determining the types of display objects in the content to be displayed, determining the blending processing method for the display objects based on their types, determining the blended display position of each display object based on the display scenario, and supplementing the display template corresponding to the target visualization system to obtain the target display template. The content to be displayed includes multiple display objects. Each display object type is matched to the resolution requirements of the target visualization system. The blending processing method is determined based on the resolution requirements, as different display object types have different resolution requirements. The target display template includes the blending processing method and the blended display position for each display object, and different blending processing methods have different scaling degrees.

[0011] Different types of display objects are obtained using video physical ports, and the different types of display objects are processed by a video processor according to the fusion processing method corresponding to each display object to obtain multiple display objects to be fused.

[0012] The multiple objects to be merged are displayed on the same canvas according to the merged display position in the target display template to obtain a merged canvas, and the merged canvas is output to the target visualization system for display.

[0013] A second aspect of this application provides a visualization system that adaptively matches the display object resolution and the blending processing method. The visualization system includes a video processor and multiple visualization systems to be controlled. The video processor is connected to the visualization systems via a video physical port.

[0014] The visualization system is used to send different types of display objects to the video processor based on the video physical port;

[0015] The video processor is used to process the different types of display objects according to the fusion processing method corresponding to each display object, and obtain multiple display objects to be merged.

[0016] The video processor is also used to determine the merged display position of the different types of display objects according to the display scene;

[0017] The video processor is also used to display the multiple objects to be merged in the same canvas according to the merged display position, to obtain a merged canvas, and to output the merged canvas to the target visualization system in the visualization system for display.

[0018] The visualization method and system provided in this application, which adaptively matches the display object resolution and fusion processing method, improves system adaptability and optimizes data processing efficiency and display effect through preprocessing optimization before hardware interface and content density-based resolution adaptation. Firstly, preprocessing optimization is performed before the hardware interface. By determining the display template before the content to be displayed enters the visualization system, the display size of the visualization system is matched in advance, thus constraining and filtering the display content. A target visualization system is selected from multiple visualization systems, and a target display template is created according to the display size and content requirements, ensuring that the content to be displayed is adapted to different hardware platforms. This avoids large-scale adjustments after data input, reduces the real-time computing burden on the video processor, and improves system adaptability and scalability. Simultaneously, pre-filtered content reduces redundant information in the data stream, optimizes transmission efficiency, reduces system bandwidth and storage pressure, thereby improving the stability and smoothness of the overall data stream processing. Secondly, based on the optimization strategy of content density and resolution adaptation, appropriate resolution requirements are matched for different types of display objects, and different fusion processing methods are adopted. First, determine the types of each display object in the content to be displayed, and set different blending methods based on their importance and resolution requirements. Then, according to the set blending methods, scale non-essential content, while keeping key content displayed at high resolution and clarity. This highlights important information, improves the user's viewing experience, and avoids information redundancy affecting overall readability. Furthermore, reasonable resolution allocation reduces the computational and storage overhead of the system in unnecessary parts, improves the operating efficiency of the visualization system, reduces the processing burden, and achieves more efficient data presentation. Attached Figure Description

[0019] Figure 1 A flowchart of a visualization method for adaptive matching of display object resolution and fusion processing method provided in Embodiment 1 of this application;

[0020] Figure 2 The images shown in Embodiment 2 of this application illustrate the display objects before and after processing using the cropping mode.

[0021] Figure 3 The images shown in Embodiment 3 of this application are the display objects before and after magnification.

[0022] Figure 4 The images shown in Embodiment 4 of this application illustrate the display objects before and after scaling down.

[0023] Figure 5 This is a schematic diagram of the structure of a visualization system that adaptively matches the display object resolution and fusion processing method, as provided in Embodiment 5 of this application. Detailed Implementation

[0024] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application.

[0025] The terminology used in this application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. The singular forms “a,” “the,” and “the” used herein are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.

[0026] It should be understood that although the terms first, second, third, etc., may be used in this application to describe various information, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of this application, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the word "if" as used herein may be interpreted as "when," "when," or "in response to determination."

[0027] The following specific embodiments are given to illustrate the technical solution of this application in detail.

[0028] Figure 1 This is a flowchart illustrating the visualization method for adaptive matching of display object resolution and blending processing method provided in Embodiment 1 of this application. Please refer to... Figure 1 The method provided in this embodiment may include:

[0029] S101. Before the content to be displayed reaches the video physical port of the visualization system, determine the display template based on the display sizes of multiple visualization systems to be controlled.

[0030] It should be noted that the method provided in this application mainly targets the integration and presentation stage of data visualization, especially the heterogeneous integration and unified display of complex multi-source data (cross-system, cross-platform). The method provided in this application achieves the fusion and presentation of multi-source data through a combination of hardware and software, while reusing existing data visualization subsystems to reduce development and integration costs. This application supports data relay and sharing between different platforms, accessing new data sources through an open architecture to ensure efficient integration in heterogeneous environments. Regarding display effects, an optimized display processing flow is adopted, ensuring that resolution and frame rate are not affected while achieving collaborative rendering and unified display across multiple platforms. Compared with traditional single-platform or refactoring integration methods, this application not only retains the functionality of existing systems but also reduces development difficulty and hardware dependence, while improving system scalability and display consistency. In particular, after receiving the content to be displayed, before sending it to the canvas for rendering, this invention performs targeted processing on the tiles at the software level, thereby classifying the tiles before transmission to the channels. Each channel has specific configuration parameters for single-task processing, thus improving the efficiency of canvas processing and display while ensuring display effects.

[0031] Specifically, a display template refers to a specification or framework used in a visualization system to define and constrain the layout and appearance of visualized content. It constrains the size of the visualized content, including the position and size of each component (such as charts, text, images, etc.) as well as the color, font, line style, etc. of the visualized content.

[0032] It should be noted that when multiple visualization systems to be controlled have similar display sizes and proportions, a universal display template can be designed to ensure that the visualization content remains consistent across different visualization systems. When the display sizes of multiple visualization systems to be controlled differ significantly, a corresponding display template needs to be designed for each visualization system to ensure optimal visualization effects and user experience.

[0033] In practice, before connecting the content to be displayed to the video physical port of the visualization system, the display size (including parameters such as width, height, and resolution) of each visualization system is first determined. Based on the determined display size, visualization systems with similar display sizes are grouped together. For each group of visualization systems, their visualization content is analyzed, and the required minimum and maximum display sizes are determined according to different visualization content to ensure adaptability across all visualization systems. Furthermore, when determining the display template, a fixed width and height are selected to suit all visualization systems, or relative units (such as percentages) are used to define the display template so that it can automatically adjust according to the specific visualization system. Margins and alignment rules are set in the display template to ensure that the visualization content maintains a consistent display effect across visualization systems of different sizes. The display template effect is tested in actual visualization systems, and adjustments are made as necessary to improve usability and aesthetics.

[0034] S102. Select the target visualization system from multiple visualization systems to be controlled based on the content density of the content to be displayed.

[0035] Specifically, the content to be displayed includes multiple different types of display objects. The target visualization system refers to the final visualization system used to display the merged visualization content. Content density measures the density of information in the content to be displayed; the calculation method differs for different types of display objects. For image-type (static images), the background area and effective display objects in the image are identified. The area of ​​the effective display objects is calculated, and the proportion of the effective display object area to the total image area is calculated to obtain the content density. For text-type (text content), semantic information of the text is identified using natural language processing technology, and relevant characters (keywords) are extracted. The proportion of relevant characters to the total number of characters is calculated to obtain the content density. For video-type (moving images), the video is divided into frame-by-frame images. The content density of each frame is calculated (using the same method as for image-type images), and the content density values ​​of all frames are averaged or summed to obtain the content density of the entire video.

[0036] Furthermore, after calculating the content density of the content to be displayed, the system is matched based on the display capabilities (resolution, refresh rate, screen size, etc.) of different visualization systems to select the most suitable target visualization system. This is done by setting content density thresholds for different visualization systems and matching the target visualization system according to the relationship between content density and these thresholds. For example, for high-density content, a content density threshold greater than 0.7 corresponds to a high-resolution, high-precision visualization system. For medium-density content, a content density threshold between 0.4 and 0.7 is used, selecting a visualization system with a standard resolution. For low-density content, a content density threshold less than 0.4 is used, selecting a low-resolution visualization system.

[0037] S103. Determine the display object type in the content to be displayed, determine the fusion processing method of the display object according to the display object type, determine the fusion display position of each display object according to the display scene, supplement the display template corresponding to the target visualization system, and obtain the target display template.

[0038] The content to be displayed includes multiple display objects. Each display object type is matched to the resolution requirements of the target visualization system. The fusion processing method is determined according to the resolution requirements. Different display object types have different resolution requirements. The target display template includes the fusion processing method and the fused display position of each display object. Different fusion processing methods have different scaling degrees.

[0039] Specifically, based on the above description, the content to be displayed includes multiple different types of display objects. Different types of display objects have different fusion processing methods (different display types). That is, the video processor selects different fusion processing methods when processing different types of display objects.

[0040] It should be noted that different blending methods have different scaling effects on the displayed objects, and the blending method is related to the resolution requirements of the displayed objects.

[0041] Furthermore, the merged display position of each display object refers to its position on the merged canvas (the content ultimately displayed in the target visualization system) after the video processor has processed the merge. The merged display position of each display object is determined based on the specific display scenario; that is, each display scenario corresponds to a pre-defined merged display position for each display object.

[0042] In specific implementation, determining the display object type in the content to be displayed and determining the blending processing method of the display object based on the display object type includes: determining the display object type in the content to be displayed; determining the resolution requirement of the display object based on the display clarity requirement corresponding to the display object type; determining the resolution attenuation degree corresponding to each candidate blending processing method; determining the blending processing method of each display object based on the resolution attenuation degree and the resolution requirement, wherein the blending processing method includes at least a cropping mode and a scaling mode, and the resolution requirement of the display object corresponding to the cropping mode is higher than that of the scaling mode; and binding the corresponding video physical port according to the blending processing method, wherein the video physical port is different for different display object types.

[0043] Specifically, different types of display objects have different requirements for display clarity, and different types of display objects also have different requirements for resolution. Resolution requirements and display clarity requirements are related. Furthermore, the resolution requirements of display objects are also related to the blending processing method. For different resolution requirements, blending processing methods include cropping mode and scaling mode. When the resolution requirement is high, cropping mode is usually used to process the display object. When the resolution requirement is low, scaling mode is usually used. For example, when display objects include images, text, and videos, images have the highest resolution requirement, text has the lowest resolution requirement, and video has a resolution requirement in between. It should be noted that the resolution requirements for the same type of display object may differ in different visualization systems. This is mainly due to factors such as the physical characteristics of the display device, viewing distance, content recognition requirements, and computational resource limitations.

[0044] It should be noted that different fusion processing methods correspond to different physical video ports. That is, when performing fusion processing on different display object types using different methods, the video processor uses different channels for fusion processing. For example, in one possible implementation, the video processor performs fusion processing on the display object based on the HDMI channel. In another possible implementation, the video processor performs fusion processing on the display object based on the DP channel.

[0045] In practical implementation, the types of display objects (such as tables, images, and text) within the content to be displayed are determined based on the content to be displayed. For each type of display object, the required display resolution is determined (e.g., tables require higher resolution, text requires lower resolution, and images require resolution in between). Based on these resolution requirements, the required resolution is determined; tables require higher resolution, and text requires lower resolution. For each display object's resolution requirement, the corresponding blending method is determined by comparing the required resolution with a preset value (cropping mode is selected when the required resolution is higher than the preset value; scaling mode is selected when the required resolution is lower than the preset value). Furthermore, based on the blending method for each display object, the corresponding video physical port is bound, and the display object is connected to the video processor via the video physical port.

[0046] Optionally, the step of matching the resolution requirements of the target visualization system according to each display object type includes: determining a priority order based on the importance of the content to be displayed; correcting the priority order based on the display capabilities of the visualization system; establishing a correspondence table between the priority order and the display system capability order to determine the resolution requirements.

[0047] In practical implementation, for images, the proportion of non-background areas, edge sharpness, and color contrast are calculated to determine information density and sort them. For videos, the proportion of dynamic areas is calculated frame-by-frame to determine the importance of moving targets, and a cumulative weighted sort is applied. For text, the proportion of core keywords is calculated, structural hierarchy (such as titles, body text, and annotations) is analyzed, and sorted according to information criticality. Furthermore, parameters such as the maximum resolution, physical screen size, and viewing distance of the visualization system are obtained. It is determined whether the current visualization system supports high-resolution display; if it exceeds the device's capabilities, the resolution of lower-priority content is reduced. Considering the viewing distance, the resolution of content viewed from a distance is appropriately reduced to decrease computational load and bandwidth requirements. A mapping table is established between priority sorting and display system capability sorting to determine resolution requirements, cross-matching content priorities with device support capabilities to generate a mapping table. Recommended resolutions for each type of display object are set on different devices, and the final resolution of each display object is adjusted according to the mapping table before being output to the visualization system for display.

[0048] As an optional embodiment, when determining which channel is used to transmit which type of object, the method provided by this invention includes: determining the number of channels of the video processor, specifically channels that are idle and do not need to process other data. Before transmitting the content to be displayed, complete tiles of each independent display object are acquired. Generally, a picture will include multiple display objects, such as sky, grass, and dogs. Each display object has different resolution requirements. If the same resolution is used, either the display accuracy will be lost, resulting in a poor viewing experience, or the amount of data processed will be large, slowing down the display processing speed. The method provided by this invention acquires complete tiles and processes them at different resolutions, reducing the burden of processing calculations in subsequent steps and improving processing efficiency. A complete tile refers to a tile with a complete outline of the display object, in which the outline of the display object is complete and it does not contain other display objects. Different tiles contain different display objects. After obtaining the complete tile, the method further includes determining the channel configuration parameters of the video processor based on the distribution characteristics of the number of tiles with different resolutions in the content to be displayed. The configured channel corresponds to a resolution requirement, and the total processing time difference of tiles with different resolution requirements is less than a threshold value, which is determined by the display switching efficiency of the display device.

[0049] Optionally, based on the above description, the display position of each merged display object is determined according to the specific display scenario. It should be noted that the content to be displayed and the display scenario are not fixed and can be changed according to relevant switching commands.

[0050] The process of determining the content to be displayed and the display scene includes: determining the content to be displayed based on the business logic of the visualization system; determining the display scene based on the display requirements of the visualization system; determining a switching instruction based on a trigger signal; the switching instruction includes a switching instruction for the content to be displayed and / or a switching instruction for the display scene, and the trigger signal includes peripheral I / O, mouse control, and a pre-set plan; and updating the content to be displayed and / or the display scene based on the switching instruction.

[0051] Specifically, the switching instructions include instructions for switching the content to be displayed and instructions for switching the display scene. The instructions for switching the content to be displayed are used to update the content to be displayed, and the instructions for switching the display scene are used to update the display scene. Both the instructions for switching the content to be displayed and the instructions for switching the display scene are triggered by the same trigger signal.

[0052] In practical implementation, the system identifies the content to be displayed based on the business logic of the visualization system (including reading data sources, data processing, and extraction of analysis results). It extracts the content relevant to the current context from the business logic to ensure that the selected content meets user needs. Furthermore, based on the visualization system's display requirements (considering user interaction needs, the characteristics of the visualization system, and the complexity of the visualized content), a suitable display scenario (including the arrangement of display objects, background information, color scheme, etc.) is determined. Further, an event capture mechanism listens for changes in trigger signals. When a switching command related to a peripheral I / O trigger, a mouse click or zoom action trigger, or a pre-set trigger is detected, the corresponding content to be displayed and / or the display scenario are updated based on the triggered switching command.

[0053] Optionally, when the switching instruction includes a switching instruction for content to be displayed and a switching instruction for the display scene, the content to be displayed and the display scene are updated based on the switching instruction; when the switching instruction includes a switching instruction for content to be displayed, the content to be displayed is updated based on the switching instruction; when the switching instruction includes a switching instruction for the display scene, the display scene is updated based on the switching instruction.

[0054] Specifically, the switching instructions include instructions to switch the content to be displayed and / or instructions to switch the display scene. When the switching instructions only include instructions to switch the content to be displayed, in this step, the content to be displayed is updated based on the switching instructions, while the display scene is still determined based on the display requirements of the visualization system. When the switching instructions only include instructions to switch the display scene, in this step, the display scene is updated based on the switching instructions, while the content to be displayed is still determined based on the business logic of the visualization system. When the switching instructions include both instructions to switch the content to be displayed and instructions to switch the display scene, in this step, both the content to be displayed and the display scene are updated based on the switching instructions.

[0055] As an optional embodiment, updating the content to be displayed and / or the display scene based on the switching instruction includes: obtaining the switching content corresponding to the switching instruction; determining the update video physical port corresponding to the switching content according to the type of the switching content; determining the display target resolution corresponding to the switching content according to the type of the switching content; determining the update processing method of the switching content based on the correspondence between the display target resolution and the fusion processing method; processing the switching content according to the update processing method and outputting it to the update video physical port.

[0056] S104. Obtain different types of display objects using video physical ports, and process the different types of display objects using a video processor according to the fusion processing method corresponding to each display object to obtain multiple display objects to be fused.

[0057] Specifically, based on the above description, different types of display objects require different fusion processing methods, and different fusion processing methods require different video physical ports.

[0058] In specific implementation, the process involves obtaining different types of display objects using video physical ports, and processing these different types of display objects using a video processor according to the fusion processing method corresponding to each display object to obtain multiple display objects to be fused. This includes: if the fusion processing method corresponding to the display object is a cropping mode, determining the target video physical port corresponding to the display object type, receiving the display object using the target video physical port, and establishing a display object coordinate system based on the display template corresponding to the display object; the origin of the display object coordinate system is the center point of the display template; aligning the center point of the display object with the origin of the display object coordinate system, and cropping the area in the display template excluding the display object to obtain the display objects to be fused.

[0059] Specifically, when the display object requires high resolution (e.g., charts), the corresponding blending method is cropping mode. Accordingly, the display object is received using the corresponding video physical port (e.g., DP interface). A display object coordinate system is established based on the display object's display template, with the origin of the coordinate system set as the center point of the display template to facilitate subsequent alignment and cropping. Furthermore, the center point of the display object is aligned with the origin of the display object coordinate system to ensure the display object's position within the display template meets design requirements. Based on the aligned display object, image processing techniques are used to crop away the area in the display template excluding the display object. After cropping, only the display object remains, resulting in the display object to be blended. Figure 2 This is the display object before and after the cropping mode processing shown in Embodiment 2 of this application.

[0060] The method provided in this embodiment obtains the display object to be merged by employing a cropping mode when the resolution requirement of the display object is high. Firstly, the cropping mode preserves the high resolution and clarity of the display object, making it particularly suitable for content requiring detailed display (such as charts and images). By displaying only the important parts, blurring or distortion caused by scaling can be avoided, ensuring that effective pixels of important display content are not lost. Secondly, the cropping mode helps users focus on the most important information or visual elements, reducing unnecessary interference. Especially in complex visualizations, the cropping mode can emphasize key data or graphics, improving the effectiveness of information delivery. Thirdly, the cropping mode can flexibly adjust the display object to adapt to different display ratios or devices, which is particularly important when designing responsive interfaces. By cropping and removing redundant content, the readability and usability of information can be improved, enabling users to understand and obtain the required information more quickly. Furthermore, the cropping mode is applicable to various types of visualization content, whether charts, images, or videos, making it more widely applicable in different application scenarios. Fourthly, the method provided in this application, which processes display objects as units, offers significant advantages in efficiency, resource utilization, flexibility, display effect, and scalability compared to overall image processing. By independently receiving and processing different types of display objects through the video physical port, each display object is cropped, adjusted, and merged as an independent unit, avoiding redundant computation and resource waste in overall image processing. This approach improves system efficiency and reduces storage and bandwidth requirements, especially in multi-source data fusion scenarios, facilitating dynamic adaptation to heterogeneous data source access. Simultaneously, unitized processing of display objects supports applying specific fusion methods to each object, ensuring precise alignment with the display template, thereby optimizing the display effect and avoiding resolution loss and image distortion caused by full-image scaling or cropping. Furthermore, this method offers greater flexibility and dynamic adjustment capabilities, enabling the system to easily adapt to the real-time interaction needs of multiple tasks and users. Through modular architecture design, distributed processing and parallel computing can also be achieved, further enhancing performance and scalability.

[0061] Optionally, after determining the distribution of resolutions, the number of channels corresponding to each resolution can be determined based on the processing requirements of different resolutions, and the configuration parameters for each channel can be determined. A template can be created for each channel, establishing a correspondence between channel, template, and resolution. When processing each display object, the display position and other information in the template can be modified according to the type and content of the display object, reducing the amount of content that needs to be modified and adjusting, and improving hardware processing efficiency.

[0062] Optionally, the step of obtaining different types of display objects using video physical ports, and processing the different types of display objects using a video processor according to the fusion processing method corresponding to each display object to obtain multiple display objects to be fused includes: if the fusion processing method corresponding to the display object is a scaling mode, determining the target video physical port corresponding to the display object type, and receiving the display object using the target video physical port; the video processor determining the scaling direction based on the size relationship between the resolution of each display object and the resolution of the corresponding video physical port; when the resolution of the display object is less than the resolution of the video physical port, scaling the display object using a row-column proportional scaling method, and adjusting the size of the scaled-up display object based on the display template; when the resolution of the display object is greater than the resolution of the video physical port, scaling the display object using a row-column proportional shrinking method, and adjusting the size of the scaled-down display object based on the display template.

[0063] Specifically, when the resolution requirement of the displayed object is not high (e.g., text, images), the corresponding blending processing method is scaling mode. Accordingly, the display object is received using the corresponding video physical port (e.g., HDMI interface). The video processor compares the resolution of each display object with the resolution of the corresponding video physical port to determine the scaling direction and ratio. When the resolution of the display object is less than the resolution of the video physical port, the display object is scaled up proportionally in rows and columns according to the determined ratio. The size of the scaled-up display object is then adjusted according to the display template (including maintaining the proportions, ensuring the scaled-up display object is correctly aligned within the display template, and potentially cropping or aligning if the scaled-up display object exceeds the boundaries of the display template to adapt to the new display environment). Figure 3 This is an example of a display object before and after magnification, as shown in Embodiment 3 of this application. When the resolution of the display object is greater than the resolution of the video physical port, the display object is scaled down proportionally in rows and columns according to a determined ratio, and the size of the scaled-down display object is adjusted according to the display template (while maintaining the core content, excess parts are cropped to ensure the clarity and readability of the display object). Figure 4 This is the display object before and after scaling shown in Embodiment 4 of this application.

[0064] The method provided in this embodiment obtains the display object to be merged by employing a scaling mode when the resolution requirement of the display object is not high. Firstly, scaling can adjust the entire display object to a suitable size, ensuring that the user can see all relevant information without missing important content due to cropping. Furthermore, scaling can flexibly adapt to different display devices and resolutions. Whether zooming in or out, it ensures that the display object maintains its visual appeal in different environments. Compared to cropping, scaling does not lose any part of the display object, which is crucial for images that need to display the full picture. Secondly, when the display object is small, scaling can make the content easier to read and understand, especially text and details. With appropriate zooming, users can view information more clearly. Scaling is relatively straightforward and usually involves simple mathematical calculations, while cropping may require more decisions (such as selecting the cropping area). In some scenarios, scaling may be more efficient. Moreover, when frequent updates or switching of content are required, scaling can more easily adapt to changes, especially in interactive applications where users may need to quickly view different data views.

[0065] Optionally, the step of obtaining different types of display objects using video physical ports, and processing the different types of display objects using a video processor according to the fusion processing method corresponding to each display object to obtain multiple display objects to be fused includes: the video processor traversing the visualization system corresponding to each display object and determining the frame rate of the visualization system; and determining the maximum frame rate among the frame rates of the visualization system as the frame rate at which the video processor outputs the fused canvas to the target visualization system for display.

[0066] Specifically, frame rate refers to the number of frames displayed per second, which directly affects the smoothness of the visualized content and the user experience. The frame rate is different for each visualization system.

[0067] In this step, to ensure optimal smoothness and responsiveness when the final merged canvas is displayed on the target visualization system, the maximum frame rate among the various visualization systems is determined as the final display frame rate. This setting ensures that rendering is performed at the highest frame rate when merging multiple display objects, guaranteeing the frame rate of important content and thus providing a better visual experience. By using the maximum frame rate, the video processor can better handle dynamic content and user interactions, ensuring smooth display and reducing latency and stuttering. Maintaining a high frame rate when merging various types of display objects ensures coordination between different content, enhancing the overall visual experience.

[0068] S105. Display the multiple objects to be merged on the same canvas according to the merged display position in the target display template to obtain a merged canvas, and output the merged canvas to the target visualization system for display.

[0069] Specifically, the target display template records the merged display positions of different display objects. In this step, based on the merged display positions of different display objects, each display object to be merged is displayed on the same canvas.

[0070] In specific implementation, displaying the multiple objects to be merged on the same canvas according to the merged display position in the target display template to obtain a merged canvas includes: determining the size of the canvas based on the size of the multiple objects to be merged and the merged display position; establishing a canvas coordinate system with the center point of the canvas as the origin; calculating the coordinates of each object to be merged in the canvas coordinate system based on the merged display position; and placing the object to be merged at the corresponding position on the canvas based on the coordinates.

[0071] Specifically, based on the dimensions (width and height) of multiple objects to be merged and their merged display positions in the target display template, the canvas dimensions are calculated while ensuring the canvas can accommodate all objects and leaving appropriate margins to avoid overlap between different objects. Further, a canvas coordinate system is established with the center point of the canvas as the origin. For each object to be merged, its coordinates are calculated relative to the canvas center based on its merged display position in the target display template. Using these calculated coordinates, each object is placed in its corresponding position on the canvas, ensuring it does not exceed the canvas boundaries to maintain consistency in the visualization design. This results in a merged canvas, which is then displayed in the target visualization system.

[0072] The method provided in this embodiment improves system adaptability and optimizes data processing efficiency and display effects by optimizing preprocessing before the hardware interface and adapting resolution based on content density. Firstly, preprocessing optimization is performed before the hardware interface. By determining the display template before the content to be displayed enters the visualization system, the display size of the visualization system is matched in advance, thus constraining and filtering the display content. A target visualization system is selected from multiple visualization systems, and a target display template is created based on the display size and content requirements, ensuring that the content to be displayed is compatible with different hardware platforms. This avoids large-scale adjustments after data input, reduces the real-time computational burden on the video processor, and improves system adaptability and scalability. Simultaneously, pre-filtered content reduces redundant information in the data stream, optimizes transmission efficiency, reduces system bandwidth and storage pressure, thereby improving the stability and smoothness of the overall data stream processing. Secondly, the optimization strategy based on content density and resolution adaptation matches appropriate resolution requirements for different types of display objects and employs different fusion processing methods. First, determine the types of each display object in the content to be displayed, and set different fusion processing methods based on their importance and resolution requirements. Then, according to the set fusion processing methods, scale down non-essential content, while keeping key content displayed at high resolution and clarity. This highlights key information, improves the user's viewing experience, and avoids information redundancy affecting overall readability. Furthermore, reasonable resolution allocation reduces the computational and storage overhead of the system in unnecessary parts, improving the operational efficiency of the visualization system, reducing processing burden, and achieving more efficient data presentation. Thirdly, when the display object requires high resolution, a cropping mode is used to obtain the objects to be merged. The cropping mode preserves the high resolution and clarity of the display object, making it particularly suitable for content requiring detailed display (such as charts and images). By displaying only the important parts, blurring or distortion caused by scaling can be avoided, ensuring that effective pixels of important display content are not lost. Moreover, the cropping mode helps users focus on the most important information or visual elements, reducing unnecessary interference. Especially in complex visualizations, the cropping mode can emphasize key data or graphics, improving the effectiveness of information delivery. The cropping mode allows for flexible adjustment of displayed objects to suit different display ratios or devices, which is especially important when designing responsive interfaces. By cropping and removing unnecessary content, readability and usability of information can be improved, enabling users to understand and obtain the information they need more quickly. Furthermore, the cropping mode is applicable to various types of visualization content, whether charts, images, or videos, making it more versatile in different application scenarios. Fourthly, when the resolution requirements of the displayed objects are not high, a scaling mode can be used to obtain the objects to be merged.Scaling adjusts the entire displayed object to a suitable size, ensuring users can see all relevant information without missing important content due to cropping. Furthermore, scaling flexibly adapts to different display devices and resolutions. Whether zooming in or out, it ensures the displayed object remains visually appealing in various environments. Compared to cropping, scaling doesn't lose any part of the displayed object, which is crucial for images that need to show the whole picture. Moreover, when the displayed object is small, scaling makes the content easier to read and understand, especially text and details. With appropriate zooming, users can view information more clearly. Scaling is relatively straightforward, usually involving simple mathematical calculations, while cropping may require more decisions (such as choosing the cropping area), and in some scenarios, scaling may be more efficient. Furthermore, in situations requiring frequent updates or switching of content, scaling can more easily adapt to changes, especially in interactive applications where users may need to quickly view different data views. Fifthly, to ensure optimal smoothness and responsiveness when the final merged canvas is displayed in the target visualization system, the maximum frame rate among the frame rates of each visualization system is determined as the final display frame rate. This setting ensures that when merging multiple display objects, rendering can be performed at the highest frame rate, guaranteeing the frame rate of important display content and thus providing better visual effects. By using the maximum frame rate, the video processor can better handle dynamic content and user interaction, ensuring smooth display and reducing latency and stuttering. Maintaining a high frame rate when merging multiple types of display objects ensures coordination between different content and improves the overall visual experience. Sixthly, the method provided in this application, which processes display objects as units, has significant advantages in efficiency, resource utilization, flexibility, display effect, and scalability compared to overall image processing. Different types of display objects are received and processed independently through the video physical port. Each display object is cropped, adjusted, and merged as an independent unit, avoiding redundant calculations and resource waste in overall image processing. This approach improves system efficiency, reduces storage and bandwidth requirements, and is particularly beneficial in multi-source data fusion scenarios, facilitating dynamic adaptation to the access of heterogeneous data sources. Meanwhile, the unitized processing of display objects supports applying specific blending methods to each object, ensuring precise alignment with the display template, thereby optimizing the display effect and avoiding resolution loss and image distortion caused by full-image scaling or cropping. Furthermore, this method offers greater flexibility and dynamic adjustment capabilities, enabling the system to easily adapt to the real-time interaction needs of multiple tasks and users. Through modular architecture design, distributed processing and parallel computing can also be achieved, further enhancing performance and scalability.

[0073] Corresponding to the aforementioned embodiment of a visualization method that adaptively matches the display object resolution and the blending processing method, this application also provides an embodiment of a visualization system that adaptively matches the display object resolution and the blending processing method.

[0074] Figure 5 This is a schematic diagram of the structure of the visualization system that adaptively matches the display object resolution and blending processing method according to Embodiment 5 of this application. Please refer to... Figure 5 The system provided in this embodiment includes a video processor and multiple visualization systems to be controlled; the video processor is connected to the visualization systems through a video physical port;

[0075] The visualization system is used to send different types of display objects to the video processor based on the video physical port;

[0076] The video processor is used to process the different types of display objects according to the fusion processing method corresponding to each display object, and obtain multiple display objects to be merged.

[0077] The video processor is also used to determine the merged display position of the different types of display objects according to the display scene;

[0078] The video processor is also used to display the multiple objects to be merged in the same canvas according to the merged display position, to obtain a merged canvas, and to output the merged canvas to the target visualization system in the visualization system for display.

[0079] The system in this embodiment can be used to execute... Figure 1 The steps of the method embodiment shown are similar in principle and process, and will not be repeated here.

[0080] The specific implementation process of the functions and roles of each unit in the above device can be found in the implementation process of the corresponding steps in the above method, and will not be repeated here.

[0081] For the device embodiments, since they basically correspond to the method embodiments, the relevant parts can be referred to in the description of the method embodiments. The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this application according to actual needs. Those skilled in the art can understand and implement this without creative effort.

[0082] The above description is merely a preferred embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of protection of this application.

Claims

1. A visualization method for adaptive matching of display object resolution and fusion processing mode, characterized in that, The method comprises: Before the content to be displayed reaches a video physical port of the visualization system, a display template is determined according to the display size of the plurality of visualization systems to be controlled, the display template being used to constrain the size of the visualized content in the visualization system; A target visualization system is selected from the plurality of visualization systems to be controlled according to the content density of the content to be displayed; A display object type in the content to be displayed is determined, a fusion processing mode of the display object is determined according to the display object type, a post-fusion display position of each display object is determined according to a display scene, a target display template corresponding to the target visualization system is supplemented, and the target display template is obtained; wherein the content to be displayed comprises a plurality of display objects, the fusion processing mode is determined according to the resolution requirement matched in the target visualization system according to each display object type, the resolution requirement is different for different display object types, the target display template comprises the fusion processing mode and the post-fusion display position of each display object, and the scaling degree is different for different fusion processing modes; Different types of display objects are obtained by using the video physical port, the different types of display objects are processed according to the fusion processing mode corresponding to each display object by using a video processor, and a plurality of display objects to be fused are obtained; The plurality of display objects to be fused are displayed in the same canvas according to the post-fusion display position in the target display template, a fusion canvas is obtained, and the fusion canvas is output to the target visualization system for display.

2. The method of claim 1, wherein, The content to be displayed comprises a plurality of different types of display objects, and the display object type in the content to be displayed is determined, and the fusion processing mode of the display object is determined according to the display object type, comprising: The display object type in the content to be displayed is determined; The resolution requirement of the display object is determined according to the display definition requirement corresponding to the display object type; The resolution attenuation degree corresponding to each candidate fusion processing mode is determined, the fusion processing mode of each display object is determined based on the resolution attenuation degree and the resolution requirement, the fusion processing mode at least comprises a clipping mode and a scaling mode, and the resolution requirement of the display object corresponding to the clipping mode is higher than that of the scaling mode; The corresponding video physical port is bound according to the fusion processing mode, and the video physical port is different for different display object types.

3. The method of claim 2, wherein, The different types of display objects are obtained by using the video physical port, the different types of display objects are processed according to the fusion processing mode corresponding to each display object by using a video processor, and a plurality of display objects to be fused are obtained, comprising: If the fusion processing mode corresponding to the display object is the clipping mode, a target video physical port corresponding to the display object type is determined, and the display object is received by using the target video physical port; A display object coordinate system is established based on the display template corresponding to the display object; the origin of the display object coordinate system is the center point of the display template; The center point of the display object is aligned with the origin of the display object coordinate system, the area of the display template except the display object is clipped, and the display object to be fused is obtained.

4. The method of claim 2, wherein, The different types of display objects are obtained by using the video physical ports respectively, and the video processor processes the different types of display objects according to the corresponding fusion processing modes of the display objects to obtain a plurality of display objects to be fused, including: If the fusion processing mode corresponding to the display object is a zoom mode, a target video physical port corresponding to the display object type is determined, and the target video physical port is used to receive the display object; The video processor determines the zoom direction based on the size relationship between the resolution of each display object and the resolution of the corresponding video physical port; When the resolution of the display object is smaller than the resolution of the video physical port, the display object is enlarged by using the row-column equivalent magnification mode, and the size of the enlarged display object is adjusted based on the display template; When the resolution of the display object is greater than the resolution of the video physical port, the display object is reduced by using the row-column equivalent reduction mode, and the size of the reduced display object is adjusted based on the display template.

5. The method of claim 1, wherein, The different types of display objects are obtained by using the video physical ports respectively, and the video processor processes the different types of display objects according to the corresponding fusion processing modes of the display objects to obtain a plurality of display objects to be fused, including: The video processor traverses the visualization system corresponding to each display object to determine the frame rate of the visualization system; The maximum frame rate in the frame rate of the visualization system is determined as the frame rate of the video processor outputting the fusion canvas to the target visualization system for display.

6. The method of claim 1, wherein, The determination process of the display content and the display scene includes: Determining the display content based on the business logic of the visualization system; Determining the display scene based on the display requirements of the visualization system; Determining a switching instruction based on a trigger signal; the switching instruction includes a switching instruction of the display content and / or a switching instruction of the display scene; Updating the display content and / or the display scene based on the switching instruction.

7. The method of claim 6, wherein, Updating the display content and / or the display scene based on the switching instruction includes: Obtaining switching content corresponding to the switching instruction; Determining an update video physical port corresponding to the switching content according to the type of the switching content; Determining a display target resolution corresponding to the switching content according to the type of the switching content; Determining an update processing mode of the switching content based on the corresponding relationship between the display target resolution and the fusion processing mode; Processing the switching content according to the update processing mode and outputting to the update video physical port.

8. The method of claim 1, wherein, The plurality of display objects to be fused are displayed in the same canvas according to the fusion display positions in the target display template to obtain a fusion canvas, including: Determining the size of the canvas based on the size of the plurality of display objects to be fused and the fusion display positions; Establishing a canvas coordinate system with the center point of the canvas as the origin; For each display object to be fused, calculating the coordinates of the display object to be fused in the canvas coordinate system based on the fusion display position; Placing the display object to be fused at the corresponding position of the canvas based on the coordinates.

9. The method of claim 1, wherein, The video processor processes the different types of display objects according to the fusion processing mode corresponding to each display object, and the processing includes: determining the number of channels of the video processor; obtaining complete tiles of each independent display object; determining the channel configuration parameters of the video processor according to the number distribution characteristics of different resolutions of all complete tiles in the content to be displayed; wherein each configured channel corresponds to a resolution requirement, and the total time difference of tile processing of different resolution requirements is less than a threshold value.

10. A visualizing system that adaptively matches the resolution of a displayed object and the processing mode of fusion, characterized by, The visual system with adaptive matching of display object resolution and fusion processing mode includes a video processor and a plurality of visual systems to be controlled; the video processor is connected with the visual system through a video physical port; The visual system is configured to send different types of display objects to the video processor based on the video physical port; The video processor is configured to obtain a fusion canvas according to the method in any one of claims 1-9, and output the fusion canvas to a target visual system in the visual system for display.

Images