An Adaptive Industrial Configuration Screen Presentation System and Method for Multiple Terminals

Abstract

This invention relates to the field of graphical user interface generation and rendering technology, and more particularly to an adaptive presentation system and method for industrial configuration screens across multiple terminals. The system includes a screen semantic parsing unit, a terminal context acquisition unit, an adaptive layout calculation unit, and a screen reconstruction and rendering unit. The method involves parsing the original industrial configuration screen to generate a screen semantic structure tree containing graphic element attributes and their relationships; collecting target terminal screen parameters, types, and interaction modes to form terminal context information; calculating the optimal display attributes of elements and generating a layout scheme based on preset adaptive rules; and reconstructing the graphic elements according to the scheme and rendering them in layers. This invention achieves accurate adaptation of a single original screen across multiple terminals, highlighting core elements, optimizing interaction and display effects, reducing costs, and ensuring industrial operation efficiency and safety. It is suitable for industrial monitoring and control scenarios.

Description

Technical Field

[0001] This invention relates to the field of graphical user interface generation and rendering technology, specifically to an adaptive presentation system and method for industrial configuration screens across multiple terminals. Background Technology

[0002] Existing industrial configuration screen technologies are ill-suited to the aforementioned differences between multiple terminals, mainly due to the following issues:

[0003] Terminal adaptation is inefficient and development and maintenance costs are high. Traditional technologies require separate design of configuration screen layouts for each type of terminal, and manual adjustment of the size, position and interaction logic of graphic elements. For example, a large screen designed for a fixed operation station may cause problems such as crowded elements and blurry text when displayed directly on a handheld monitoring device, requiring manual modification of the layout. If a new terminal type is added, screen adaptation development needs to be carried out repeatedly, which not only extends the project cycle, but also significantly increases manpower and time costs.

[0004] The interaction mode is not compatible with the characteristics of the terminal, resulting in a poor user experience and a high risk of misoperation. The existing screen is not optimized for the two mainstream interaction modes of touch and mouse: On touch operation terminals, some graphic elements are too small, making it difficult for staff to touch accurately and easily causing misoperation; On mouse operation terminals, some large elements optimized for touch occupy too much screen space, affecting the display of other key information, and the excessive spacing between elements reduces operation efficiency.

[0005] The unclear display priority of core business elements affects the safety of monitoring and operation. The industrial configuration screen contains a large number of graphic elements, including core elements such as real-time data monitoring panels and emergency stop buttons, as well as non-core elements such as system description text and historical data query portals. Existing technologies usually adopt a fixed layout and do not distinguish the importance of elements in combination with industrial business logic. This can easily lead to core elements being obscured by non-core elements or core elements being displayed in remote positions, making it difficult for staff to quickly obtain key data or emergency operation options, increasing production monitoring delays and operational safety risks.

[0006] Unstable screen display affects the accuracy of information transmission; differences in pixel density and resolution between different terminals often cause problems such as element distortion, blurry text, and disordered layout when the existing configuration screen is displayed across terminals; these display abnormalities can lead to staff misreading equipment parameters and misjudging the status of the process flow, thereby affecting the accuracy of production decisions and even causing production failures.

[0007] In summary, existing industrial configuration screen technologies have significant limitations in terms of multi-terminal adaptability, interaction optimization, element priority control, and display stability, making it difficult to meet the diverse usage needs of terminals in industrial scenarios. There is an urgent need for an industrial configuration screen adaptive presentation technology that can automatically adapt to the characteristics of multiple terminals and ensure operational efficiency and security. Summary of the Invention

[0008] The purpose of this invention is to provide an adaptive display system and method for industrial configuration screens on multiple terminals, in order to solve the problems mentioned in the background art.

[0009] To achieve the above objectives, the present invention provides the following technical solution:

[0010] An adaptive presentation method for industrial configuration screens across multiple terminals includes the following steps:

[0011] Step S1: Image Semantic Parsing: Obtain the original industrial configuration image, parse the image based on the predefined industrial configuration description specification, identify and extract the element type, attribute parameters, and element identifier of each graphic element in the image, and parse the hierarchical structure relationship, topological connection relationship, and logical association relationship between graphic elements to generate an image semantic structure tree; wherein, the image semantic structure tree adopts a tree data structure representation, the nodes correspond to graphic elements, the edges represent the structural or logical relationship between elements, and the logical association relationship includes data binding relationship and control dependency relationship;

[0012] Step S2: Terminal Context Acquisition: Acquire the terminal context information of the target terminal. The terminal context information includes the screen physical size, resolution, pixel density, interaction mode, and terminal type. The interaction mode includes touch operation or mouse operation.

[0013] Step S3: Adaptive Layout Calculation: Based on the screen semantic structure tree and terminal context information, and according to preset adaptive layout rules, the optimal display attributes of each graphic element on the target terminal screen are dynamically calculated to generate an adaptive layout scheme; the adaptive layout rules include:

[0014] Element importance assessment: Based on the logical relationships and element types in the image semantic structure tree, the importance weight of each graphic element is assessed;

[0015] Layout priority allocation: Layout priority is allocated based on the importance weight of elements and the screen physical size in the terminal context information;

[0016] Responsive adjustment strategy: Adjust the position coordinates, size, scaling, visibility, and rendering order of elements based on the resolution, pixel density, and interaction mode in the terminal context information;

[0017] Optimal display attributes include element position coordinates, size, scaling, visibility, and rendering order;

[0018] Step S4: Screen Reconstruction and Rendering: Based on the adaptive layout scheme, adjust the attributes, reconstruct the layout, and optimize the rendering of the graphic elements of the original industrial configuration screen, and display them on the target terminal screen; among them, rendering optimization includes rendering the graphic elements in layers according to the rendering order, so that important elements are displayed first.

[0019] As a preferred approach, the semantic parsing of the image in step S1 specifically includes:

[0020] Based on the predefined industrial configuration description specification, the original industrial configuration screen is parsed to extract the list of graphic elements in the screen. The list of graphic elements contains the basic descriptive information of all graphic elements.

[0021] For each graphic element in the graphic element list, semantic recognition is performed to identify the element type, attribute parameters, and element identifier of each graphic element, and a set of graphic element attributes is generated.

[0022] Based on the element identifiers in the set of graphic element attributes, and referring to the structural definition in the industrial configuration description specification, the hierarchical relationship between graphic elements is analyzed to construct a preliminary tree structure. The preliminary tree structure uses the root node to represent the screen container and the child nodes to represent nested graphic elements.

[0023] Based on the logical rules in the industrial configuration description specification, the relationships of the graphical elements in the preliminary tree structure are parsed to identify the topological connections and logical associations between the graphical elements, including data binding relationships and control dependencies, and a relationship mapping table is generated.

[0024] By integrating the initial tree structure and relationship mapping table, and through node association and edge addition, the hierarchical structure relationship, topological connection relationship and logical relationship relationship are merged into the tree data structure to generate a complete image semantic structure tree.

[0025] As a preferred embodiment, the terminal context acquisition in step S2 specifically includes:

[0026] By parsing the user agent string or device fingerprint features of the target terminal, the terminal type of the target terminal can be identified. The terminal type includes industrial mobile terminals, fixed operator stations, or handheld monitoring devices.

[0027] Based on the identified terminal type, the system interface of the target terminal is called to obtain the screen physical size, resolution and pixel density parameters, forming a set of basic screen parameters;

[0028] Based on the terminal type and the screen physical size in the set of basic screen parameters, the interaction mode of the target terminal is determined. Industrial mobile terminals and handheld monitoring devices are determined to be touch operation mode, while fixed operation stations are determined to be mouse operation mode.

[0029] The terminal type, screen basic parameter set and interaction mode are structurally integrated to generate a terminal context information object containing a complete description of terminal attributes;

[0030] The validity of each parameter in the terminal context information object is verified to ensure that the screen physical size is within a preset reasonable range, the resolution and pixel density are correctly matched, and the interaction mode is consistent with the terminal type logic.

[0031] As a preferred option, the adaptive layout calculation in step S3 specifically includes:

[0032] Based on the logical relationships and element types in the semantic tree structure of the image, element importance assessment is performed. The element importance weight of each graphic element is calculated according to the number of data binding relationships and the strength of control dependencies.

[0033] Based on the importance weight of the elements and the screen physical size in the terminal context information, a layout priority is assigned to each graphic element, and the layout area allocation strategy of each graphic element on the screen is determined according to the layout priority.

[0034] Based on the layout area allocation strategy and combined with the resolution and pixel density in the terminal context information, the initial position coordinates and reference size of each graphic element are calculated.

[0035] Based on the interaction mode in the terminal context information, the initial position coordinates and reference size are adjusted in a responsive manner to generate the adjusted position coordinates and size of the graphic elements.

[0036] Based on the adjusted position coordinates and size of the graphic elements, the layout overlap between graphic elements is evaluated, and the scaling ratio and visibility of the graphic elements are dynamically optimized based on layout priority.

[0037] Finally, by integrating the final position coordinates, final size, final scaling, final visibility of all graphic elements, as well as the rendering order determined by layout priority, an adaptive layout scheme is generated.

[0038] As a preferred option, the preset adaptive layout rules include:

[0039] Element importance benchmark definition: Based on the industrial configuration description specification, the common element types and logical relationships in the historical industrial configuration screen are analyzed, and the importance benchmark weight of element types is defined. Among them, element types with a large number of data binding relationships, high control dependency relationships, or strong business criticality are assigned higher importance benchmark weights.

[0040] Dynamic adjustment of element importance: Based on historical terminal usage data, the correlation between user interaction patterns and element importance under different terminal types is analyzed, and the baseline weight of element importance is dynamically adjusted to generate an element importance weight adjustment table. Among them, the weight of interactive elements in touch operation mode is increased, and the weight of precise control elements in mouse operation mode is enhanced.

[0041] Layout priority strategy preset: Based on the element importance weight adjustment table and the screen physical size in the terminal context information, a layout priority allocation strategy is preset, including the allocation rules of high priority elements in the center area of ​​the screen, the layout constraints of medium priority elements in the edge area, and the dynamic visibility conditions of low priority elements.

[0042] Responsive adjustment parameter presets: Based on the terminal type and interaction mode, preset a set of parameters for the responsive adjustment strategy, including the minimum touch size threshold in touch operation mode, the element spacing accuracy requirement in mouse operation mode, and the scaling ratio adjustment coefficient based on resolution and pixel density.

[0043] Adaptive rule base generation: Integrating the element importance weight adjustment table, layout priority allocation strategy and responsive adjustment parameter set, and performing logical fusion and consistency verification through the rule engine, a structured adaptive layout rule base is generated to guide dynamic decision-making in the adaptive layout calculation process.

[0044] As a preferred option, the image reconstruction and rendering in step S4 specifically includes:

[0045] Based on the adaptive layout scheme, the final position coordinates, final size, final scaling ratio, final visibility and rendering order of each graphic element are extracted;

[0046] Based on final visibility, select visible graphic elements from all graphic elements to form a list of visible graphic elements;

[0047] For each graphic element in the list of visible graphic elements, perform geometric position calculation and size adjustment based on the final position coordinates and final size, and scale it according to the final scaling ratio to generate a transformed graphic element adapted to the terminal screen.

[0048] Based on the rendering order, the transformed graphic elements are assigned to different rendering layers to construct a layered rendering structure, where graphic elements with higher rendering order are located in the upper layer.

[0049] Based on the layered rendering structure, the graphic elements in each layer are rendered sequentially from the bottom layer to the top layer and displayed on the target terminal screen, so as to give priority to the display of important elements.

[0050] An industrial configuration screen adaptive presentation system for multiple terminals, comprising:

[0051] The image semantic parsing unit is used to acquire the original industrial configuration image. Based on the predefined industrial configuration description specification, it parses the image, identifies and extracts the element type, attribute parameters, and element identifier of each graphic element in the image, and parses the hierarchical structure relationship, topological connection relationship and logical association relationship between graphic elements to generate the image semantic structure tree.

[0052] The terminal context acquisition unit is used to acquire the terminal context information of the target terminal, including screen physical size, resolution, pixel density, interaction mode and terminal type.

[0053] The adaptive layout calculation unit is used to dynamically calculate the optimal display attributes of each graphic element on the target terminal screen based on the screen semantic structure tree and terminal context information, and according to the preset adaptive layout rules, and generate an adaptive layout scheme.

[0054] The screen reconstruction and rendering unit is used to adjust the attributes, reconstruct the layout and optimize the rendering of the graphic elements of the original industrial configuration screen according to the adaptive layout scheme, and display it on the target terminal screen.

[0055] The image semantic structure tree generated by the image semantic parsing unit is output to the adaptive layout calculation unit, the terminal context information obtained by the terminal context acquisition unit is output to the adaptive layout calculation unit, and the adaptive layout scheme generated by the adaptive layout calculation unit is output to the image reconstruction and rendering unit.

[0056] As can be seen from the technical solution provided by the present invention above, the industrial configuration screen adaptive presentation system and method for multiple terminals provided by the present invention have the following beneficial effects:

[0057] Enhance the flexibility of multi-terminal adaptation and meet the diverse terminal needs of industrial scenarios: This invention can automatically identify the physical screen size, resolution, pixel density and interaction mode of different types of terminals such as industrial mobile terminals, fixed operation stations and handheld monitoring devices. Through adaptive layout calculation, it dynamically adjusts the position, size, visibility and rendering order of graphic elements in the configuration screen. There is no need to design a separate screen for each terminal. It achieves accurate adaptation of a set of original configuration screens on multiple terminals, effectively addressing the problem of diverse terminal types and large differences in hardware parameters in industrial scenarios.

[0058] To ensure the efficiency and safety of industrial operations and highlight the value of core business elements: By extracting the logical relationships between graphic elements through semantic analysis of the screen, and assessing the importance weight of elements in combination with the business needs of industrial scenarios, core elements such as real-time data monitoring panels and emergency control buttons are prioritized for allocation to key areas of the screen and rendered first, avoiding non-core elements from obscuring or interfering with operations; at the same time, the size of elements is optimized for both touch and mouse interaction modes (e.g., ensuring that elements are not smaller than the minimum touch size in touch mode), reducing the probability of misoperation, thereby improving operational efficiency and reducing safety risks caused by unclear display or inconvenient operation of key elements;

[0059] Reduce the development and maintenance costs of industrial configuration screens and decrease manual workload: Traditional industrial configuration screens require manual adjustment of layout, size and interaction logic for different terminals, resulting in long development cycles and repeated modifications when new terminals are added or parameters are changed. This invention automates the entire process from original screen parsing, terminal context acquisition, adaptive layout calculation to screen rendering without manual intervention, significantly shortening the screen adaptation development cycle. When terminal types are updated or hardware parameters change, the system can automatically adapt without redesign, significantly reducing the manpower and time costs of development and long-term maintenance.

[0060] Optimize the visual display effect to ensure clear and accurate information transmission: use layered rendering technology to process the display hierarchy of graphic elements to avoid overlapping and occlusion of elements; adjust the scaling ratio of elements according to the terminal pixel density and resolution to prevent image distortion, blurring or illegible text; at the same time, perform dynamic visibility control on low-priority elements to avoid screen space crowding, ensuring that the configuration screen maintains a clear and neat display effect on different terminals, helping operators quickly obtain key data and control options, and reducing information misreading caused by screen display problems;

[0061] Supporting multi-terminal collaborative operation in industry to improve overall production management efficiency: In industrial production scenarios, staff often need to use multiple terminals to work collaboratively, such as the central control room monitoring the overall situation through fixed operating stations, on-site personnel conducting inspections through handheld monitoring devices, and mobile operators operating equipment through industrial mobile terminals; This invention enables the configuration screens presented by different terminals to not only conform to their respective hardware and interaction characteristics, but also maintain the consistency of core information, ensuring that the configuration information obtained by the central control, on-site, and mobile operators is accurately synchronized, avoiding collaborative deviations caused by screen differences, and helping to promote the efficient advancement of the overall production management process. Attached Figure Description

[0062] Figure 1 This is a schematic diagram of the steps of an adaptive presentation method for industrial configuration screens on multiple terminals according to the present invention.

[0063] Figure 2 This is a schematic diagram of the structure of an industrial configuration screen adaptive presentation system for multiple terminals according to the present invention. Detailed Implementation

[0064] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the invention.

[0065] To better understand the above technical solutions, the following will provide a detailed explanation of the technical solutions in conjunction with the accompanying drawings and specific embodiments.

[0066] like Figure 1-2 As shown, this embodiment of the invention provides a method for adaptive presentation of industrial configuration screens for multiple terminals, including the following steps:

[0067] Step S1: Image Semantic Parsing: Obtain the original industrial configuration image, parse the image based on the predefined industrial configuration description specification, identify and extract the element type, attribute parameters, and element identifier of each graphic element in the image, and parse the hierarchical structure relationship, topological connection relationship, and logical association relationship between graphic elements to generate an image semantic structure tree; wherein, the image semantic structure tree adopts a tree data structure representation, the nodes correspond to graphic elements, the edges represent the structural or logical relationship between elements, and the logical association relationship includes data binding relationship and control dependency relationship;

[0068] Step S2: Terminal Context Acquisition: Acquire the terminal context information of the target terminal. The terminal context information includes the screen physical size, resolution, pixel density, interaction mode, and terminal type. The interaction mode includes touch operation or mouse operation.

[0069] Step S3: Adaptive Layout Calculation: Based on the screen semantic structure tree and terminal context information, and according to preset adaptive layout rules, the optimal display attributes of each graphic element on the target terminal screen are dynamically calculated to generate an adaptive layout scheme; the adaptive layout rules include:

[0070] Element importance assessment: Based on the logical relationships and element types in the image semantic structure tree, the importance weight of each graphic element is assessed;

[0071] Layout priority allocation: Layout priority is allocated based on the importance weight of elements and the screen physical size in the terminal context information;

[0072] Responsive adjustment strategy: Adjust the position coordinates, size, scaling, visibility, and rendering order of elements based on the resolution, pixel density, and interaction mode in the terminal context information;

[0073] Optimal display attributes include element position coordinates, size, scaling, visibility, and rendering order;

[0074] Step S4: Screen Reconstruction and Rendering: Based on the adaptive layout scheme, adjust the attributes, reconstruct the layout, and optimize the rendering of the graphic elements of the original industrial configuration screen, and display them on the target terminal screen; among them, rendering optimization includes rendering the graphic elements in layers according to the rendering order, so that important elements are displayed first.

[0075] In this embodiment, step S1 involves performing comprehensive semantic analysis on the original industrial configuration screen to extract the core information of the graphic elements and various relationships between them, generating a structured screen semantic tree structure, and providing accurate and complete screen data support for subsequent adaptive layout calculations. The detailed steps are as follows:

[0076] Step S1-1: Original image syntax parsing and element list extraction:

[0077] Industrial configuration description specification adaptation: Based on the predefined industrial configuration description specification, a syntax parsing framework is built to ensure that the parsing process conforms to the standard data format requirements of industrial configuration screens;

[0078] Original image parsing and execution: Initiate a syntax parsing process on the acquired original industrial configuration image, traverse all visual components in the image, filter out graphic elements with independent functional attributes, and form an initial element set;

[0079] Element list generation and organization: Collect basic information for each graphic element in the initial element set, including basic identifiers, original presentation forms and other basic descriptive information of the element, organize this information in a unified format, and generate a complete graphic element list;

[0080] Step S1-2: Semantic recognition of graphic elements and generation of attribute sets:

[0081] Precise element type determination: For each graphic element in the graphic element list, the semantic recognition algorithm analyzes the functional characteristics, morphological characteristics and application scenario associations of the element to determine the specific element type of each graphic element, such as data display element, control operation element, topology connection element, etc.

[0082] Comprehensive attribute parameter extraction: In-depth analysis of the configuration information of each graphic element, extracting all attribute parameters including size parameters, color parameters, status parameters, and associated data interfaces, ensuring that no parameters are omitted;

[0083] Element identifier assignment and attribute set integration: A unique element identifier is assigned to each graphic element to distinguish different elements and subsequent relationship resolution; the element type, attribute parameters, and element identifier are linked and integrated to generate a graphic element attribute set containing complete semantic information of a single graphic element.

[0084] Step S1-3: Hierarchical structure relationship resolution and preliminary tree structure construction:

[0085] Identifier association basis establishment: Taking the element identifiers in the set of graphic element attributes as the core association basis, and referring to the structural definition rules clearly defined in the industrial configuration description specification, the hierarchical association logic such as inclusion and nesting between graphic elements is sorted out.

[0086] Hierarchical relationship analysis: By matching identifiers and validating structural rules, the hierarchical position of each graphic element in the overall image is determined, and the correspondence between parent and child elements is clarified. For example, the image container is the top-level element, and various functional child elements are nested under it.

[0087] Preliminary tree structure construction: The root node represents the entire screen container, and each graphic element is attached as a child node according to the hierarchical relationship to build a preliminary tree structure that only contains hierarchical relationships, intuitively presenting the nested distribution logic of graphic elements;

[0088] Step S1-4: Topological and logical relationship resolution and relationship mapping table generation:

[0089] Logical rule loading application: Loads logical parsing rules defined in the industrial configuration description specification, including topology connection determination rules, data binding identification rules, control dependency determination rules, etc., as the basis for relation parsing;

[0090] Topology connection relationship identification: Based on logical rule analysis of the spatial position association and signal transmission path of graphic elements in the preliminary tree structure, the topology connection relationship between elements is identified, such as the connection relationship between pipe elements and equipment elements, and the signal transmission relationship between sensor elements and display elements.

[0091] Logical relationship analysis: In-depth exploration of the data interaction logic and control links between graphic elements, identification of data binding relationships (i.e., the correspondence between elements and data sources), and control dependency relationships (i.e., the control influence of the operation state of one element on another element);

[0092] Relationship mapping table compilation: The identified topological connection relationships, data binding relationships, and control dependency relationships are classified and recorded. A corresponding mapping of element identifiers is established for each type of relationship, generating a structured relationship mapping table that clearly presents the non-hierarchical associations between elements.

[0093] Steps S1-5: Structure and Relationship Integration and Generation of a Complete Image Semantic Structure Tree:

[0094] Tree structure and mapping table association: Based on the initially constructed tree structure, various relationships in the relationship mapping table are transformed into edge attributes of the tree structure. Topological connection relationships, logical relationship relationships and hierarchical structure relationships are bound through node association operations.

[0095] Edge attribute addition and structure improvement: For each node in the tree structure, add corresponding edge connections to the corresponding graphical element according to the relationship mapping table. The edge type is clearly identified as hierarchical structure edge, topological connection edge, data binding edge or control dependency edge, thus improving the relationship expression of the tree structure.

[0096] Complete semantic structure tree generation: After node association and edge addition, a complete tree data structure is formed that integrates hierarchical structure, topological connection, and logical association, namely the image semantic structure tree. This structure tree can comprehensively and accurately reflect the semantic information and association logic of the original industrial configuration image.

[0097] In this embodiment, step S2 aims to accurately obtain the core attribute information of the target terminal, forming complete terminal context data. This provides a precise basis for subsequent adaptive layout calculations at the terminal level, ensuring that the layout scheme is highly compatible with the terminal hardware characteristics and interaction methods. The detailed steps are as follows:

[0098] Step S2-1: Target terminal type identification:

[0099] Terminal feature data collection: The feature data of the target terminal is obtained through the system interface, mainly including user agent string and device fingerprint feature; the user agent string contains basic identification information such as the terminal's operating system version, browser type, and device model; the device fingerprint feature covers the terminal's hardware configuration parameters such as processor model, memory capacity, and storage type, as well as software environment parameters such as application version and system kernel information;

[0100] Feature data parsing and processing: Perform syntactic analysis on the collected user agent strings, extract the device model field and system type field to determine the preliminary category of the terminal; perform multi-dimensional matching on the device fingerprint features, combine with the preset terminal type feature library, and use feature comparison algorithms to select the terminal category identifier that best matches the current terminal features;

[0101] Terminal type determination output: Based on the feature analysis results, the specific type of the target terminal is determined. The terminal type is divided into three categories: industrial mobile terminal, fixed operator station, and handheld monitoring device. For example, when the device model is analyzed as an industrial-grade tablet and the system is a mobile operating system, it is determined to be an industrial mobile terminal; when the device is analyzed to be connected to an external display and the system is a desktop-grade industrial operating system, it is determined to be a fixed operator station.

[0102] Step S2-2: Obtaining basic screen parameters:

[0103] System interface call trigger: Based on the terminal type determined in step S2-1, the system native interface of the target terminal is called; different terminal types correspond to different interface call schemes. Industrial mobile terminals and handheld monitoring devices call the display management interface of the mobile operating system, while fixed operation stations call the screen control interface of the desktop industrial operating system.

[0104] Screen parameter acquisition and execution: By calling the system interface, three core parameters of the target terminal screen are read: screen physical size, which is the actual length of the screen diagonal, in inches; resolution, which is the number of pixels in the horizontal and vertical directions of the screen, recorded in the format of horizontal pixels × vertical pixels; and pixel density, which is the number of pixels per inch of screen, in pixels per inch.

[0105] Basic parameter set generation: The collected screen physical size, resolution, and pixel density are organized according to a preset data format to form a structured set of basic screen parameters. This set contains information in three dimensions: parameter name, parameter value, and parameter unit, ensuring that the parameter information is complete and easy to call in subsequent calculations.

[0106] Step S2-3: Terminal interaction mode determination:

[0107] Integration of judgment criteria: The terminal type determined in step S2-1 and the screen physical size in the set of basic screen parameters generated in step S2-2 are used as the dual criteria for judging the interaction mode; the terminal type determines the basic direction of the interaction mode, and the screen physical size is used to verify and refine the interaction mode judgment result.

[0108] Preliminary determination of interaction mode: Based on the terminal type, industrial mobile terminals and handheld monitoring devices are preliminarily determined to be touch operation mode because their device form facilitates direct touch operation; fixed operation stations are preliminarily determined to be mouse operation mode because they are usually used with peripherals such as mice and keyboards.

[0109] Secondary verification of the judgment result: The preliminary judgment result is verified in combination with the physical size of the screen; if the physical size of the screen of the industrial mobile terminal is too large and exceeds the normal touch operation range, or the physical size of the screen of the fixed operation station is too small and supports touch function, the interaction mode is adjusted according to the actual use scenario requirements; if the physical size of the screen is within the normal range of the corresponding terminal type, the interaction mode of the preliminary judgment is maintained.

[0110] Step S2-4: Terminal context information integration:

[0111] Information field definition: The standard field structure of the predefined terminal context information object includes terminal type field, screen physical size field, resolution field, pixel density field, and interaction mode field; each field has a clearly defined data type and data format, for example, the terminal type field is a string type, and the screen physical size field is a numeric type with one decimal place;

[0112] Multi-dimensional information filling: Fill the terminal type determined in step S2-1 into the terminal type field, fill the screen physical size, resolution, and pixel density collected in step S2-2 into the corresponding fields, and fill the interaction mode determined in step S2-3 into the interaction mode field; during the filling process, ensure that the information in each field is completely consistent with the previously obtained results, and that there is no data tampering or omission.

[0113] Context object generation: After filling in the information of all fields, the structured field information is converted into a storable and transmittable terminal context information object according to the preset object serialization rules; this object allows subsequent adaptive layout calculation units to directly call any field data in it;

[0114] Step S2-5: Terminal context parameter verification:

[0115] Physical size reasonableness verification: Retrieve the preset reasonable range threshold for screen physical size. This threshold is set according to the common specifications of industrial terminals. For example, the reasonable range for the screen physical size of industrial mobile terminals is 5 to 12 inches, and the reasonable range for the screen physical size of fixed operation stations is 19 to 27 inches. Compare the screen physical size in the terminal context information object with the reasonable range threshold for the corresponding terminal type. If it exceeds the range, it is marked as an invalid parameter.

[0116] Resolution and pixel density matching verification: The matching between resolution and pixel density is verified by calculation. The calculation logic is to divide the number of horizontal pixels of the screen by the horizontal physical length of the screen to obtain the actual horizontal pixel density, and divide the number of vertical pixels of the screen by the vertical physical length of the screen to obtain the actual vertical pixel density. The average value of the actual horizontal pixel density and the actual vertical pixel density is compared with the pixel density in the terminal context information object. If the deviation value exceeds the preset allowable error range, it is marked as an invalid parameter.

[0117] Interaction mode and terminal type consistency verification: Based on the preset terminal type and interaction mode correspondence rules, the rules include two parts: general adaptation relationship and exception scenario thresholds. The general adaptation relationship is clear: industrial mobile terminals default to touch operation mode, fixed operation stations default to mouse operation mode, and handheld monitoring devices default to touch operation mode. The exception scenario thresholds are set as follows: industrial mobile terminals with a screen physical size greater than 12 inches are allowed to adapt to mouse operation mode, fixed operation stations with a screen physical size less than 15 inches and supporting touch function are allowed to adapt to touch operation mode, and handheld monitoring devices with a screen physical size greater than 10 inches are allowed to adapt to dual interaction modes.

[0118] During verification, if the interaction mode in the terminal context information object belongs to the normal adaptation relationship of the current terminal type, or meets the reasonable adaptation relationship within the threshold range of the exception scenario, it is determined to be consistent; if it exceeds the above range, such as a fixed operation station without touch function adapting to the touch operation mode, it is marked as an invalid parameter.

[0119] If the result is consistent but falls under an exceptional scenario, an exceptional scenario identifier needs to be added to the terminal context information object, and there is no need to return to the data acquisition step; only when the parameter is marked as invalid will the corresponding data acquisition step be returned to reacquire the data, thus avoiding an infinite loop in the system;

[0120] Verification result processing: If all parameters pass the verification (no invalid parameters, including cases that are consistent but belong to exception scenarios), then the terminal context information object is confirmed to be valid; if there are invalid parameters (such as physical size exceeding the range, resolution and pixel density not matching, or interaction mode being unreasonable and mismatched), then return to the corresponding data acquisition step to reacquire data until a terminal context information object with all parameters being valid is generated.

[0121] In this embodiment, step S3 is to extract the screen logic and element information based on the screen semantic structure tree, combine it with the hardware characteristics and interaction requirements in the terminal context information, and dynamically calculate the optimal display attributes of each graphic element through preset adaptive layout rules, ultimately generating an adaptive layout scheme adapted to the target terminal; the detailed steps are as follows:

[0122] Step S3-1: Calculate the importance weight of elements:

[0123] Evaluation Dimension Parameter Definitions: Preset calculation parameters for three core evaluation dimensions, including the data binding impact coefficient. Control Dependence Influence Coefficient and element type benchmark weight ;in, The value ranges from 0.3 to 0.5, and is set according to the importance of data interaction in the industrial configuration scenario; The value ranges from 0.4 to 0.6, and is set according to the degree of impact of the control logic on operational safety. Based on element type presets, such as data monitoring elements Auxiliary identification elements This ensures that key business elements have a higher base weight.

[0124] Multi-dimensional weighting: The importance weight of each graphic element is calculated using a weighted summation formula. The formula is ,in, This represents the importance weight of graphic elements, with a value ranging from 0 to 1. The number of data binding relationships for a graphic element, i.e., the number of data sources associated with that element; The strength of the control dependency relationship of the graphic element, with a value range of 0-1, is defined by the tightness of logical association in the industrial configuration description specification; For data binding impact coefficient, To control the dependency impact coefficient, Baseline weights for element types;

[0125] Weight result verification: The calculated weights will be verified. Compared with the preset weighted reasonableness threshold (0.1-0.9), if If the number of data binding relationships exceeds the threshold, recheck the number of data binding relationships. Strength of control dependency To ensure statistical accuracy, the calculation was corrected and repeated until... Within a reasonable range;

[0126] Step S3-2: Layout priority allocation and regional strategy determination:

[0127] Weighted classification: based on the importance of elements. The numerical range is used to divide all graphic elements into three priority levels; higher priority corresponds to... Core elements of the operation include real-time data monitoring panels and emergency control buttons; medium priority corresponds to... For auxiliary operation elements such as parameter setting windows and status indicator lights; low priority corresponds to This includes supplementary information elements such as explanatory text and historical data query portals;

[0128] Screen physical size adaptation: Obtain the screen physical size from the terminal context information. (Unit: inches), and according to Adjust the layout area proportion of each priority element; when (For small-screen terminals such as handheld monitoring devices), the layout area for high-priority elements is set to 60%, medium-priority elements to 30%, and low-priority elements to 10%; when (For mid-screen terminals such as industrial mobile terminals), the high priority ratio is 50%, the medium priority ratio is 35%, and the low priority ratio is 15%; when... When using large-screen terminals such as fixed operation stations, the high priority ratio is 40%, the medium priority ratio is 40%, and the low priority ratio is 20%.

[0129] Layout area strategy generation: Combining priority level and area proportion, the layout area of ​​each priority element is determined; high priority elements are assigned to the center area of ​​the screen, which has coordinates ranging from 25% to 75% of the horizontal pixels and 20% to 80% of the vertical pixels; medium priority elements are assigned to the edge area of ​​the screen, including the horizontal range of 0% to 25%, 75% to 100%, and the vertical range of 0% to 20%, 80% to 100%; low priority elements are assigned to the corner areas of the screen, i.e., the horizontal range of 0% to 15%, 85% to 100%, and the vertical range of 0% to 15%, 85% to 100%, forming a clear layout area allocation strategy;

[0130] Step S3-3: Calculation of initial position coordinates and datum dimensions:

[0131] Screen pixel coordinate system establishment: A two-dimensional pixel coordinate system is established with the top left corner of the target terminal screen as the origin, with the horizontal axis as the X-axis and the vertical axis as the Y-axis. The maximum value of the X-axis is the number of horizontal pixels of the screen resolution. The maximum value on the Y-axis (positive downwards) represents the number of vertical pixels in the screen resolution. ;

[0132] Initial position coordinates are determined as follows: Based on the layout area allocation strategy, the area space is divided equally according to the number of elements within the layout area corresponding to each priority level; for elements within the same priority level... Each graphic element divides the X-axis range of the priority layout area into equal parts. Both the segment and the Y-axis range are divided into part( Each element is assigned an independent sub-region, and the center coordinates of the sub-region are the initial position coordinates of that element. The calculation formula is: ,

[0133] ,in, The initial position coordinates of the graphic element; , The minimum and maximum values ​​on the X-axis of the priority layout region to which this element belongs; , The minimum and maximum values ​​on the Y-axis of the priority layout region to which this element belongs; The index of the element along the X-axis, ranging from 0 to... ; The element's index along the Y-axis, ranging from 0 to... ; This represents the number of sub-regions along the X-axis. This represents the number of sub-regions along the Y-axis.

[0134] Baseline size calculation: combining pixel density from terminal context information. (Unit: pixels per inch), adjustment factor based on the size and pixel density of the layout sub-regions. (Values ​​between 0.8 and 0.9 are used to avoid elements filling sub-regions and causing crowding), calculate the baseline size (width) of the graphic element. ,high The calculation formula is: ; (in, The baseline width for the graphic element. The reference height for graphic elements; The length of the layout area along the X-axis; The length of the layout area along the Y-axis; , These represent the number of sub-regions along the X-axis and Y-axis, respectively. (This is a pixel density adjustment factor);

[0135] Step S3-4: Responsive Adjustment Based on Interaction Patterns:

[0136] Interaction mode parameter loading: Retrieves a preset set of responsive adjustment parameters, where the minimum touch size threshold corresponds to the touch operation mode. (Value set to 44×44 pixels, meeting the precision requirements of industrial touch operation), touch distance threshold. (Value set to 15 pixels to avoid accidental clicks); Mouse operation mode corresponds to element spacing precision requirements. (Value is 5 pixels, for precise mouse positioning), Fine size coefficient (A value of 0.9 allows for smaller element sizes);

[0137] Touch operation mode adjustment:

[0138] Size Enlargement Verification: If the terminal interaction mode is touch operation, first verify whether the baseline size of the graphic element meets the requirements. and If the requirements are not met, the size will be scaled up proportionally to the minimum touch size, with a scaling factor of [missing value]. The adjusted size is , ;

[0139] Position coordinate adjustment: Simultaneously adjust the initial position coordinates Ensure that the distance between adjacent elements is not less than If the spacing is insufficient, the coordinates will be offset along the X-axis or Y-axis, with the offset amount being... Given the existing spacing, obtain the adjusted position coordinates. ;

[0140] Screen boundary validation: After adjustment, it is necessary to check whether the elements exceed the screen boundaries. The validation formula is as follows:

[0141] Left boundary: ;

[0142] Right boundary: ( (For screen landscape resolution);

[0143] Upper boundary: ;

[0144] Lower boundary: ( (for screen portrait resolution);

[0145] Out-of-boundary handling: If any boundary check fails, first offset the element position in the opposite direction of the out-of-bounds direction. The corrected position coordinates are:

[0146] Right boundary exceeds: Correction ;

[0147] Lower boundary exceeded: Correction

[0148] Left boundary exceeds: Correction ;

[0149] The upper boundary exceeds: Correction ;

[0150] If multiple elements are densely packed, and positional offset alone cannot avoid exceeding the limit (i.e., boundary exceedance or element overlap still exists after offset), then elements are sorted in descending order of importance weight, and elements with lower weights are scaled down proportionally, with a scaling factor of [missing value]. The initial value is 0.95, and it is reduced by 5% each time. The corrected size is:

[0151] ;

[0152] ;

[0153] Synchronous verification is required after scaling down. and Continue until all elements meet the boundary requirements and are not lower than the minimum touch size threshold.

[0154] Mouse operation mode adjustment: If the terminal interaction mode is mouse operation, adjust according to the spacing accuracy requirements. Adjust the initial position coordinates of the elements To control the spacing between adjacent elements Within a pixel range, ensure precise mouse positioning; simultaneously, according to a fine size coefficient. After reducing the base size, the adjusted size is:

[0155] ; ;

[0156] Obtain the adjusted position coordinates With adjusted size To accommodate more elements within a limited space;

[0157] Step S3-5: Layout overlap assessment and dynamic optimization:

[0158] Overlap Calculation: For all graphic elements after responsive adjustments, calculate the layout overlap pairwise. The calculation formula is: ,in, The layout overlap between two graphic elements, with a value of 0-1; The area of ​​the overlapping region between the two elements; Let A be the adjusted area of ​​element A. This is the adjusted area of ​​element B;

[0159] Overlap threshold determination: Preset overlap allowance threshold (The value is 0.1, meaning the overlapping area does not exceed 10% of the total area). If the two elements... If the layout is reasonable, then the layout is considered reasonable; if If so, the optimization process will be initiated;

[0160] Priority-based optimization: Prioritize preserving the position and size of high-priority elements while optimizing low-priority elements; first attempt to reduce the scaling ratio of low-priority elements. Each time the size is reduced by 5%, two conditions need to be checked simultaneously after reduction:

[0161] Overlap ;

[0162] If the terminal interaction mode is touch operation, the size of the scaled-down element must meet the following requirements. and ( (44×44 pixels);

[0163] If both conditions are met, the current scaling ratio will be retained, and the size after scaling will be: , ;

[0164] If the overlap requirement is met but the touch size requirement is not, the shrinking process stops, and the position of lower priority elements is adjusted by offsetting them along the overlap direction. The offset amount is 1.2 times the width or height of the overlap area, and the coordinates after the offset are: , ;

[0165] If overlap still exists after position adjustment, or if the scaling ratio has been reduced to the minimum threshold. If (value 0.5) and none of the conditions are met, the visibility of the low-priority element is set to "hidden", and the hidden state of the element is recorded to ensure that the high-priority element is displayed normally and the operation in touch mode is effective.

[0166] Step S3-6: Integration of adaptive layout schemes:

[0167] Final attribute determination of elements: For each graphic element, summarize the final position coordinates obtained through the above steps. ), final dimensions ( Final scaling (Determined by the ratio of the adjusted size to the reference size), final visibility ("show" or "hide");

[0168] Rendering order setting: The rendering order of graphic elements is determined according to the layout priority. High priority elements have the smallest rendering order number (rendered first, located in the upper layer), medium priority elements have the next smallest number, and low priority elements have the largest number (rendered last, located in the lower layer). If elements exist within the same priority, the rendering order is set according to the hierarchical order of the elements in the semantic structure tree of the screen, with the parent element rendering order taking precedence over the child element.

[0169] Structured output of the solution: The final attributes and rendering order of all graphic elements are organized according to a preset format to generate a structured adaptive layout solution containing element identifiers, final position coordinates, final size, final scaling ratio, final visibility, and rendering order. This solution can be directly output to the screen reconstruction and rendering unit for use.

[0170] In this embodiment, the preset function of the adaptive layout rules is to construct a standardized and dynamically adjustable rule system, providing a clear decision basis for adaptive layout calculation, and ensuring that the layout logic of graphic elements is consistent and accurately adapted in different terminal scenarios; the following are the details:

[0171] Element importance benchmark definition:

[0172] Historical data analysis: Based on predefined industrial configuration description specifications, historical industrial configuration screen data from the past 3 years are collected, covering typical industrial scenarios such as power monitoring, intelligent manufacturing, and chemical control. Common graphic element types with a frequency of ≥80% in the screen are extracted, such as real-time data monitoring panel, equipment status indicator light, emergency stop control button, parameter setting window, historical data query entry, system description text, etc.

[0173] Logical association analysis: For the extracted common graphic element types, the average number of data binding relationships and the average control dependency strength of each type of element are statistically analyzed; for example, the real-time data monitoring panel is bound to an average of 5 data sources with a control dependency strength of 0.9, the emergency stop control button is bound to an average of 2 data sources with a control dependency strength of 1.0, and the system description text is bound to an average of 0 data sources with a control dependency strength of 0.1.

[0174] Baseline weight assignment: Based on the business criticality of the element type, the number of data binding relationships, and the strength of control dependencies, an importance baseline weight is defined for each element type. Among them, element types with a large number of data binding relationships (≥3), high control dependency strength (≥0.8), or strong business criticality (directly affecting production safety or core processes) are assigned higher baseline weights, such as the real-time data monitoring panel baseline weight of 0.8 and the emergency stop control button baseline weight of 0.9. Element types with a small number of data binding relationships (≤1), low control dependency strength (≤0.3), and weak business criticality are assigned lower baseline weights, such as the system description text baseline weight of 0.2 and the historical data query entry baseline weight of 0.3.

[0175] Element importance is dynamically adjusted:

[0176] Historical terminal usage data collection: Collect user operation log data for different terminal types (industrial mobile terminals, fixed operation stations, handheld monitoring devices) over the past year, including the type of graphic elements corresponding to user interaction behaviors such as clicks, swipes, and long presses under each terminal type, as well as the response time and operation success rate (number of successfully completed operations / total number of operations).

[0177] Correlation analysis: Statistical analysis of collected log data is conducted to uncover the correlation patterns between interaction modes and element importance under different terminal types. For example, in industrial mobile terminals (touch operation mode), users perform more than 50 operations per day on interactive elements (such as control buttons and parameter adjustment sliders) with a success rate of ≥95%, while viewing non-interactive elements (such as status indicator lights) only 10 times per day. In fixed operation stations (mouse operation mode), users perform more than 30 operations per day on precise control elements (such as parameter fine-tuning knobs and multi-option menus) with a success rate of ≥98%, while the demand for large-size touch buttons is relatively low.

[0178] Weight Adjustment Table Generation: Based on the correlation analysis results, the baseline weights of element importance are dynamically adjusted to generate an element importance weight adjustment table. In touch operation mode, the weights of interactive elements are increased by 20%-30% based on the baseline weights. For example, the baseline weight of a control button is 0.6, and after adjustment, it becomes 0.72-0.78. In mouse operation mode, the weights of precise control elements are increased by 15%-25% based on the baseline weights. For example, the baseline weight of a parameter fine-tuning knob is 0.5, and after adjustment, it becomes 0.575-0.625. The adjustment table clearly records the final weight values ​​of each element type in different terminal interaction modes to ensure that the adjustment logic is traceable.

[0179] Preset layout priority strategy:

[0180] Region allocation rule formulation: Combining the element importance weight adjustment table and the screen physical size in the terminal context information, a layout priority allocation strategy is preset; the screen is divided into three layout regions: the center region, the edge region, and the corner region, with different priority elements corresponding to different regions; high priority elements (weight ≥ 0.7) are allocated to the center region of the screen, which has the best field of view and the most convenient operation; medium priority elements (0.4 ≤ weight < 0.7) are allocated to the edge region of the screen as a supplement to the core functions; low priority elements (weight < 0.4) are allocated to the corner region of the screen to avoid occupying the core field of view space;

[0181] Screen size adaptation adjustment: For different screen physical sizes, the area proportion and layout constraints are refined; when the screen physical size is ≤8 inches (small screen terminals, such as handheld monitoring devices), the central area accounts for 60% (horizontal pixels 25%-75%, vertical pixels 20%-80%), the edge area accounts for 30% (horizontal 0%-25%, 75%-100% and vertical 0%-20%, 80%-100%), and the corner area accounts for 10% (horizontal 0%-15%, 85%-100% and vertical 0%-15%, 80%-100%). The screen size is 5%-100% (5%-100%), and low-priority elements are only displayed when the screen is idle; when the screen size is 8 inches < physical size ≤ 19 inches (medium-sized terminals, such as industrial mobile terminals), the center area occupies 50%, the edge area occupies 35%, and the corner area occupies 15%, and low-priority elements are displayed by default but can be folded; when the screen size is > 19 inches (large-sized terminals, such as fixed operation stations), the center area occupies 40%, the edge area occupies 40%, and the corner area occupies 20%, and all low-priority elements are displayed and their positions can be customized.

[0182] Dynamic visibility condition setting: Set dynamic visibility conditions for low-priority elements. When screen space is insufficient (e.g., a mid-screen terminal loads ≥15 graphic elements simultaneously) or the user's operation is focused on high-priority elements (e.g., no low-priority elements are clicked for 5 consecutive minutes), the low-priority elements are automatically hidden, and the hidden state is indicated by an "expand" icon in the corner of the screen. When the user clicks the "expand" icon or screen space is freed up (e.g., some high-priority element windows are closed), the low-priority elements are redisplayed, ensuring the flexibility and simplicity of the screen layout.

[0183] Responsive adjustment parameter presets:

[0184] Interaction mode parameter definition: Based on the terminal type and interaction mode, a set of parameters for the preset responsive adjustment strategy is defined. In touch operation mode, key touch interaction parameters are set, including minimum touch size threshold, touch element spacing threshold, and touch feedback delay threshold. The minimum touch size threshold is set to 44×44 pixels to ensure accurate finger operation recognition; the touch element spacing threshold is set to 15 pixels to avoid accidental touches on adjacent elements; and the touch feedback delay threshold is set to 100 milliseconds to ensure timely operation response. In mouse operation mode, key mouse interaction parameters are set, including element spacing accuracy requirements, mouse hover tooltip delay, and mouse click area accuracy. The element spacing accuracy requirement is set to 5 pixels to adapt to the fine positioning of the mouse pointer; the mouse hover tooltip delay is set to 300 milliseconds to avoid frequent pop-up tooltips interfering with operation; and the mouse click area accuracy is set to 90% of the actual element size to ensure effective edge clicks.

[0185] Scaling adjustment factor calculation: Based on the terminal resolution and pixel density, a preset scaling adjustment factor is used; the baseline resolution is defined as 1920×1080 pixels and the baseline pixel density is 96 pixels per inch. The result is obtained through calculation using the formula:

[0186] ,in, Adjust the scaling factor; The base resolution is 1920×1080 pixels; The baseline pixel density is 96 pixels per inch. For the target terminal resolution; (Target terminal pixel density); when the target terminal resolution is higher than the reference resolution or pixel density is higher than the reference pixel density. <1, elements are scaled down by a coefficient; when the target terminal resolution is lower than the reference resolution or the pixel density is lower than the reference pixel density, >1, elements are enlarged by a coefficient to ensure consistent display clarity across different resolutions and pixel densities;

[0187] Adaptive rule base generation:

[0188] Rule Integration: Import the element importance weight adjustment table, layout priority allocation strategy, and responsive adjustment parameter set into the rule integration module, and classify and integrate them according to the hierarchical structure of "element type - terminal type - interaction mode - layout rule - adjustment parameter". For example, the real-time data monitoring panel under the industrial mobile terminal (touch operation mode) corresponds to the 0.96 weight value in the weight adjustment table, the center area allocation rule in the layout strategy, and the 44×44 pixel minimum touch size and 1.2 scaling factor in the responsive parameters to form a complete rule entry.

[0189] Logical Fusion and Consistency Verification: The rule engine performs logical fusion on the integrated rule entries, establishing association mappings between different rules, such as the mapping between element weights and layout areas, and the mapping between interaction modes and responsive parameters. At the same time, consistency verification is performed to check for rule conflicts, such as two different weight values ​​for the same element type in the same terminal mode, or the total layout area occupancy not equal to 100% under the same screen size. If a conflict is found, the conflict location is automatically marked and manual verification and correction are prompted until all rule logic is consistent.

[0190] Structured storage: The validated rule system is stored in JSON format to generate an adaptive layout rule library. Each rule in the rule library contains fields such as a unique identifier, applicable terminal type, applicable interaction mode, element importance weight, layout area allocation, and responsive adjustment parameters. It supports fast querying and calling by dimensions such as terminal type and element type, providing standardized data support for subsequent adaptive layout calculations.

[0191] In this embodiment, step S4 is to adjust the attributes, reconstruct the space, and optimize the rendering of the graphic elements of the original industrial configuration screen according to the adaptive layout scheme, so as to achieve accurate, clear, and important element-priority screen display on the target terminal screen. The detailed steps are as follows:

[0192] Step S4-1: Extracting attributes of adaptive layout scheme:

[0193] Solution analysis begins: The structured data interface of the adaptive layout solution is called to read all relevant information of graphic elements stored in the solution, ensuring that there is no loss or tampering in the data reading process, and guaranteeing the accuracy of the original data for subsequent operations;

[0194] Core Attribute Extraction: For each graphic element, five core attributes are extracted from the scheme; these are the final position coordinates, in the terminal screen pixel coordinate system (top left corner as origin, horizontal axis as X-axis, vertical axis as Y-axis). , Extracted in ( ) format; final size, in pixels. , Extraction in () format; final scaling ratio Extracted as a decimal; final visibility extracted as a "show" or "hide" status indicator; rendering order extracted as a positive integer (the smaller the value, the higher the rendering priority).

[0195] Attribute verification and checking: Compare each extracted element attribute with the original record in the adaptive layout scheme one by one to check whether the values ​​are consistent and whether the status indicators are correct; for example, verifying Is it within the X-axis pixel range of the terminal screen (0≤ (Screen horizontal resolution) Check if the value is positive to ensure that the extracted attribute data fully conforms to the scheme definition. If there is a deviation, re-extract until it is consistent.

[0196] Step S4-2: Filtering visible graphic elements:

[0197] The filtering rules are established: the final visibility attribute of the graphic element is used as the sole filtering criterion, and the filtering rule is to retain all graphic elements whose final visibility is marked as "shown" and exclude graphic elements whose final visibility is marked as "hidden".

[0198] Element filtering execution: Iterate through all the graphic element attribute sets extracted in step S4-1, and check the visibility status of each element one by one; for elements marked as "display", retrieve their corresponding element identifier, final position coordinates, etc. , ), final dimensions ( , Final scaling Attributes such as rendering order are included in the temporary filter list; elements marked as "hidden" are directly marked as "not participating in subsequent processing" and are not included in the list.

[0199] Filtering result verification: Count the number of elements in the temporary list after filtering and compare it with the total number of elements in the "display" state in the adaptive layout scheme; if the numbers match, the filtering result is confirmed to be valid, and the temporary list is officially named the visible graphic element list; if the numbers do not match, backtrack and check the filtering process to check for any omissions or misjudgments, correct them, and re-filter until the numbers match.

[0200] Step S4-3: Geometric transformation and scaling of graphic elements:

[0201] Geometric position calculation: Based on the target terminal's screen pixel coordinate system, calculate the final position coordinates of each element in the list of visible graphic elements. This is mapped to the actual physical location on the screen; the calculation process must ensure that the coordinates correspond accurately, for example... When the value is 500 pixels, it directly corresponds to the position of the 500th pixel horizontally from the origin on the screen. Similarly, ensure that the position of the elements on the screen is completely consistent with the layout scheme;

[0202] Size adjustment is performed according to the final size of each element. , Adjust the dimensions of the original graphic elements; maintain the aspect ratio of the elements to the original ratio during adjustment (unless the layout scheme has no specific ratio adjustment requirements). For example, if the original element's aspect ratio is 2:1, after adjustment... Pixels The pixels are kept in a 2:1 ratio to avoid element distortion that could affect the visual effect.

[0203] Scaling implementation: based on the final scaling ratio of each element. This performs a scaling operation on the resized graphic elements; the scaling formula is... ,in, This represents the actual display size of the element after scaling. The dimensions of the element after adjustment to the final size. The final scaling factor for the element; for example Pixels hour, Pixels ensure that the size of elements is adapted to the screen resolution and pixel density of the terminal, and that the display is clear and without blur.

[0204] Step S4-4: Building the Layered Rendering Structure

[0205] Rendering layer division: Based on the rendering order of each element in the visible graphic element list, corresponding rendering layers are divided; the rendering order value is set to be inversely proportional to the layer level, that is, the smaller the rendering order value, the higher the corresponding layer level (closer to the top of the screen); for example, the element with a rendering order of 1 is assigned to layer 1 (top layer), the element with a rendering order of 2 is assigned to layer 2 (below layer 1), and so on, until all visible elements are assigned to their corresponding layers;

[0206] Element layer assignment: Traverse the list of visible graphic elements and assign each element to the corresponding rendering layer one by one according to its rendering order; during the assignment process, record the number of elements and element identifiers contained in each layer to form a layer-element mapping table, which facilitates layer management and element positioning in the subsequent rendering process; for example, the first layer contains the "Emergency Stop Control Button" element with a rendering order of 1, and the second layer contains the "Real-time Data Monitoring Panel" element with a rendering order of 2.

[0207] Layer order verification: Check whether the order of all rendered layers is consistent with the rendering order logic, ensuring that the first layer is the top layer and the last layer is the bottom layer, and that there are no cases of layer order reversal; at the same time, verify that each element is assigned to only one layer, with no duplicate or unassigned elements, to ensure the integrity and correctness of the layered rendering structure.

[0208] Step S4-5: Layered rendering and terminal screen display:

[0209] Rendering order is determined by following the "from bottom to top" rendering order rule. That is, the lowest layer is rendered first, and after all elements in the lowest layer are rendered, the layers above it are rendered, until the top layer is rendered. For example, the last layer (such as the 5th layer) is rendered first, then the 4th, 3rd, and 2nd layers are rendered in sequence, and finally the 1st layer is rendered. This ensures that the upper layer elements can cover the lower layer elements (if there is an overlapping area), so that important elements are displayed first.

[0210] Layer rendering execution: For each graphic element in the layer, the terminal's graphics rendering interface is called to render it; during the rendering process, rendering performance is optimized, for example, batch rendering technology is used to process multiple elements in the same layer, reducing the number of rendering interface calls and avoiding screen display lag or delay; at the same time, it is ensured that the color, lines, text and other details of the elements are consistent with the design style of the original industrial configuration screen, with no color deviation or loss of details.

[0211] Screen Display and Effect Verification: After all layers have been rendered, the rendering result is output to the target terminal screen for display. After display, the effect verification process is initiated to check whether the element positions match the final position coordinates. Consistency, whether the element size matches the final size ( , Check whether important elements (high rendering order) are clearly displayed on the top layer, without overlap or abnormal occlusion (except for overlap allowed by the layout scheme); if display abnormalities are found, go back to step S4-3 or S4-4, adjust the element transformation parameters or layer assignment, and re-render until the display effect meets expectations.

[0212] An adaptive presentation system for industrial configuration screens for multiple terminals belongs to the field of graphical user interface generation and rendering technology. Its core objective is to solve the pain points of adapting industrial configuration screens to various types of terminals (industrial mobile terminals, fixed operation stations, and handheld monitoring devices) in industrial scenarios: avoiding screen distortion, element occlusion, or inconvenience caused by differences in terminal screen size, resolution, and interaction mode, and achieving full-process automation and high adaptability from original screen parsing to accurate terminal display.

[0213] The system adopts a modular design, comprising four core functional units, each with clearly defined responsibilities and a closed-loop data interaction mechanism. Specific details are as follows:

[0214] Image semantic parsing unit: Achieves "structured translation" of the original image.

[0215] This unit is the "data input and parsing core" of the system, responsible for converting unstructured raw industrial configuration screens (such as configuration software engineering files, vector graphics, or bitmaps) into machine-recognizable structured data. The specific process is as follows: First, based on predefined industrial configuration description specifications, the type, attribute parameters (color, size, data interface), and unique identifiers of all graphic elements (such as real-time data panels, control buttons, status indicators, and topology connections) in the screen are extracted. Then, the relationships between elements are analyzed in depth: including hierarchical structural relationships (such as panel nested indicator lights), topological connection relationships (such as the physical link between pipes and pumps), and logical relationships (such as data binding relationships and control dependencies). Finally, this information is integrated into a screen semantic structure tree (a tree-shaped data structure, where nodes correspond to elements and edges correspond to various relationships), providing a precise logical foundation for subsequent layout calculations.

[0216] Terminal context acquisition unit: Enables "precise perception" of terminal features.

[0217] This unit serves as the system's "terminal adaptation basis source," responsible for collecting and verifying the core characteristics of the target terminal to ensure that the layout scheme aligns with the terminal hardware and interaction habits. Specific operations include: identifying the terminal type (industrial mobile terminal / fixed operator station / handheld monitoring device) by parsing the terminal's user agent string (including device model and system version) or device fingerprint features; obtaining key screen parameters (physical size, resolution, pixel density) by calling the terminal system interface to form a set of basic screen parameters; determining the interaction mode by combining the terminal type and screen size (industrial mobile terminals / handheld monitoring devices use touch operation, fixed operator stations use mouse operation); and finally integrating this information into a terminal context information object and verifying the validity of the parameters (e.g., screen size within a reasonable range for industrial terminals, resolution and pixel density matching) to prevent invalid data from affecting the layout.

[0218] Adaptive layout calculation unit: enabling "intelligent decision-making" for layout schemes.

[0219] This unit is the "core decision-making hub" of the system, responsible for integrating image semantic data and terminal feature data to generate a layout scheme adapted to the target terminal. Key steps include: calculating the importance weight of each element based on preset adaptive layout rules (including element importance weight table, layout priority strategy, and responsive adjustment parameters) and the logical relationships between elements in the image semantic structure tree (number of data bindings, control dependency strength); allocating layout priority according to weight and terminal screen size (high-weight elements occupy the central area of ​​the screen first); adjusting the initial position and size of elements based on terminal resolution, pixel density, and interaction mode (e.g., elements in touch mode should not be smaller than the minimum touch size of 44×44 pixels); handling element overlap issues (shrinking or hiding low-priority elements); and finally integrating the final display attributes of all elements (position, size, scaling ratio, visibility, rendering order) to generate a structured adaptive layout scheme.

[0220] Image reconstruction and rendering unit: Achieving the "final output" of the adapted image:

[0221] This unit is the system's "execution and display interface," responsible for transforming the layout scheme into a displayable configuration screen on the terminal. The specific process is as follows: extract the final attributes of the elements from the layout scheme, and filter out elements in the "display" state; perform geometric processing on visible elements (mapping screen coordinates to their final position, adjusting their size to their final dimensions, and optimizing the display effect according to the scaling ratio); construct a layered rendering structure based on the rendering order (high-priority elements are located in the upper layer); call the terminal rendering interface in batch rendering in a "from bottom to top" order to ensure that important elements are displayed first; finally, verify the display effect (accurate element positions, compliant sizes, and no blurring or distortion). If any abnormalities are found, backtrack and adjust accordingly, ultimately presenting a clear, adapted industrial configuration screen that meets business priorities on the target terminal screen.

[0222] Overall system coordination logic:

[0223] The four main units collaborate in a closed loop in the order of "analysis → perception → decision → execution": the image semantic analysis unit and the terminal context acquisition unit synchronously collect and process data, and input the structured semantic tree and terminal information into the adaptive layout calculation unit; after the layout calculation unit generates the scheme, it is passed to the image reconstruction and rendering unit to complete the final display, ensuring that industrial terminals with different hardware characteristics and interaction modes can efficiently adapt to the configuration screen and meet the needs of industrial monitoring and operation.

[0224] Although embodiments of the invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.

Claims

1. A multi-terminal oriented industrial configuration picture adaptive presentation method, characterized in that: The method comprises the following steps: Step S1: picture semantic analysis: obtaining an original industrial configuration picture, parsing the picture based on a predefined industrial configuration description specification, identifying and extracting the element type, attribute parameter and element identifier of each graphical element in the picture, and analyzing the hierarchical structure relationship, topological connection relationship and logical association relationship between the graphical elements to generate a picture semantic structure tree; wherein the picture semantic structure tree is represented by a tree data structure, the nodes correspond to the graphical elements, and the edges represent the structure or logical relationship between the elements; the logical association relationship includes a data binding relationship and a control dependency relationship; Step S2: terminal context acquisition: acquiring terminal context information of a target terminal, wherein the terminal context information includes screen physical size, resolution, pixel density, interaction mode and terminal type, and the interaction mode includes touch operation or mouse operation; Step S3: adaptive layout calculation: based on the picture semantic structure tree and the terminal context information, dynamically calculating the optimal display attribute of each graphical element on the screen of the target terminal according to a preset adaptive layout rule to generate an adaptive layout scheme; the adaptive layout rule includes: element importance evaluation: evaluating the importance weight of each graphical element based on the logical association relationship and the element type in the picture semantic structure tree; layout priority allocation: allocating a layout priority according to the element importance weight and the screen physical size in the terminal context information; responsive adjustment strategy: adjusting the position coordinates, size, scaling ratio, visibility and rendering order of the elements according to the resolution, pixel density and interaction mode in the terminal context information; the optimal display attribute includes the position coordinates, size, scaling ratio, visibility and rendering order of the elements; Step S4: picture reconstruction and rendering: adjusting the attributes, reconstructing the layout and optimizing the rendering of the graphical elements of the original industrial configuration picture according to the adaptive layout scheme, and displaying on the screen of the target terminal; wherein the rendering optimization includes hierarchical rendering of the graphical elements according to the rendering order to display important elements first.

2. The multi-terminal oriented industrial configuration screen adaptive presentation method according to claim 1, characterized in that: The picture semantic analysis in step S1 specifically comprises: based on the predefined industrial configuration description specification, performing syntax analysis on the original industrial configuration picture to extract a list of graphical elements in the picture, wherein the list of graphical elements contains basic description information of all graphical elements; for each graphical element in the list of graphical elements, performing semantic recognition to identify the element type, attribute parameter and element identifier of each graphical element, and generating a graphical element attribute set; based on the element identifier in the graphical element attribute set, referring to the structure definition in the industrial configuration description specification, analyzing the hierarchical structure relationship between the graphical elements to construct a preliminary tree structure, wherein the preliminary tree structure represents the picture container by a root node and the nested graphical elements by child nodes; according to the logical rules in the industrial configuration description specification, performing relationship analysis on the graphical elements in the preliminary tree structure to identify the topological connection relationship and the logical association relationship between the graphical elements, including the data binding relationship and the control dependency relationship, and generating a relationship mapping table; The preliminary tree structure and the relational mapping table are integrated, the hierarchical relationship, the topological connection relationship and the logical association relationship are fused into the tree data structure through node association and edge addition, and a complete picture semantic structure tree is generated.

3. The multi-terminal oriented industrial configuration screen adaptive presentation method according to claim 1, characterized in that: The terminal context acquisition in the step S2 specifically includes: By analyzing the user agent string or the device fingerprint feature of the target terminal, the terminal type of the target terminal is identified, and the terminal type includes an industrial mobile terminal, a fixed operation station or a handheld monitoring device; Based on the identified terminal type, the system interface of the target terminal is called to obtain screen physical size, resolution and pixel density parameters to form a screen basic parameter set; According to the terminal type and the screen physical size in the screen basic parameter set, the interaction mode of the target terminal is determined, wherein the industrial mobile terminal and the handheld monitoring device are determined as a touch operation mode, and the fixed operation station is determined as a mouse operation mode; The terminal type, the screen basic parameter set and the interaction mode are structurally integrated to generate a terminal context information object containing complete terminal attribute description; The parameters in the terminal context information object are verified for validity, so that the screen physical size is within a preset reasonable range, the resolution and the pixel density are correctly matched, and the interaction mode is logically consistent with the terminal type.

4. The multi-terminal oriented industrial configuration screen adaptive presentation method according to claim 1, characterized in that: The adaptive layout calculation in the step S3 specifically includes: Based on the logical association relationship and the element type in the picture semantic structure tree, element importance evaluation is performed, and element importance weights of each graphic element are calculated according to the number of data binding relationships and the strength of control dependency of the graphic elements; According to the element importance weights and the screen physical size in the terminal context information, a layout priority is allocated to each graphic element, and a layout area allocation strategy of each graphic element on the screen is determined according to the layout priority; According to the layout area allocation strategy, the resolution and the pixel density in the terminal context information are combined to calculate initial position coordinates and reference sizes of each graphic element; Based on the interaction mode in the terminal context information, responsive adjustment is performed on the initial position coordinates and the reference sizes to generate adjusted graphic element position coordinates and graphic element sizes; According to the adjusted graphic element position coordinates and the graphic element sizes, the layout overlap degree between the graphic elements is evaluated, and the scaling ratio and the visibility of the graphic elements are dynamically optimized based on the layout priority; Finally, the final position coordinates, the final sizes, the final scaling ratio, the final visibility of all graphic elements and the rendering order determined by the layout priority are integrated to generate an adaptive layout scheme.

5. The multi-terminal oriented industrial configuration screen adaptive presentation method according to claim 1, characterized in that: The preset of the adaptive layout rule includes: Element importance benchmark definition: based on the industrial configuration description specification, common element types and logical association relationships in historical industrial configuration pictures are analyzed, and importance benchmark weights of the element types are defined, wherein element types with more data binding relationship numbers, higher control dependency relationship strengths or stronger business criticality are given higher importance benchmark weights; Element importance dynamic adjustment: according to historical terminal usage data, the correlation between user interaction mode and element importance under different terminal types is analyzed, the element importance benchmark weight is dynamically adjusted, and the element importance weight adjustment table is generated, wherein the weight of the interactive element under touch operation mode is improved, and the weight of the precise control element under mouse operation mode is enhanced; Layout priority strategy preset: based on the element importance weight adjustment table and the screen physical size in the terminal context information, the layout priority allocation strategy is preset, including the allocation rule of high priority elements in the screen center area, the layout constraint of medium priority elements in the edge area, and the dynamic visibility condition of low priority elements; Responsive adjustment parameter preset: according to the terminal type and the interaction mode, the parameter set of the responsive adjustment strategy is preset, including the minimum touch size threshold under touch operation mode, the element spacing precision requirement under mouse operation mode, and the scaling ratio adjustment coefficient based on resolution and pixel density; Adaptive rule library generation: integrate the element importance weight adjustment table, the layout priority allocation strategy and the responsive adjustment parameter set, perform logical fusion and consistency check through the rule engine, generate the structured storage adaptive layout rule library, and use it to guide the dynamic decision in the adaptive layout calculation process.

6. The multi-terminal oriented industrial configuration screen adaptive presentation method according to claim 1, characterized in that: The picture reconstruction and rendering in step S4 specifically includes: Based on the adaptive layout scheme, the final position coordinates, the final size, the final scaling ratio, the final visibility and the rendering order of each graphical element are extracted; According to the final visibility, the visible graphical elements are screened from all graphical elements to form a visible graphical element list; For each graphical element in the visible graphical element list, perform geometric position calculation and size adjustment according to the final position coordinates and the final size, and perform scaling processing according to the final scaling ratio to generate transformed graphical elements adapted to the terminal screen; Based on the rendering order, the transformed graphical elements are allocated to different rendering layers to construct a layered rendering structure, wherein the graphical elements with high rendering order are located in the upper layer; According to the layered rendering structure, the graphical elements in each layer are rendered in order from bottom to top, and displayed on the target terminal screen to realize the priority display of important elements.

7. A multi-terminal oriented industrial configuration picture adaptive presentation system for performing the method of any one of claims 1-6, characterized by: It includes: A picture semantic analysis unit is used to obtain an original industrial configuration picture, analyze the picture based on a predefined industrial configuration description specification, identify and extract the element type, attribute parameter and element identifier of each graphical element in the picture, and analyze the hierarchical structure relationship, topological connection relationship and logical association relationship between the graphical elements to generate a picture semantic structure tree; A terminal context acquisition unit is used to acquire the terminal context information of a target terminal, which includes screen physical size, resolution, pixel density, interaction mode and terminal type; An adaptive layout calculation unit is used to dynamically calculate the optimal display attribute of each graphical element on the target terminal screen based on the picture semantic structure tree and the terminal context information according to the preset adaptive layout rule, and generate an adaptive layout scheme. The picture reconstruction and rendering unit is configured to adjust attributes, reconstruct layout and optimize rendering of the graphic elements of the original industrial configuration picture according to the adaptive layout scheme, and display on a target terminal screen. The picture semantic structure tree generated by the picture semantic analysis unit is output to the adaptive layout calculation unit, the terminal context information acquired by the terminal context acquisition unit is output to the adaptive layout calculation unit, and the adaptive layout scheme generated by the adaptive layout calculation unit is output to the picture reconstruction and rendering unit.

Images