Method for processing image data between multiple peripheral display devices and system thereof

Abstract

This invention relates to the field of computer graphics and image processing, specifically to a method and system for image data processing between multiple peripheral display devices. The method includes: acquiring display configuration information and operating status information of the target display device; receiving content to be displayed and generating material feature records; performing coordinate mapping based on the display configuration information; generating parameterized layer descriptions and residual block data to characterize reconstruction errors; jointly optimizing the parameterized layer descriptions and residual block data based on perceptual distortion costs, bandwidth costs, and resource consumption costs, combined with operating status information, generating a transmission and refresh plan and sending it to the target display device, whereby the target display device synthesizes and renders the output image; and receiving the returned operating status information and updating the transmission and refresh plan. This invention achieves low-load transmission and stable refresh under bandwidth and computing power constraints, reducing cache congestion and frame drop probability.

Description

Technical Field

[0001] This invention relates to the field of computer graphics and image processing, specifically to a method and system for image data processing between multiple peripheral display devices. Background Technology

[0002] With the increasing prevalence of integrated display peripherals within computer cases, the small screen in the center of the cooling fan has gradually evolved from a static illuminated indicator to a customizable dynamic image carrier, used to display operating status, personalized themes, and interactive prompts (e.g., our prior patent application number: 202522536442.4). These display peripherals are typically limited by interface bandwidth, cache capacity, and edge computing power, and are more prone to refresh instability when multiple peripherals concurrently occupy the bus. Existing solutions mostly use whole-frame pixel transmission or simple scaling and cropping before distribution, lacking fine mapping of the effective display area, compressible representation of content structure, and closed-loop scheduling based on operating status. This results in high link load, easy cache congestion, frequent frame drops and screen tearing, making it difficult to balance image quality and continuity, and hindering the implementation of a large-scale customized content ecosystem. Summary of the Invention

[0003] This invention provides an image data processing method and system for multiple peripheral display devices, which is used to at least solve the problem of how to achieve low latency and low frame drop dynamic content refresh with controllable image quality under the conditions of limited bandwidth and computing power of peripheral display screens.

[0004] In a first aspect, the present invention provides an image data processing method among multiple peripheral display devices, the method comprising: Obtain the display configuration information and operating status information of the target display device. The display configuration information includes the effective display area or resolution, and the operating status information includes cache usage or frame drop count. Receive the content to be displayed and generate material feature records. Perform coordinate mapping based on display configuration information to generate parameterized layer descriptions and residual block data. The residual block data represents the reconstruction error. Based on the perceived distortion cost, bandwidth cost, and resource consumption cost, and combined with the running status information, the parameterized layer description and residual block data are jointly optimized to generate a transmission and refresh plan. According to the transmission and refresh plan, the parameterized layer description and residual block data are sent to the target display device, and the composite rendering output screen is generated on the target display device. Receive the operating status information returned by the target display device and update the transmission and refresh plan.

[0005] In one possible implementation, the display configuration information further includes at least one of pixel format or maximum stable refresh rate, wherein the pixel format is used to define the pixel output format of the composite rendering, and the maximum stable refresh rate is used to define the refresh rate in the transmission and refresh plan; the running status information further includes link throughput, which is used to determine bandwidth cost or to define the rate at which the transmission and refresh plan is sent.

[0006] In one possible implementation, the material feature record includes at least one of the following: content category, content resolution information or aspect ratio information, transparency information, and frame rate information or inter-frame duration information.

[0007] In one possible implementation, coordinate mapping includes: establishing a display coordinate system corresponding to the valid display area contained in the display configuration information; and mapping the content to be displayed to the display coordinate system to determine the position and size parameters in the parameterized layer description.

[0008] In one possible implementation, generating a parameterized layer description includes: representing the content to be displayed as multiple layers, the multiple layers including at least position parameters, size parameters, and layer order; performing layer compositing based on the multiple layers to generate reconstructed content; and performing parameter fitting on the multiple layers according to the differences between the content to be displayed and the reconstructed content to obtain a parameterized layer description.

[0009] In one possible implementation, generating residual block data includes: dividing the effective display area into multiple block areas in the display coordinate system; calculating the difference between the content to be displayed and the reconstructed content in each block area to obtain residual block data; and assigning a block index to the residual block data, the block index being used to indicate the block area corresponding to the residual block data.

[0010] In one possible implementation, joint optimization includes: constructing an objective function that includes perceptual distortion cost, bandwidth cost, and resource consumption cost; determining the weight parameters of the objective function based on the material feature record; and optimizing the objective function to generate a transmission and refresh plan, while satisfying the effective display area and display resolution constraints contained in the display configuration information and the cache usage and frame drop count constraints contained in the running status information.

[0011] In one possible implementation, the transmission and refresh plan includes an incremental delivery strategy, which includes: comparing the parameterized layer description and residual block data corresponding to the current refresh cycle determined by the transmission and refresh plan with the parameterized layer description and residual block data corresponding to the previous refresh cycle to determine the updated parameterized layer description and updated residual block data to be delivered; and executing the delivery based on the updated parameterized layer description and updated residual block data to be delivered.

[0012] In one possible implementation, updating the transmission and refresh plan includes: when the running status information indicates that the frame loss count exceeds a first preset threshold or the buffer usage exceeds a second preset threshold, adjusting at least one of the refresh frame rate or the residual block data quality level in the transmission and refresh plan, wherein the residual block data quality level is used to indicate at least one of the quantization accuracy or compression ratio of the residual block data.

[0013] In a second aspect, the present invention provides an image data processing system for multiple peripheral display devices, used to implement an image data processing method for multiple peripheral display devices, the system comprising: The configuration acquisition module is used to acquire the display configuration information and operating status information of the target display device. The display configuration information includes the effective display area or resolution, and the operating status information includes cache usage or frame drop count. The content modeling module is used to receive the content to be displayed and generate material feature records, perform coordinate mapping based on display configuration information, and generate parameterized layer descriptions and residual block data. The residual block data represents the reconstruction error. The plan execution module is used to jointly optimize the parameterized layer description and residual block data based on the perceived distortion cost, bandwidth cost, and resource consumption cost, combined with the running status information, to generate a transmission and refresh plan. According to the transmission and refresh plan, the parameterized layer description and residual block data are sent to the target display device, and the composite rendering output screen is generated on the target display device. The feedback update module is used to receive the operating status information returned by the target display device and update the transmission and refresh plan.

[0014] Compared with the prior art, the advantages and beneficial effects of the present invention are as follows: By employing coordinate mapping and layer parameterization techniques driven by display configuration information, precise adaptation to the effective display area of ​​peripherals is achieved, reducing redundant pixel transmission. Residual block data compensation techniques enable on-demand updates of detail differences under low bandwidth while maintaining image readability. Joint optimization techniques addressing perceived distortion costs, bandwidth costs, and resource consumption costs enable adaptive generation of transmission and refresh plans and suppress link congestion. Closed-loop feedback update techniques for operational status information enable real-time constraints on cache usage and frame loss risks, improving refresh stability. Attached Figure Description

[0015] Figure 1 This is a schematic diagram of the execution flow of the method of the present invention; Figure 2 This is a schematic diagram of the effective display area and layer residuals in a specific embodiment of the present invention; Figure 3 This is a statistical chart of the amount of data sent per refresh cycle in a specific embodiment of the present invention; Figure 4 This is a diagram showing the relationship between bandwidth requirements and image quality in a specific embodiment of the present invention; Figure 5 This is a diagram illustrating the impact of feedback updates on caching and frame dropping in a specific embodiment of the present invention; Figure 6 This is a structural block diagram of the system of the present invention. Detailed Implementation

[0016] The embodiments of the present disclosure will now be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the disclosure. In the following detailed description, numerous specific details are set forth to provide a thorough understanding of the embodiments of the present disclosure for ease of explanation. However, it will be apparent that one or more embodiments may be practiced without these specific details. Furthermore, descriptions of well-known structures and techniques are omitted in the following description to avoid unnecessarily obscuring the concepts of the present disclosure.

[0017] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit this disclosure. The terms “comprising,” “including,” etc., as used herein indicate the presence of the stated features, steps, operations, and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, or components.

[0018] All terms used herein (including technical and scientific terms) have the meanings commonly understood by those skilled in the art, unless otherwise defined. It should be noted that the terms used herein are to be interpreted in a manner consistent with the context of this specification, and not in an idealized or overly rigid way.

[0019] In a typical application, the main control device and multiple peripheral display devices are connected via the same data link. These peripheral display devices differ in physical size, effective display area, display resolution, pixel format, and stable refresh capability. Simultaneously, concurrent operation of multiple peripherals introduces bandwidth contention and timing jitter, causing significant heterogeneity and dynamism in the adaptation and refresh of the same content on different peripherals. Therefore, an image data processing mechanism for multi-peripheral collaboration is needed: on the one hand, it should be able to map content to its displayable effective area based on the peripheral's display configuration and generate a transmittable structured representation; on the other hand, it should be able to adaptively schedule transmission and refresh based on the peripheral's operating status, thereby achieving stable and controllable content delivery and end-side display output under multi-peripheral shared link conditions.

[0020] like Figure 1 As shown, an image data processing method among multiple peripheral display devices includes: Obtain the display configuration information and operating status information of the target display device. The display configuration information includes the effective display area or resolution, and the operating status information includes cache usage or frame drop count. In one embodiment, after establishing a control link with the target display device, the master control device obtains display configuration information and operating status information. The display configuration information can be reported by the target display device during the enumeration handshake phase, or read by the master control device through a query command. The display configuration information at least includes the effective display area or display resolution, used to define the available pixel range for subsequent coordinate mapping and layer composition. The operating status information can be periodically returned by the target display device, or obtained by the master control device through polling at the refresh cycle. The operating status information at least includes buffer usage or frame drop counts, used to characterize the display processing capability of the target display device under the current load, and serves as a constraint input for subsequently generating transmission and refresh plans.

[0021] The display configuration information further includes at least one of pixel format or maximum stable refresh rate, where pixel format is used to define the pixel output format of the composite rendering and maximum stable refresh rate is used to define the refresh rate in the transmission and refresh plan; the running status information further includes link throughput, which is used to determine bandwidth cost or to define the rate at which the transmission and refresh plan is sent.

[0022] In one embodiment, the display configuration information, in addition to the effective display area and display resolution, further includes at least one of pixel format or maximum stable refresh rate. The pixel format is used to define the pixel output format for composite rendering. When establishing a control link, the master control device reads the pixel format identifier of the target display device and maps this identifier to frame buffer write rules, including the number of bytes per pixel, channel order, and whether an alpha channel is included. When the pixel format does not include an alpha channel, subsequent layer compositing converts the transparency information into a pre-multiplied color or uses the background color for filling to ensure pixel consistency in the output image.

[0023] The maximum stable refresh frame rate is used to limit the refresh frame rate in the transmission and refresh plan. During the initialization phase, the main control device performs frame rate detection: it sets candidate refresh frame rates incrementally and maintains multiple refresh cycles at each candidate refresh frame rate, tracking the increment of the frame loss count and the fluctuation of buffer usage. When the frame loss count continues to increase within the statistical window or the buffer usage exceeds a preset upper limit, it is determined that the current candidate refresh frame rate cannot be stably maintained, and the previous stable candidate refresh frame rate is determined as the maximum stable refresh frame rate. In addition to buffer usage and frame loss count, the operating status information further includes link throughput, which is used to determine bandwidth costs or to limit the rate at which the transmission and refresh plan is deployed.

[0024] Link throughput can be obtained using end-to-end payload statistics: the master control device records the total number of bytes of parameterized layer description and residual block data sent in each refresh cycle, and records the corresponding acknowledgment reception time. Link throughput can be calculated as the ratio of payload bytes to acknowledgment latency over the refresh cycle, and smoothed using a sliding window or exponential weighted average to reduce the impact of occasional jitter on subsequent plans. When the master control device cannot obtain acknowledgments, link throughput can also be calculated from the actual number of bytes sent and the duration of occupancy provided by the communication driver. When link throughput is used to constrain the transmission rate, the master control device limits the amount of data planned to be sent in the current refresh cycle to the upper limit corresponding to link throughput multiplied by the refresh cycle duration, and prioritizes sending parameterized layer descriptions, delays sending residual block data, or reduces the quality level of residual block data when necessary, so that buffer usage remains within a controllable range and avoids the continuous increase of frame loss count.

[0025] Receive the content to be displayed and generate material feature records. Perform coordinate mapping based on display configuration information to generate parameterized layer descriptions and residual block data. The residual block data represents the reconstruction error. In one embodiment, after receiving the content to be displayed, the master control device generates a material feature record based on the display configuration information, and completes coordinate mapping with the effective display area as a constraint, converting the content to be displayed into display coordinate data adapted to the target display device. On this basis, the content to be displayed is decomposed into a multi-layer structure that can be parameterized, forming a parameterized layer description. At the same time, the difference between the reconstructed content obtained by synthesizing the parameterized layers and the content to be displayed is calculated to generate residual block data. The residual block data is used to characterize the reconstruction error and serve as the input for subsequent transmission and refresh scheduling.

[0026] The material feature record includes at least one of the following: content category, content resolution information or aspect ratio information, transparency information, and frame rate information or inter-frame duration information.

[0027] In one embodiment, the material feature record, compared to the method of only saving the original file header information, has an additional limitation: the material feature record is oriented towards the processing boundaries of subsequent decomposition, synthesis and distribution, and includes at least one of the following: content category, content resolution information or aspect ratio information, transparency information, and frame rate information or inter-frame duration information, so that different types of content have a consistent executable entry point in the same processing link.

[0028] Content category is used to distinguish between types such as static images, dynamic image sequences, video clips, vector graphics, and mixed text and graphics. The main control device can make a determination based on information such as file encapsulation format, media type identifier, presence of timestamp sequence, and whether it contains vector path instructions. When the content category is a dynamic image sequence or video clip, frame rate information or inter-frame duration information is used to determine the refresh rhythm and frame selection strategy. Frame rate information can come from the content encapsulation header or decoder output, and inter-frame duration information can come from timestamp difference. When the content category is a static image or vector graphics, the frame rate information can be set to a default value and the repeat display cycle is determined by the subsequent refresh plan.

[0029] Content resolution or aspect ratio information is used to define scaling and cropping boundaries. The master control device can obtain the pixel width and height of the source content during the decoding or parsing stage, or calculate the equivalent resolution of vector content based on viewport parameters. When only aspect ratio information is obtained, subsequent coordinate mapping prioritizes maintaining the aspect ratio to avoid geometric distortion caused by stretching. Transparency information is used to define the blending method for compositing rendering. Transparency information can come from the alpha channel, an independent transparency plane, or the fill transparency parameters of the vector object. When transparency information is not available, the master control device sets the transparency to opaque and writes it over the layer during the layer compositing stage. To improve feasibility, material feature records can be stored using structured fields, such as content category, source width, source height, aspect ratio, transparency presence flag, frame rate, inter-frame duration, and content duration. Field values ​​are entered into subsequent coordinate mapping and layer decomposition processes after generation, avoiding unclear boundaries caused by relying solely on external business logic inference.

[0030] Coordinate mapping includes: establishing a display coordinate system corresponding to the valid display area contained in the display configuration information; and mapping the content to be displayed to the display coordinate system to determine the position and size parameters in the parameterized layer description.

[0031] In one embodiment, coordinate mapping, compared to the method of directly scaling by resolution, adds the following limitation: first, a display coordinate system corresponding to the effective display area is established, and then the content to be displayed is mapped to the display coordinate system to determine the position parameters and size parameters in the parameterized layer description, thereby ensuring that the layer parameters correspond one-to-one with the pixel space of the target display device.

[0032] The display coordinate system can use two-dimensional pixel coordinates, and the range of values ​​for the horizontal and vertical coordinates is determined by the effective display area. When the effective display area is rectangular, the origin of the coordinates can be set at the upper left corner of the effective display area, with the horizontal coordinate increasing horizontally and the vertical coordinate increasing vertically. When the effective display area is not rectangular, the display configuration information can provide a region mask or outline description, and the display coordinate system is still expressed by the bounded rectangle pixel coordinates. During mapping and compositing, pixels outside the mask are clipped.

[0033] The mapping process includes at least scaling, translation, and optional cropping: The master control device calculates the scaling ratio based on the content resolution information or aspect ratio information. Common strategies include mailbox mode with equal scaling and margins and overlay mode with equal scaling and center cropping; translation is used to align the scaled content to a specified anchor point in the effective display area. The anchor point can be the center point or the upper left corner; cropping is used to truncate the part that exceeds the effective display area and retain only the pixels within the mask when a region mask exists.

[0034] To facilitate subsequent layer parameter calculation, the master control device outputs a unified mapping result description during the mapping stage. This description includes at least the scaling ratio, horizontal offset, vertical offset, cropping window, and region mask reference identifier. Subsequent determination of position and size parameters is based on this mapping result description, ensuring that the bounding box of each layer in the display coordinate system directly falls onto the pixel grid. For dynamic image sequences or video clips, coordinate mapping can apply the same mapping parameters to each frame. When there are inter-frame resolution changes or rotation metadata, the master control device first normalizes the frames to ensure consistent mapping parameters over time, preventing increased compositing errors caused by layer position fluctuations due to frame jitter.

[0035] The process of generating a parameterized layer description includes: representing the content to be displayed as multiple layers, each layer including at least position parameters, size parameters, and layer order; performing layer compositing based on the multiple layers to generate reconstructed content; and fitting the parameters of the multiple layers according to the differences between the content to be displayed and the reconstructed content to obtain a parameterized layer description.

[0036] In one embodiment, the generation of parameterized layer descriptions, compared to the method of only transmitting whole frame pixels, has an additional limitation: the content to be displayed is represented as multiple layers, each layer including at least position parameters, size parameters, and layer order, and reconstructed content is generated by layer synthesis. Then, the parameters of the layers are fitted based on the differences between the content to be displayed and the reconstructed content, thereby obtaining a set of reusable and incrementally updatable layer parameters.

[0037] Layers can be categorized into several types based on their expressive capabilities, such as solid color background layers, gradient layers, text layers, icon bitmap layers, shape layers, and mask layers. Each type of layer is described parametrically, with position and size parameters represented by pixel bounding boxes in the display coordinate system. The layer order is used to determine the composition sequence. The main control device prioritizes utilizing the structural information of the content: when the content to be displayed originates from vector format or layered material format, candidate layers and their initial parameters can be directly parsed; when the content to be displayed is a regular bitmap or video frame, candidate regions can be obtained through segmentation and clustering, such as extracting text candidate blocks based on connected components, obtaining large-area background candidate regions based on color clustering, and locating icon candidate regions based on edge and corner distribution, and mapping the candidate regions to layer bounding boxes.

[0038] Layer parameter fitting can adopt a coarse-to-fine process: first, generate an initial layer set from candidate regions and complete a layer synthesis to obtain the initial reconstructed content; then calculate the difference map between the initial reconstructed content and the content to be displayed, and expand or shrink the bounding box, correct the color and transparency parameters, and locally swap the layer order based on the difference map; for text layers, adjust the character spacing and font size according to the stable area of ​​the font edge, and for icon bitmap layers, adjust the scaling ratio according to the template matching results.

[0039] The fitting process can set an upper limit for the number of iterations and an error convergence condition. When the error decreases below a threshold or reaches the upper limit for the number of iterations, a parameterized layer description is output. To facilitate subsequent incremental distribution, the parameterized layer description can be stored in a list structure. Each layer records the layer identifier, layer type, position parameters, size parameters, layer order, color parameters, transparency parameters, and optional resource references. Resource references are used as cache keys to point to icon bitmaps or font resources, enabling the target display device to reproduce the composite result without repeatedly transmitting large resources. In this way, the reconstructed content is obtained by compositing multiple layers on the target display device, and data distribution can be transformed into updating layer parameters and supplementing a small number of resources.

[0040] Generating residual block data includes: dividing the effective display area into multiple block areas in the display coordinate system; calculating the difference between the content to be displayed and the reconstructed content in each block area to obtain residual block data; and assigning block indexes to the residual block data, which are used to indicate the block areas corresponding to the residual block data.

[0041] In one embodiment, the generation of residual block data, compared to the method of only saving global errors, has an additional limitation: the effective display area is divided into multiple block areas in the display coordinate system, the difference between the content to be displayed and the reconstructed content in each block area is calculated to obtain residual block data, and a block index is assigned to the residual block data so that the residual can be accurately located according to spatial location and support block distribution.

[0042] The segmented regions can be divided using a fixed-size grid, such as dividing by rows and columns in units of pixel blocks. When a region mask exists in the effective display area, the segmented regions are still established using an outer rectangular grid, and pixels outside the mask are ignored when calculating differences, thus ensuring the stability of the indexing system. Difference calculation can be completed in the pixel domain. The main control device traverses the pixels in each segmented region, calculates the channel difference between the pixels to be displayed and the reconstructed content pixels, and encodes the difference as a residual. When the pixel format does not contain an alpha channel, the difference is calculated only for the color channel. When the pixel format contains an alpha channel, the difference calculation is performed based on the visible result after compositing, avoiding inconsistencies in error measurement caused by changes in transparency.

[0043] Residual block data can adopt a structure of "block header information + intra-block residual sequence". The block header information includes at least the block index, the pixel range within the block, and the residual encoding method identifier. The block index is used to indicate the location of the block region corresponding to the residual block data, usually formed by a combination of row and column indices, or by using a linear index mapped to row and column coordinates. To reduce the overhead of distribution, the intra-block residual sequence can use a lightweight compression method, such as performing truncated quantization on the residual sequence and then performing run-length encoding or differential encoding. When the residual is small or the pixel differences within the block are sparse, sparse positions and corresponding residual values ​​can be recorded. If no position is recorded, the residual is assumed to be zero.

[0044] After generation, the main control device binds the residual block data and parameterized layer description to the output structure of the same refresh cycle. During subsequent incremental distribution, it can selectively distribute the residual blocks with larger errors based on the block index, while the blocks with smaller errors rely only on the layer synthesis results. This achieves controllable image reconstruction accuracy and transmission cost without changing the display coordinate system and layer structure.

[0045] Based on the perceived distortion cost, bandwidth cost, and resource consumption cost, and combined with the running status information, the parameterized layer description and residual block data are jointly optimized to generate a transmission and refresh plan. According to the transmission and refresh plan, the parameterized layer description and residual block data are sent to the target display device, and the composite rendering output screen is generated on the target display device. After obtaining the parameterized layer description and residual block data, the master control device comprehensively senses the distortion cost, bandwidth cost, and resource consumption cost, and generates a transmission and refresh plan based on the operating status information. The transmission and refresh plan includes at least the refresh cycle, the data set to be sent in each refresh cycle, and the sending order. The master control device sends the parameterized layer description and residual block data to the target display device according to the transmission and refresh plan. The target display device completes layer compositing based on the parameterized layer description and uses the residual block data to compensate for errors in the compositing result, finally outputting the display screen. During the rendering process, buffer usage and frame drop counts are continuously collected to drive the plan update for the next refresh cycle.

[0046] Joint optimization includes: constructing an objective function, which includes perceptual distortion cost, bandwidth cost, and resource consumption cost; determining the weight parameters of the objective function based on the material feature records; and optimizing the objective function to generate a transmission and refresh plan, while satisfying the effective display area and display resolution constraints contained in the display configuration information and the cache usage and frame drop count constraints contained in the running status information.

[0047] In one embodiment, the additional constraint of joint optimization is that the image reconstruction quality, link transmission overhead and end-side processing load are uniformly incorporated into the same solution framework, and the running status information is used as the solution constraint input, so that the transmission and refresh plan can be stably generated under different running loads.

[0048] Joint optimization first constructs an objective function, which includes the perceptual distortion cost, bandwidth cost, and resource consumption cost, and is used to measure the overall cost of the current refresh cycle. The objective function can be expressed as:

[0049] The objective function value; The cost of perceiving distortion; For bandwidth cost; This comes at the cost of resource consumption. Weighting parameters for the perceived cost of distortion; The weighting parameter represents the bandwidth cost; The weighting parameter represents the cost of resource consumption.

[0050] Perceptual distortion cost characterizes the visible difference between the composited rendering output and the content to be displayed. It is calculated based on the intra-block differences in the residual block data, combined with material feature records to weight the visibility of these differences: when the content category is text or contains high-contrast edges, the weight of blocks near the edges is increased; when the content is a static background or a low-texture area, the weight of the corresponding block is decreased; when transparency information exists and there are many layers stacked, the weight of the stacked area blocks is increased to suppress color shift introduced by transparency blending. Bandwidth cost characterizes the amount of data that needs to be sent in this refresh cycle. It can be obtained by summing the encoding length described by the parameterized layer and the encoding length of the residual block data. Furthermore, it can be combined with link throughput to calculate the "available bandwidth," avoiding the planned sending volume exceeding the link's carrying capacity.

[0051] Resource consumption cost is used to characterize the processing load of the target display device during the compositing rendering stage. It can be estimated based on the number of layers, the number of pixels covered by each layer, the number of residual blocks, and the number of pixels covered by each residual block. The more layers, the larger the coverage area, or the denser the residual blocks, the greater the resource consumption cost. The weight parameters are determined by the material feature records: when the content category is a dynamic image sequence or video clip and the frame rate information is high, the bandwidth cost weight and resource consumption cost weight are increased to limit the amount of data sent per cycle and avoid overloading the edge rendering; when the content category is mainly static images or text and transparency information is present, the perceptual distortion cost weight is increased to prioritize the reconstruction quality.

[0052] The optimization solution simultaneously satisfies the constraints corresponding to the display configuration information and the running status information: the display resolution and effective display area limit the legal range of layer parameters and block indices to avoid generating out-of-bounds parameters; cache usage and frame drop count are used to limit the planned refresh cycle and data volume limit. When the cache usage is close to the limit or the frame drop count continues to increase, the refresh frame rate is reduced, the number of residual blocks issued is reduced, or the data quality level of the residual blocks is reduced; when the cache usage is low and the frame drop count is stable, the refresh frame rate can be increased or more residual blocks can be added to reduce distortion.

[0053] To facilitate engineering implementation, the optimization solution can employ a heuristic search of candidate action sets: First, generate several combinations of candidate refresh frame rates and candidate residual block data quality levels. Then, under each combination, select the set of residual blocks to be distributed according to block priority. The block priority is jointly determined by the decrease in perceived distortion cost and the increase in bandwidth cost, until the constraints of link throughput, cache usage, and edge rendering load are met. Finally, select the candidate combination with the smallest objective function value as the transmission and refresh plan. Through this method, the generation of the transmission and refresh plan has clear inputs, executable solution steps, and verifiable constraint boundaries.

[0054] The transmission and refresh plan includes an incremental distribution strategy, which includes: comparing the parameterized layer description and residual block data corresponding to the current refresh cycle determined by the transmission and refresh plan with the parameterized layer description and residual block data corresponding to the previous refresh cycle to determine the updated parameterized layer description and updated residual block data to be distributed; and executing the distribution based on the updated parameterized layer description and updated residual block data to be distributed.

[0055] In one embodiment, the incremental delivery strategy has an additional limitation: maintaining the difference set between two consecutive plans on a refresh cycle basis, and only delivering the parameterized layer description and residual block data that have changed, thereby reducing link occupancy and reducing end-side parsing pressure while maintaining the stability of the coordinate system and layer structure.

[0056] Incremental deployment compares the "snapshot of the previous refresh cycle" and the "candidate output of the current refresh cycle": the snapshot of the previous refresh cycle contains the parameterized layer descriptions, residual block data, and their block index sets that were deployed and took effect in the previous cycle; the candidate output of the current refresh cycle contains the parameterized layer descriptions, residual block data, and their block index sets generated by the joint optimization in this cycle. Difference comparison is first performed on the parameterized layer descriptions: each layer is matched using its layer identifier as the key. If the layer identifier is newly added to the current set, the layer is added to the updated parameterized layer description; if the layer identifier exists in the previous set but is missing in the current set, a deletion instruction is generated and added to the updated parameterized layer description; if the layer identifier exists in both sets, the position parameters, size parameters, layer order, and transparency-related parameter fields are compared field by field. Any change in any field adds the layer's change record to the updated parameterized layer description.

[0057] To avoid duplicate distribution of large resources, icon bitmaps or font resources use resource references. Difference comparisons only trigger resource reissue when the resource reference key changes; otherwise, only parameter changes are distributed. The difference comparison then applies to residual block data: comparing the current and previous period's residual block sets using the block index as the key; updating residual block data when a block index is added or the residual block encoding content changes; generating a clear flag when a block index is missing allows the endpoint to revert to the layer composition result for the corresponding block.

[0058] The determination of changes in residual block encoded content can employ lightweight consistency checks. For example, a checksum can be generated and compared between the block header information and the residual sequence within the block. If the checksums are the same, no further transmission is required; otherwise, transmission is necessary, thus reducing invalid transmissions. Transmission is executed in a planned order: priority is given to updating the parameterized layer description, allowing the target display device to update its layer structure and parameters and form new reconstructed content; subsequently, residual block data is updated according to block priority, ensuring that blocks with larger errors are compensated first; when the running status information reflects increased buffer usage or a rise in frame drop counts, it is permissible to only update the parameterized layer description in this cycle and postpone some residual block data updates, or to perform sampled transmission of the updated residual block data, ensuring continuous output on the edge under controllable load.

[0059] To ensure the timing consistency of edge-side composite rendering, the data sent in each refresh cycle carries a refresh cycle identifier. Upon receiving the updated parameterized layer description corresponding to the same refresh cycle identifier, the edge can begin composite rendering and perform incremental compensation on the corresponding blocks when subsequently receiving updated residual block data. If some residual blocks fail to arrive within a cycle, the edge compensates with the currently arriving residual blocks, while the remaining blocks retain their layer composite results. The next cycle then completes the remaining blocks based on the updated residual block data. Through this incremental sending strategy, the transmission and refresh plan not only specifies "what to send and when to send," but also "how it will change relative to the previous cycle," thus keeping link overhead and edge-side processing load controllable during continuous refresh.

[0060] Receive the operating status information returned by the target display device and update the transmission and refresh plan.

[0061] In one embodiment, while performing composite rendering and data reception, the target display device sends back operation status information to the master control device according to a preset feedback cycle. The master control device receives the operation status information at the end of each refresh cycle and uses it as input for the next refresh cycle to update the transmission and refresh plan. The operation status information includes at least buffer usage or frame drop count. Buffer usage reflects the buffer pressure on the target display device during data reception, data parsing, and composite rendering. Frame drop count reflects the number of times composite rendering output was not completed on schedule within the refresh cycle. After receiving the operation status information, the master control device reconciles the execution results of the current cycle plan: comparing the planned output volume with the actual received volume of the target display device, comparing the planned refresh frame rate with the actual output rhythm of the target display device, and writing the changing trends of buffer usage and frame drop count into the status cache. Based on the trend information in the status cache, the master control device recalculates or fine-tunes the transmission and refresh plan for the next refresh cycle to ensure that the subsequent output volume and order are consistent with the end-side load constraints, and to avoid continuous increases in buffer usage or frame drop count over consecutive cycles.

[0062] The update transmission and refresh plan includes: when the running status information indicates that the frame loss count exceeds a first preset threshold or the buffer usage exceeds a second preset threshold, adjusting at least one of the refresh frame rate or residual block data quality level in the transmission and refresh plan, wherein the residual block data quality level is used to indicate at least one of the quantization accuracy or compression ratio of the residual block data.

[0063] In one embodiment, the new limiting point of the update transmission and refresh plan is: using verifiable indicators given by the running status information as trigger conditions, the refresh frame rate and residual block data quality level are used as adjustable control quantities, thereby forming an executable deload path and a recoverable path.

[0064] When the operation status information indicates that the frame loss count exceeds the first preset threshold or the buffer usage exceeds the second preset threshold, the main control device enters a constraint tightening mode, adjusting at least one of the refresh frame rate or residual block data quality level in the transmission and refresh plan. The first and second preset thresholds can be configured during the initialization phase and can be set to different values ​​depending on the displayed configuration information and the capabilities of the terminal side. To avoid frequent adjustments triggered by a single jitter, the main control device can adopt continuous triggering judgment, that is, adjustment is only performed when the threshold conditions are met for several consecutive refresh cycles, and adjustment is only lifted after the threshold recovers and stabilizes for several consecutive cycles.

[0065] Adjusting the refresh rate is used to directly reduce the frequency of edge-side composite rendering and link delivery. When reducing the refresh rate, the master control device simultaneously extends the refresh cycle duration and recalculates the upper limit of data allowed to be delivered per cycle, so that composite rendering can be completed within a longer cycle. When the frame drop count is mainly caused by rendering load, the refresh rate is reduced first. When the cache usage is mainly caused by link bursts, batch delivery is used first, combined with a slight reduction in the refresh rate.

[0066] The residual block data quality level is used to indicate at least one of the quantization precision or compression ratio of the residual block data. When adjusting the residual block data quality level, the master control device reduces the number of bytes of residual block data by reducing the quantization precision or increasing the compression ratio, thereby reducing bandwidth costs and end-side decoding overhead. When the running status information shows that the buffer usage is increasing but the frame loss count is not significantly increased, the residual block data quality level is reduced first to reduce the receiving buffer pressure. When the frame loss count increases and the buffer usage increases at the same time, the refresh frame rate and the residual block data quality level are adjusted in combination to enable the end side to maintain continuous output at a lower frequency and a lower residual data volume.

[0067] After the adjustment action is executed, the master control device writes the adjusted parameters into the transmission and refresh plan of the next refresh cycle, and performs closed-loop verification of the execution effect within the cycle: whether the increment of the frame loss count decreases, whether the cache usage drops or stabilizes; if it still exceeds the threshold, the plan is further tightened, including continuing to reduce the refresh frame rate, further reducing the residual block data quality level, or reducing the number of residual blocks issued and only retaining the highest priority block residuals.

[0068] Corresponding to the load reduction path, the main control device can also set a recovery path: when the operating status information indicates that the frame drop count is lower than the first preset threshold and the cache usage is lower than the second preset threshold for several consecutive cycles, the refresh frame rate is gradually increased or the residual block data quality level is gradually improved, so that the picture quality and response speed are gradually restored within the tolerable range. Through the above-mentioned closed-loop update method of triggering, adjusting and verifying, the transmission and refresh plan can be adaptively updated according to the real-time load changes of the target display device, and each adjustment has clear triggering conditions, clear control variables and verifiable result boundaries.

[0069] In one specific embodiment, taking a reproducible desktop multi-peripheral display scenario as an example: the main control device is a host computer, the target display device is a fan-shaped screen (peripheral display), the panel resolution is 240×240, the effective display area is a circular area (radius of approximately 118 pixels), the pixel output format is RGB565, and the maximum stable refresh rate is set to 30 frames per second. The target display device internally has a circular buffer for receiving refresh data and waiting for compositing and rendering. The operating status information includes the buffer occupancy percentage and the frame drop count; the link throughput is estimated as "the amount of data that can be stably transmitted per second (KB / s)" and fluctuates with bus contention.

[0070] like Figure 2 As shown, the main control device first performs coordinate mapping and layered modeling on the content to be displayed, and then splits the results into two types of loads: "parametric layer description + residual block data". The lower part of the figure shows the effective display area and display coordinate system. Layers A / B / C are represented by different textures to indicate differences in level and transparency. The residual block diagram on the right shows the correspondence between the residual block index and the block area. The blocks with diagonal textures represent the selected residual update areas. The key to this organization method is that stable elements are included in the parametric layer description as much as possible, and detailed differences and transient changes are filled in through residual blocks, thereby transforming "whole frame pixel transfer" into "structured description + local error repair".

[0071] The example content comes from a dynamic desktop component on the main control device: the bottom layer is a scaled dynamic background, overlaid with a semi-transparent icon and a line of scrolling text. Material feature records are generated upon receipt, including at least the content category (dynamic image + semi-transparent overlay), content resolution and aspect ratio, transparency marker, frame rate, and inter-frame duration. Subsequently, a display coordinate system is established according to the display configuration information, cropping the source content into a square window and mapping it to a circular effective display area; pixels exceeding the effective area are directly cropped in subsequent compositing stages and do not enter residual encoding. In the layering stage, the content is represented as multiple layers: the background layer covers the effective display area; the icon layer is positioned near (12,18) with a size of approximately 64×64; the text layer is positioned in the bottom strip area with a transparency parameter. The parameterized layer description uses a structure of "layer type + position parameter + size parameter + layer order + transparency + pixel format constraint," where the position and size are derived from the coordinate mapping result, and the layer order is determined by the combination relationship. To avoid overfitting in one go, parameter fitting uses two rounds of iteration: the first round fixes the hierarchy and only corrects the position and size to pixel alignment; the second round introduces transparency fine-tuning in the edge region to bring the edge jitter of the reconstructed content to an acceptable range.

[0072] Residual block generation is performed in the display coordinate system: the outer square of the effective display area is divided into 12×12 blocks, each 20×20 pixels; the difference between the content to be displayed and the reconstructed content is calculated for each block to obtain residual block data, and a block index is assigned to indicate the block position. Taking the 10th refresh cycle as an example, the parameterized layer description is about 1.41KB, the residual block data is about 17.09KB, and the total is about 18.50KB. If full frame delivery is used, the size of an RGB565 full frame is 240×240×2=115200 bytes, about 112.50KB; at 30 frames per second, full frame delivery requires 112.50×30=3375KB / s, while the corresponding data rate of this invention in this cycle is about 18.50×30=555KB / s. This difference mainly comes from the fact that the layer description compresses the static structure into parameters, and the residual only covers local difference blocks and is significantly reduced after quantization and compression.

[0073] The joint optimization phase unifies the perceived distortion cost, bandwidth cost, and resource consumption cost into a solvable objective and incorporates runtime state information into the constraints. The example uses the following form: in, For the cost of the plan; The cost of perceptual distortion (obtained by weighting the error in the edge region after residual block quantization); Bandwidth cost (characterized by the ratio of the amount of data sent in the current refresh cycle to the link throughput budget); The cost of resource consumption (estimated by a combination of the number of blocks, compression overhead, and cache occupation risk). To perceive distortion weights, For bandwidth weight, Resource consumption weights are determined by the material feature records: when the proportion of text and icons increases, the perceptual distortion weight is increased to prioritize edge readability; when the link throughput decreases or cache usage increases, the bandwidth weight and resource consumption weight are increased to avoid queuing and frame dropping.

[0074] like Figure 3 As shown, over 120 refresh cycles, the "parameterized layer description data volume" curve fluctuated slightly within the range of approximately 1KB, while the "residual block data volume" fluctuated significantly with content changes and bandwidth strategy adjustments. The "total data volume sent" remained between 5KB and 15KB in most cycles. Statistical results show an average data volume of approximately 9.99KB per cycle, with layer description averaging approximately 1.21KB and residual blocks averaging approximately 8.78KB; the 95th percentile total data volume is approximately 17.30KB. Converted to 30 frames per second, the average data rate is approximately 9.99 × 30 = 299.8KB / s, and the 95th percentile data rate is approximately 17.30 × 30 = 519.0KB / s. Sufficient margin can be maintained when the link throughput is at a normal level of approximately 900KB / s; when the throughput drops to around 300KB / s, the plan is to lower the residual block quality level and reduce the refresh rate to prioritize maintaining continuity.

[0075] like Figure 4 As shown, the horizontal axis represents instantaneous bandwidth demand, and the vertical axis represents the image reconstruction quality index. The point cloud distributed across the entire frame is concentrated in the high-bandwidth region, while the point cloud of this invention is distributed in the low-bandwidth region, and the quality index remains within the usable range, demonstrating the basic benefits of "structured transmission + local error repair". Taking the 48th refresh cycle as an example, the layer description is approximately 1.25KB, the residual block is approximately 9.27KB, totaling approximately 10.52KB. When the link throughput drops to approximately 276KB / s during this period, if 30 frames per second is maintained, the single-cycle budget is approximately 276 / 30 = 9.20KB. Budget penetration occurs in the current cycle, the cache usage increases synchronously, and an increase in the frame drop count is triggered. After feedback arrives, the plan is to reduce the refresh rate from 30 frames per second to 24 frames per second and lower the residual block quality level by one level, increasing the single-cycle budget to approximately 276 / 24 = 11.50KB. Subsequently, the cache usage gradually decreases over several cycles. The same mechanism also appeared around the 52nd and 71st cycles: a small increase in the number of dropped frames occurred under sudden load, but it quickly converged after the frame rate and residual quality were adjusted in conjunction.

[0076] like Figure 5As shown, the left axis compares cache usage, and the right axis compares cumulative frame drops. During full-frame delivery, due to the data rate consistently exceeding the available link throughput, cache usage remained close to its limit, resulting in significant frame drops. The average cache usage of this invention was approximately 52.10%, with a peak of approximately 66.58%, and a cumulative frame drop of 6 frames. In contrast, the average cache usage for full-frame delivery was approximately 91.29%, with a peak of 98%, and a cumulative frame drop of 197 frames. In terms of user experience, full-frame delivery exhibits noticeable stuttering and image jumps during periods of decreased throughput. This invention, within the same throughput range, primarily shows a slight decrease in image quality or softening of local details, but the image continuity is more stable, and text and icon outlines remain recognizable.

[0077] This embodiment also employs an incremental delivery strategy to reduce redundant transmissions: it compares the parameterized layer descriptions and residual block data for two consecutive refresh cycles. If only the text content changes, the layer description only delivers the text string and position / size fine-tuning parameters, and the residual block only covers the blocks near the text strip. If the background changes are more severe, the residual block coverage expands but is automatically limited by bandwidth and cache constraints. By displaying configuration information to constrain the refresh limit and using a closed-loop correction plan based on runtime status information, a stable balance is achieved between transmission and refresh in terms of "available throughput, cache pressure, and image quality target." This ensures that the continuity and controllable quality of peripheral display output are maintained even when multiple peripherals concurrently occupy link resources.

[0078] like Figure 6 As shown, an image data processing system for multiple peripheral display devices is used to implement an image data processing method for multiple peripheral display devices. The system includes: The configuration acquisition module is used to acquire the display configuration information and operating status information of the target display device. The display configuration information includes the effective display area or resolution, and the operating status information includes cache usage or frame drop count. The configuration acquisition module can be implemented in hardware by the main control processor and its peripheral interface circuits, and establishes a link with the target display device in conjunction with the bus controller and communication transceiver. By reading the device description information and status register of the target display device, it obtains display configuration information such as the effective display area and resolution, and obtains operating status information such as cache usage and frame drop count through the counter register or driver statistics interface.

[0079] The content modeling module receives the content to be displayed and generates material feature records. Based on the display configuration information, it performs coordinate mapping and generates parameterized layer descriptions and residual block data. The residual block data represents the reconstruction error. The content modeling module can be implemented by a main control processor in conjunction with a graphics acceleration unit or a media acceleration unit. If necessary, on-chip cache and high-speed memory can provide data throughput. This module receives the frame buffer or texture data of the content to be displayed, extracts features such as content category, resolution, transparency, and frame rate, and forms material feature records. At the same time, it completes coordinate mapping based on the display configuration information and outputs transmittable parameterized layer descriptions and residual block data. The residual block data can be generated by a block differential calculation unit and a quantization compression unit.

[0080] The planning and execution module is used to jointly optimize the parameterized layer description and residual block data based on the cost of perceived distortion, bandwidth, and resource consumption, combined with the running status information, to generate a transmission and refresh plan. Based on this plan, the module sends the parameterized layer description and residual block data to the target display device, and then composites and renders the output image on the target display device. On the hardware side, the optimization and scheduling logic of the planning and execution module can be executed by the main control processor, and the sending is completed collaboratively by the timer, DMA controller, and link transmission engine. This module calculates the costs of perceived distortion, bandwidth, and resource consumption, and performs joint optimization based on the running status information to generate a transmission and refresh plan. Subsequently, it triggers batch or incremental sending according to the plan, writing the parameterized layer description and residual block data into the transmission queue and transmitting it to the target display device via the link. On the target display device side, the display controller, compositing unit, and rendering engine complete the layer compositing rendering and output the image.

[0081] The feedback update module is used to receive the operating status information returned by the target display device and update the transmission and refresh plan. In terms of hardware, the feedback update module is implemented by the main control end communication transceiver, receive buffer and interrupt controller to receive the status feedback, and the processor completes the policy update. This module receives the operating status information returned by the target display device, analyzes indicators such as buffer usage and frame loss count, and adjusts the refresh frame rate, residual block quality level or distribution rate of the subsequent transmission and refresh plan accordingly to form a closed-loop control for link and end-side resources.

[0082] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects.

[0083] The above are merely embodiments of the present invention and are not intended to limit the invention. Various modifications and variations can be made to the present invention by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principle of the present invention should be included within the scope of the claims of the present invention.

Claims

1. A method for processing image data between multiple peripheral display devices, characterized in that, The method includes: Obtain the display configuration information and operating status information of the target display device. The display configuration information includes the effective display area or resolution, and the operating status information includes cache usage or frame drop count. Receive the content to be displayed and generate material feature records. Perform coordinate mapping based on the display configuration information to generate parameterized layer descriptions and residual block data. The residual block data represents the reconstruction error. Based on the perceived distortion cost, bandwidth cost, and resource consumption cost, and combined with the running status information, the parameterized layer description and the residual block data are jointly optimized to generate a transmission and refresh plan. According to the transmission and refresh plan, the parameterized layer description and the residual block data are sent to the target display device, and the rendered output screen is synthesized on the target display device. Receive the operating status information returned by the target display device and update the transmission and refresh plan.

2. The method according to claim 1, characterized in that, The display configuration information further includes at least one of pixel format or maximum stable refresh rate, wherein the pixel format is used to define the pixel output format of the composite rendering, and the maximum stable refresh rate is used to define the refresh rate in the transmission and refresh plan. The operational status information further includes link throughput, which is used to determine the bandwidth cost or to limit the issuance rate of the transmission and refresh plan.

3. The method according to claim 1, characterized in that, The material feature record includes at least one of the following: content category, content resolution information or aspect ratio information, transparency information, and frame rate information or inter-frame duration information.

4. The method according to claim 1, characterized in that, The coordinate mapping includes: Establish a display coordinate system corresponding to the effective display area contained in the display configuration information; The content to be displayed is mapped to the display coordinate system to determine the position and size parameters in the parameterized layer description.

5. The method according to claim 4, characterized in that, Generating the parameterized layer description includes: The content to be displayed is represented as multiple layers, and the multiple layers include at least the position parameter, the size parameter, and the layer order; Layer compositing is performed based on the multiple layers to generate reconstructed content, and the multiple layers are parameter-fitted according to the differences between the content to be displayed and the reconstructed content to obtain the parameterized layer description.

6. The method according to claim 5, characterized in that, Generating the residual block data includes: The effective display area is divided into multiple segmented regions in the display coordinate system. The difference between the content to be displayed and the reconstructed content in each segmented region is calculated to obtain the residual block data; A block index is assigned to the residual block data, and the block index is used to indicate the block region corresponding to the residual block data.

7. The method according to claim 1, characterized in that, The joint optimization includes: Construct an objective function, which includes the perceptual distortion cost, the bandwidth cost, and the resource consumption cost; The weight parameters of the objective function are determined based on the recorded material characteristics. Under the condition of satisfying the effective display area and display resolution constraints contained in the display configuration information, and in combination with the cache usage and frame drop count constraints contained in the running status information, the objective function is optimized and solved to generate the transmission and refresh plan.

8. The method according to claim 7, characterized in that, The transmission and refresh plan includes an incremental delivery strategy, which includes: The parameterized layer description and residual block data corresponding to the current refresh cycle determined by the transmission and refresh plan are compared with the parameterized layer description and residual block data corresponding to the previous refresh cycle to determine the updated parameterized layer description and updated residual block data to be sent. The update is executed based on the updated parameterized layer description and the updated residual block data to be issued.

9. The method according to claim 1, characterized in that, Updating the transmission and refresh plan includes: When the running status information indicates that the frame loss count exceeds a first preset threshold or the buffer usage exceeds a second preset threshold, at least one of the refresh frame rate or residual block data quality level in the transmission and refresh plan is adjusted. The residual block data quality level is used to indicate at least one of the quantization accuracy or compression ratio of the residual block data.

10. An image data processing system between multiple peripheral display devices, used to implement the image data processing method between multiple peripheral display devices according to any one of claims 1-9, characterized in that, The system includes: The configuration acquisition module is used to acquire the display configuration information and operating status information of the target display device. The display configuration information includes the effective display area or resolution, and the operating status information includes cache usage or frame drop count. The content modeling module is used to receive the content to be displayed and generate material feature records, perform coordinate mapping based on the display configuration information, and generate parameterized layer descriptions and residual block data, wherein the residual block data represents the reconstruction error; The plan execution module is used to jointly optimize the parameterized layer description and the residual block data based on the perceived distortion cost, bandwidth cost, and resource consumption cost, combined with the running status information, to generate a transmission and refresh plan, and to send the parameterized layer description and the residual block data to the target display device according to the transmission and refresh plan, and to synthesize and render the output screen on the target display device. The feedback update module is used to receive the operating status information returned by the target display device and update the transmission and refresh plan.

Images