System and method for rendering divided blocks of industrial serial port screen to texture
By using partitioned block rendering to texture system, block design and dynamic data handling on industrial serial port screens, the problem of low frame data read-back efficiency caused by low-speed interfaces is solved, efficient rendering to texture effect is achieved, and the built-in memory is supported. Rendering to texture technology of industrial serial screens.
Patent Information
- Application Number
- CN202311752403.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-19
- Publication Date
- 2024-12-13
AI Technical Summary
The existing industrial serial port screens have low-speed interfaces because the display driver chip uses a low-speed interface, resulting in low frame data read-back efficiency, and cannot support render-to-texture technology in graphic rendering technology.
Using partitioned block rendering to texture system, including main control module, block color cache module and block data handling module, the frame data is cached and dynamically transferred to the display driver chip memory through block design, reducing the read-back process of rendered object data .
It improves the display efficiency of the system, supports rendering to texture technology, avoids the application of whole-frame storage space, and reduces the load on the main control chip.
Smart Images
Figure CN119127105A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field related to image processing, and in particular to a system and method for rendering partition blocks of an industrial serial port screen to a texture. Background Art
[0002] Industrial Serial Port Screen is a display screen used for industrial equipment control and monitoring. It is usually equipped with a serial port interface, which can communicate with other devices (such as PLC, industrial computer, sensor, etc.) through the serial port. The industrial serial port screen has high reliability and durability and can work normally in harsh industrial environments. It can display the operating status, parameter settings and other information of the equipment by displaying graphical interface, text, numbers, status indicator lights, etc., and can also receive instructions from other devices and respond. Industrial serial port screens are widely used in industrial automation, mechanical control, instrument monitoring and other fields.
[0003] Industrial serial port screens generally contain a display driver chip, which is used to display the images transmitted by the user on the display screen. Display driver chips can be divided into two categories according to the way they receive color data: 1. The user generates control signals and data signals according to the timing requirements specified by the driver chip, such as line synchronization, field synchronization, RGB color data, etc., and then the driver chip refreshes each pixel on the display screen in real time. 2. The display driver chip contains a memory (built-in memory), which stores a frame of data for display. The user transfers the image data to the memory of the driver chip through a low-speed interface, and the driver chip generates control signals and data signals to drive the screen display.
[0004] The first driving mode has the advantage of better real-time display, but the disadvantage is that it has high requirements on the timing of the driver module on the user side. The second driving mode has the advantage of low real-time requirements and more flexible data processing, but the disadvantage is that in order to save costs, the data handling efficiency of the low-speed interface is relatively low, so the reading and writing efficiency of frame data is very low.
[0005] Rendering to texture is a commonly used rendering method in current graphics processing units (GPUs). It means that after the data of the previous frame is written to the render target cache, the next frame uses the data of the render target cache as a texture for secondary rendering, thereby achieving a similar purpose of "incremental rendering". Figure 1 This method can reduce the rendering pressure of the GPU and ensure the reuse of some scenes.
[0006] However, for industrial serial port screen products with built-in memory, since the frame data is cached in the display driver chip of the serial port screen, the main control chip is often not equipped with memory, so the main control chip has no storage space for the rendering target, and the rendering target can only be stored in the memory of the serial port screen display driver chip. In the rendering process of the next frame, the color data of the rendering target needs to be read as a texture, which will cause the performance bottleneck to be stuck in the reading process of the color data of the rendering target.
[0007] In summary, based on the above problems, no effective solution has been found in the prior art.
[0008] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention
[0009] In view of the above-mentioned shortcomings and deficiencies of the prior art, the present application provides a partition block rendering to texture system and method for an industrial serial port screen to solve the problem that in existing industrial serial port screen products, the display driver chip often adopts a low-speed interface, resulting in very low efficiency in reading back frame data and unable to support the rendering to texture technology in graphics rendering technology.
[0010] This application mainly includes the following aspects:
[0011] In the first aspect, the present application provides a partition block rendering to texture system of an industrial serial port screen, including a main control module, a block color cache module, and a block data handling module, wherein:
[0012] The main control module is used to parse and render the user interface to generate frame data;
[0013] The block color buffer module is used to temporarily store the frame data generated by the main control module to generate buffer data; the buffer data is rendering object buffer data or frame buffer data;
[0014] The block data transfer module is used to transfer the frame buffer data to the memory of the screen display driver chip, so that the screen display driver chip reads the color data in the memory and displays it on the display screen.
[0015] In one embodiment of the present invention, a block layer blending module is further included for performing blending operations between a plurality of different rendering objects according to a received instruction.
[0016] In one embodiment of the present invention, the block layer blending module is further used to output the data of the rendering object to the main control module for rendering again.
[0017] In one embodiment of the present invention, the block color buffer module is further used for:
[0018] When the cache data is rendering object cache data, the rendering object cache data is not transferred to the memory of the screen display driver chip;
[0019] When the buffer data is frame buffer data, the frame buffer data is transferred to the memory of the screen display driving chip.
[0020] In one embodiment of the present invention, in the block color buffer module, the size of a single frame buffer data is 16x16x4 bytes, which is used to buffer color data with a resolution of 16x16; and the number of the frame buffer data is less than or equal to 4.
[0021] In one embodiment of the present invention, the block transfer module is further used to dynamically change the size and position of the transferred data according to the size of the frame buffer data.
[0022] In one embodiment of the present invention, the block transport module is also used to dynamically configure the clock frequency, interface type and color type of the output port to adapt to different screen display driver chips.
[0023] In the second aspect, the embodiment of the present application further provides a method for rendering a partition block of an industrial serial port screen to a texture, which is applied to the partition block rendering to a texture system of the industrial serial port screen in any one of the above embodiments, and the steps include:
[0024] Parse and render the user interface to generate frame data;
[0025] Temporarily storing the frame data to generate cache data; the cache data is rendering object cache data or frame cache data;
[0026] The frame buffer data is transferred to the memory of the screen display driver chip, so that the screen display driver chip reads the color data in the memory and displays it on the display screen.
[0027] In one embodiment of the present invention, it also includes:
[0028] A blending operation is performed between multiple different rendering objects according to the received instructions.
[0029] In one embodiment of the present invention, when the cache data is rendering object cache data, the rendering object cache data is not moved to the memory of the screen display driver chip; when the cache data is frame cache data, the frame cache data is moved to the memory of the screen display driver chip.
[0030] The above technical solution of the present application has the following advantages compared with the prior art:
[0031] The present application provides a partitioned block rendering to texture system and method for an industrial serial port screen. The rendering to texture technology of an industrial serial port screen with built-in memory supports block rendering to texture through a block design. Therefore, each rendering object does not need to apply for a whole frame of storage space, but only needs to apply for block storage space. Therefore, the rendering process does not need to read back the data of the rendering object from the memory of the screen display driver chip, thereby accelerating the display efficiency of the system. BRIEF DESCRIPTION OF THE DRAWINGS
[0032] In order to make the content of the present invention more clearly understood, the present invention is further described in detail below according to specific embodiments of the present invention in conjunction with the accompanying drawings, wherein:
[0033] Figure 1 A schematic diagram of the structure of a partition block rendering to a texture system of an industrial serial port screen provided in an embodiment of the present application is shown;
[0034] Figure 2 A flow chart of a method for implementing block rendering to texture for an industrial serial port screen with industrial built-in memory provided in an embodiment of the present application is shown;
[0035] Figure 3 A flowchart of a block rendering to texture technology for an industrial serial port screen with industrial built-in storage provided in an embodiment of the present application is shown. DETAILED DESCRIPTION
[0036] To make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. It should be understood that the drawings in the present application only serve the purpose of explanation and description and are not used to limit the scope of protection of the present application. In addition, it should be understood that the schematic drawings are not drawn in real proportion. The flowchart used in this application shows the operations implemented according to some embodiments of the present application. It should be understood that the operations of the flowchart can be implemented out of sequence, and the steps without logical context can be reversed in order or implemented simultaneously. In addition, those skilled in the art, under the guidance of the content of the present application, can add one or more other operations to the flowchart, or remove one or more operations from the flowchart.
[0037] In addition, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.
[0038] In order to enable those skilled in the art to use the contents of this application, the following implementation method is given in combination with the specific application scenario "Block rendering to texture technology of industrial serial port screen with built-in memory". For those skilled in the art, the general principles defined here can be applied to other embodiments and application scenarios without departing from the spirit and scope of this application.
[0039] The following method of the embodiment of the present application can be applied to any scenario that requires block rendering to texture technology of an industrial serial port screen with its own memory. The embodiment of the present application is not limited to the specific application scenario. Any solution using the block rendering to texture technology of an industrial serial port screen with its own memory provided by the embodiment of the present application is within the scope of protection of the present application.
[0040] To facilitate the understanding of the present application, the technical solution provided by the present application is described in detail below in conjunction with specific embodiments.
[0041] Among the products of industrial serial port screens, there is a type of product that uses a display screen driver chip with built-in memory, which is used to store frame data to be displayed. In this way, the main control system does not need to be equipped with a memory for storing frame data, thereby reducing costs. However, the display screen driver chip often uses a low-speed interface, resulting in very low efficiency in reading back frame data. This results in the application scenario being unable to support the "render to texture" technology commonly used in graphics rendering technology. The present application provides a partition block rendering to texture system and method for an industrial serial port screen, which can achieve a display effect rendered to texture.
[0042] See also Figure 1 , Figure 1 A schematic diagram of the structure of a partition block rendering to texture system of an industrial serial port screen provided in this application, the system includes a main control module, a block color cache module, and a block data handling module, wherein:
[0043] The main control module is used to parse and render the user interface to generate frame data.
[0044] Exemplarily, the main control module is a module that parses and renders the user interface, which can be a microprocessor or a graphics processor. The frame data generated during the rendering process will be temporarily stored in the block color cache.
[0045] The block color buffer module is used to temporarily store the frame data generated by the main control module to generate buffer data; the buffer data is rendering object buffer data or frame buffer data.
[0046] In some possible implementations, the block color cache module is further used to:
[0047] When the cache data is rendering object cache data, the rendering object cache data is not transferred to the memory of the screen display driver chip;
[0048] When the buffer data is frame buffer data, the frame buffer data is transferred to the memory of the screen display driving chip.
[0049] Exemplarily, the block color cache module is used to temporarily store the frame data generated by the graphics rendering module. The cache data can be used as rendering object cache data or frame cache data. When used for rendering object cache data, the cache data will not be written back to the display driver chip cache, and will only be moved when used as frame object cache data.
[0050] In some possible implementations, in the block color cache module, the size of a single frame cache data is 16x16x4 bytes, which is used to cache color data with a resolution of 16x16; and the number of the frame cache data is less than or equal to 4.
[0051] For example, a single cache size is generally 16x16x4 bytes, which is used to cache color data with a resolution of 16x16. In general, a system allows a maximum of 4 such caches to be applied for, so that the cache can be stored in the on-chip cache of the main control system.
[0052] The block data transfer module is used to transfer the frame buffer data to the memory of the screen display driver chip, so that the screen display driver chip reads the color data in the memory and displays it on the display screen.
[0053] In some possible implementations, the block transfer module is further configured to dynamically change the size and position of the transferred data according to the size of the frame buffer data.
[0054] In some possible implementations, the block transport module is also used to dynamically configure the clock frequency, the interface type and the color type of the output port to adapt to different screen display driver chips.
[0055] Exemplarily, the block transport module transports the data in the block used as the frame buffer to the corresponding position of the screen driver chip memory. The screen display driver chip reads the color data in the memory and displays it on the display screen. The module can dynamically change the size and location of the transported data according to the size of the frame buffer. In addition, the module also supports dynamic configuration of the clock frequency, the interface type and color type of the output port, so as to adapt to different screen display driver chips.
[0056] In some possible implementations, a block layer blending module is further included for performing blending operations between multiple different rendering objects according to received instructions.
[0057] In some possible implementations, the block layer blending module is further used to output the data of the rendering object to the main control module for rendering again.
[0058] Exemplarily, the block layer blending module can implement blending operations between multiple different rendering objects through hard instructions, or output the data of the rendering object to the main control module for the next rendering.
[0059] In a specific embodiment, Figure 2 As shown, a certain industrial serial port screen uses a display driver chip named "SitronixST7789V2" as the screen display driver chip. The resolution of the serial port screen is 240x320. In the implementation of this application, the block size is set to 16x16, so the overall block is divided into 16x20 blocks.
[0060] Implementation plan 1: The microprocessor (MCU) implements the processes of the main control module, the block layer mixing module, and the block data handling module through software code, and configures on-chip SRAM to implement the function of the block color cache module.
[0061] Implementation Plan 2: Self-developed graphics rendering IP core that supports block rendering to texture, block layer mixing IP core, and block data handling IP core, and integrated them with on-chip memory IP into an application-specific integrated circuit chip (ASIC) to realize the functions of each module of the system of this application.
[0062] Based on the same application concept, the embodiment of the present application also provides a partition block rendering to texture method of an industrial serial port screen corresponding to the partition block rendering to texture system of an industrial serial port screen provided in the above embodiment. Since the principle of solving the problem by the method in the embodiment of the present application is similar to the partition block rendering to texture system of the industrial serial port screen in the above embodiment of the present application, the implementation of the method can refer to the implementation of the system, and the repeated parts will not be repeated.
[0063] The present application also provides a method for rendering a partition block of an industrial serial port screen to a texture, which is applied to the system for rendering a partition block of an industrial serial port screen to a texture as described in any one of the above embodiments, and the steps include:
[0064] Step 1: Parse and render the user interface to generate frame data;
[0065] Step 2: temporarily storing the frame data to generate cache data; the cache data is rendering object cache data or frame cache data;
[0066] Step 3: The frame buffer data is transferred to the memory of the screen display driver chip, so that the screen display driver chip reads the color data in the memory and displays it on the display screen.
[0067] In some possible implementations, the following further includes:
[0068] Step 4: Perform a blending operation between multiple different rendering objects according to the received instructions.
[0069] In some possible implementations, when the cache data is rendering object cache data, the rendering object cache data is not moved to the memory of the screen display driver chip; when the cache data is frame cache data, the frame cache data is moved to the memory of the screen display driver chip.
[0070] For example, Figure 3 As shown, the screen is first divided into multiple 16x16 pixel blocks (TILE) according to the screen resolution, and the rendering to texture operation is performed separately in each pixel block until the final rendering target of this pixel block is frame data, and then the frame buffer data is moved to the memory of the screen driver chip.
[0071] The rendering process in each TILE is as follows: First, check whether the TILE needs to execute the rendering process of rendering to texture. If it needs to be executed, then apply for the storage space of the rendering object according to the number of rendering objects, and store the rendered color data in the rendering space of the rendering object. Then, if the storage object of the rendered color data is the frame buffer, apply for the TILE frame buffer space, and cache the rendering result in the storage space. Then, the block data transfer module transfers it to the memory of the display driver chip.
[0072] Each TILE executes the above rendering process until all TILEs are executed, and the rendering of one frame is completed.
[0073] Although GPUs on the market also support block rendering technology, all rendering processes must apply for storage space for rendering space in units of whole frames. Assuming that the resolution of the serial port screen is 240x320, a rendering process needs to apply for 4 rendering objects, and each pixel occupies 4 bytes of storage space. Then according to the rendering to texture process of the GPU on the market, the storage space required to apply is 240×320×(4+1)×4byte=1536000byte≈1.46MB, and the storage space required for this application is 32×32×(4+1)×4byte=20480byte=20KB. Therefore, this application does not require the main control chip to be equipped with additional memory, and only uses on-chip cache to enable industrial serial port screen products with built-in memory to support rendering to texture technology.
[0074] In summary, the partitioned block rendering to texture system and method provided by the present application is aimed at the block rendering to texture technology of the industrial serial port screen with built-in memory. By cutting the original rendering scene into multiple blocks, each block independently performs the frame rendering process of rendering to texture, thereby realizing the rendering to texture process without reading back the frame data using only a small amount of on-chip storage of the main control chip.
[0075] Those skilled in the art should understand that the embodiments of the present application can be provided as methods, system structures, and thus, the present application can be in the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware.
[0076] Obviously, the above embodiments are merely examples for clear explanation and are not intended to limit the implementation methods. For those skilled in the art, other different forms of changes or modifications can be made based on the above description. It is not necessary and impossible to list all the implementation methods here. The obvious changes or modifications derived from these are still within the protection scope of the invention.
Claims
1. A partition block rendering to texture system for an industrial serial port screen, characterized in that: It includes the main control module, the block color buffer module, and the block data handling module, among which: The main control module is used to parse and render the user interface to generate frame data; The block color buffer module is used to temporarily store the frame data generated by the main control module to generate buffer data; the buffer data is rendering object buffer data or frame buffer data; The block data transfer module is used to transfer the frame buffer data to the memory of the screen display driver chip, so that the screen display driver chip reads the color data in the memory and displays it on the display screen.
2. The partition block rendering to texture system of the industrial serial port screen according to claim 1 is characterized in that: It also includes a block layer blending module for performing blending operations between multiple different rendering objects according to received instructions.
3. The partition block rendering to texture system of the industrial serial port screen according to claim 2 is characterized in that: The block layer mixing module is also used to output the data of the rendering object to the main control module for rendering again.
4. The partition block rendering to texture system of the industrial serial port screen according to claim 1 is characterized in that: The block color buffer module is also used for: When the cache data is rendering object cache data, the rendering object cache data is not transferred to the memory of the screen display driver chip; When the buffer data is frame buffer data, the frame buffer data is transferred to the memory of the screen display driving chip.
5. The partition block rendering to texture system of the industrial serial port screen according to claim 1 is characterized in that: In the block color buffer module, the size of a single frame buffer data is 16x16x4 bytes, which is used to buffer color data with a resolution of 16x16; the number of the frame buffer data is less than or equal to 4.
6. The partition block rendering to texture system of the industrial serial port screen according to claim 1 is characterized in that: The block transfer module is also used to dynamically change the size and position of the transferred data according to the size of the frame buffer data.
7. The partition block rendering to texture system of the industrial serial port screen according to claim 1 is characterized in that: The block handling module is also used to dynamically configure the clock frequency, interface type and color type of the output port to adapt to different screen display driver chips.
8. A method for rendering partition blocks of an industrial serial port screen to texture, characterized in that: The partition block rendering to the texture system applied to the industrial serial port screen according to any one of claims 1 to 7 comprises the following steps: Parse and render the user interface to generate frame data; Temporarily storing the frame data to generate cache data; the cache data is rendering object cache data or frame cache data; The frame buffer data is transferred to the memory of the screen display driver chip, so that the screen display driver chip reads the color data in the memory and displays it on the display screen.
9. The method for rendering partition blocks of an industrial serial port screen to texture according to claim 8, characterized in that: Also includes: A blending operation is performed between multiple different rendering objects according to the received instructions.
10. The method for rendering partition blocks of an industrial serial port screen to texture according to claim 8, characterized in that: When the cache data is rendering object cache data, the rendering object cache data is not transferred to the memory of the screen display driver chip; when the cache data is frame cache data, the frame cache data is transferred to the memory of the screen display driver chip.