Image display processing method and device and storage medium

Abstract

The embodiment of the invention provides an image display processing method and device and a storage medium, and belongs to the technical field of image processing. The method comprises the steps of determining row boundary coordinates of each row of pixels in each target rectangular image displayed in a preset canvas; according to the row boundary coordinates of the target rectangular images in the same row, target pixel segments formed by mutual segmentation of the target rectangular images are determined; generating an image request message according to each target pixel segment, and sending the image request message to a preset memory through a preset bus; receiving target image data of the memory in response to the image request message; and updating uncovered pixels in each target rectangular image in the canvas according to the target image data. The device and the storage medium can realize the method. The embodiment of the invention can give consideration to the image display effect while reducing the hardware resource consumption of the device and the bandwidth consumption of the hardware system of the device.

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to a method, device and storage medium for processing image display. Background Art

[0002] In the field of image display technology, in order to relieve the pressure on the central processing unit (CPU) of the device, a layer processor can be added as a hardware accelerator to process the image separately before displaying it. In the related art, since there are multiple images displayed in the same canvas, there is a possibility of overlapping each other. Therefore, in the related art, it is necessary to use multiple layer processors to extract each image from the memory respectively, and then process the image in the overlapping area through a layer aliasing algorithm to ensure that multiple images can be displayed in the same canvas in the case of overlap. However, although this technical solution can ensure the display effect of the canvas, it will lead to an increase in the consumption of hardware resources of the device and an increase in the bandwidth demand of the hardware system. At the same time, when at least one image displayed at the same time in the canvas corresponds to a frame in the video and the frames of the video are continuously changing for at least a period of time, this technical solution will also cause the consumption of the bandwidth of the device system, thereby increasing the consumption of hardware resources of the entire system. Therefore, how to reduce the consumption of hardware resources of the device and the bandwidth consumption of the hardware system while taking into account the effect of image display is a technical problem that needs to be solved urgently. Summary of the invention

[0003] The main purpose of the embodiments of the present application is to provide an image display processing method, device and storage medium, which can reduce the consumption of device hardware resources and the bandwidth consumption of the device hardware system while taking into account the effect of image display.

[0004] To achieve the above-mentioned purpose, a first aspect of an embodiment of the present application proposes a method for processing image display, which is applied to a layer processor; the method comprises: In response to an image position adjustment request triggered by a position change of at least one target rectangular image in a preset canvas, determining the row boundary coordinates of each row of pixels in a plurality of target rectangular images displayed in the canvas; at least two of the plurality of target rectangular images at least partially overlap; Determine, according to the row boundary coordinates of each of the target rectangular images located in the same row, a target pixel segment formed by dividing each of the target rectangular images; wherein the target pixel segment is a pixel segment formed by non-overlapping pixels in each of the target rectangular images; In response to the image update request of the canvas, generating an image request message according to each of the target pixel segments, and sending the image request message to a preset memory through a preset bus; receiving target image data from the memory in response to the image request message; The uncovered pixels in each target rectangular image in the canvas are updated according to the target image data.

[0005] To achieve the above object, a second aspect of an embodiment of the present application provides a terminal device, wherein the terminal device includes: A layer processor, wherein the layer processor executes any method of the first aspect; A memory, wherein the memory is connected to the layer processor via a preset bus communication.

[0006] To achieve the above-mentioned purpose, the third aspect of an embodiment of the present application proposes an electronic device, which includes a memory and a processor, the memory stores a computer program, and the processor implements the image display processing method described in any one of the first aspects when executing the computer program.

[0007] To achieve the above-mentioned purpose, the fourth aspect of the embodiments of the present application proposes a computer-readable storage medium, wherein the storage medium stores a computer program, and when the computer program is executed by a processor, the method described in any one of the first aspects is implemented.

[0008] The image display processing method, device and storage medium proposed in the present application can determine the row boundary coordinates of each target rectangular image in each row of the canvas, thereby determining the pixel segment information of each row of the canvas divided by the boundary of each target rectangular image in the column direction of the canvas, so that the target pixel segment can be determined based on each pixel segment information. At this time, each target pixel segment corresponds to a pixel on a target rectangular image of a layer. Therefore, when an image request message is generated based on the target pixel segment, the amount of data transmitted by the memory can be reduced. At the same time, there is no need to consider the processing in the overlapping situation when the canvas is updated. Therefore, compared with the related technology, the embodiment of the present application can reduce the consumption of device hardware resources and the bandwidth consumption of the device hardware system while taking into account the effect of image display. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 is a schematic diagram of the structure of an embodiment of a terminal device provided in an embodiment of the present application; Figure 2 It is a module diagram of a partial structure of an embodiment of a terminal device provided in an embodiment of the present application; Figure 3 It is a flowchart of an image display processing method provided in an embodiment of the present application; Figure 4 It is a schematic diagram of canvas display of an embodiment of the image display processing method provided in the embodiment of the present application; Figure 5This is a schematic diagram of pixel segment information storage in one embodiment of the image display processing method provided in the embodiment of the present application; Figure 6 is a schematic diagram of a target pixel segment determination process in an embodiment of the image display processing method provided in an embodiment of the present application; Figure 7 This is a schematic diagram of sending an image request message in an embodiment of the image display processing method provided in an embodiment of the present application; Figure 8 It is a structural diagram of the hardware structure corresponding to the image display processing method provided in the embodiment of the present application. DETAILED DESCRIPTION

[0010] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0011] It should be noted that, although the functional modules are divided in the device schematic diagram and the logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than the module division in the device or the order in the flowchart. The terms "first", "second", etc. in the specification, claims and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0012] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0013] In the field of image display technology, in order to relieve the pressure on the central processing unit (CPU) of the device, a layer processor can be added as a hardware accelerator to process the image separately and then display it. In the related art, since there are multiple images displayed in the same canvas, there is a possibility of overlapping each other. Therefore, in the related art, it is necessary to use multiple layer processors to extract each image from the memory respectively, and then use the layer aliasing algorithm to cover the image in the overlapping area to ensure that multiple images can be displayed in the same canvas in the case of overlap. However, although this technical solution can ensure the display effect of the canvas, it will lead to an increase in the consumption of hardware resources of the device and an increase in the bandwidth demand of the hardware system. At the same time, when displaying a video in the canvas, it is necessary to update the displayed image in the canvas according to the content of the video frame, especially when the image of each frame in the video is changing, it is necessary to update the image of each frame in the canvas. At this time, this technical solution will also cause the consumption of the bandwidth of the device system, which will lead to an increase in the consumption of hardware resources of the entire system. Therefore, how to reduce the consumption of hardware resources of the device and the bandwidth consumption of the hardware system while taking into account the effect of image display is a technical problem that needs to be solved urgently. Based on this, the embodiments of the present application propose an image display processing method, device and storage medium, which can reduce the hardware resource consumption of the device and the bandwidth consumption of the hardware system while taking into account the effect of image display.

[0014] The image display processing method, device and storage medium provided in the embodiments of the present application are specifically described through the following embodiments. First, the image display processing method in the embodiments of the present application is described.

[0015] The processing method of the image display of the present application can be used in many general or special computer system environments or configurations. For example: personal computers, server computers, handheld devices or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronic devices, network PCs, minicomputers, mainframe computers, hardware accelerators in distributed computing environments including any of the above systems or devices, etc. The present application can be described in the general context of computer executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application can also be practiced in distributed computing environments, in which tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media including storage devices.

[0016] Refer to the following Figure 1 As shown, according to the terminal device provided in the embodiment of the present application, the terminal device includes: Layer Processor; The memory is connected to the layer processor through a preset bus communication; Among them, the layer processor is used to respond to an image position adjustment request triggered by a position change of at least one target rectangular image in a preset canvas, determine the row boundary coordinates of each row of pixels in multiple target rectangular images displayed in the canvas; determine the target pixel segments formed by the mutual division of each target rectangular image according to the row boundary coordinates of each target rectangular image located in the same row; respond to the image update request of the canvas, generate an image request message according to each target pixel segment and send the image request message to a preset memory through a preset bus; receive the target image data of the memory in response to the image request message; and update the uncovered pixels in each target rectangular image in the canvas according to the target image data.

[0017] It is understandable that the embodiments of the present application do not limit the relationship between the layer processor and the terminal device. In some embodiments, the layer processor can be pluggable and set in the terminal device and perform image processing as a hardware accelerator of the terminal device. In other embodiments, the layer processor is integrated in the terminal device and performs image processing as a hardware accelerator of the terminal device.

[0018] It is understandable that the canvas is used to provide a visual interface to display the target rectangular image. Each target rectangular image corresponds to a rectangular display area in the canvas. The target rectangular image indicates that the original outline of the image in the canvas is a rectangle. In some embodiments, a border can be superimposed on each target rectangular image, and this is not limited in the embodiments of the present application.

[0019] It is understandable that the embodiment of the present application does not limit the number of target rectangular images displayed in the same canvas, and those skilled in the art can selectively set it according to actual needs.

[0020] The target rectangular image can be a frame image in the corresponding video or an independent image. Multiple target rectangular images in the same canvas can be partially independent images, partially frame images in the video, or all frame images in the video. In this regard, the embodiments of the present application do not impose any restrictions on the type composition of the target rectangular images in the same canvas.

[0021] The target pixel segment is a pixel segment formed by non-overlapping pixels in each target rectangular image.

[0022] The embodiment of the present application does not limit the type of bus, and those skilled in the art can selectively set the type of bus according to actual needs.

[0023] For example, Figure 1As shown, the CPU of the terminal device is connected to the memory, and the memory of the terminal device is connected to the layer processor. At this time, the CPU can process operations other than image display, and the layer processor is used to process operations related to image display, thereby reducing the pressure on the CPU.

[0024] For example, refer to Figure 2 As shown, the memory stores data of multiple target rectangular images to be displayed; the layer processor includes a processing module and a DMA; the processing module includes a first scanning module, a second scanning module, a valid segment processing module, a data preprocessing module, a valid segment storage module and a data pool; wherein the functions of each module are as follows: DMA receives the request from the valid segment processing module, converts it into an image request message in AXI format and sends the data request to the memory; and sends the data returned by the memory back to the data pre-processing module; The first scanning module scans the overlapping form of each row of images (reflected by the attribution and length information of each pixel segment) according to the coordinates of multiple target rectangular images in the target area; The valid segment processing module sequentially scans the information of all valid pixel segments after each target rectangular image is segmented in each row of the canvas to send a corresponding request, and saves the information of the uncovered pixel segments to the valid segment storage module; The data preprocessing module deletes invalid data from the requested data and extracts valid data based on the information of the pixel segments read from the valid segment storage module. (AXI requests have data alignment requirements, for example, a 64-bit bus is aligned to 8 bytes, so invalid data may be retrieved); The data pool is used to store valid data (that is, pixels that are not covered).

[0025] The second scanning module scans the coordinates of the target rectangular image in a preset scanning direction (such as from left to right, from top to bottom), and instructs the filling module to extract data from the data pool; The filling module is used to fill the invalid position corresponding to the target rectangular image with background data according to the instruction of the second scanning module, and fill the valid area with data from the data pool.

[0026] Reference Figure 3 As shown, the image display processing method provided in the embodiment of the present application is applied to a layer processor; the method includes: Step S100, in response to an image position adjustment request triggered by a position change of at least one target rectangular image in a preset canvas, determining the row boundary coordinates of each row of pixels in a plurality of target rectangular images displayed in the canvas; Step S200, determining a target pixel segment formed by dividing each target rectangular image according to the row boundary coordinates of each target rectangular image located in the same row; wherein the target pixel segment is a pixel segment formed by non-overlapping pixels in each target rectangular image; Step S300, in response to an image update request of the canvas, generating an image request message according to each target pixel segment, and sending the image request message to a preset memory through a preset bus; Step S400, receiving target image data of a memory in response to an image request message; Step S500: Update uncovered pixels in each target rectangular image in the canvas according to the target image data.

[0027] Therefore, by determining the row boundary coordinates of each target rectangular image in each row of the canvas, the pixel segment information of each row of the canvas divided by the boundary of each target rectangular image in the column direction of the canvas can be determined, so that the target pixel segment can be determined based on each pixel segment information. At this time, each target pixel segment corresponds to a pixel on a target rectangular image of a layer. Therefore, when an image request message is generated based on the target pixel segment, the amount of data transmitted by the memory can be reduced, and there is no need to consider the processing of overlapping situations when the canvas is updated. Therefore, compared with the related art, the embodiment of the present application can reduce the consumption of device hardware resources and the bandwidth consumption of the hardware system while taking into account the effect of image display.

[0028] The present application does not limit how to determine the row boundary coordinates of each target rectangular image. For example, when adjusting the position of the target rectangular image, at least one coordinate can be captured in the canvas, and the size of each target rectangle is unchanged. Therefore, the row boundary coordinates of each target rectangular image can be determined based on the size of the target rectangular image. In other embodiments, the row boundary coordinates can also be determined by scanning the canvas.

[0029] It is understandable that when the position of the target rectangular image in the canvas changes, steps S100 to S200 will be triggered to recalculate the target pixel segment. At this time, before the next triggering of the position change of the target rectangular image, the target image data can be continuously requested based on the calculated target pixel segment to update the canvas. The embodiment of the present application does not limit the direction of the rows in the target rectangular image. For example, the horizontal direction of the canvas can be used as the row and the vertical direction of the canvas can be used as the column, or the horizontal direction of the canvas can be used as the column and the vertical direction of the canvas can be used as the row. The starting point coordinates and the ending point coordinates of each row of pixels in each target rectangular image are both row boundary coordinates.

[0030] The target pixel segments are non-overlapping pixel segments and can be determined based on the image attribution relationship of the pixel segments sequentially formed by the row boundary coordinates and the layer position information of each target rectangular image, or based on the size relationship between the row boundary coordinates.

[0031] The image update request is used to update the displayed image data in the canvas and can be triggered periodically.

[0032] For example, refer to Figure 4 As shown in FIG. 1 , assume that there are five target rectangular images displayed in the canvas, namely PIC0 to PIC4. Among them, along the depth direction of the canvas, the images displayed in sequence from the outermost layer of the canvas are PIC4, PIC3, PIC2, ​​PIC1 and PIC0. Taking the horizontal arrangement of pixels in the canvas as an example, refer to Figure 4 As shown, in the row where the dotted line of the canvas is located, a total of 10 row boundary coordinates can be determined. Among them, the 10 row boundary coordinates can determine a total of 9 non-overlapping target pixel segments (it can be understood that due to different overlapping relationships, the number of row boundary coordinates and the number of target pixel segments will change, Figure 4 This is just one example). For example, the target pixel segment includes a pixel segment formed from the coordinates at the starting point of PIC0 to the coordinates at the starting point of PIC1, a pixel segment formed from the coordinates at the starting point of PIC1 and the coordinates at the starting point of PIC2, ​​a pixel segment formed from the coordinates at the starting point of PIC2 and the coordinates at the starting point of PIC3, and a pixel segment formed from the coordinates at the starting point of PIC3 and the coordinates at the starting point of PIC4.

[0033] It can be understood that step S200, determining the target pixel segments formed by dividing the target rectangular images according to the row boundary coordinates of the target rectangular images located in the same row, includes: Sort the boundary coordinates of each row in the same row of the canvas by coordinate size; Combine the coordinates of two adjacent row boundaries that are in the same row and are in good order, and determine a plurality of pixel segments in the same row and candidate belonging images corresponding to each pixel segment; Merge two pixel segments that are located in the same row and belong to the same candidate belonging image to obtain a target pixel segment of the candidate belonging image; The unmerged pixel segments are taken as the target pixel segments of the corresponding candidate belonging images.

[0034] The candidate belonging image is the target rectangular image displayed on the outermost layer of the corresponding pixel segment. For example, the target pixel segment Seg2 belongs to PIC0 and PIC1, but PIC1 is above PIC0, so the candidate belonging image of Seg2 is PIC1.

[0035] For example, refer to Figure 6 As shown in FIG. 1 , take the case where there are five target rectangular images displayed in the canvas as an example, and the five target rectangular images are PIC0 to PIC4 respectively. Figure 6 As shown in the figure, along the depth direction of the canvas, the five target rectangular images from outside to inside are PIC4, PIC3, PIC2, ​​PIC1 and PIC0, respectively. Take one row as an example, the row boundary coordinates determined are 10 and are X0~X9, respectively, where X0 and X9 are the two row boundary coordinates of PIC0, X1 and X8 are the two row boundary coordinates of PIC1; X2 and X7 are the two row boundary coordinates of PIC2; X3 and X6 are the two row boundary coordinates of PIC3, and X4 and X5 are the two row boundary coordinates of PIC4. At this time, X0~X9 can divide the pixels located in the row into 8 pixel segments, namely Seg1~Seg8. From traversing X0~X9 in sequence, Seg1~Seg8 belong to different candidate belonging images respectively, so Seg1~Seg8 are all the target pixel segments of the corresponding candidate belonging images in this row. Assuming that X4, X5, and X6 all belong to PIC3, at this time, Seg4 and Seg5 can be merged to form a target pixel segment as the target pixel segment of PIC3.

[0036] Before determining the row boundary coordinates of each row of pixels in each target rectangular image displayed in the preset canvas, the method further includes: Allocate pixel segment storage intervals according to multiple target rectangular images displayed in a preset canvas; According to the row boundary coordinates of each target rectangular image located in the same row, the target pixel segments formed by segmenting each target rectangular image from each other are determined, including: The row boundary coordinates of each target rectangular image located in the same row are stored in the pixel segment storage interval in sequence according to the coordinate value; According to the pixel segment storage interval, target pixel segments formed by dividing pixels displayed in each row of the canvas by each target rectangular image are determined.

[0037] Only one pixel segment storage interval may be allocated; or multiple pixel segment storage intervals may be set so that the pixel segment storage intervals correspond one-to-one to the rows with pixel display in the canvas; or one pixel segment storage interval may be allocated to each row of the canvas. In this regard, the embodiment of the present application does not limit the number of pixel segment storage intervals, and those skilled in the art may selectively set the number according to actual needs.

[0038] When one pixel segment storage interval is allocated, each time a target pixel segment corresponding to each target rectangular image in a row is determined, the target pixel segment is stored and then the pixel segment storage interval is initialized.

[0039] It can be understood that, according to the pixel segment storage interval, determining the target pixel segments formed by dividing the pixels displayed in each row of the canvas by each target rectangular image includes: For each pixel segment storage interval, traverse from the first storage position of the pixel segment storage interval. Connect the coordinates of each of the two adjacent storage locations traversed to form a pixel segment and use the target rectangular image where the outermost layer of the pixel segment is located as a candidate belonging image; When two adjacent pixel segments belong to the same candidate belonging image, the two adjacent pixel segments are merged into one pixel segment, and the merged pixel segment is used as the target pixel segment of the corresponding candidate belonging image; Each pixel segment that has not been merged is used as a target pixel segment of the corresponding candidate belonging image.

[0040] In some embodiments, a pixel segment storage interval is provided, and the method further includes initializing the pixel segment storage interval after traversing the pixel segment storage interval, storing each target pixel segment in a preset storage area, to re-store the row boundary coordinates of each target rectangular image in the next row.

[0041] Since each storage location stores row boundary coordinates, the target rectangular image corresponding to each pixel segment can be determined based on the ownership of the two row boundary coordinates of each pixel segment, and then the outermost target rectangular image can be used as the candidate ownership image of the pixel segment based on the relationship between the layers in which the determined target rectangular image is located.

[0042] According to each target pixel segment, an image request message is generated and the image request message is sent to a preset memory through a preset bus, including: Divide each target pixel segment row by row along the column direction of the canvas; The target pixel segments divided in each row are sorted in sequence according to the layer order of each target rectangular image and a corresponding image request message is generated; Each image request message is sent to a preset memory through the bus.

[0043] By reading all valid pixel segments of the target rectangular images line by line, multiple target rectangular images can be updated line by line on the canvas as a complete image, thereby improving the display effect.

[0044] The target image data of the receiving memory in response to the image request message includes: Get the field alignment length of the bus communication protocol used to communicate with the memory; Each interval field is aligned to a length, and valid data is extracted from the response data in the memory as target image data according to the extraction indication information defined in the image request message.

[0045] Update the uncovered pixels in each target rectangular image in the canvas according to the target image data, including: In each layer of the canvas, scan the target rectangular image of the corresponding layer according to the preset scanning order; When it is determined that a target pixel corresponding to the target pixel segment is scanned in the target rectangular image, image data corresponding to the target pixel is extracted from the target image data and updated; The pixels in each layer that are not determined as target pixel segments are filled with preset background data.

[0046] When each target rectangular image in the canvas is updated row by row, the scanning order is scanning row by row along the column direction of the canvas. When each target rectangular image in the canvas is updated synchronously, the embodiment of the present application does not limit the scanning order.

[0047] For example, refer to Figure 2 , Figures 5 and 6 The display method of image processing in the embodiment of the present application is described, taking 5 overlapping target rectangular images as an example, wherein the memory stores images that are continuously displayed in the display area where the 5 target rectangular images (PIC0~PIC4) are located in the canvas, and the images are stored in 5 (10 or 15) areas of the memory according to a preset data format. The canvas is scanned line by line, taking the line with the largest overlapping area as an example, the specific operation method is as follows: 1) Reference Figure 4 As shown, PIC0, PIC1, PIC2, ​​PIC3 and PIC4 are randomly distributed in the target rectangular image in the canvas. At this time, each row of the canvas will generate a maximum of 10 row boundary coordinates, such as Figure 4 As shown, 10 coordinates are formed at the dotted lines.

[0048] 2) After sorting the 10 row boundary coordinates from small to large, we get a new sequence X

[10] . The new sequence X

[10] is as follows: Figure 5 As shown, they are X0~X9 respectively; 3) The data segments consisting of two adjacent coordinates (9 in total) are judged in turn to determine which PIC (i.e., candidate belonging image) they belong to; Figure 6 As shown, the 9 pixel segments are Seg0 to Seg8; taking Seg0 as an example, the candidate belonging image of Seg0 is PIC0. Seg1 belongs to both PIC0 and PIC1, but PIC1 is above PIC0, so the candidate belonging image of Seg1 is PIC1.

[0049] 4) Scan the 9 pixel segments again to determine whether adjacent pixel segments belong to the same PIC (candidate belonging image). If so, merge them; 5) Reference Figure 7, sort the target pixel segments in PIC0~PIC3 in turn, and generate image request messages row by row to request the target image data from the memory (due to the randomness of the coverage, there may be invalid segments with a length of 0 in these 9 segments). At the same time, record the requested information, including head_offset (data header offset), tail_offset (data tail offset), and data_len (data length).

[0050] 6) Reference Figure 2 As shown, taking the 64-bit AXI bus as an example, a data has 8 bytes. According to the instructions of the previous request information, the invalid part of the first data indicated by head_offset and the invalid part of the last data indicated by tail_offset are deleted, and the remaining data are all stored in the data pool.

[0051] 7) Draw the target map, reference Figure 2 As shown, the target image is scanned from left to right and from top to bottom, the invalid parts are filled with background data, and the valid parts are extracted from the data pool and filled.

[0052] The embodiment of the present application also provides an electronic device, the electronic device includes a memory, a processor and a layer processor, the memory stores a computer program, and the processor implements the above-mentioned image display processing method when executing the computer program. The electronic device can be any intelligent terminal including a tablet computer, a car computer, etc.

[0053] See also Figure 8 , Figure 8 The hardware structure of an electronic device of another embodiment is illustrated, and the electronic device includes: The processor 801 may be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement solutions other than the technical solutions provided in the embodiments of the present application; The memory 802 may be a NAND flash; A layer processor 803, in which relevant program codes are stored, and the layer processor is used to call and execute the image display processing method of the embodiment of the present application; Input / output interface 804, used to implement information input and output; Communication interface 805, used to realize communication interaction between the device and other devices, which can be realized through wired mode (such as USB, network cable, etc.) or wireless mode (such as mobile network, WIFI, Bluetooth, etc.); A first bus 806 , which transmits information between various components of the device (e.g., the processor 801 , the memory 802 , the input / output interface 804 , and the communication interface 805 ); A second bus 807, the second bus 807 transmits information between the memory 802 and the layer processor 803; The processor 801 , the memory 802 , the input / output interface 804 and the communication interface 805 are connected to each other in communication within the device via the first bus 806 .

[0054] An embodiment of the present application also provides a computer-readable storage medium, which is a computer-readable storage medium that stores a computer program. When the computer program is executed by a processor, the above-mentioned image display processing method is implemented.

[0055] The memory, as a non-transient computer-readable storage medium, can be used to store non-transient software programs and non-transient computer executable programs. In addition, the memory may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory may optionally include a memory remotely disposed relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0056] The embodiments described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Those skilled in the art will appreciate that with the evolution of technology and the emergence of new application scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0057] Those skilled in the art will appreciate that the technical solutions shown in the figures do not constitute a limitation on the embodiments of the present application, and may include more or fewer steps than shown in the figures, or a combination of certain steps, or different steps.

[0058] The device embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0059] Those skilled in the art will appreciate that all or some of the steps in the methods disclosed above, and the functional modules / units in the systems and devices may be implemented as software, firmware, hardware, or a suitable combination thereof.

[0060] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0061] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0062] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the above units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0063] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0064] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0065] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including multiple instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store programs.

[0066] The preferred embodiments of the present invention are described above with reference to the accompanying drawings, but the scope of the rights of the present invention is not limited thereto. Any modification, equivalent substitution and improvement made by a person skilled in the art without departing from the scope and essence of the present invention should be within the scope of the rights of the present invention.

Claims

1. A method for processing image display, characterized in that: Applied to a layer processor; the method comprises: In response to an image position adjustment request triggered by a position change of at least one target rectangular image in a preset canvas, determining the row boundary coordinates of each row of pixels in a plurality of target rectangular images displayed in the canvas; at least two of the plurality of target rectangular images at least partially overlap; Determine, according to the row boundary coordinates of each of the target rectangular images located in the same row, a target pixel segment formed by dividing each of the target rectangular images; wherein the target pixel segment is a pixel segment formed by non-overlapping pixels in each of the target rectangular images; In response to the image update request of the canvas, an image request message is generated according to each of the target pixel segments, and the image request message is sent to a preset memory through a preset bus; the memory and the layer processor are connected through the bus; receiving target image data from the memory in response to the image request message; The uncovered pixels in each target rectangular image in the canvas are updated according to the target image data.

2. The image display processing method according to claim 1, characterized in that: The step of determining target pixel segments formed by dividing the target rectangular images from each other according to the row boundary coordinates of the target rectangular images located in the same row includes: Sort the boundary coordinates of each row in the same row of the canvas according to the size of the coordinates; Combine the coordinates of two adjacent row boundaries that are located in the same row and are in good order, and determine a plurality of pixel segments located in the same row and candidate belonging images corresponding to each of the pixel segments; Merging two adjacent pixel segments located in the same row and belonging to the same candidate attribute image to obtain the target pixel segment of the candidate attribute image; The unmerged pixel segments are taken as the target pixel segments of the corresponding candidate belonging images.

3. The image display processing method according to claim 1, characterized in that: Before determining the row boundary coordinates of each row of pixels in each target rectangular image displayed in the preset canvas, the method further includes: Allocate pixel segment storage intervals according to multiple target rectangular images displayed in a preset canvas; The step of determining target pixel segments formed by dividing the target rectangular images from each other according to the row boundary coordinates of the target rectangular images located in the same row includes: The row boundary coordinates of each target rectangular image located in the same row are stored in the pixel segment storage interval in sequence according to the coordinate value; According to the pixel segment storage interval, target pixel segments formed by dividing pixels displayed in each row of the canvas by each target rectangular image are determined.

4. The image display processing method according to claim 3, characterized in that: The step of determining, according to the pixel segment storage interval, target pixel segments formed by dividing pixels displayed in each row of the canvas by each target rectangular image comprises: For each of the pixel segment storage intervals, traversing is performed starting from the first storage position of the pixel segment storage interval, Connect the coordinates of each of the two adjacent storage locations traversed to form a pixel segment and use the target rectangular image where the outermost layer of the pixel segment is located as a candidate belonging image; When two adjacent pixel segments belong to the same candidate belonging image, the two adjacent pixel segments are merged into one pixel segment, and the merged pixel segment is used as the target pixel segment of the corresponding candidate belonging image; Each pixel segment that has not been merged is used as a target pixel segment of the corresponding candidate belonging image.

5. The image display processing method according to claim 1, characterized in that: The step of generating an image request message according to each of the target pixel segments and sending the image request message to a preset memory through a preset bus includes: Divide each of the target pixel segments row by row along the column direction of the canvas; The target pixel segments divided in each row are sorted in sequence according to the layer order of each target rectangular image and a corresponding image request message is generated; Each image request message is sent to a preset memory through the bus.

6. The image display processing method according to claim 1, characterized in that: The receiving the target image data of the memory in response to the image request message comprises: Obtaining a field alignment length of a bus communication protocol for communicating with the memory; At intervals of the field alignment length, valid data is extracted from the response data in the memory as target image data according to the extraction indication information defined in the image request message.

7. The image display processing method according to claim 1, characterized in that: The updating of uncovered pixels in each target rectangular image in the canvas according to the target image data includes: On each layer of the canvas, scanning a target rectangular image of the corresponding layer according to a preset scanning order; When it is determined that a target pixel corresponding to the target pixel segment exists in the scanned target rectangular image, image data corresponding to the target pixel is extracted from the target image data and updated; The pixels in each layer that are not determined as target pixel segments are filled with preset background data.

8. A terminal device, characterized in that: The terminal device comprises: A layer processor, wherein the layer processor executes the method according to any one of claims 1 to 7; A memory, wherein the memory is connected to the layer processor via a preset bus communication.

9. An electronic device, characterized in that: The electronic device includes a memory and a processor, the memory stores a computer program, and the processor implements the image display processing method according to any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the image display processing method according to any one of claims 1 to 7 is implemented.

Images