Image processing method and device, equipment, medium and product

Abstract

The invention discloses an image processing method and device, equipment, a medium and a product. The method comprises the steps of determining a target pixel value of at least one target pixel point in a target image according to pixel information, cached in a first cache unit, of the original image in response to an event of displaying the target image after an original image is amplified; and generating and displaying a target image based on the target pixel value of the at least one target pixel point, the determination mode of the target pixel value is as follows: constructing a first pixel point array according to the target pixel position information of the target pixel point, the amplification parameter and the pixel information cached in the first cache unit; determining pixel interpolation information corresponding to the current column according to the pixel information of the pixel points located in the current column; and determining a target pixel value of the target pixel point according to the at least one piece of pixel interpolation information. According to the technical scheme, on the basis that the image quality of the amplified target image is improved, the effect of amplifying the image with any resolution to the image with any resolution can be achieved.

Description

Technical Field

[0001] The present invention relates to the technical field of image processing, and in particular, to an image processing method, apparatus, device, medium, and product. Background Art

[0002] With the rapid development of the information age, LED display screens have been rapidly popularized due to their advantages such as high brightness and wide viewing angles. However, LED sending cards face dual resolution adaptation challenges: the input video source resolution is complex and variable, and the output needs to accurately match the user-customized screen size.

[0003] In the related art, when performing image magnification, not only will the image have severe jaggedness and distortion, resulting in a serious decline in image quality, but it is also limited by the fixed magnification ratio and cannot achieve arbitrary ratio scaling. Moreover, based on the existing image magnification methods, it is impossible to achieve ultra-high resolution magnification, which cannot meet the user's demand for applying ultra-high resolution to LED display screens and ensuring high image quality. Summary of the Invention

[0004] The present invention provides an image processing method, apparatus, device, medium, and product, so as to achieve the effect of magnifying an image with any resolution to any resolution on the basis of improving the image quality of the magnified target image, and improve the universality of image magnification operations at any resolution.

[0005] According to an aspect of the present invention, an image processing method is provided, and the method includes:

[0006] In response to an event of displaying a target image magnified from an original image, determine the target pixel value of at least one target pixel point in the target image according to the pixel information corresponding to the original image cached in the first cache unit;

[0007] Generate the target image based on the target pixel values of at least one target pixel point and display it;

[0008] Wherein, the target pixel value of the target pixel point is determined by the following method:

[0009] According to the target pixel position information of the target pixel point, the pre-determined magnification parameter, and the pixel information corresponding to the original image cached in the first cache unit, construct a first pixel point array corresponding to the target pixel point; wherein, the first pixel point array is used to determine the target pixel value of the target pixel point; the first pixel point array includes the pixel information of the original pixel point corresponding to the target pixel point in the original image and the pixel information of at least one associated pixel point associated with the original pixel point; the magnification parameter is used to characterize the ratio relationship between the resolution of the magnified first image and the resolution of the second image of the original image;

[0010] For at least one column of pixel points included in the first pixel point array, determine pixel interpolation information corresponding to the current column according to pixel information corresponding to the pixel points in the current column.

[0011] Determine the target pixel value of the target pixel point according to at least one of the pixel interpolation information.

[0012] According to another aspect of the present invention, there is provided an image processing apparatus, the apparatus comprising:

[0013] A pixel value determination module, configured to, in response to an event of displaying a target image obtained by magnifying an original image, determine the target pixel value of at least one target pixel point in the target image according to pixel information corresponding to the original image cached in the first cache unit;

[0014] An image generation module, configured to generate and display the target image based on the target pixel values of at least one of the target pixel points;

[0015] Wherein, the pixel value determination module is specifically configured to construct a first pixel point array corresponding to the target pixel point according to the target pixel position information of the target pixel point, a pre-determined magnification parameter, and pixel information corresponding to the original image cached in the first cache unit; wherein, the first pixel point array is used to determine the target pixel value of the target pixel point; the first pixel point array includes pixel information of the original pixel point corresponding to the target pixel point in the original image and pixel information of at least one associated pixel point associated with the original pixel point; the magnification parameter is used to characterize the ratio relationship between the resolution of the magnified first image and the resolution of the second image of the original image; for at least one column of pixel points included in the first pixel point array, determine pixel interpolation information corresponding to the current column according to pixel information corresponding to the pixel points in the current column; determine the target pixel value of the target pixel point according to at least one of the pixel interpolation information.

[0016] According to another aspect of the present invention, there is provided an electronic device, the electronic device comprising:

[0017] At least one processor; and

[0018] A memory communicatively connected to the at least one processor; wherein,

[0019] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the image processing method according to any embodiment of the present invention.

[0020] According to another aspect of the present invention, there is provided a computer-readable storage medium storing computer instructions for causing a processor to implement the image processing method according to any embodiment of the present invention when executed.

[0021] According to another aspect of the present invention, there is provided a computer program product including a computer program which implements the image processing method according to any embodiment of the present invention when executed by a processor.

[0022] The technical solution provided by the embodiments of the present invention, by responding to an event of displaying a target image after magnifying an original image, determines the target pixel values of at least one target pixel point in the target image according to the pixel information corresponding to the original image cached in the first cache unit, avoiding repeated reading of the pixel information of the original image from the original data source, reducing the input / output delay, ensuring a quick response to the magnifying operation, and achieving the effect of improving the image processing efficiency on the basis of ensuring real-time performance. Moreover, since the method for determining the target pixel value is as follows: according to the target pixel position information of the target pixel point, a pre-determined magnification parameter, and the pixel information corresponding to the original image cached in the first cache unit, a first pixel point array corresponding to the target pixel point is constructed; wherein, the first pixel point array is used to determine the target pixel value of the target pixel point; the first pixel point array includes the pixel information of the original pixel point corresponding to the target pixel point in the original image and the pixel information of at least one associated pixel point associated with the original pixel point; the magnification parameter is used to characterize the ratio relationship between the resolution of the magnified first image and the resolution of the original second image; for at least one column of pixel points included in the first pixel point array, according to the pixel information corresponding to the pixel points in the current column, the pixel interpolation information corresponding to the current column is determined; according to at least one pixel interpolation information, the target pixel value of the target pixel point is determined, achieving the effect of being able to magnify an image of any resolution to any resolution on the basis of improving the image quality of the magnified target image, making the image magnifying operation adaptable to different magnification multiples, and improving the universality of the image magnifying operation at any resolution. Further, based on the target pixel values of at least one target pixel point, a target image is generated and displayed, achieving a balance between high-quality image magnification and efficient real-time rendering, and meeting the user's demand for image detail display by magnifying a low-resolution original image into a high-resolution target image. The technical solution of the embodiments of the present invention solves the problems such as image quality degradation, edge jagging, and limited magnification resolution existing in the related art when magnifying images, achieves the effect of being able to magnify an image of any resolution to any resolution on the basis of improving the image quality of the magnified target image, meets the demand for large-magnification image magnification in high-resolution application fields, and at the same time, improves the image processing efficiency while ensuring the image quality of the magnified target image, achieving a balance between high-quality images and efficient real-time rendering.

[0023] It should be understood that the content described in this part is not intended to identify the key or important features of the embodiments of the present invention, nor is it used to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. Brief Description of the Drawings

[0024] To more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the accompanying drawings required for the description of the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other accompanying drawings can be obtained based on these drawings.

[0025] Figure 1 is a flowchart of an image processing method provided according to an embodiment of the present invention;

[0026] Figure 2 is a schematic structural diagram of an image processing apparatus provided according to an embodiment of the present invention;

[0027] Figure 3 is a schematic structural diagram of an electronic device for implementing the image processing method of the embodiment of the present invention. Specific embodiments

[0028] In order to enable those skilled in the art to better understand the solution of the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0029] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above accompanying drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products, or devices.

[0030] Embodiment 1

[0031] Figure 1 is a flowchart of an image processing method provided in Embodiment 1 of the present invention. This embodiment is applicable to the case of enlarging an original image with any resolution to a target image with any resolution. This method can be executed by an image processing apparatus, which can be implemented in the form of hardware and / or software, and the image processing apparatus can be configured in a terminal and / or a server. As Figure 1As shown, the method includes:

[0032] S110. In response to an event of displaying a target image obtained by magnifying an original image, determine the target pixel values of at least one target pixel point in the target image according to the pixel information corresponding to the original image cached in the first cache unit.

[0033] It should be noted that the image processing method provided in this embodiment can be implemented in a field-programmable gate array (FPGA), and the field-programmable gate array can be integrated on an LED sending card to magnify the original image received based on the LED sending card and display it on the LED display screen. It can be understood that the LED sending card is the core control device in the LED display screen system, mainly used for processing, encoding the image / video data of a computer or other signal sources, and transmitting them to the receiving card and display unit of the LED display screen to achieve real-time display of the picture.

[0034] Among them, the original image can be an image to be magnified. In this embodiment, the original image can be transmitted from a computer or other signal sources and is an image to be magnified and displayed magnified on the LED display screen. The target image can be a result image obtained by magnifying the original image, and the image size of this result image is larger than that of the original image. The target image can be the image finally presented on the LED display screen. It can be understood that image magnification is the magnification of the image resolution, that is, the image resolution of the original image is magnified so that the magnified target image presents a larger visual effect. Exemplarily, assume that the image resolution of the original image is 512×512, and the image resolution of the target image obtained by magnifying the original image can be 1024×1024.

[0035] Among them, the event of displaying the target image after magnifying the original image can be understood as the event generated when a triggering operation of magnifying and displaying the magnified target image of the original image is detected. This event can be used to trigger the system to execute the logic of magnifying the image and displaying the magnified image. The event of displaying the target image after magnifying the original image can occur in multiple situations. Optionally, it includes: when a triggering operation on a preset image magnification display control is detected, the event of displaying the target image after magnifying the original image can be generated; or, when it is detected that the pixel information corresponding to the original image cached in the first cache unit is all the pixel information of the original image, the event of displaying the target image after magnifying the original image can be generated; or, the first cache unit for caching the pixel information of the original image includes four cache subunits, each cache subunit is used to cache the pixel information of one row of pixel points of the original image, and the pixel information cached by the four cache subunits is partial pixel information of the original image. When all four cache subunits have been fully occupied, the event of displaying the target image after magnifying the original image can be generated.

[0036] Among them, the first cache unit can be a cache space for caching the pixel information of the original image. Optionally, the first cache unit can be used to store at least partial pixel information of the original image. The first cache unit can be used to store all the pixel information of the original image; and / or, the first cache unit can also be used to cache partial pixel information of the original image. When the cached partial pixel information is not needed, other pixel information in the original image that is not cached can be used to overwrite the partial pixel information cached in the first cache unit. The pixel information corresponding to the original image can be the pixel information corresponding to each pixel point in the original image, and this pixel information can at least include pixel point position information and pixel value. The target pixel point can be a pixel point in the target image. The target pixel value can be the color value (such as RGB value) of the target pixel point.

[0037] In practical applications, when caching the pixel information of the original image, it is usually in the form of single-pixel caching, that is, the pixel information of a single pixel point is cached sequentially. However, single-pixel caching results in a serial data stream output, which requires multiple transmissions to meet the image processing requirements, causing bandwidth waste and long time consumption.

[0038] In view of the above situation, in this embodiment, when caching the pixel information of the original image, a multi-pixel parallel manner can be adopted. The specific operation method can be as follows: receive the original image, and write the pixel information of the original pixel points in the original image into the second cache unit in sequence according to the arrangement order of the pixel points; when the number of the original pixel points written in the second cache unit reaches a preset number, write the pixel information of the preset number of the written original pixel points into the first cache unit according to a preset order, and delete the pixel information of the written original pixel points from the second cache unit.

[0039] Among them, the arrangement order of the pixel points can be the arrangement order of the pixel points in the original image, and usually can be written row by row and column by column from left to right and from top to bottom. The second cache unit can be a buffer for temporarily storing the original image transmitted from a computer or other signal source. The second cache unit is used to receive pixel information pixel by pixel according to the pixel arrangement order of the original image, and temporarily store the original pixel points until the preset number is reached, triggering the transmission to the first cache unit. The preset number can be any value greater than 1. Optionally, it can be 2, 3, 4 or 5, etc. The preset order can be the time order of writing the pixel information into the second cache unit, that is, the first-in first-out order, and the pixel information written into the second cache unit first is preferentially read and written into the first cache unit.

[0040] In a specific implementation, receive the original image transmitted from other terminal devices, and write the pixel information of the original pixel points in the original image into the second cache unit pixel by pixel in sequence from left to right and from top to bottom. Further, when the number of the original pixel points written in the second cache unit reaches a preset number, the pixel information of the preset number of the written original pixel points can be written into the first cache unit according to the first-in first-out order of the pixel information, and the pixel information of the written original pixel points is deleted from the second cache unit.

[0041] In this embodiment, when determining the target pixel value of at least one target pixel point, it can correspond to at least two situations: the first cache unit can store all the pixel information of the original image at one time; or, the first cache unit stores part of the pixel information of the original image at one time. In different situations, the determination process of the target pixel value of at least one target pixel point is different. The following can separately describe these two situations.

[0042] The first situation: when it is detected that the pixel information corresponding to the original image cached in the first cache unit is all the pixel information of the original image, an event of displaying the target image after magnifying the original image can be generated. Further, in response to this event, obtain the pixel information corresponding to the original image cached in the first cache unit, and determine the target pixel value of at least one target pixel point in the target image according to the obtained pixel information.

[0043] Second case: In order to improve the image processing efficiency while reducing the memory resource occupancy rate, the pixel information of the original image can be cached in a block caching manner, that is, the first cache unit can include at least four cache subunits; each cache subunit is at least used to cache the pixel information of one row of pixel points of the original image; that is, the storage depth of each cache subunit is consistent with the image width of the original image. It can be understood that the storage depth is usually the storage capacity of the cache subunit, that is, the number of data units that the cache subunit can accommodate; the storage depth being consistent with the image width can be that the number of data units that the cache subunit can accommodate is consistent with the number of pixel points in one row of the original image. The cache subunit can be any memory capable of data access. Optionally, the cache subunit can be a random access memory (RAM).

[0044] In this embodiment, when the first cache subunit includes at least four cache subunits and the pixel information cached by the at least four cache subunits is partial pixel information of the original image, in order to implement a pipelined image processing flow and improve the image processing efficiency, the pixel information cached in the first cache subunit can be "rolled updated", and only the adjacent rows required for the current calculation are retained.

[0045] Based on this, on the basis of the above embodiment, it further includes: when the target pixel point is the last pixel point in the pixel row where it is located in the target image and the target pixel value corresponding to the target pixel point has been determined, determining the target cache subunit to be updated in the first cache unit; determining the pixel information to be updated to the target cache subunit according to the pixel information writing order and the pixel information in the original image that has not been cached to the first cache unit, and updating the determined pixel information to the target cache subunit; during the process of determining the target pixel value of the target pixel point, repeatedly execute the operations of determining the target cache subunit and updating the pixel information until the target pixel point for which the target pixel value has been determined is the last pixel point in the target image.

[0046] Among them, the target cache subunit can be the cache subunit that needs to be overwritten (or updated). The target cache subunit can be determined according to the time order in which the pixel information is written into the first cache unit (the first-written is preferentially replaced), that is, the pixel information that enters the first cache unit earliest will be preferentially replaced, and the cache subunit storing this pixel information can be used as the target cache subunit. It can be understood that by adopting a cyclic replacement mechanism (such as the first-in-first-out mechanism), it is ensured that the first cache unit always retains the latest multiple rows of pixel information. The pixel information writing order can be the time order in which the pixel information is written into the first cache unit (such as writing in sequence according to the row order of the original image).

[0047] As another alternative implementation of this embodiment, when it is detected that at least four cache subunits included in the first cache unit are all occupied by the pixel information of the original image, an event for displaying the target image obtained by magnifying the original image can be generated. Further, in response to this event, the pixel information corresponding to the original image cached in the first cache unit is obtained, and the target pixel value of at least one target pixel point in the target image is determined according to the obtained pixel information. Further, when the target pixel point is the last pixel in the pixel row where it is located in the target image and the target pixel value corresponding to the target pixel point has been determined, the target cache subunit to be updated can be determined from the four cache subunits according to the time sequence in which the pixel information is written into the first cache unit. Further, the pixel information to be updated to the target cache subunit can be determined from the pixel information of the original image that has not been cached in the first cache unit according to the pixel information writing order. Further, the pixel information stored in the target cache subunit is cleared, and the determined pixel information is written in to update the pixel information cached in the target cache subunit. Further, during the process of determining the target pixel value of the target pixel point, each time the last target pixel point in a row of the target image is processed, a cache update is triggered, and the operations of determining the target cache subunit and updating the pixel information are repeatedly executed until the last target pixel point in the target image is processed.

[0048] It should be noted that the advantage of using the above loop replacement mechanism to determine the target pixel value is that: the cache unit with limited memory can be used to process images of any size, breaking through the limitation of the memory capacity on the image size, reducing the memory occupation and improving the processing efficiency; through the pipeline update, it is ensured that during the calculation of the target pixel value, the required neighboring pixels are always available, guaranteeing the real-time performance of the interpolation calculation.

[0049] It should be noted that when performing image magnification processing on the original image, there are various ways to determine the target pixel value of each target pixel point in the magnified target image. Optionally, they include the nearest neighbor interpolation algorithm, the bilinear interpolation algorithm, the bicubic interpolation algorithm, etc.

[0050] In practical applications, when performing image magnification, the nearest neighbor interpolation algorithm or the bilinear interpolation algorithm is usually used for processing. However, when using this method for image magnification, the magnification flexibility is low, and only fixed-ratio magnification can be achieved, unable to support wireless continuous magnification, and it is difficult to accurately adapt to diverse resolution requirements; moreover, the image quality loss after magnification is significant. When the magnification factor is large, obvious pixelated jaggedness, edge blurring, and detail loss will occur in the image.

[0051] In view of the above situation, in this embodiment, the target pixel value of the target pixel can be determined by the following formula: According to the target pixel position information of the target pixel, the pre-determined magnification parameter, and the pixel information corresponding to the original image cached in the first cache unit, construct a first pixel point array corresponding to the target pixel; for at least one column of pixel points included in the first pixel point array, determine the pixel interpolation information corresponding to the current column according to the pixel information corresponding to the pixel points in the current column; determine the target pixel value of the target pixel according to at least one pixel interpolation information.

[0052] Among them, the target pixel position information can be the coordinate position of the target pixel in the magnified target image, such as the (x, y) coordinate in the two-dimensional plane. The target pixel position information is used to locate the corresponding position of the target pixel in the target image. The magnification parameter is used to characterize the ratio relationship between the resolution of the magnified first image and the resolution of the second image of the original image, usually expressed in multiples. The first image resolution can be the image resolution that meets the image magnification requirement, that is, the image resolution of the magnified target image. Exemplarily, the first image resolution can include 1080P resolution and 4K resolution, etc. The second image resolution is the image resolution of the original image. Generally, the second image resolution of the original image and the first image resolution that meets the image magnification requirement can be obtained. Further, the ratio between the first image resolution and the second image resolution can be determined, and this ratio can be used as the magnification factor.

[0053] Among them, the first pixel point array can be a set of pixel points. This set of pixel points is a set of pixel points corresponding to the target pixel extracted from the original image according to the target pixel position information of the target pixel and the magnification factor. The first pixel point array can be used to determine the target pixel value of the target pixel. The first pixel point array can be composed of at least one column of pixel points and at least one row of pixel points. The first pixel point array contains the pixel information of the original pixel points corresponding to the target pixel in the original image and the pixel information of at least one associated pixel point associated with the original pixel points. The original pixel point can be determined based on the target pixel position information of the target pixel and the magnification factor, which is the mapping point or reference point corresponding to the target pixel in the original image. The associated pixel point can be a pixel point that has an association relationship with the original pixel point. Optionally, the associated pixel point can be a pixel point adjacent to the original pixel point. For example, with the original pixel point as the center, the 15 pixel points around it, and these 16 pixel points form a 4×4 pixel point matrix, and this pixel point matrix can be the first pixel point array.

[0054] Among them, the pixel interpolation information can be the intermediate result obtained by performing pixel value interpolation calculation on a certain column of pixel points, and is used to characterize the change trend of the pixels in this column.

[0055] In a specific implementation, for at least one target pixel point whose target pixel value is to be determined, the pixel position information of the target pixel point in the target image can be obtained as the target pixel position information. Moreover, the second image resolution of the original image and the first image resolution that meets the image magnification requirement are obtained, and the ratio between the first image resolution and the second image resolution is determined as the magnification factor. Further, based on the target pixel position information and the magnification factor, the original pixel position information of the original pixel point corresponding to the target pixel point in the original image can be determined, and based on the original pixel position information, the associated pixel position information of at least one associated pixel point associated with the original pixel point can be determined. Further, based on the original pixel position information and the at least one associated pixel position information, the original pixel value corresponding to the original pixel point and the associated pixel values corresponding to the at least one associated pixel point can be obtained from the pixel information corresponding to the original image cached in the first cache unit. Further, based on the original pixel position information and the original pixel value of the original pixel point and the associated pixel position information and the associated pixel values of the at least one associated pixel point, a first pixel point array corresponding to the target pixel point can be constructed. Further, for at least one column of pixel points included in the first pixel point array, pixel interpolation processing can be performed based on the pixel information corresponding to the pixel points in the current column of the first pixel point array to obtain pixel interpolation information corresponding to the current column. Further, in the case of obtaining the pixel interpolation information corresponding to at least one column of pixel points, pixel interpolation processing can be performed based on the pixel interpolation information corresponding to the at least one column of pixel points to obtain the target pixel value of the target pixel point.

[0056] S120. Generate and display a target image based on the target pixel values of at least one target pixel point.

[0057] In this embodiment, when the target pixel values of at least one target pixel point are obtained and the obtained target pixel points are all the pixel points required for generating the target image, image synthesis can be performed based on the obtained target pixel values of the at least one target pixel point to obtain the target image, and the obtained target image can be displayed on the target display device.

[0058] In a specific implementation, when the target pixel values of at least one target pixel point are obtained and the obtained target pixel points are all the pixel points required to generate the target image, the obtained target pixel values can be subjected to format conversion to be converted into a format that can be displayed on the target display device, obtaining the converted pixel data, and adding metadata such as resolution and synchronization signals to the converted pixel data. Further, the pixel data with added metadata can be serially transmitted to the target display device through a transmission interface, and the target display device scans the pixels row by row and column by column after parsing the signal, and finally synthesizes and displays the enlarged target image on the display device. Among them, the target display device can be any device capable of image display. Optionally, the target display device is an LED display screen, an LCD monitor, etc. Optionally, the format conversion can be converting the pixel values from the RGB format to the YUV format. The transmission interface can include interfaces such as HDMI and DP.

[0059] It should be noted that in the field of LED display screens, by using the image processing method provided by the embodiments of the present invention, it is possible to achieve the effect of enlarging an image with any resolution into a target image with any resolution on the basis of ensuring that the enlarged target image is a high-quality image, meeting the user's requirement of applying an ultra-high resolution (such as 4K resolution) to the LED display screen and ensuring high picture quality.

[0060] The technical solution provided by the embodiments of the present invention, by responding to an event of displaying a target image after magnifying an original image, determines the target pixel values of at least one target pixel point in the target image according to the pixel information corresponding to the original image cached in the first cache unit, avoiding repeated reading of the pixel information of the original image from the original data source, reducing the input-output delay, ensuring a fast response to the magnifying operation, achieving the effect of improving the image processing efficiency on the basis of ensuring real-time performance; and, since the method for determining the target pixel value is: according to the target pixel position information of the target pixel point, the pre-determined magnifying parameter, and the pixel information corresponding to the original image cached in the first cache unit, constructing a first pixel point array corresponding to the target pixel point; wherein, the first pixel point array is used to determine the target pixel value of the target pixel point; the first pixel point array includes the pixel information of the original pixel point corresponding to the target pixel point in the original image and the pixel information of at least one associated pixel point associated with the original pixel point; the magnifying parameter is used to characterize the ratio relationship between the resolution of the magnified first image and the resolution of the second image of the original image; for at least one column of pixel points included in the first pixel point array, according to the pixel information corresponding to the pixel points in the current column, determining the pixel interpolation information corresponding to the current column; according to at least one pixel interpolation information, determining the target pixel value of the target pixel point, achieving the effect of being able to magnify an image of any resolution to any resolution on the basis of improving the image quality of the magnified target image, enabling the image magnifying operation to adapt to different magnification factors, and improving the universality of the image magnifying operation at any resolution; further, based on the target pixel values of at least one target pixel point, generating and displaying the target image, achieving the balance between high-quality image magnification and efficient real-time rendering, and meeting the user's demand for image detail display by magnifying a low-resolution original image into a high-resolution target image. The technical solution of the embodiments of the present invention solves the problems such as image quality degradation, edge jagging, and limited magnifying resolution existing in the related art when magnifying images, achieving the effect of being able to magnify an image of any resolution to any resolution on the basis of improving the image quality of the magnified target image, meeting the large-magnification image magnifying requirements in high-resolution application fields, and, while ensuring the image quality of the magnified target image, improving the image processing efficiency, and achieving the balance between high-quality images and efficient real-time rendering.

[0061] On the basis of the foregoing embodiments, there can be various construction methods for the first pixel point array used to determine the target pixel value of the target pixel point. Optionally, it includes taking the original pixel point as the center and obtaining at least one associated pixel point adjacent to the original pixel point according to a preset neighborhood to construct the first pixel point array; or, taking the original pixel point as the upper left corner pixel point and determining at least one associated pixel point associated with the original pixel point according to a preset neighborhood to construct the first pixel point array, etc.

[0062] Optionally, the construction method of the first pixel point array corresponding to the target pixel point may be as follows: obtain the first image resolution of the magnified target image and the second image resolution of the original image to be magnified, determine the ratio between the first image resolution and the second image resolution to obtain a magnification parameter; obtain the target pixel position information of the target pixel point whose pixel value is to be determined, and determine the original pixel position information of the original pixel point corresponding to the target pixel point in the original image according to the target pixel position information and the magnification parameter; take the original pixel point as the center, and determine at least one associated pixel point associated with the original pixel point and the associated pixel position information of each associated pixel point according to the original pixel position information of the original pixel point and a preset neighborhood; according to the original pixel position information of the original pixel point and the associated pixel position information of at least one associated pixel point, obtain the original pixel value of the original pixel point and the associated pixel values of at least one associated pixel point from the first cache unit; take the original pixel point as the center, and construct a first pixel point array corresponding to the target pixel point based on the original pixel position information and the original pixel value of the original pixel point and the associated pixel position information and the associated pixel values of at least one associated pixel point.

[0063] Among them, the original pixel position information may be the position information of the original pixel point in the original image, such as pixel coordinates. The preset neighborhood may be a rectangular area centered on the original pixel point, and is used to determine the range of associated pixel points participating in interpolation. Optionally, the preset neighborhood includes a 3×3 neighborhood (that is, the original pixel point and the 8 pixel points around it), a 4×4 neighborhood (that is, taking a rectangular area of 4 rows × 4 columns centered on the original pixel point, and this area includes 15 pixel points other than the original pixel point), a 5×5 neighborhood (that is, the original pixel point and the 24 pixel points around it), etc. Exemplarily, assuming that the preset neighborhood is a 4×4 neighborhood and the original pixel position information of the original pixel point is (i,j), then the taken neighborhood range is Among them, the associated pixel position information of the associated pixel points is (i-1,j-1), (i-1,j), (i-1,j+1), (i-1,j+2), (i,j-1), (i,j+1), (i,j+2), (i+1,j-1), (i+1,j), (i+1,j+1), (i+1,j+2), (i+2,j-1), (i+2,j), (i+2,j+1), and (i+2,j+2). The associated pixel points are the pixel points within the preset neighborhood. The associated pixel position information is the position information of the associated pixel points in the original image. The original pixel value may be the color value of the original pixel point (such as RGB value). The associated pixel value may be the color value of the associated pixel point (such as RGB value).

[0064] In a specific implementation, the second image resolution of the original image and the first image resolution that meets the image magnification requirement can be obtained, and the ratio between the first image resolution and the second image resolution can be determined as the magnification factor. Further, the target pixel position information of the target pixel point for which the pixel value is to be determined can be obtained, and the ratio between the target pixel position information and the magnification factor can be determined, and this ratio can be determined as the original pixel position information of the original pixel point corresponding to the target pixel point in the original image. Further, with the original pixel point as the center, at least one associated pixel point associated with the original pixel point and the associated pixel position information corresponding to each associated pixel point can be determined according to the original pixel position information of the original pixel point and a preset neighborhood. Further, the original pixel value corresponding to the original pixel point can be obtained from the pixel information corresponding to the original image cached in the first cache unit according to the original pixel position information, and for at least one associated pixel point, the associated pixel value corresponding to the associated pixel point can be obtained from the pixel information corresponding to the original image cached in the first cache unit according to the pixel position information of the associated pixel point. Further, with the original pixel point as the center, the original pixel point and at least one associated pixel point can be arranged according to the original pixel position information and the associated pixel position information, and the original pixel position information and the original pixel value can be filled into the original pixel point, and the associated pixel position information and the associated pixel value can be filled into the corresponding associated pixel point to obtain a pixel point array including pixel position information and pixel values, and this pixel point array can be used as the first pixel point array corresponding to the target pixel point.

[0065] It should be noted that an image is composed of discrete pixel points, but the interpolation algorithm needs to calculate the pixel values of continuous coordinate points. At this time, the algorithm needs to map the continuous coordinates of the target point to the surrounding pixel points, and this process will introduce an offset relative to the discrete grid. In this embodiment, when the original pixel position information of the original pixel point is determined according to the target pixel position information of the target pixel point and the magnification parameter, the original pixel position information can be updated according to a preset pixel offset, and further, the updated pixel position information can be used as the original pixel position information of the original pixel point. Among them, the offset can be any value. Optionally, it is 0.5 or 1, etc. The advantage of such a setting is that the introduction of the offset enables the interpolation algorithm to generate smooth transition values between discrete pixels, avoiding the jagged edges or mosaic phenomena caused by direct sampling, thereby achieving a smooth transition in the image magnification operation.

[0066] Exemplarily, assume that the second resolution of the original image is 512×512, the first image resolution is 1024×1024, and the target pixel position information of the target pixel point is (300, 300). Further, the magnification parameter is 2, and the original pixel position information of the original pixel point corresponding to the target pixel point is: Further, taking the original pixel as the center, the associated pixel position information of the associated pixels in the 4×4 neighborhood includes: (148, 148), (148, 149), (148, 150), (148, 151), (149, 148), (149, 150), (149, 151), (150, 148), (150, 149), (150, 150), (150, 151), (151, 148), (151, 149), (151, 150), and (151, 151).

[0067] It should be noted that when determining the first pixel point array, there may be a situation where the original pixel is a boundary pixel of the original image. For this situation, different methods can be used to construct the first pixel point array according to the boundary position where the original pixel is located.

[0068] Optionally, when the original pixel is the left boundary pixel of the original image, when obtaining the associated pixels, the associated pixels located to the left of the left boundary pixel cannot be obtained. At this time, virtual pixels can be obtained by mirror filling, that is, taking the pixel column where the original pixel is located as the central axis and mirroring it to the left to fill at least one column of virtual pixels on the left side of the pixel column where the original pixel is located, and constructing the first pixel point array centered on the left boundary pixel based on the at least one column of filled virtual pixels and the original pixels existing in the original image.

[0069] Optionally, when the original pixel is the upper boundary pixel of the original image, when obtaining the associated pixels, the associated pixels located above the upper boundary pixel cannot be obtained. At this time, virtual pixels can be obtained by mirror filling, that is, taking the pixel row where the original pixel is located as the central axis and mirroring it upward to fill at least one row of virtual pixels above the pixel row where the original pixel is located, and constructing the first pixel point array centered on the upper boundary pixel based on the at least one row of filled virtual pixels and the original pixels existing in the original image.

[0070] Optionally, when the original pixel is the right boundary pixel of the original image, when obtaining the associated pixels, the associated pixels located to the right of the right boundary pixel cannot be obtained. At this time, the associated pixels located to the right of the right boundary pixel can be obtained by edge pixel replication, that is, directly using the right boundary pixel value to fill at least one column of virtual pixels on the right side of the right boundary, so that the pixel values of the virtual pixel points on the right side of the right boundary are consistent with the right boundary pixel value. Further, the first pixel point array centered on the right boundary pixel is constructed based on the at least one column of filled virtual pixels and the original pixels existing in the original image.

[0071] Optionally, when the original pixel point is the lower boundary pixel point of the original image, when obtaining the associated pixel points, the associated pixel points located below the lower boundary pixel point cannot be obtained. At this time, the associated pixel points located below the lower boundary pixel point can be obtained by means of edge pixel replication, that is, directly use the lower boundary pixel value to fill at least one row of virtual pixels below the lower boundary, so that the pixel values of the virtual pixel points below the lower boundary are consistent with the lower boundary pixel value. Further, based on the at least one row of virtual pixels filled and the original pixel points existing in the original image, a first pixel point array centered on the lower boundary pixel point is constructed.

[0072] It should be noted that the advantage of determining the first pixel point array corresponding to the target pixel point based on the above method is that: it can improve the quality and accuracy of the enlarged image; compared with only using the nearest neighbor pixel points, obtaining the associated pixel points around the original pixel points through the preset neighborhood can capture the local features of the image more comprehensively, and provides a rich data basis for subsequent calculation of the target pixel value, effectively reducing jaggedness and blurring, realizing the smooth transition of pixel interpolation information, and enabling the enlarged target image to more accurately restore the image details of the original image; and, by pre-caching the original image into the first cache unit and then batch reading the pixel values according to the position information, repeated access to the memory is avoided, and the calculation efficiency is improved. Furthermore, on the basis of improving the image enlargement efficiency, the image quality of the enlarged target image is improved.

[0073] On the basis of the foregoing embodiments, when the first pixel point array corresponding to the target pixel point is obtained, the target pixel value corresponding to the target pixel point can be determined according to the first pixel point array. When determining the target pixel value corresponding to the target pixel point according to the first pixel point, it can be determined in a variety of ways. Optionally, it includes the nearest neighbor interpolation algorithm, the bilinear interpolation algorithm, and / or the bicubic interpolation algorithm. In this embodiment, in order to make the finally determined target pixel value more accurate, the first pixel point array can be interpolated vertically first, and then the first pixel point array can be interpolated horizontally, that is, first determine the pixel interpolation information of each column in the first pixel point array, and then determine the target pixel value of the target pixel point according to the pixel interpolation information of each column.

[0074] Optionally, the method for determining the pixel interpolation information corresponding to each column includes: determining the pixel interpolation information corresponding to the current column according to the pixel information of the pixel points located in the current column and the original pixel position information of the original pixel points.

[0075] Among them, the first pixel point can be composed of at least one column of pixel points and at least one row of pixel points. The pixel information includes at least pixel position information and pixel value.

[0076] In this embodiment, for at least one column of pixel points included in the first pixel point array, pixel information of at least one pixel point located in the current column can be obtained from the first pixel point array, and interpolation processing can be performed on the pixel information of at least one pixel point located in the current column and the original pixel position information of the original pixel points according to a preset interpolation algorithm to determine pixel interpolation information corresponding to the current column. Optionally, the interpolation algorithm includes a bilinear interpolation algorithm and / or a bicubic interpolation algorithm, etc.

[0077] Optionally, determining pixel interpolation information corresponding to the current column according to the pixel information of the pixel points located in the current column and the pixel position information of the original pixel points includes: for at least one pixel point located in the current column, determining the difference between the ordinate information in the pixel position information of the pixel point and the ordinate information in the original pixel position information of the original pixel points as a first value corresponding to the pixel point; determining a first weight corresponding to the pixel point according to a preset piecewise weight function and the first value; and performing a weighted summation operation on the first weights of at least one pixel point and the pixel values of the pixel points to obtain pixel interpolation information corresponding to the current column.

[0078] Among them, the preset piecewise weight function can be a function that assigns weights according to the distance between the pixel point and the original pixel point. This function is usually a piecewise polynomial. For example, the cubic polynomial function in the bicubic interpolation algorithm. Generally, the piecewise weight function usually includes weight functions corresponding to multiple piecewise intervals. When determining the weight value, the piecewise interval can be determined according to the distance between the pixel point and the original pixel point, and the weight function corresponding to this piecewise interval can be used for weight calculation.

[0079] In a specific implementation, for at least one pixel point located in the current column, the pixel position information of the pixel point and the original pixel position information of the original pixel points can be obtained from the first pixel point array, and the difference between the ordinate information in the pixel position information and the ordinate information in the original pixel position information can be determined and used as the first value corresponding to the pixel point. Further, a weight function matching the first value can be selected from the preset piecewise weight function according to the first value, and the first value can be input into the weight function to obtain the first weight corresponding to the pixel point. Further, in the case where the first weights corresponding to at least one pixel point are determined, for at least one pixel point, the first weight corresponding to the pixel point can be multiplied by the pixel value corresponding to the pixel point to obtain a value to be superimposed corresponding to the pixel point. Further, the values to be superimposed corresponding to at least one pixel point are added together, and the value obtained after the addition is used as the pixel interpolation information corresponding to the current column.

[0080] Exemplarily, continuing to refer to the above example, the original pixel position information of the original pixel point is (149.5, 149.5), and the first pixel point array is The preset piecewise weight function is: where a represents the balance parameter. Preferably, a = -0.5. Taking the current columns (148, 148), (148, 149), (148, 150), and (148, 151) as examples. For the pixel point (148, 148), determine the difference between the ordinate information of this pixel point and the ordinate information of the original pixel position information, and obtain the first value as -1.5. Further, based on this first value, determine the corresponding piecewise weight function as W(x) = a|x| 3 -5a|x| 2 +8a|x|-4a. Substitute the first value -1.5 into this weight function, W(-1.5) = -0.5×(1.5) 3 +2.5×(1.5) 2 -4×1.5+2 = 0. Further, for the pixel point (148, 149), determine the difference between the ordinate information of this pixel point and the ordinate information of the original pixel position information, and obtain the first value as -0.5. Further, based on this first value, determine the corresponding piecewise weight function as W(x) = (a + 2)|x| 3 -(a + 3)|x| 2 +1. Substitute the first value -0.5 into this weight function, W(-0.5) = 1.5×0.5 3 -2.5×0.5 2 +1 = 0.5625; for the pixel point (148, 150), determine the difference between the ordinate information of this pixel point and the ordinate information of the original pixel position information, and obtain the first value as 0.5. Further, based on this first value, determine the corresponding piecewise weight function as W(x) = (a + 2)|x| 3 -(a + 3)|x| 2 +1. Substitute the first value 0.5 into this weight function, W(0.5) = 1.5×0.5 3 -2.5×0.5 2 +1 = 0.5625; for the pixel point (148, 151), determine the difference between the ordinate information of this pixel point and the ordinate information of the original pixel position information, and obtain the first value as 1.5. Further, based on this first value, determine the corresponding piecewise weight function as W(x) = a|x| 3 -5a|x| 2 +8a|x|-4a. Substitute the first value 1.5 into this weight function, W(1.5) = -0.5×(1.5) 3+2.5×(1.5) 2 -4×1.5 + 2 = 0。

[0081] Further, determine the pixel interpolation information corresponding to this column based on the following formula:

[0082]

[0083] where R 148 represents the pixel interpolation information corresponding to the pixel points in the 148th column; j represents the vertical coordinate information in the pixel position information; Δy represents the difference between the vertical coordinate information of the pixel point and the vertical coordinate information in the original pixel position information, that is, the first value; W(Δy) represents the first weight corresponding to the pixel point; f(i, j) represents the pixel value of the pixel point.

[0084] It should be noted that by determining the pixel interpolation information of at least one column of pixel points included in the first pixel point array, the two-dimensional interpolation is decomposed into one-dimensional interpolation in the horizontal and vertical directions, reducing the computational complexity and improving the computational efficiency.

[0085] On the basis of the foregoing embodiments, after obtaining the pixel interpolation information corresponding to at least one column of pixel points, the target pixel value corresponding to the target pixel point can be determined according to at least one pixel interpolation information.

[0086] Optionally, determining the target pixel value of the target pixel point according to at least one pixel interpolation information includes: for at least one pixel interpolation information, determining the horizontal coordinate information corresponding to the pixel point column according to the pixel position information of the pixel points in the pixel point column corresponding to the pixel interpolation information in the first pixel point array; determining the difference between the horizontal coordinate information corresponding to the pixel point column and the horizontal coordinate information in the original pixel position information of the original pixel point as the second value corresponding to the pixel point column; determining the second weight corresponding to the pixel point column according to the preset piecewise weight function and the second value; and processing the second weights of at least one pixel point column and the pixel interpolation information corresponding to each pixel point column through weighted summation operation to obtain the target pixel value corresponding to the target pixel point.

[0087] It can be understood that for a column of pixel points, the horizontal coordinate information in the pixel position information of this column of pixel points is usually the same. Furthermore, this horizontal coordinate information can be used as the horizontal coordinate information corresponding to this pixel point column. The pixel point column corresponding to the pixel interpolation information in the first pixel point array can be understood as that the pixel interpolation information is determined based on the pixel information of the pixel points located in this column.

[0088] In a specific implementation, for at least one pixel interpolation information, according to the pixel position information of the pixels in the pixel column corresponding to the first pixel point array of the pixel interpolation information, the horizontal coordinate information corresponding to the pixel column is determined. Further, the difference between the horizontal coordinate information corresponding to the pixel column and the horizontal coordinate information in the original pixel position information is determined, and this difference is used as the second value corresponding to the pixel column. Further, the weight function matching the second value can be selected from a preset piecewise weight function according to the second value, and the second value is input into the weight function to obtain the second weight corresponding to the pixel column. Further, in the case where the second weights corresponding to at least one pixel column are determined, for at least one pixel column, the second weight corresponding to the pixel column is multiplied by the pixel interpolation information corresponding to the pixel column to obtain the value to be superimposed corresponding to the pixel column. Further, the values to be superimposed corresponding to at least one pixel column are added together, and the value obtained after addition is used as the target pixel value corresponding to the target pixel.

[0089] Exemplarily, continuing to refer to the above example, the horizontal coordinate information corresponding to the 148th column is 148. The difference between this horizontal coordinate information and the horizontal coordinate information in the original pixel position information is determined, and the second value is obtained as -1.5. Further, according to this second value, the corresponding piecewise weight function is determined as W(x) = a|x| 3 -5a|x| 2 +8a|x|-4a. Substitute the second value -1.5 into this weight function, W(-1.5) = -0.5×(1.5) 3 +2.5×(1.5) 2 -4×1.5+2 = 0; the horizontal coordinate information corresponding to the 149th column is 149. The difference between this horizontal coordinate information and the horizontal coordinate information in the original pixel position information is determined, and the second value is obtained as -0.5. Further, according to this second value, the corresponding piecewise weight function is determined as W(x) = (a + 2)|x| 3 -(a + 3)|x| 2 +1. Substitute the second value -0.5 into this weight function, W(-0.5) = 1.5×0.5 3 -2.5×0.5 2 +1 = 0.5625; the horizontal coordinate information corresponding to the 150th column is 150. The difference between this horizontal coordinate information and the horizontal coordinate information in the original pixel position information is determined, and the second value is obtained as 0.5. Further, according to this second value, the corresponding piecewise weight function is determined as W(x) = (a + 2)|x| 3 -(a + 3)|x| 2 +1. Substitute the second value -0.5 into this weight function, W(0.5) = 1.5×0.53 -2.5 × 0.5 2 +1 = 0.5625; The abscissa information corresponding to the 151st column is 151. Determine the difference between this abscissa information and the abscissa information of the original pixel position information, and obtain the second value as 1.5. Further, based on this second value, determine the corresponding piecewise weight function as W(x) = a|x| 3 -5a|x| 2 +8a|x| - 4a. Substitute the second value 1.5 into this weight function, W(1.5) = -0.5×(1.5) 3 +2.5×(1.5) 2 -4×1.5 + 2 = 0.

[0090] Further, determine the target pixel value of the target pixel point based on the following formula:

[0091]

[0092] It should be noted that through the weighted fusion of pixel interpolation information, the balanced transition of pixel values is achieved, effectively reducing the jagged phenomenon after magnification, greatly retaining the details of the magnified image, balancing the smoothness of the image, and thus effectively improving the image quality of the magnified target image.

[0093] Figure 2 It is a schematic structural diagram of an image processing device provided by an embodiment of the present invention. As Figure 2 shown, the device includes: a pixel value determination module 210 and an image generation module 220.

[0094] Among them, the pixel value determination module 210 is configured to, in response to an event of displaying a target image obtained by magnifying an original image, determine target pixel values of at least one target pixel point in the target image according to pixel information corresponding to the original image cached in the first cache unit; an image generation module 220 is configured to generate and display the target image based on the target pixel values of at least one of the target pixel points; among them, the pixel value determination module 210 is specifically configured to construct a first pixel point array corresponding to the target pixel point according to the target pixel position information of the target pixel point, a pre-determined magnification parameter, and pixel information corresponding to the original image cached in the first cache unit; wherein the first pixel point array is used to determine the target pixel value of the target pixel point; the first pixel point array includes pixel information of an original pixel point corresponding to the target pixel point in the original image and pixel information of at least one associated pixel point associated with the original pixel point; the magnification parameter is used to characterize the ratio relationship between the resolution of the magnified first image and the resolution of the second image of the original image; for at least one column of pixel points included in the first pixel point array, determine pixel interpolation information corresponding to the current column according to pixel information corresponding to the pixel points in the current column; determine the target pixel value of the target pixel point according to at least one of the pixel interpolation information.

[0095] The technical solution provided by the embodiments of the present invention, by responding to an event of displaying a target image after magnifying an original image, determines the target pixel values of at least one target pixel point in the target image according to the pixel information corresponding to the original image cached in the first cache unit, avoiding repeated reading of the pixel information of the original image from the original data source, reducing the input-output delay, ensuring a fast response to the magnifying operation, achieving the effect of improving the image processing efficiency on the basis of ensuring real-time performance; and, since the determination method of the target pixel value is: according to the target pixel position information of the target pixel point, the pre-determined magnifying parameter, and the pixel information corresponding to the original image cached in the first cache unit, constructing a first pixel point array corresponding to the target pixel point; wherein, the first pixel point array is used to determine the target pixel value of the target pixel point; the first pixel point array includes the pixel information of the original pixel point corresponding to the target pixel point in the original image and the pixel information of at least one associated pixel point associated with the original pixel point; the magnifying parameter is used to characterize the ratio relationship between the resolution of the magnified first image and the resolution of the second image of the original image; for at least one column of pixel points included in the first pixel point array, according to the pixel information corresponding to the pixel points located in the current column, determining the pixel interpolation information corresponding to the current column; according to at least one pixel interpolation information, determining the target pixel value of the target pixel point, achieving the effect of being able to magnify an image with any resolution to any resolution on the basis of improving the image quality of the magnified target image, enabling the image magnifying operation to adapt to different magnification factors, and improving the universality of the image magnifying operation at any resolution; further, based on the target pixel values of at least one target pixel point, generating a target image and displaying it, achieving a balance between high-quality image magnification and efficient real-time rendering, and meeting the user's demand for image detail display by magnifying a low-resolution original image into a high-resolution target image. The technical solution of the embodiments of the present invention solves the problems such as image quality degradation, edge jagging, and limited magnification resolution existing in the related art when magnifying images, achieves the effect of being able to magnify an image with any resolution to any resolution on the basis of improving the image quality of the magnified target image, meets the large-magnification image magnification requirements in high-resolution application fields, and, while ensuring the image quality of the magnified target image, improves the image processing efficiency, achieving a balance between high-quality images and efficient real-time rendering.

[0096] Optionally, the device further includes: an image receiving module and a pixel information writing module. Among them, the image receiving module is configured to receive an original image and write the pixel information of the original pixel points in the original image into the second buffer unit in sequence according to the pixel point arrangement order; the pixel information writing module is configured to, when the number of the original pixel points written in the second buffer unit reaches a preset number, write the pixel information of the preset number of the written original pixel points into the first buffer unit according to a preset order, and delete the pixel information of the written original pixel points from the second buffer unit.

[0097] Optionally, the pixel value determination module 210 includes: a magnification parameter determination unit, an original pixel position information determination unit, an associated pixel point determination unit, a pixel value acquisition unit, and a pixel point array determination unit.

[0098] The magnification parameter determination unit is configured to obtain a first image resolution and a second image resolution of the original image to be magnified, determine a ratio between the first image resolution and the second image resolution to obtain a magnification parameter;

[0099] The original pixel position information determination unit is configured to obtain target pixel position information of a target pixel point for which a pixel value is to be determined, and determine original pixel position information of an original pixel point corresponding to the target pixel point in the original image according to the target pixel position information and the magnification parameter;

[0100] The associated pixel point determination unit is configured to use the original pixel point as a center, and determine at least one associated pixel point associated with the original pixel point and associated pixel position information of each of the associated pixel points according to the original pixel position information of the original pixel point and a preset neighborhood;

[0101] The pixel value acquisition unit is configured to obtain the original pixel value of the original pixel point and the associated pixel values of at least one of the associated pixel points from the first buffer unit according to the original pixel position information of the original pixel point and the associated pixel position information of at least one of the associated pixel points;

[0102] The pixel point array determination unit is configured to use the original pixel point as a center, and construct a first pixel point array corresponding to the target pixel point based on the original pixel position information and the original pixel value of the original pixel point and the associated pixel position information and the associated pixel values of at least one of the associated pixel points.

[0103] Optionally, the pixel value determination module 210 includes: a pixel interpolation information determination unit. Among them, the pixel interpolation information determination unit is configured to determine pixel interpolation information corresponding to the current column according to the pixel information of the pixel points in the current column and the original pixel position information of the original pixel point.

[0104] Optionally, the pixel interpolation information determining unit includes: a vertical coordinate difference determining subunit, a first weight determining subunit, and a pixel interpolation information determining subunit. Among them, the vertical coordinate difference determining subunit is configured to determine, for at least one pixel point located in the current column, the difference between the vertical coordinate information in the pixel position information of the pixel point and the vertical coordinate information in the original pixel position information of the original pixel point, as a first value corresponding to the pixel point; the first weight determining subunit is configured to determine a first weight corresponding to the pixel point according to a preset piecewise weight function and the first value; the pixel interpolation information determining subunit is configured to process the first weights of at least one pixel point and the pixel values of the pixel points through weighted summation operations to obtain pixel interpolation information corresponding to the current column.

[0105] Optionally, the pixel value determining module 210 includes: an abscissa determining unit, an abscissa difference determining unit, a second weight determining unit, and a target pixel value determining unit. Among them, the abscissa determining unit is configured to determine, for at least one pixel interpolation information, the abscissa information corresponding to the pixel point column according to the pixel position information of the pixel point in the pixel point column corresponding to the pixel interpolation information in the first pixel point array; the abscissa difference determining unit is configured to determine the difference between the abscissa information corresponding to the pixel point column and the abscissa information in the original pixel position information of the original pixel point, as a second value corresponding to the pixel point column; the second weight determining unit is configured to determine a second weight corresponding to the pixel point column according to a preset piecewise weight function and the second value; the target pixel value determining unit is configured to process the second weights of at least one pixel point column and the pixel interpolation information corresponding to each pixel point column through weighted summation operations to obtain a target pixel value corresponding to the target pixel point.

[0106] Optionally, the first buffer unit includes at least four buffer subunits; the storage depth of each buffer subunit is consistent with the image width of the original image; the pixel information cached by at least four buffer subunits is partial pixel information of the original image; correspondingly, the event of displaying the target image after magnifying the original image is that at least four buffer subunits have been completely occupied.

[0107] Optionally, the device further includes: a target cache subunit determination module, a pixel information update module, and a repeated execution module. Among them, the target cache subunit determination module is configured to determine the target cache subunit to be updated in the first cache unit when the target pixel point is the last pixel point in the pixel row where it is located in the target image and the target pixel value corresponding to the target pixel point has been determined; the pixel information update module is configured to determine the pixel information to be updated to the target cache subunit according to the pixel information writing order and the pixel information in the original image that has not been cached into the first cache unit, and update the determined pixel information to the target cache subunit; the repeated execution module is configured to repeatedly execute the operations of determining the target cache subunit and updating the pixel information during the process of determining the target pixel value of the target pixel point until the target pixel point for which the target pixel value has been determined is the last pixel point in the target image.

[0108] The image processing device provided by the embodiment of the present invention can execute the image processing method provided by any embodiment of the present invention, and has the corresponding functional modules and beneficial effects for executing the method.

[0109] Figure 3 FIG. shows a schematic structural diagram of an electronic device 10 that can be used to implement the embodiments of the present invention. The electronic device is intended to represent various forms of digital computers, such as, laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as, personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are only examples and are not intended to limit the implementation of the present invention described and / or claimed herein.

[0110] As Figure 3 shown, the electronic device 10 includes at least one processor 11, and a memory communicatively connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc. Among them, the memory stores a computer program executable by the at least one processor. The processor 11 can execute various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 into the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. The input / output (I / O) interface 15 is also connected to the bus 14.

[0111] Multiple components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disc, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0112] The processor 11 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the processor 11 include but are not limited to a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as the image processing method.

[0113] In some embodiments, the image processing method can be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed onto the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the image processing method described above can be executed. Alternatively, in other embodiments, the processor 11 can be configured to execute the image processing method by any other suitable means (e.g., by means of firmware).

[0114] The various embodiments of the systems and technologies described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include: being implemented in one or more computer programs, which can be executed and / or interpreted on a programmable system including at least one programmable processor, the programmable processor can be a special or general programmable processor, and can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit the data and instructions to the storage system, the at least one input device, and the at least one output device.

[0115] A computer program for implementing the method of the present invention can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowchart and / or block diagram to be implemented. The computer programs can be executed entirely on the machine, partially on the machine, executed partially on the machine and partially on a remote machine as an independent software package, or executed entirely on a remote machine or server.

[0116] In the context of the present invention, a computer-readable storage medium can be a tangible medium that can contain or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer-readable storage medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, the computer-readable storage medium can be a machine-readable signal medium. More specific examples of the machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0117] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or a trackball) through which the user can provide input to the electronic device. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and the input from the user can be received in any form (including acoustic input, speech input, or tactile input).

[0118] The systems and techniques described herein can be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system can be interconnected to each other by digital data communication in any form or medium (e.g., a communication network). Examples of communication networks include: local area network (LAN), wide area network (WAN), target blockchain network, and the Internet.

[0119] The computing system can include a client and a server. The client and the server are generally far from each other and usually interact through a communication network. The client-server relationship is created by computer programs running on respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or a cloud host, which is a host product in the cloud computing service system and solves the defects of difficult management and weak business scalability existing in traditional physical hosts and VPS services.

[0120] In particular, according to an embodiment of the present invention, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, an embodiment of the present invention includes a computer program product that includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes program codes for performing the methods shown in the flowcharts. In such an embodiment, the computer program can be downloaded and installed from the network through the communication unit 19, or installed from the storage unit 18, or installed from the ROM 12. When the computer program is executed by the processor 11, the above-mentioned functions defined in the method of the embodiment of the present invention are executed.

[0121] It should be understood that various forms of the flow shown above can be used, steps can be reordered, added, or deleted. For example, the steps recited in the present invention can be executed in parallel, sequentially, or in a different order, as long as the desired results of the technical solution of the present invention can be achieved, and this is not limited herein.

[0122] The above specific embodiments do not constitute a limitation on the protection scope of the present invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.

Claims

1. An image processing method, characterized in that Including: In response to an event of displaying a target image after magnifying an original image, determine the target pixel value of at least one target pixel point in the target image according to the pixel information corresponding to the original image cached in the first cache unit; Generate the target image based on the target pixel values of at least one of the target pixel points and display it; Wherein, the target pixel value of the target pixel point is determined by the following method: According to the target pixel position information of the target pixel point, a pre-determined magnification parameter, and the pixel information corresponding to the original image cached in the first cache unit, construct a first pixel point array corresponding to the target pixel point; wherein, the first pixel point array is used to determine the target pixel value of the target pixel point; the first pixel point array includes the pixel information of the original pixel point corresponding to the target pixel point in the original image and the pixel information of at least one associated pixel point associated with the original pixel point; the magnification parameter is used to characterize the ratio relationship between the resolution of the magnified first image and the resolution of the second image of the original image; For at least one column of pixel points included in the first pixel point array, determine the pixel interpolation information corresponding to the current column according to the pixel information corresponding to the pixel points in the current column; Determine the target pixel value of the target pixel point according to at least one of the pixel interpolation information.

2. The image processing method according to claim 1, wherein, Further including: Receive an original image, and write the pixel information of the original pixel points in the original image into the second cache unit in sequence according to the arrangement order of the pixel points; When the number of the original pixel points written in the second cache unit reaches a preset quantity, write the pixel information of the preset quantity of the written original pixel points into the first cache unit according to a preset order, and delete the pixel information of the written original pixel points from the second cache unit.

3. The image processing method according to claim 1, wherein The constructing a first pixel point array corresponding to the target pixel point according to the target pixel position information of the target pixel point, a pre-determined magnification parameter, and the pixel information corresponding to the original image cached in the first cache unit includes: Obtain the resolution of the first image and the resolution of the second image of the original image to be magnified, and determine the ratio between the resolution of the first image and the resolution of the second image to obtain a magnification parameter; Obtain the target pixel position information of the target pixel point whose pixel value is to be determined, and determine the original pixel position information of the original pixel point corresponding to the target pixel point in the original image according to the target pixel position information and the magnification parameter; With the original pixel point as the center, determine at least one associated pixel point associated with the original pixel point and the associated pixel position information of each associated pixel point according to the original pixel position information of the original pixel point and a preset neighborhood; Obtain the original pixel value of the original pixel point and the associated pixel values of at least one of the associated pixel points from the first cache unit according to the original pixel position information of the original pixel point and the associated pixel position information of at least one of the associated pixel points; Construct a first pixel point array corresponding to the target pixel point centered on the original pixel point, based on the original pixel position information and original pixel value of the original pixel point, and the associated pixel position information and associated pixel value of at least one of the associated pixel points.

4. The image processing method according to claim 1, characterized in that The determining of the pixel interpolation information corresponding to the current column according to the pixel information corresponding to the pixel points in the current column includes: Determine the pixel interpolation information corresponding to the current column according to the pixel information of the pixel points in the current column and the original pixel position information of the original pixel point.

5. The image processing method according to claim 4, characterized in that, The pixel information includes pixel position information and pixel value; The determining of the pixel interpolation information corresponding to the current column according to the pixel information of the pixel points in the current column and the pixel position information of the original pixel point includes: For at least one pixel point in the current column, determine the difference between the ordinate information in the pixel position information of the pixel point and the ordinate information in the original pixel position information of the original pixel point as the first value corresponding to the pixel point; Determine the first weight corresponding to the pixel point according to a preset piecewise weight function and the first value; Process the first weights of at least one of the pixel points and the pixel values of the pixel points through a weighted summation operation to obtain the pixel interpolation information corresponding to the current column.

6. The image processing method according to claim 1, wherein The determining of the target pixel value of the target pixel point according to at least one of the pixel interpolation information includes: For at least one pixel interpolation information, determine the abscissa information corresponding to the pixel point column according to the pixel position information of the pixel points in the pixel point column corresponding to the pixel interpolation information in the first pixel point array; Determine the difference between the abscissa information corresponding to the pixel point column and the abscissa information in the original pixel position information of the original pixel point as the second value corresponding to the pixel point column; Determine the second weight corresponding to the pixel point column according to a preset piecewise weight function and the second value; Process the second weights of at least one of the pixel point columns and the pixel interpolation information corresponding to each pixel point column through a weighted summation operation to obtain the target pixel value corresponding to the target pixel point.

7. The image processing method according to claim 1, wherein The first cache unit includes at least four cache sub-units; the storage depth of each cache sub-unit is consistent with the image width of the original image; The pixel information cached by at least four cache sub-units is partial pixel information of the original image; correspondingly, the event of displaying the target image after magnifying the original image is that at least four cache sub-units have been completely occupied.

8. The image processing method according to claim 7, wherein Further includes: In the case where the target pixel point is the last pixel point in the pixel row where it is located in the target image and the target pixel value corresponding to the target pixel point has been determined, determine the target cache sub-unit to be updated in the first cache unit; Determine the pixel information to be updated to the target cache subunit according to the writing order of pixel information and the pixel information in the original image that has not been cached in the first cache unit, and update the determined pixel information to the target cache subunit; During the process of determining the target pixel value of the target pixel point, repeatedly perform the operations of determining the target cache subunit and updating the pixel information until the target pixel point for which the target pixel value has been determined is the last pixel point in the target image.

9. An image processing apparatus, characterized in that, It includes: A pixel value determination module, configured to respond to an event of displaying a target image obtained by magnifying an original image, and determine the target pixel value of at least one target pixel point in the target image according to the pixel information corresponding to the original image cached in the first cache unit; An image generation module, configured to generate and display the target image based on the target pixel values of at least one of the target pixel points; Among them, the pixel value determination module is specifically configured to construct a first pixel point array corresponding to the target pixel point according to the target pixel position information of the target pixel point, a pre-determined magnification parameter, and the pixel information corresponding to the original image cached in the first cache unit; wherein, the first pixel point array is used to determine the target pixel value of the target pixel point; the first pixel point array includes the pixel information of the original pixel point corresponding to the target pixel point in the original image and the pixel information of at least one associated pixel point associated with the original pixel point; the magnification parameter is used to represent the ratio relationship between the resolution of the magnified first image and the resolution of the original second image; for at least one column of pixel points included in the first pixel point array, determine the pixel interpolation information corresponding to the current column according to the pixel information corresponding to the pixel points in the current column; determine the target pixel value of the target pixel point according to at least one of the pixel interpolation information.

10. An electronic device, characterized in that, The electronic device includes: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the image processing method according to any one of claims 1-8.

Images