Image processing method and apparatus

Abstract

The present application belongs to the technical field of photography. Disclosed are an image processing method and apparatus. The method is executed by an electronic device, which comprises an image sensor, wherein the image sensor comprises a first pixel array. The method comprises: receiving a photographing input; in response to the photographing input, collecting an original image by means of an image sensor, wherein the array mode of an image pixel array of the original image is the same as the array mode of a first pixel array; and when a first zoom ratio corresponding to the first pixel array is greater than a second zoom ratio selected by a user, determining a target array mode matching the second zoom ratio, and converting the array mode of the image pixel array of the original image into the target array mode, so as to obtain a target image.

Description

Image processing method and device

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to Chinese patent application No. 202410377387.6 filed in China on March 29, 2024, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present application belongs to the field of photographing technology, and specifically relates to an image processing method and device thereof. Background Art

[0004] With the development of electronic devices, more and more functions are included in the electronic devices. For example, the electronic devices can perform zoom processing on an image to obtain a zoomed image.

[0005] In related technologies, electronic devices can typically use optical zoom to zoom the original image captured by the image sensor in the electronic device. For example, taking the pixel array in the image sensor as a Nonabayer array, since the Nonabayer array corresponds to a fixed 3x equivalent optical zoom, the electronic device can only achieve a 3x equivalent optical zoom through the Nonabayer array. For zoom ratios between 1 and 3 times, digital zoom is typically used to achieve zooming. Specifically, digital zoom means that the electronic device cuts out a portion of the image from the original data image based on the zoom center, and then magnifies the portion of the image to a 2x zoom ratio to obtain a zoomed image.

[0006] However, because digital zoom typically magnifies a portion of an image, the captured image details are less comprehensive, resulting in poor quality of the resulting zoomed image. Consequently, if the user-selected zoom factor does not match the pixel array of the electronic device's image sensor, the zoomed image captured by the electronic device will have poor quality. Summary of the Invention

[0007] The purpose of the embodiments of the present application is to provide an image processing method and apparatus thereof, which can improve the image quality of a zoomed image when the zoom factor selected by a user does not match the pixel array in the image sensor of the electronic device.

[0008] In a first aspect, an embodiment of the present application provides an image processing method, which is applied to an electronic device, the electronic device including an image sensor, the image sensor including a first pixel array; the image processing method includes: receiving a shooting input; in response to the shooting input, acquiring an original image through the image sensor, the array pattern of the image pixel array of the original image is the same as the array pattern of the first pixel array; when a first zoom ratio corresponding to the first pixel array is greater than a second zoom ratio selected by a user, determining a target array pattern that matches the second zoom ratio, and converting the array pattern of the image pixel array of the original image into the target array pattern to obtain a target image.

[0009] In a second aspect, an embodiment of the present application provides an image processing device for use in an electronic device, the electronic device including an image sensor including a first pixel array; the image processing device including: a receiving module, an acquisition module, and a processing module; the receiving module is configured to receive a shooting input. The acquisition module is configured to acquire an original image through the image sensor in response to the shooting input received by the receiving module, wherein the array pattern of the image pixel array of the original image is the same as the array pattern of the first pixel array. The processing module is configured to determine a target array pattern that matches the second zoom ratio when a first zoom ratio corresponding to the first pixel array is greater than a second zoom ratio selected by a user, and convert the array pattern of the image pixel array of the original image into the target array pattern to obtain a target image.

[0010] In a third aspect, an embodiment of the present application provides an electronic device comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0011] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0012] In a fifth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the method described in the first aspect.

[0013] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the method described in the first aspect.

[0014] In an embodiment of the present application, after receiving a shooting input, an original image is captured through an image sensor, and the array pattern of the image pixel array of the original image is the same as the array pattern of the first pixel array. When the first zoom ratio corresponding to the first pixel array is greater than the second zoom ratio selected by the user, the electronic device can determine a target array pattern that matches the second zoom ratio based on the second zoom ratio, and change the array pattern of the image pixel array of the original image based on the target array pattern to obtain a target image corresponding to the second zoom ratio. In this way, by changing the array pattern of the image pixel array of the original image, the pixel array corresponding to the second zoom ratio is simulated, so that the electronic device performs equivalent optical zoom through the simulated pixel array corresponding to the second zoom ratio. In this way, even if the zoom ratio selected by the user does not match the pixel array in the image sensor of the electronic device, the electronic device can still achieve equivalent optical zoom, thereby improving the image quality of the zoomed image acquired by the electronic device. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] FIG1 is a flow chart of an image processing method provided by an embodiment of the present application;

[0016] FIG2 is a schematic diagram of an example of a second pixel matrix provided in an embodiment of the present application;

[0017] FIG3 is a second schematic diagram of an example of a second pixel matrix provided in an embodiment of the present application;

[0018] FIG4 is a third example schematic diagram of a second pixel matrix provided in an embodiment of the present application;

[0019] FIG5 is a fourth schematic diagram of an example of a second pixel matrix provided in an embodiment of the present application;

[0020] FIG6 is a schematic structural diagram of an image processing device provided in an embodiment of the present application;

[0021] FIG7 is a schematic diagram of a hardware structure of an electronic device provided in an embodiment of the present application;

[0022] FIG8 is a second schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0023] The following will be combined with the accompanying drawings in the embodiments of this application to clearly describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.

[0024] The terms "first," "second," and the like in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of this application can be implemented in an order other than that illustrated or described herein, and that the objects distinguished by "first," "second," and the like are generally of the same type, and do not limit the number of objects; for example, the first object can be one or more. In addition, the term "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0025] The terms "at least one" and "at least one of" in the specification and claims of this application refer to any one, any two, or a combination of more than two of the objects included. For example, at least one of a, b, and c can be represented by: "a", "b", "c", "a and b", "a and c", "b and c", and "a, b, and c", where a, b, and c can be single or multiple. Similarly, "at least two" means two or more, and its meaning is similar to "at least one".

[0026] The following is a detailed explanation of the professional terms involved in the image processing method provided in this application.

[0027] 1) Image sensor

[0028] An image sensor, also known as a photosensitive element, is a device that converts optical image information into electrical signals. It is widely used in digital cameras and other electronic optical devices. Image sensors include charge coupled device (CDD) image sensors and complementary metal oxide semiconductor (CMOS) image sensors.

[0029] For example, an image sensor generally includes a pixel array, which includes a plurality of pixel units, each of which includes at least one pixel point. Generally, different pixel array arrangements correspond to different numbers of pixel points in the pixel units of the pixel array.

[0030] For example, the pixel array in an image sensor is typically a Bayer array or an extended Bayer array. Typically, a conventional Bayer array has a 1x1 pixel arrangement.

[0031] For example, an extended array of a Bayer array may include any of the following:

[0032] The Nonbayer array expands the Bayer array into a 3x3 pixel arrangement, with each 3x3 area having the same color filter. This provides higher color resolution and image quality by combining nine adjacent pixels into a sub-pixel unit and sharing the color filter.

[0033] Quadbayer: The Bayer array is extended to a 2x2 pixel arrangement, with each 2x2 area having the same color filter; that is, it provides higher color resolution and image quality by combining four adjacent pixels into a sub-pixel unit and sharing the color filter;

[0034] Hexbayer: The Bayer array is extended to a 4x4 pixel arrangement, and each 4x4 area has the same color filter; that is, it provides higher color resolution and image quality by combining 16 adjacent pixels into a sub-pixel unit and sharing the color filter.

[0035] 2) Equivalent optical zoom

[0036] Equivalent optical zoom refers to the use of relevant methods to simulate optical zoom, achieving the optical magnification effect while introducing minimal image quality loss.

[0037] 3) TetraPixel

[0038] TetraPixel is a camera pixel arrangement technology that provides higher color resolution and image quality by combining four adjacent pixels into a sub-pixel unit and sharing color filters. It is a variation of the traditional Bayer arrangement used to improve color reproduction and detail expression.

[0039] 4) Tetra2Pixel

[0040] Tetra2Pixel is a camera pixel arrangement technology that provides higher color resolution and image quality by combining 16 adjacent pixels into a sub-pixel unit and sharing color filters. It is a variation of the traditional Bayer arrangement used to improve color reproduction and detail expression.

[0041] 4) RAW images

[0042] RAW is an English word, which means "raw" in Chinese. RAW image is the original data that the image sensor converts the captured light source signal into a digital signal.

[0043] The image processing method provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0044] The image processing method provided in the embodiment of the present application can be applied in zoom shooting scenarios.

[0045] With the development of electronic devices, more and more functions are being added to them. For example, electronic devices can perform zoom processing on images captured by the electronic devices to obtain zoomed images. Generally, electronic devices can perform zoom processing on images captured by the electronic devices through image sensors using equivalent optical zoom and digital zoom methods to obtain zoomed images.

[0046] In the related art, taking the pixel array in the image sensor in the electronic device as an example, which is a Nonabayer array, since the pixel arrangement of the pixel unit in the Nonabayer array is a 3x3 pixel arrangement, when the user wants to select a 3x zoom ratio for shooting, after the electronic device collects the original data image, that is, the raw image, through the Nonabayer array, each pixel point in the raw image can be split into 9 pixel points, thereby expanding the number of pixel points in the raw image to 3 times the original number. In this way, a 3x equivalent optical zoom of the original data image can be achieved.

[0047] Normally, in order to ensure that equivalent optical zoom can be achieved, the actual zoom ratio needs to match the array arrangement of the pixel array in the image sensor. Since the array arrangement of the Nonabayer array is a fixed 3x3 pixel arrangement, the electronic device can only achieve a 3x equivalent optical zoom. For equivalent optical zoom between 1 and 3 times, digital zoom is usually used to achieve zoom. Specifically, digital zoom refers to the electronic device cutting out a part of the image from the original data image according to the zoom center, and then enlarging the part of the image to a 2x zoom ratio to obtain an enlarged image. However, the above-mentioned digital zoom method only enlarges part of the image and does not actually capture more image details, resulting in serious damage to the clarity of the enlarged image. As a result, the image quality of the zoomed image taken by the electronic device at a specific zoom ratio is poor.

[0048] In the image processing method and device provided in the embodiments of the present application, the electronic device simulates the pixel array corresponding to the second zoom ratio by changing the array pattern of the image pixel array of the original image, so that the electronic device performs equivalent optical zoom through the simulated pixel array corresponding to the second zoom ratio. In this way, when the zoom ratio selected by the user does not match the pixel array in the image sensor of the electronic device, the electronic device can still achieve equivalent optical zoom, thereby improving the image quality of the zoom image acquired by the electronic device.

[0049] The image processing method provided in the embodiment of the present application may be executed by an image processing device, which may be an electronic device or a functional module in an electronic device. The technical solution provided in the embodiment of the present application is described below using an electronic device as an example.

[0050] An embodiment of the present application provides an image processing method. FIG1 shows a flowchart of the image processing method provided in the embodiment of the present application. The image processing method is applied to an electronic device including an image sensor including a first pixel array. As shown in FIG1 , the image processing method provided in the embodiment of the present application may include the following steps 201 to 203.

[0051] Step 201: The electronic device receives a shooting input.

[0052] In the embodiment of the present application, the above-mentioned shooting input is used to shoot a zoom image.

[0053] Optionally, in an embodiment of the present application, the electronic device can display a shooting preview interface based on the user's input, which includes shooting controls and zoom controls. Then, the user can input the zoom controls and shooting controls so that the electronic device can shoot a zoom image.

[0054] Optionally, in an embodiment of the present application, the above-mentioned shooting input may include: user input to the zoom control and input to the shooting control.

[0055] Optionally, in the embodiment of the present application, the above-mentioned shooting input can be a user input to the shooting control; or it can be a sound input.

[0056] For example, the shooting input may be any of the following: a click input, a long press input, a sliding input, or a preset trajectory input of the shooting control by the user. Specific input may be determined based on actual conditions and is not limited in the present embodiment.

[0057] Exemplarily, a shooting preview interface is displayed, which displays a 1× zoom ratio mark, a 2× zoom ratio mark, and a 3× zoom ratio mark. The user can click and input the 2× zoom ratio mark to enable the electronic device to determine that the current zoom ratio is a 2× zoom ratio. Then, the user can click the shooting control so that the electronic device receives the shooting input.

[0058] Step 202: The electronic device captures an original image through an image sensor in response to a shooting input.

[0059] In the embodiment of the present application, the array pattern of the image pixel array of the original image is the same as the array pattern of the first pixel array.

[0060] It should be noted that the above original image is a RAW image.

[0061] Optionally, in the embodiment of the present application, the first pixel array may be any one of the following: a Nonabayer array, a Quadbayer array, and a Hexbayer array. The pixel array in the image sensor in the present application takes the Nonabayer array as an example.

[0062] In the embodiment of the present application, the above-mentioned array pattern is the arrangement of pixels in the image sensor.

[0063] For example, assuming that the arrangement of pixels in the image sensor is 3×3, the array pattern of pixels in the original image is also 3×3.

[0064] Step 203: When the first zoom ratio corresponding to the first pixel array is greater than the second zoom ratio selected by the user, the electronic device determines a target array pattern that matches the second zoom ratio, and converts the array pattern of the image pixel array of the original image into the target array pattern to obtain a target image.

[0065] Optionally, in an embodiment of the present application, the second zoom ratio selected by the user is the second zoom ratio selected by the user when the electronic device displays a shooting preview interface, and the user inputs the zoom ratio identifier of the target among the at least one zoom ratio identifier, i.e., the 1× zoom ratio identifier, the 2× zoom ratio identifier, and the 3× zoom ratio identifier.

[0066] Exemplarily, the second zoom ratio may be a 2× zoom ratio.

[0067] In the embodiment of the present application, the electronic device can convert the array pattern of the image pixel array of the original image into a target array pattern through the pixel points in the image pixel array of the original image to obtain a target image.

[0068] In the image processing method provided in an embodiment of the present application, after receiving a shooting input, an original image is captured through an image sensor, and the array pattern of the image pixel array of the original image is the same as the array pattern of the first pixel array. When a first zoom ratio corresponding to the first pixel array is greater than a second zoom ratio selected by the user, the electronic device can determine a target array pattern that matches the second zoom ratio based on the second zoom ratio, and change the array pattern of the image pixel array of the original image based on the target array pattern to obtain a target image corresponding to the second zoom ratio. In this way, by changing the array pattern of the image pixel array of the original image, the pixel array corresponding to the second zoom ratio is simulated, so that the electronic device performs equivalent optical zoom through the simulated pixel array corresponding to the second zoom ratio. In this way, even if the zoom ratio selected by the user does not match the pixel array in the image sensor of the electronic device, the electronic device can still achieve equivalent optical zoom, thereby improving the image quality of the zoomed image acquired by the electronic device.

[0069] Optionally, in an embodiment of the present application, the step 203 of "converting the array pattern of the image pixel array of the original image into a target array pattern to obtain a target image" can be specifically implemented through the following steps 203a and 203b.

[0070] Step 203a: The electronic device converts the first pixel matrix corresponding to each pixel unit in the first pixel array in the image pixel array of the original image into a second pixel matrix according to the target array mode to obtain a target image.

[0071] In the embodiment of the present application, the pixel points included in the image pixel array of the original image correspond one-to-one to the pixel points included in the first pixel array.

[0072] Exemplarily, each pixel unit in the first pixel array is divided in advance.

[0073] Optionally, in an embodiment of the present application, the electronic device may convert the first pixel matrix into a second pixel matrix by performing inter-pixel recombination, copying, merging, etc. on pixel points in the first pixel matrix.

[0074] It can be understood that for each pixel matrix in the original image, the electronic device can perform the above-mentioned pixel-to-pixel reorganization, copying, merging and other processing, thereby converting each pixel matrix into a second pixel matrix, thereby obtaining the target image.

[0075] It should be noted that the number of pixels in the first pixel matrix is ​​greater than the number of pixels in the second pixel matrix.

[0076] Optionally, in an embodiment of the present application, the electronic device may calculate the RGB value of each pixel in the adjusted original image through an interpolation algorithm, thereby obtaining a target image.

[0077] In an embodiment of the present application, the electronic device simulates the pixel array corresponding to the second zoom ratio by changing the array pattern of the image pixel array of the original image, so that the electronic device performs equivalent optical zoom through the simulated pixel array corresponding to the second zoom ratio. In this way, when the zoom ratio selected by the user does not match the pixel array in the image sensor of the electronic device, the electronic device can still achieve equivalent optical zoom, thereby improving the image quality of the zoom image acquired by the electronic device.

[0078] Optionally, in an embodiment of the present application, the above step 203a can be specifically implemented through the following steps 301 to 303.

[0079] Step 301: The electronic device determines, from an image pixel array of an original image, a first pixel matrix corresponding to a first pixel unit in a first pixel array.

[0080] In the embodiment of the present application, the electronic device may divide the pixel points in the image pixel array of the original image according to the number of first pixel units in the first pixel array, thereby obtaining a first pixel matrix.

[0081] It should be noted that, since the image pixel array of the original image is completely consistent with the first pixel array, the number and position of pixel units in the first pixel array are also consistent with the number and position of pixel matrices in the image pixel array of the original image.

[0082] Step 302: The electronic device extracts M first pixel points from a first pixel matrix corresponding to a first pixel unit according to a target array pattern.

[0083] In the embodiment of the present application, the M first pixel points are non-repeated pixel points in the first pixel matrix.

[0084] In the embodiment of the present application, M is determined based on the target array pattern.

[0085] In an embodiment of the present application, the electronic device may randomly extract M first pixel points from the first pixel matrix according to a target array pattern.

[0086] For example, assuming that the target array pattern is 2×2 and the array pattern corresponding to the first pixel matrix is ​​3×3, the electronic device can randomly extract 4 first pixel points from the 3×3 pixel matrix.

[0087] The above embodiment is explained in detail below through specific examples.

[0088] Method 1: As shown in FIG2 , the first pixel matrix includes 9 pixel points A to I, and the electronic device can randomly extract 4 pixel points A, B, D, and E from the first pixel matrix.

[0089] Method 2: As shown in FIG2 , the first pixel matrix includes 9 pixel points A to I, and the electronic device can randomly extract 4 pixel points A, C, G, and I from the first pixel matrix.

[0090] Method 3: As shown in FIG2 , the first pixel matrix includes 9 pixel points A to I, and the electronic device can randomly extract 4 pixel points B, F, D, and H from the first pixel matrix.

[0091] It should be noted that the above three methods only list three possible implementation methods, which can be determined according to actual usage and are not limited in the embodiments of this application.

[0092] Optionally, in an embodiment of the present application, the electronic device may extract M first pixel points from the first pixel matrix according to user needs.

[0093] Step 303: The electronic device splices the M first pixel points to form a second pixel matrix corresponding to the first pixel unit.

[0094] In the embodiment of the present application, the first pixel unit is a pixel unit in the first pixel array.

[0095] Optionally, in an embodiment of the present application, the electronic device may splice the M first pixel points according to the positions of the M first pixel points in the first pixel matrix to form a second pixel matrix corresponding to the first pixel unit.

[0096] Optionally, in an embodiment of the present application, the electronic device may randomly splice M first pixel points to form a second pixel matrix corresponding to the first pixel unit.

[0097] It should be noted that, for each first pixel matrix in the image pixel array of the original image, the electronic device can employ the above-described embodiment to convert each first pixel matrix in the image pixel array of the original image into a second pixel matrix corresponding to each first pixel matrix. To avoid repetition, further details are omitted here.

[0098] In an embodiment of the present application, the electronic device can convert the first pixel matrix into the second pixel matrix by means of a subsampling method. When the zoom factor selected by the user does not match the pixel array in the image sensor of the electronic device, the electronic device can still achieve equivalent optical zoom, thereby improving the image quality of the zoom image obtained by the electronic device.

[0099] Optionally, in an embodiment of the present application, the above step 203a can be specifically implemented through the following steps 401 to 403.

[0100] Step 401: The electronic device determines, from an image pixel array of an original image, a first pixel matrix corresponding to a second pixel unit in a first pixel array.

[0101] It should be noted that the specific implementation process can be found in the above embodiments, and will not be described again here to avoid repetition.

[0102] Step 402: The electronic device extracts at least two groups of pixel points from the first pixel matrix corresponding to the second pixel unit according to the target array mode.

[0103] In the embodiment of the present application, each of the at least two groups of pixel points includes M second pixel points, where M is determined based on the target array pattern.

[0104] Optionally, in an embodiment of the present application, the electronic device may randomly extract at least two groups of pixel points from the first pixel matrix corresponding to the second pixel unit according to the target array pattern.

[0105] Optionally, in an embodiment of the present application, the electronic device may randomly extract at least two groups of pixel points from the first pixel matrix corresponding to the second pixel unit according to a preset extraction rule.

[0106] Exemplarily, as shown in FIG3 , the electronic device may extract four groups of pixel points corresponding to the four corners ABDE, BCEF, DEGH and EFHI in the first pixel matrix, thereby obtaining four groups of pixel points.

[0107] As another example, as shown in FIG3 , the electronic device may extract four pixels in each of the four corners ACGI and four pixels in the center cross direction BFDH in the first pixel matrix, and then copy the middle pixel E four times, thereby obtaining three groups of pixel points.

[0108] Step 403: The electronic device obtains a second pixel matrix corresponding to the second pixel unit based on at least two groups of pixel points.

[0109] In the embodiment of the present application, the second pixel unit is a pixel unit in the first pixel array.

[0110] Optionally, in an embodiment of the present application, the electronic device may perform a fusion process or a splicing process on at least two groups of pixel points, thereby obtaining a second pixel matrix corresponding to the second pixel unit.

[0111] In an embodiment of the present application, the electronic device can convert a first pixel matrix into a second pixel matrix through at least two groups of pixel points. When the zoom factor selected by the user does not match the pixel array in the image sensor of the electronic device, the electronic device can still achieve equivalent optical zoom, thereby improving the image quality of the zoom image obtained by the electronic device.

[0112] Optionally, in an embodiment of the present application, the above step 403 can be specifically implemented through the following steps 501 and 502.

[0113] Step 501: When the number of groups of at least two pixel points is M, the electronic device obtains the average brightness value of the first group of pixel points, adjusts the brightness value of each second pixel point in the first group of pixel points to the average brightness value, and merges all pixel points in the first group of pixel points after brightness adjustment into one pixel point.

[0114] Optionally, in an embodiment of the present application, the electronic device may obtain an average brightness value of the first group of pixels through a mean algorithm.

[0115] For example, assuming that the first group of pixels includes pixels A, B, C, and D, the electronic device can obtain the average brightness value corresponding to the first group of pixels by the following formula 1. Formula 1 is specifically: E = (A1 + B1 + C1 + D1) / 4 (1)

[0116] Wherein, E is the average brightness value corresponding to the first group of pixels, A1 is the brightness value of pixel A, B1 is the brightness value of pixel B, C1 is the brightness value of pixel C, and D1 is the brightness value of pixel D.

[0117] Optionally, in an embodiment of the present application, the electronic device may obtain the average brightness value of the first group of pixels through a weighted average algorithm.

[0118] For example, assuming that the first group of pixels includes pixels A, B, C, and D, the weight of pixel A is R1, the weight of pixel B is R2, the weight of pixel C is R3, and the weight of pixel D is R4; then the electronic device can obtain the average brightness value corresponding to the first group of pixels using the following formula 2. Formula 2 is specifically: E = (R1A1 + R2B1 + R3C1 + R4D1) / (R1 + R2 + R3 + R4) (2)

[0119] Wherein, E is the average brightness value corresponding to the first group of pixels, A1 is the brightness value of pixel A, B1 is the brightness value of pixel B, C1 is the brightness value of pixel C, and D1 is the brightness value of pixel D.

[0120] Step 502: The electronic device splices the fused pixel points corresponding to each group of pixel points in the M groups of pixel points to form a second pixel matrix corresponding to the first pixel unit.

[0121] In an embodiment of the present application, the electronic device can fuse each group of pixel points in M ​​groups of pixel points into M pixel points, and then splice the M pixel points to obtain a second pixel matrix corresponding to the first pixel unit.

[0122] For example, as shown in Figure 4, assuming that the first pixel matrix corresponding to the first pixel unit includes 9 pixel points A to I, the electronic device can extract 4 groups of pixel points from the first pixel matrix in sequence, and the 4 groups of pixel points are A, B, D, E; B, C, E, F; D, E, G, H and E, F, H, I; the electronic device can calculate the average brightness value of the 4 pixel points A, B, D, E, and adjust the brightness value of each second pixel point in A, B, D, E to the average brightness value; then the 4 pixel points A, B, D, E are merged into one pixel point W. For the three groups of pixels B, C, E, F; D, E, G, H and E, F, H, I, the electronic device can calculate the average brightness values ​​of the three groups of pixels respectively, and adjust the brightness value of each pixel in the three groups of pixels to the average brightness value corresponding to the three groups of pixels, and fuse them to obtain the fused X, Y, Z pixel points corresponding to the three groups of pixels respectively, and then splice the W, X, Y, Z pixel points to obtain the second pixel matrix 11.

[0123] In the embodiments of the present application, the electronic device uses the averaging method to integrate the original pixel information, without losing pixel information while obtaining more details, more accurate colors, and lower noise levels. This helps produce clearer, more realistic images, improving image quality and detail.

[0124] Optionally, in an embodiment of the present application, the above step 403 can be specifically implemented through the following step 501.

[0125] Step 501: The electronic device superimposes at least two groups of pixels according to a target array pattern, and merges all pixels at the same pixel superposition position into one pixel to obtain a second pixel matrix corresponding to a second pixel unit.

[0126] In an embodiment of the present application, after obtaining at least two groups of pixel points, the electronic device can input the at least two groups of pixel points into a neural network model, thereby fusing all pixel points at the same pixel superposition position into one pixel point, and obtaining a second pixel matrix corresponding to the second pixel unit.

[0127] For example, assuming that the first pixel matrix includes 9 pixels A to I, the electronic device can extract 4 groups of pixel points from the first pixel matrix in sequence, and the 4 groups of pixel points are A, B, D, E; B, C, E, F; D, E, G, H and E, F, H, I; then, the electronic device can input the 4 groups of pixel points into the neural network model respectively to fuse all pixel points at the same pixel superposition position into one pixel point to obtain a second pixel matrix corresponding to the second pixel unit.

[0128] As another example, assuming that the first pixel matrix includes 9 pixels A to I, the electronic device can extract 3 groups of pixel points from the first pixel matrix in sequence, and the 3 groups of pixel points are A, C, G, I; B, F, D, H and E, E, E, E, and then the electronic device can input the 3 groups of pixel points into the neural network model respectively to fuse all pixel points at the same pixel superposition position into one pixel point to obtain a second pixel matrix corresponding to the second pixel unit.

[0129] In an embodiment of the present application, the electronic device can reduce the resolution of the spatial dimension, increase the depth in the channel dimension, and convert the spatial dimension information into the depth dimension through the above embodiment, thereby maintaining the original pixel information and ensuring the clarity of the image.

[0130] Optionally, in an embodiment of the present application, the above step 203a can be specifically implemented through the following steps 601 and 602.

[0131] Step 601: The electronic device extracts M pixel matrices from the image pixel array of the original image according to the target array pattern.

[0132] In the embodiment of the present application, M is determined based on the target array pattern.

[0133] In the embodiment of the present application, the number of pixel points contained in each of the above-mentioned M pixel matrices is different.

[0134] Optionally, in an embodiment of the present application, the electronic device may randomly extract M pixel matrices from the image pixel array of the original image; or, the above-mentioned M pixel matrices are set in advance by the user.

[0135] For example, assuming that the first pixel matrix includes 9 pixels A to I, the electronic device can randomly extract 4 groups of pixel points from the first pixel matrix in sequence, and the 4 groups of pixel points are distributed as A, B, D, E; G, H; C, F; and I. Then the electronic device can splice the above 4 groups of pixel points according to the arrangement rules of the 4 groups of pixel points in the image pixel array of the original image. The 4 groups of pixel points form a pixel matrix.

[0136] Step 602: The electronic device stitches M pixel matrices together to obtain a target image.

[0137] Optionally, in an embodiment of the present application, the electronic device may transform the first pixel array in the image sensor into the above-mentioned M pixel matrices.

[0138] For example, as shown in Figure 5, taking a pixel unit in the first pixel array as an example, the pixel matrix corresponding to the pixel unit includes 9 pixel points from A to I. The electronic device can merge ABDE into W, CF into X, GH into Y, and I remains unchanged and becomes Z, thereby realizing the conversion from a 3x3 array to a 2x2 array.

[0139] In the embodiment of the present application, the electronic device can improve its sampling signal-to-noise ratio by expanding the area of ​​a single pixel, thereby improving the image quality of the zoom image.

[0140] It should be noted that the above-mentioned method embodiments, or various possible implementation methods in each method embodiment, can be executed separately, or, under the premise that there is no contradiction, can also be executed in combination with each other. The specific implementation can be determined according to actual usage requirements, and the embodiments of this application do not limit this.

[0141] It should be noted that the image processing method provided in the embodiments of the present application can be executed by an image processing device, an electronic device, or a functional module or entity in an electronic device. In the embodiments of the present application, the image processing device provided in the embodiments of the present application is described by taking the image processing method executed by the image processing device as an example.

[0142] FIG6 shows a possible structural diagram of an image processing device involved in an embodiment of the present application. As shown in FIG6 , the image processing device 70 may include: a receiving module 71 , a collection module 72 , and a processing module 73 .

[0143] The receiving module 71 is configured to receive a shooting input. The acquisition module is configured to, in response to the shooting input received by the receiving module 71, capture an original image via an image sensor, wherein the array pattern of the image pixel array of the original image is the same as the array pattern of the first pixel array. The processing module 73 is configured to, when a first zoom magnification corresponding to the first pixel array is greater than a second zoom magnification selected by the user, determine a target array pattern that matches the second zoom magnification, and convert the array pattern of the image pixel array of the original image into the target array pattern to obtain a target image.

[0144] In a possible implementation, the processing module 73 is specifically configured to convert a first pixel matrix corresponding to each pixel unit in the first pixel array in the image pixel array of the original image into a second pixel matrix according to a target array mode to obtain a target image.

[0145] In one possible implementation, the processing module 73 is specifically configured to determine, from the image pixel array of the original image, a first pixel matrix corresponding to a first pixel unit in the first pixel array; extract, according to a target array pattern, M first pixel points from the first pixel matrix corresponding to the first pixel unit, where M is determined based on the target array pattern; and splice the M first pixel points to form a second pixel matrix corresponding to the first pixel unit, where the first pixel unit is a pixel unit in the first pixel array.

[0146] In one possible implementation, the processing module 73 is specifically configured to determine, from the image pixel array of the original image, a first pixel matrix corresponding to the second pixel unit in the first pixel array; extract, according to a target array pattern, at least two groups of pixel points from the first pixel matrix corresponding to the second pixel unit, each group of pixel points including M second pixel points, where M is determined based on the target array pattern; and obtain, based on the at least two groups of pixel points, a second pixel matrix corresponding to the second pixel unit, where the second pixel unit is a pixel unit in the first pixel array.

[0147] In one possible implementation, the above-mentioned processing module 73 is specifically used to obtain the average brightness value of the first group of pixel points when the number of groups of at least two pixel points is M, and adjust the brightness value of each second pixel point in the first group of pixel points to the average brightness value, and fuse all the pixel points in the first group of pixel points after brightness adjustment into one pixel point; splice the pixel points corresponding to the fusion of each group of pixel points to form a second pixel matrix corresponding to the first pixel unit.

[0148] In a possible implementation, the processing module 73 is specifically configured to superimpose at least two groups of pixels according to a target array pattern, and fuse all pixels at the same pixel superposition position into one pixel to obtain a second pixel matrix corresponding to a second pixel unit.

[0149] In one possible implementation, the processing module 73 is specifically configured to extract M pixel matrices from the image pixel array of the original image according to the target array pattern, where M is determined based on the target array pattern; and to splice the M pixel matrices to obtain the target image.

[0150] An embodiment of the present application provides an image processing device, which simulates a pixel array corresponding to a second zoom ratio by changing the array pattern of the image pixel array of an original image, so that the image processing device performs equivalent optical zoom through the simulated pixel array corresponding to the second zoom ratio. In this way, even if the zoom ratio selected by the user does not match the pixel array in the image sensor of the electronic device, the image processing device can still achieve equivalent optical zoom, thereby improving the image quality of the zoom image obtained by the image processing device.

[0151] The image processing device in the embodiment of the present application can be an electronic device or a component in an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other device other than a terminal. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. It can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not specifically limit it.

[0152] The image processing device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0153] The image processing device provided in the embodiment of the present application can implement each process implemented in the above embodiment. To avoid repetition, it will not be described here.

[0154] Optionally, as shown in Figure 7, an embodiment of the present application also provides an electronic device 90, including a processor 91 and a memory 92, and the memory 92 stores a program or instruction that can be run on the processor 91. When the program or instruction is executed by the processor 91, the various steps of the above-mentioned image processing method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0155] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0156] FIG8 is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.

[0157] The electronic device 100 includes but is not limited to components such as a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110. The electronic device also includes an image sensor, which includes a first pixel array.

[0158] Those skilled in the art will appreciate that the electronic device 100 may further include a power source (such as a battery) for powering various components. The power source may be logically connected to the processor 110 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The electronic device structure shown in FIG8 does not limit the electronic device. The electronic device may include more or fewer components than shown, or may combine certain components or arrange the components differently, which will not be described in detail here.

[0159] The user input unit 107 is configured to receive a capture input. The processor 110 is configured to, in response to the capture input, capture an original image via an image sensor, wherein the array pattern of the image pixel array of the original image is the same as the array pattern of the first pixel array; and, if a first zoom magnification corresponding to the first pixel array is greater than a second zoom magnification selected by the user, determine a target array pattern that matches the second zoom magnification, and convert the array pattern of the image pixel array of the original image into the target array pattern to obtain a target image.

[0160] An embodiment of the present application provides an electronic device, which simulates a pixel array corresponding to a second zoom ratio by changing the array pattern of the image pixel array of an original image, so that the electronic device performs equivalent optical zoom through the simulated pixel array corresponding to the second zoom ratio. In this way, even if the zoom ratio selected by the user does not match the pixel array in the image sensor of the electronic device, the electronic device can still achieve equivalent optical zoom, thereby improving the image quality of the zoom image acquired by the electronic device.

[0161] Optionally, in an embodiment of the present application, the processor 110 is specifically configured to convert a first pixel matrix corresponding to each pixel unit in the first pixel array in the image pixel array of the original image into a second pixel matrix according to a target array mode to obtain a target image.

[0162] Optionally, in an embodiment of the present application, the processor 110 is specifically used to determine, from the image pixel array of the original image, a first pixel matrix corresponding to the first pixel unit in the first pixel array; extract M first pixel points from the first pixel matrix corresponding to the first pixel unit according to the target array pattern, where M is determined based on the target array pattern; and splice the M first pixel points to form a second pixel matrix corresponding to the first pixel unit, where the first pixel unit is a pixel unit in the first pixel array.

[0163] Optionally, in an embodiment of the present application, the processor 110 is specifically used to determine, from the image pixel array of the original image, a first pixel matrix corresponding to the second pixel unit in the first pixel array; extract at least two groups of pixel points from the first pixel matrix corresponding to the second pixel unit according to the target array pattern, each group of pixel points includes M second pixel points, and M is determined based on the target array pattern; based on the at least two groups of pixel points, obtain a second pixel matrix corresponding to the second pixel unit, and the second pixel unit is a pixel unit in the first pixel array.

[0164] Optionally, in an embodiment of the present application, the processor 110 is specifically used to obtain the average brightness value of the first group of pixel points when the number of groups of at least two pixel points is M, and adjust the brightness value of each second pixel point in the first group of pixel points to the average brightness value, and fuse all the pixel points in the first group of pixel points after brightness adjustment into one pixel point; splice the pixel points corresponding to the fusion of each group of pixel points to form a second pixel matrix corresponding to the first pixel unit.

[0165] Optionally, in an embodiment of the present application, the processor 110 is specifically used to superimpose at least two groups of pixel points according to a target array pattern, and merge all pixel points at the same pixel superposition position into one pixel point to obtain a second pixel matrix corresponding to the second pixel unit.

[0166] Optionally, in an embodiment of the present application, the processor 110 is specifically used to extract M pixel matrices from the image pixel array of the original image according to the target array pattern, where M is determined based on the target array pattern; and splice the M pixel matrices to obtain the target image.

[0167] The electronic device provided in the embodiment of the present application can implement each process implemented in the above method embodiment and can achieve the same technical effect. To avoid repetition, it will not be described here.

[0168] The beneficial effects of various implementations in this embodiment can be specifically referred to the beneficial effects of the corresponding implementations in the above method embodiment. To avoid repetition, they will not be described here.

[0169] It should be understood that in an embodiment of the present application, the input unit 104 may include a graphics processing unit (GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes a touch panel 1071 and at least one of other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0170] The memory 109 can be used to store software programs and various data. The memory 109 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 109 may include a volatile memory or a non-volatile memory, or the memory 109 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM), and a direct memory bus random access memory (DRRAM). The memory 109 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0171] Processor 110 may include one or more processing units. Optionally, processor 110 integrates an application processor and a modem processor. The application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 110.

[0172] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0173] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0174] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned method embodiment and achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0175] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0176] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned image processing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0177] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0178] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), including a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0179] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.

Claims

1. An image processing method, performed by an electronic device, wherein the electronic device includes an image sensor, the image sensor includes a first pixel array, the method comprising: Receive shooting input; In response to the shooting input, capturing a raw image through the image sensor, wherein an array pattern of an image pixel array of the raw image is the same as an array pattern of the first pixel array; When a first zoom ratio corresponding to the first pixel array is greater than a second zoom ratio selected by the user, a target array pattern matching the second zoom ratio is determined, and the array pattern of the image pixel array of the original image is converted into the target array pattern to obtain a target image.

2. The method according to claim 1, wherein Converting the array pattern of the image pixel array of the original image into the target array pattern to obtain the target image comprises: According to the target array pattern, a first pixel matrix corresponding to each pixel unit in the first pixel array in the image pixel array of the original image is converted into a second pixel matrix to obtain the target image.

3. The method according to claim 2, wherein: The converting, according to the target array mode, a first pixel matrix corresponding to each pixel unit in the first pixel array in the image pixel array of the original image into a second pixel matrix includes: Determining, from an image pixel array of the original image, a first pixel matrix corresponding to a first pixel unit in the first pixel array; Extracting M first pixel points from a first pixel matrix corresponding to the first pixel unit according to the target array pattern, where M is determined based on the target array pattern; The M first pixel points are spliced ​​together to form a second pixel matrix corresponding to the first pixel unit, where the first pixel unit is a pixel unit in the first pixel array.

4. The method according to claim 2, wherein: The converting, according to the target array mode, a first pixel matrix corresponding to each pixel unit in the first pixel array in the image pixel array of the original image into a second pixel matrix includes: Determining, from an image pixel array of the original image, a first pixel matrix corresponding to a second pixel unit in the first pixel array; Extracting at least two groups of pixels from the first pixel matrix corresponding to the second pixel unit according to the target array pattern, each group of pixels including M second pixels, where M is determined based on the target array pattern; A second pixel matrix corresponding to the second pixel unit is obtained based on the at least two groups of pixel points, where the second pixel unit is a pixel unit in the first pixel array.

5. The method according to claim 4, wherein The obtaining, based on the at least two groups of pixel points, a second pixel matrix corresponding to the second pixel unit includes: When the number of the at least two groups of pixel points is M, obtaining an average brightness value of the first group of pixel points, adjusting the brightness value of each second pixel point in the first group of pixel points to the average brightness value, and fusing all the pixel points in the first group of pixel points after the brightness adjustment into one pixel point; The pixel points fused corresponding to each group of pixel points are spliced ​​together to form a second pixel matrix corresponding to the first pixel unit.

6. The method according to claim 4, wherein: The obtaining, based on the at least two groups of pixel points, a second pixel matrix corresponding to the second pixel unit includes: According to the target array pattern, the at least two groups of pixel points are superimposed, and all pixel points at the same pixel superposition position are merged into one pixel point to obtain a second pixel matrix corresponding to the second pixel unit.

7. The method according to claim 2, wherein: Converting the array pattern of the image pixel array of the original image into the target array pattern to obtain the target image comprises: extracting M pixel matrices from the image pixel array of the original image according to the target array pattern, where M is determined based on the target array pattern; The M pixel matrices are spliced ​​together to obtain the target image.

8. An image processing apparatus, executed by an electronic device, the electronic device comprising an image sensor, the image sensor comprising a first pixel array, the apparatus comprising: Receiving module, acquisition module and processing module; The receiving module is used to receive shooting input; The acquisition module is configured to acquire an original image through the image sensor in response to the shooting input received by the receiving module, wherein the array pattern of the image pixel array of the original image is the same as the array pattern of the first pixel array; The processing module is configured to determine a target array pattern that matches a second zoom ratio selected by a user, when a first zoom ratio corresponding to the first pixel array is greater than a second zoom ratio selected by a user, and convert the array pattern of the image pixel array of the original image into the target array pattern to obtain a target image.

9. The device according to claim 8, wherein The processing module is specifically configured to convert a first pixel matrix corresponding to each pixel unit in the first pixel array in the image pixel array of the original image into a second pixel matrix according to the target array mode, so as to obtain the target image.

10. The device according to claim 9, wherein The processing module is specifically used to determine, from the image pixel array of the original image, a first pixel matrix corresponding to the first pixel unit in the first pixel array; extract M first pixel points from the first pixel matrix corresponding to the first pixel unit according to the target array pattern, where M is determined based on the target array pattern; and splice the M first pixel points to form a second pixel matrix corresponding to the first pixel unit, where the first pixel unit is a pixel unit in the first pixel array.

11. The device according to claim 9, wherein The processing module is specifically configured to determine, from the image pixel array of the original image, a first pixel matrix corresponding to the second pixel unit in the first pixel array; Extracting at least two groups of pixels from the first pixel matrix corresponding to the second pixel unit according to the target array pattern, each group of pixels including M second pixels, where M is determined based on the target array pattern; A second pixel matrix corresponding to the second pixel unit is obtained based on the at least two groups of pixel points, where the second pixel unit is a pixel unit in the first pixel array.

12. The device according to claim 11, wherein The processing module is specifically configured to, when the number of the at least two groups of pixel points is M, obtain an average brightness value of the first group of pixel points, adjust the brightness value of each second pixel point in the first group of pixel points to the average brightness value, and merge all the pixel points in the first group of pixel points after brightness adjustment into one pixel point; The pixel points fused corresponding to each group of pixel points are spliced ​​together to form a second pixel matrix corresponding to the first pixel unit.

13. The device according to claim 11, wherein The processing module is specifically used to superimpose the at least two groups of pixel points according to the target array pattern, and merge all pixel points at the same pixel superposition position into one pixel point to obtain a second pixel matrix corresponding to the second pixel unit.

14. The device according to claim 9, wherein The processing module is specifically used to extract M pixel matrices from the image pixel array of the original image according to the target array pattern, where M is determined based on the target array pattern; and splice the M pixel matrices to obtain the target image.

15. A user equipment (UE), comprising a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the image processing method according to any one of claims 1 to 7. 16 . A readable storage medium storing a program or instruction, wherein the program or instruction, when executed by a processor, implements the steps of the image processing method according to claim 1 . 17 . A computer program product, wherein the program product is executed by at least one processor to implement the image processing method according to claim 1 .

18. A user equipment (UE), comprising: the UE being configured to execute the image processing method according to any one of claims 1 to 7.

Images