Image processing method, image processing apparatus, electronic device, and storage medium
The main control chip generates images at the target resolution and transmits them to the image processing chip for processing. This solves the problem of insufficient image quality improvement and content loss caused by insufficient frame buffer, and achieves effective image quality improvement.
Patent Information
- Application Number
- PCT/CN2025/102810
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-06-27
- Filing Date
- 2025-06-23
- Publication Date
- 2026-01-02
AI Technical Summary
In electronic devices, when the high-precision image generated by the main control chip exceeds the frame buffer capacity of the image processing chip, existing technologies require reducing the image precision before processing, resulting in insufficient image quality improvement and potential loss of some image content.
The main control chip generates a first image based on the target resolution and transmits it to the image processing chip for processing. This ensures that the resolution of the first image does not exceed the maximum processing capacity of the image processing chip, thereby avoiding a reduction in accuracy and directly improving image quality.
It effectively improves image quality without sacrificing image content, ensuring that image precision remains intact during processing, and achieving a higher display effect.
Smart Images

Figure CN2025102810_02012026_PF_FP_ABST
Abstract
Description
Image processing method, image processing apparatus, electronic device, and storage medium
[0001] Cross Reference to Related Applications
[0002] The present application claims priority to the Chinese patent application No. 202410849384.8 filed on June 27, 2024 in China, the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD
[0003] The present application belongs to the technical field of image processing, and particularly relates to an image processing method, an image processing apparatus, an electronic device, and a storage medium. BACKGROUND
[0004] At present, when a user uses an electronic device to view a picture displayed by the electronic device, the user usually has a high demand for the picture quality. In the related art, after a main control chip of the electronic device generates a picture, an image processing chip of the electronic device can perform picture quality processing on the picture to improve the picture quality of the picture.
[0005] However, if the precision of the picture generated by the main control chip is too high and the frame buffer of the image processing chip is insufficient to process the high-precision picture transmitted by the main control chip, the image processing chip needs to first reduce the precision of the picture, then perform picture quality processing on the picture with reduced precision, and then improve the precision of the picture before display.
[0006] However, by using the above scheme, the precision of the picture is reduced and then improved, and part of the picture content may be lost, thereby failing to effectively improve the picture quality of the finally displayed picture. SUMMARY
[0007] An embodiment of the present application provides an image processing method, an image processing apparatus, an electronic device, and a storage medium, which can improve the picture quality.
[0008] In a first aspect, an embodiment of the present application provides an image processing method applied to an image processing apparatus, the image processing apparatus including a main control chip and an image processing chip, and the method includes:
[0009] obtaining, by the main control chip, a first picture based on a target resolution; the target resolution is less than or equal to a first resolution; the first resolution is a maximum resolution of an image supported by the image processing chip for processing;
[0010] transmitting, by the main control chip, the first picture to the image processing chip;
[0011] processing, by the image processing chip, the first picture to obtain a second picture; the resolution of the second picture is equal to the resolution of a screen; and the screen is used to display the second picture.
[0012] In a second aspect, an embodiment of the present application provides an image processing apparatus, comprising a master chip and an image processing chip, comprising:
[0013] The master chip is configured to obtain a first picture based on a target resolution, wherein the target resolution is less than or equal to a first resolution, and the first resolution is a maximum resolution of an image supported by the image processing chip for processing.
[0014] The master chip is further configured to transmit the first picture to the image processing chip.
[0015] The image processing chip is configured to process the first picture to obtain a second picture, wherein a resolution of the second picture is equal to a resolution of a screen, and the screen is configured to display the second picture.
[0016] In a third aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory, wherein the memory stores programs or instructions executable on the processor, and the programs or instructions are executed by the processor to implement the steps of the method according to the first aspect.
[0017] In a fourth aspect, an embodiment of the present application provides a readable storage medium, wherein the readable storage medium stores programs or instructions, and the programs or instructions are executed by a processor to implement the steps of the method according to the first aspect.
[0018] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is configured to execute programs or instructions to implement the method according to the first aspect.
[0019] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method according to the first aspect.
[0020] In the embodiments of the present application, the image processing apparatus can obtain a first picture based on a target resolution by the master chip, so that the resolution of the first picture is less than or equal to a maximum resolution of an image supported by the image processing chip for processing. Thus, when the master chip transmits the first picture to the image processing chip, the image processing chip can directly process the first picture to obtain a second picture, without performing precision processing on the picture transmitted by the master chip, thereby avoiding loss of picture content caused by precision processing on the picture, and further ensuring that the picture content of the picture transmitted by the master chip will not be lost while improving the picture quality of the picture transmitted by the master chip, so that the picture quality of the final displayed image is effectively improved. BRIEF DESCRIPTION OF DRAWINGS
[0021] FIG. 1 is a flowchart of an image processing method according to some embodiments of the present application;
[0022] FIG. 2 is a flowchart of an image processing method according to some embodiments of the present application;
[0023] FIG. 3 is a flowchart of an image processing method according to some embodiments of the present application;
[0024] FIG. 4 is a flowchart of an image processing method according to some embodiments of the present application;
[0025] FIG. 5 is a flowchart of an image processing method according to some embodiments of the present application;
[0026] FIG. 6 is a flowchart of a game screen processing method according to some embodiments of the present application;
[0027] FIG. 7 is a schematic diagram of a game screen processing link according to some embodiments of the present application;
[0028] FIG. 8 is a flowchart of a game screen processing method according to some embodiments of the present application;
[0029] FIG. 9 is a flowchart of a game screen processing method according to some embodiments of the present application;
[0030] FIG. 10 is a schematic diagram of an image processing apparatus according to some embodiments of the present application;
[0031] FIG. 11 is a schematic diagram of an electronic device according to some embodiments of the present application;
[0032] FIG. 12 is a schematic diagram of an electronic device according to some embodiments of the present application. DETAILED DESCRIPTION
[0033] The technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all the embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those of ordinary skill in the art belong to the scope of protection of the present application.
[0034] The terms "first", "second", and the like in the description and claims of the application are used for distinguishing between similar objects and are not necessarily used to describe a particular sequential or chronological order. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the application described herein are, for example, capable of orderly or chronological sequential use, and / or the like, and that "first", "second", and the like can be construed in some contexts as one, two, three, or more items or terms. Furthermore, reference to first, second, and the like in the description and claims can be construed as referring to one or more items unless otherwise indicated by the context.
[0035] The terms "at least one", "at least one of", and the like in the description and claims are used to mean one or more than one, or any combination thereof, of the referenced items. For example, "at least one of a, b, and c" can mean "a", "b", "c", "a and b", "a and c", "b and c", or "a and b and c". Similarly, "at least two of a, b, and c" can mean "a and b", "a and c", "b and c", or "a and b and c".
[0036] It should be noted that the image processing method provided by the embodiments of the application can be executed by a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, or the like. In some embodiments of the application, the image processing method is executed by an electronic device as an execution subject, and the image processing method provided by the embodiments of the application is described.
[0037] The image processing method and the electronic device provided by the embodiments of the application are described in detail below in combination with the drawings and specific embodiments and application scenarios.
[0038] The image processing method provided by the embodiments of the application can be applied to a picture display scenario. For example, the picture can be an application picture (i.e., a game picture) of a game application, an application picture (i.e., a video picture) of a video application, or another application picture, and the embodiments of the application do not make a specific limitation.
[0039] The image processing method provided by the embodiments of the application can be executed by an image processing device. The image processing device can be an electronic device, or at least one of a functional module and an entity module capable of implementing the image processing method in the electronic device. The specific implementation can be determined according to actual use requirements, and the embodiments of the application do not make a limitation.
[0040] The image processing method provided by the embodiments of the application is applied to an image processing device. The image processing device includes a main control chip and an image processing chip.
[0041] In some embodiments of the present application, the master chip mentioned above can be a System on Chip (SoC), also known as a system-level chip, which is a system composed of multiple integrated circuits with specific functions. It generally includes modules such as Central Processing Unit (CPU), Graphics Processing Unit (GPU), Display processing Unit (DPU), Digital signal processor (DSP), Random Access Memory (RAM), and Modem. Among them, the DPU is used for image synthesis operation processing, and the image processed by the DPU can be directly sent to the screen for display.
[0042] In some embodiments of the present application, the image processing chip mentioned above can be an independent display chip. As a dedicated image processing chip, the independent display (hereinafter referred to as the independent display) chip has a very obvious advantage in improving the display effect of electronic display equipment. After processing the display frame rate, image resolution, color adjustment, etc. by the independent display chip, the human visual perception can be significantly enhanced. Generally, the independent display chip is placed between the master chip and the screen.
[0043] In some embodiments of the present application, a separate frame buffer will be opened in the memory of the image processing chip to store image data. Generally, due to the limitations of the hardware design of the image processing chip itself, the memory of the image processing chip has certain limitations, which may result in that the frame buffer available in the memory of the image processing chip is not enough to store the high-precision application picture transmitted by the master chip. That is, the maximum image data that the Frame Buffer in the memory of the image processing chip can store is fixed.
[0044] In combination with the above content, the embodiments of the present application provide an image processing method, as shown in FIG. 1, the image processing method provided by the embodiments of the present application can include the following steps:
[0045] Step 101, the image processing device obtains a first picture based on a target resolution through the master chip.
[0046] Among them, the target resolution is less than or equal to the first resolution.
[0047] In some embodiments of the present application, the first resolution is the maximum resolution of the image supported by the image processing chip.
[0048] It should be noted that the current available frame buffer of the image processing chip is different, and the image processing chip supports different maximum resolutions of the image to be processed.
[0049] It can be understood that the current available frame buffer of the image processing chip specifically refers to the current remaining available storage space in the frame buffer of the memory of the image processing chip.
[0050] That is, the first resolution is the maximum resolution of the image that can be processed under the current remaining available storage space in the frame buffer of the memory of the image processing chip.
[0051] In some embodiments of the present application, when the image processing device receives the screen processing instruction of the user, the image processing device obtains a first screen based on the target resolution through the master control chip. The first screen is a screen to be processed by the image processing chip.
[0052] In some embodiments of the present application, the first resolution is less than or equal to the resolution of the screen.
[0053] It can be understood that when the precision of the first screen obtained by the master control chip is too high, if the current remaining available storage space in the frame buffer of the memory of the image processing chip is insufficient to store the first screen, the image processing chip needs to reduce the precision of the first screen to reduce the resolution of the first screen to be less than or equal to the first resolution, so that the image processing chip can process the first screen under the current available frame buffer. However, reducing the precision of the first screen will cause the problem of losing part of the screen content of the first screen. Based on this, the image processing device in the present application obtains a first application screen with a resolution less than or equal to the first resolution based on the target resolution through the master control chip, so that the current remaining available storage space in the frame buffer of the memory of the image processing chip can store the application screen. Therefore, the image processing chip does not need to reduce the precision of the first screen, and there is no problem of losing the screen content of the first screen.
[0054] In some embodiments of the present application, the first screen is a first application screen. As shown in FIG. 2, the step 101 can be implemented by the following step 101a1 in combination with FIG. 1.
[0055] In step 101a1, the image processing device master control chip renders the first application screen content according to the target resolution to obtain the first screen.
[0056] In some embodiments of the present application, the target resolution is the resolution of the screen output by the first application.
[0057] In some embodiments of the present application, the image processing device can render the first application screen content according to the target resolution through the GPU in the master control chip to obtain the first screen with the target resolution.
[0058] In some embodiments of the present application, when the first picture is a picture of the first application, the image processing apparatus can obtain the first picture content of the first application from the background server of the first application in real time, and then render the first picture content of the first application according to the target resolution by the GPU to obtain the first picture of the target resolution.
[0059] Example 1, taking the first application as a game application as an example, the above-mentioned first picture can be a game picture in the game application. Assuming that the resolution of the picture output by the game application is 810P, that is, the target resolution is 810P, the image processing apparatus renders the game picture content of the game application according to the resolution 810P of the picture output by the game application by the GPU to obtain the game picture with a resolution of 810P.
[0060] In this way, the image processing apparatus renders the first picture content according to the target resolution by the host chip to obtain the first picture with a resolution smaller than the first resolution, and then the image processing chip can directly process the first picture transmitted by the host chip to obtain the second picture, without the need for precision processing of the first picture transmitted by the host chip, thereby avoiding the loss of picture content caused by precision processing of the first picture, and further ensuring that the picture content of the first picture transmitted by the host chip will not be lost while the quality of the first picture transmitted by the host chip is improved, so that the quality of the application image finally displayed is effectively improved.
[0061] In some embodiments of the present application, in combination with FIG. 1, as shown in FIG. 3, the above-mentioned step 101 can be implemented by the following step 101b1 and step 101b2.
[0062] Step 101b1, the image processing apparatus renders the first picture content of the first application according to the target resolution by the host chip to obtain the first rendered picture.
[0063] It should be noted that the implementation process of step 101b1 is similar to that of step 101a1, and in order to avoid repetition, this embodiment will not be described here.
[0064] Step 101b2, the image processing apparatus enlarges the first rendered picture according to the first resolution by the host chip to obtain the first picture.
[0065] In some embodiments of the present application, in the case where the target resolution is smaller than the first resolution, the image processing apparatus can enlarge the first rendered picture according to the first resolution by the DPU in the host chip in an up-sampling manner to obtain the first picture of the first resolution.
[0066] In some embodiments of the present application, the image processing apparatus can use existing nearest interpolation, single linear interpolation, bilinear interpolation, bicubic interpolation and other algorithms to upsample the first rendered picture by the DPU, and the present embodiment does not make specific restrictions here.
[0067] Exemplarily, the nearest interpolation is to assign the gray value of the nearest adjacent pixel point to the pixel point to be solved among the four adjacent pixel points of the pixel point to be solved.
[0068] Example 2, assuming that the image processing chip supports a maximum resolution of 1080P for the image to be processed under the current available frame buffer, in combination with example 1, the image processing apparatus renders the game picture content of the game application according to the resolution 810P of the picture output by the game application, and obtains the game rendered picture with a resolution of 810P, and then the host chip can upsample the game rendered picture from 810P to 1080P to enlarge the game rendered picture to a game picture with a resolution of 1080P.
[0069] In this way, the image processing apparatus renders the first picture content of the first application according to the target resolution by the host chip, obtains the first rendered picture, and the host chip enlarges the first rendered picture according to the first resolution to obtain the first picture with the first resolution. Then, when the host chip transmits the first picture to the image processing chip, the image processing chip can directly process the first picture to obtain the second picture, without the need for precision processing of the picture transmitted by the host chip, thereby avoiding the loss of picture content caused by precision processing of the application picture, and further ensuring that the picture content of the picture transmitted by the host chip will not be lost while improving the picture quality of the picture transmitted by the host chip, so that the picture quality of the final displayed image is effectively improved.
[0070] Step 102, the image processing apparatus transmits the first picture to the image processing chip by the host chip.
[0071] In some embodiments of the present application, when the picture processing instruction of the user is received, the image processing apparatus obtains the first picture by the host chip, and after obtaining the first picture, transmits the first picture and the picture processing instruction to the image processing chip by the host chip, so that the image processing chip processes the first picture according to the picture processing instruction.
[0072] For example, in response to receiving a picture processing instruction of a user, in combination with the above example 1 or example 2, the image processing apparatus obtains a game rendering picture with a resolution of 810P or a game picture with a resolution of 1080P based on the picture processing instruction, and then transmits the picture processing instruction and the game rendering picture with a resolution of 810P or the game picture with a resolution of 1080P to the image processing chip through the master control chip, so that the image processing chip processes the game picture transmitted by the master control chip according to the picture processing instruction.
[0073] In step 103, the image processing apparatus processes the first picture through the image processing chip to obtain a second picture.
[0074] In the above, the resolution of the second picture is equal to the resolution of a screen for displaying the second picture.
[0075] In some embodiments of the present application, the process of processing the first picture can be a process of performing quality improvement processing on the first picture.
[0076] In some embodiments of the present application, the process of processing the first picture through the image processing chip of the image processing apparatus includes but is not limited to performing frame interpolation processing on the first picture and performing super-resolution operation on the first picture.
[0077] It should be noted that performing frame interpolation processing on the first picture can make the picture quality more smooth, and performing super-resolution operation on the first picture can make the picture quality more clear.
[0078] In some embodiments of the present application, the image processing apparatus processes the first picture based on the picture processing instruction through the image processing chip to obtain the second picture. In other words, the processing operation of the image processing chip on the first picture can be determined by the picture processing instruction.
[0079] For example, when the picture processing instruction indicates to improve the picture smoothness, the image processing apparatus obtains a frame interpolation picture based on the first picture according to the picture processing instruction through the image processing chip, and then processes the frame interpolation picture according to the resolution of the screen to obtain the second picture.
[0080] For example, in combination with example 1 or example 2, when the picture processing instruction indicates to improve the game picture smoothness, the image processing apparatus can perform frame interpolation on the game rendering picture with a resolution of 810P or the game picture with a resolution of 1080P through the image processing chip to obtain a frame interpolation game picture, and then process the frame interpolation game picture according to the resolution of the screen to obtain a processed game picture.
[0081] Exemplarily, when the picture processing instruction indicates to improve the picture definition, the image processing apparatus obtains a super-resolution picture based on the first picture through the image processing chip, and then processes the super-resolution picture according to the resolution of the screen to obtain the second picture.
[0082] For example, in combination with Example 1 or Example 2, when the picture processing instruction indicates to improve the game picture definition, the image processing apparatus performs super-resolution processing on the 1080P game rendering picture or the 1080P game picture through the image processing chip to obtain a super-resolution game picture, and then processes the super-resolution game picture according to the resolution of the screen to obtain the processed game picture.
[0083] In some embodiments of the present application, if the image processing apparatus does not receive the picture processing instruction of the user, the image processing apparatus obtains the second picture through the master control chip and directly transmits the second picture to the screen for display.
[0084] Exemplarily, if the image processing apparatus does not receive the picture processing instruction of the user, the image processing apparatus renders the first picture content of the first application according to the resolution of the picture output by the first application through the master control chip to obtain a first rendering picture, and then processes the first rendering picture according to the resolution of the screen to obtain the second picture of the first application.
[0085] Example 3 takes the first application as a game application as an example. Assuming that the resolution of the picture output by the game application is 1080P and the resolution of the screen is 1440P, the master control chip renders the game picture content of the game application according to 1080P to obtain a 1080P game rendering picture. Then, the game rendering picture is enlarged according to the resolution of 1440P to obtain a 1440P game picture. After obtaining the 1440P game picture, the image processing apparatus transmits the 1440P game picture to the screen for display through the master control chip.
[0086] The image processing method provided in the embodiment can make the image processing apparatus obtain the first picture based on the target resolution through the master control chip, so that the resolution of the first picture is less than or equal to the maximum resolution of the image supported by the image processing chip for processing. In this way, when the master control chip transmits the first picture to the image processing chip, the image processing chip can directly process the first picture to obtain the second picture, without the need to perform precision processing on the picture transmitted by the master control chip, thereby avoiding the loss of picture content caused by precision processing on the picture, and further ensuring that the picture content of the picture transmitted by the master control chip will not be lost when the picture quality of the picture transmitted by the master control chip is improved, so that the picture quality of the finally displayed image is effectively improved.
[0087] In some embodiments of the present application, as shown in FIG. 4, the step 103 can be implemented by the steps 103a1 and 103a2 in combination with FIG. 1.
[0088] The step 103a1, the image processing device inserts frames in the first picture by the image processing chip to obtain a first inserted frame picture.
[0089] In some embodiments of the present application, the resolution of the first inserted frame picture is consistent with the resolution of the first picture.
[0090] In some embodiments of the present application, the image processing device can store the multiple frames of the first picture into the frame buffer by the image processing chip, then insert a frame of the third picture between every two adjacent first pictures to obtain the first inserted frame picture, the first inserted frame picture includes the multiple frames of the first picture and the third picture, and the resolution of the third picture is consistent with the resolution of the first picture.
[0091] In some embodiments of the present application, when the image processing device inserts a frame of the third picture between every two adjacent first pictures by the image processing chip, the Motion Estimation and Motion Compensation (MEMC) algorithm can be used to generate the third picture. For example, the image processing device can use the MEMC algorithm to perform motion estimation on two adjacent first pictures according to the continuity of the dynamic picture by the image processing chip, to obtain the displacement vector and the motion vector of the pixels in the two adjacent first pictures, then compensate the previous frame picture in the two adjacent first pictures according to the displacement vector and the motion vector, to generate the third picture, and then insert the third picture between the two adjacent first pictures.
[0092] For example 4, in combination with example 1, assuming that the multiple frames of the 810P rendered game pictures stored in the frame buffer are game picture a, game picture b, game picture c and game picture d respectively, the image processing device can insert a frame of the 810P game picture e between the game picture a and the game picture b, a frame of the 810P game picture f between the game picture b and the game picture c, and a frame of the 810P game picture g between the game picture c and the game picture d by the image processing chip using the MEMC, to obtain multiple inserted frame pictures, the multiple inserted frame pictures include the game picture a, the game picture e, the game picture b, the game picture f, the game picture c, the game picture g and the game picture d, i.e. the first inserted frame picture.
[0093] The step 103a2, the image processing device processes the first inserted frame picture according to the resolution of the screen by the image processing chip to obtain the second picture.
[0094] In some embodiments of the present application, the image processing apparatus can apply picture up-sampling on each frame of the first inserted frame image respectively according to the resolution of the screen to obtain a second picture corresponding to each frame of the first inserted frame image.
[0095] In example 5, in combination with example 4, the first inserted frame image includes game picture a, game picture e, game picture b, game picture f, game picture c, game picture g, and game picture d. Assuming that the resolution of the screen is 1260P and the resolution of the first inserted frame image is 810P, the image processing apparatus can up-sample game picture a, game picture e, game picture b, game picture f, game picture c, game picture g, and game picture d respectively according to the resolution of 1260P to obtain a 1260P game picture corresponding to game picture a, a 1260P game picture corresponding to game picture e, a 1260P game picture corresponding to game picture b, a 1260P game picture corresponding to game picture f, a 1260P game picture corresponding to game picture c, a 1260P game picture corresponding to game picture g, and a 1260P game picture corresponding to game picture d, i.e., the above-mentioned second picture.
[0096] In this way, the image processing apparatus inserts frames for the first picture through the image processing chip to make the picture more smooth, and the image processing apparatus processes the first inserted frame image according to the resolution of the screen through the image processing chip to obtain the second picture, so that the second picture can be displayed on the screen according to the resolution of the screen, thereby improving the picture quality and definition of the second picture displayed on the screen.
[0097] In some embodiments of the present application, in combination with FIG. 1, as shown in FIG. 5, the above-mentioned step 103 can be implemented by the following steps 103b1 to 103b4.
[0098] In step 103b1, the image processing apparatus compresses the first picture through the image processing chip to obtain a first compressed image.
[0099] In the first compressed image, the bit depth of the pixel point is less than the bit depth of the pixel point in the first picture.
[0100] It should be noted that the above-mentioned bit depth refers to the number of colors that can be represented by a pixel point. The higher the bit depth, the more colors that can be represented by a pixel point, so that more rich colors and details can be presented. Generally, common bit depths include 8 bits, 16 bits, and 32 bits, corresponding to 256, 65536, and about 4.2 billion colors, respectively.
[0101] In some embodiments of the present application, the image processing apparatus encodes the first application picture through the image processing chip to convert the color space of the first picture, thereby compressing the first picture to obtain the first compressed image.
[0102] For example, when the image processing apparatus encodes the first picture through the image processing chip, the first picture color space can be converted from YUV444 to YUV420. The YUV color space is composed of one Y "luminance" component and two UV "chrominance" components, Y is referred to as a gray component, UV is a chrominance component, U represents a blue component, and V represents a red component; YUV444 means that the Y, U, and V components of each pixel point in the first application picture are all 4, and YUV420 means that the Y, U, and V components of each pixel point in the first application picture are 4, 2, and 0 respectively. Therefore, compared with YUV444, YUV420 format lacks 3 / 4 of the chrominance component of each pixel point in the image, and thus the bit depth of the pixel point in the first compressed image is less than that of the pixel point in the first picture.
[0103] It should be noted that when the image processing apparatus compresses the first picture through the image processing chip, the resolution of the first picture compression remains unchanged, that is, the resolution of the first compressed image and the first picture is consistent.
[0104] Step 103b2, the image processing apparatus inserts a frame into the first compressed image through the image processing chip to obtain a second inserted frame image.
[0105] In some embodiments of the present application, the image processing apparatus can store the plurality of first compressed images corresponding to the plurality of first pictures respectively to the frame buffer through the image processing chip, then insert a third compressed image into every two adjacent first compressed images to obtain a second inserted frame image, the second inserted frame image includes the plurality of first compressed images and the third compressed image, and the resolution and color space of the third compressed image are consistent with those of the first compressed image.
[0106] It should be noted that the image processing apparatus can insert a third compressed image into every two adjacent first compressed images through the image processing chip.
[0107] It should be noted that the above insertion process can refer to the above step 103a1, and this embodiment will not be repeated here to avoid repetition.
[0108] Step 103b3, the image processing apparatus decompresses the second inserted frame image through the image processing chip to obtain a first decompressed image.
[0109] The bit depth of the pixel point in the first decompressed image is equal to the bit depth of the pixel point in the first application picture.
[0110] In some embodiments of the present application, the image processing apparatus decodes each frame of compressed image in the second inserted frame image through the image processing chip, reversely converts the color space of each frame of compressed image in the second inserted frame image, realizes decompression of each frame of compressed image in the second inserted frame image, and obtains the first decompressed image, so that the color space of the first decompressed image is consistent with that of the first picture, and then the bit depth of the pixel point in the first decompressed image is equal to that of the pixel point in the first picture. It should be noted that the first decompressed image includes a decompressed image corresponding to each frame of compressed image in the second inserted frame image.
[0111] For example, when the image processing apparatus decompresses the second inserted frame image through the image processing chip, the color space of the second inserted frame image can be converted from YUV420 to YUV444, and the color space of the second decompressed image is consistent with that of the first picture, so that the bit depth of the pixel point in the first decompressed image is equal to that of the pixel point in the first picture.
[0112] Step 103b4, the image processing apparatus processes the first decompressed image according to the resolution of the screen through the image processing chip, and obtains the second application picture.
[0113] In some embodiments of the present application, the image processing apparatus can upsample each frame of decompressed image in the first decompressed image according to the resolution of the screen, and obtain a second picture corresponding to each frame of the first decompressed image in the first decompressed image.
[0114] In this way, the image processing apparatus compresses the first picture through the image processing chip to obtain the first compressed image; when the image processing chip inserts frames to the first compressed image, the data amount in the frame insertion operation process can be reduced, so as to improve the frame insertion operation efficiency; the second inserted frame image is obtained by inserting frames to the first compressed image through the image processing chip, which can improve the picture fluency; the image processing apparatus decompresses the second inserted frame image through the image processing chip to obtain the first decompressed image, and then processes the first decompressed image according to the resolution of the screen through the image processing chip to obtain the second picture, so that the second picture can be displayed on the screen according to the resolution of the screen, and the clarity of the second picture displayed on the screen is improved.
[0115] The image processing method provided by the embodiments of the present application will be exemplarily described below by taking three specific scenes as examples, which are scene 1, scene 2 and scene 3.
[0116] Scene 1: In the game picture display scene, the image processing chip compresses and encodes during the processing of the game picture, the first resolution is 1080P, the target resolution, i.e. the resolution of the picture output by the game application, is 810P, and the resolution of the screen is 1260P.
[0117] Scene 2: in the game picture display scene, the image processing chip performs compression encoding in the game picture processing process, and the target resolution is 810P, and the resolution of the screen is 1260P.
[0118] Scene 3: in the game picture display scene, the image processing chip does not perform compression encoding in the game picture processing process, and the target resolution is 810P, the first resolution is 1080P, and the resolution of the screen is 1260P.
[0119] In embodiment one, for scene 1, as shown in FIG. 6, the image processing method provided by the application can specifically include the following steps 601 to 606.
[0120] Step 601, the GPU in the master control chip renders the game picture content according to the resolution of the game picture output by the game application, and obtains a game rendering picture.
[0121] For example, the resolution supported by the game application is 810P, and the resolution of the game rendering picture is 810P, and the color space is YUV444.
[0122] Step 602, the master control chip judges whether to start frame insertion, if the frame insertion is started, step 603 is performed, if the frame insertion is not started, the DPU in the master control chip synthesizes the game rendering picture according to the current physical display screen size, at this time, the game rendering picture is synthesized and enlarged from the resolution of 810P and the color space of YUV444 to the second game picture with the resolution of 1260P and the color space of YUV444, and is delivered to the display screen, and step 606 is executed.
[0123] Exemplarily, whether the frame insertion is performed can be judged by whether the game picture quality processing instruction of the user is received. If the game picture quality processing instruction of the user is received, it is determined that the frame insertion is started.
[0124] For example, a control with “picture quality smooth” prompt information can be displayed on the screen of the mobile phone, if the user clicks the control, the master control chip will receive the game picture quality processing instruction of the user.
[0125] Step 603, the master control chip sends first indication information to the image processing chip, the first indication information is used to instruct the image processing chip to process the first game picture without reducing the precision of the first game picture, and the resolution of the second game picture finally output to the screen is 1260P and the color space is YUV444.
[0126] Exemplarily, the host chip sets the output resolution of the DPU as 1080P and the color space as YUV444; wherein, 1080P is the maximum image resolution 1080P that the Frame Buffer of the image processing chip can handle when doing frame interpolation, and 1260P is the resolution of the physical display screen.
[0127] In step 604, the DPU enlarges the game rendering picture with the resolution of 810P and the color space of YUV444 into the first game picture with the resolution of 1080P and the color space of YUV444, and then delivers the first game picture to the image processing chip for processing.
[0128] In step 605, the image processing chip receives the first game picture with the resolution of 1080P and the color space of YUV444 from the DPU, compresses and encodes the first game picture, converts the color space of the first game picture from YUV444 to YUV420 to obtain the first compressed image with the resolution of 1080P and the color space of YUV420, then performs frame interpolation algorithm operation on the first compressed image, and then enlarges the first interpolated image with the resolution of 1080P and the color space of YUV420 into the second game picture with the resolution of 1260P and the color space of YUV444 according to the resolution 1260P and the color space YUV444 set in step 603, and delivers the second game picture to the display screen.
[0129] Exemplarily, by compressing and encoding the first game picture, converting the color space of the first game picture from YUV444 to YUV420 to obtain the first compressed image with the resolution of 1080P and the color space of YUV420, the bit depth of the pixel points in the first game picture can be reduced, and then when performing frame interpolation algorithm operation on the first compressed image, the data amount of the frame interpolation operation can be reduced and the frame interpolation efficiency can be improved.
[0130] In the embodiment, since the input of the image processing chip is the first game picture with the resolution of 1080P and the output is the second game picture with the resolution of 1260P, it is not necessary to reduce the resolution of the game picture.
[0131] In step 606, the display screen receives and displays the second game picture with the resolution of 1260P.
[0132] FIG. 7 is a schematic diagram of the game picture processing link before and after the implementation of the embodiment. As shown in FIG. 7, compared with before the implementation of the embodiment, the game picture processing link after the implementation of the embodiment omits the step of reducing the accuracy of the game picture. The essence of improving the picture quality is not to let the image processing chip reduce the resolution of the game picture, so as to avoid the loss of the accuracy of the game picture. Therefore, by using the embodiment of the application, the picture quality of the game picture can be improved.
[0133] To sum up, the embodiment can realize the opening of the user to improve the game fluency while optimizing the problem of the game picture blur caused by the limitation of hardware capability, thereby improving the picture quality of the game picture.
[0134] In embodiment two, for scene 2, as shown in FIG. 8, the image processing method provided by the application can specifically include the following steps 801 to 806.
[0135] Step 801, the GPU in the master control chip renders the game picture content according to the resolution of the game application output picture, and obtains a game rendering picture.
[0136] For example, the resolution supported by the game application is 810P, and the resolution of the game rendering picture is 810P, and the color space is YUV444.
[0137] Step 802, the master control chip judges whether to open the interpolation or not. If the interpolation is opened, step 803 is performed. If the interpolation is not opened, the DPU in the master control chip synthesizes the game rendering picture according to the current physical display screen size. At this time, the game rendering picture is synthesized and enlarged from the resolution of 810P and the color space of YUV444 to the second game picture with the resolution of 1260P and the color space of YUV444, and is delivered to the display screen, and step 806 is executed.
[0138] Step 803, the master control chip sends the first indication information to the image processing chip. The first indication information is used to indicate that when the image processing chip processes the game picture, the resolution of the game picture output to the screen is 1260P and the color space is YUV444 without reducing the accuracy of the game picture.
[0139] Step 804, the DPU does not enlarge the game rendering picture, and directly compresses and encodes the game rendering picture according to the resolution 810P supported by the game application, converts the color space of the game rendering picture from YUV444 to YUV420, obtains the first game picture with the resolution of 810P and the color space of YUV420, and then delivers it to the independent display chip for processing.
[0140] Step 805, the image processing chip receives the first game picture with the resolution of 810P and the color space of YUV444 from the DPU to perform interpolation algorithm operation, and then enlarges the first interpolation image with the resolution of 810P and the color space of YUV420 to the second game picture with the resolution of 1260P and the color space of YUV444 set in step 803, and delivers it to the display screen.
[0141] In the embodiment, since the input of the image processing chip is a game picture with a resolution of 810P and the output is a game picture with a resolution of 1260P, the resolution of the game picture does not need to be reduced.
[0142] Step 806, the display screen receives and displays the image with a resolution of 1260P.
[0143] In summary, in the embodiment, the first game picture processed by the image processing chip is the native image data of the game rendering picture, while the first game picture processed by the image processing chip in the first embodiment is generated after the game rendering picture is enlarged. Therefore, when the first game picture is the native image data of the game rendering picture for the interpolation operation in the second embodiment of the application, the most accurate data can be used for the interpolation operation. Therefore, the second embodiment of the application can further improve the game quality on the basis of the effects achieved by the first embodiment, thereby obtaining better quality effects.
[0144] In the third embodiment, for scene 3, as shown in FIG. 9, the image processing method provided by the application can include the following steps 901 to 906.
[0145] Step 901, the GPU in the host chip renders the game picture content according to the resolution 810P of the picture output by the game application, to obtain a game rendering picture with a resolution of 810P and a color space of YUV444.
[0146] Step 902, the host chip determines whether to start interpolation. If the interpolation is started, step 903 is performed, and if the interpolation is not started, step 906 is performed.
[0147] Step 903, the host chip sends second indication information to the image processing chip, the second indication information being used to instruct the image processing chip to process the game picture without reducing the game picture accuracy, and the game picture output to the screen finally having a resolution of 1260P, a color space of YUV444, and a bit depth not being reduced.
[0148] Step 904, the DPU does not perform magnification processing and encoding compression on the game picture, and directly transmits the game rendering picture with a resolution of 810P and a color space of YUV444 to the independent display chip for processing.
[0149] Step 905, the image processing chip receives the game rendering picture with a resolution of 810P and a color space of YUV444 from the host chip, performs interpolation algorithm operation, and then magnifies the first interpolation image with a resolution of 810P and a color space of YUV444 obtained by interpolation to the second game picture with a resolution of 1260P and a color space of YUV444 set in step 903, and transmits the second game picture to the display screen.
[0150] Exemplarily, since the image processing chip receives a game rendering picture with a resolution of 810P and a color space of YUV444 from the master chip, the resolution of the game rendering picture is small, and thus the Frame Buffer has more storage space. Therefore, the image processing chip can perform the interpolation algorithm operation without compressing and encoding the game picture.
[0151] In the embodiment, since the input of the image processing chip is a game rendering picture with a resolution of 810P, the output is a game picture with a resolution of 1260P, and the whole image is YUV444, the image precision does not need to be reduced.
[0152] In step 906, the display screen receives and displays a second game picture with a resolution of 1260P and a color space of YUV444.
[0153] In summary, the essence of improving the picture quality is that the image processing chip does not reduce the precision of the game picture. However, in the first and second embodiments, the image processing chip needs to compress and encode the game picture when performing the interpolation operation, which reduces the bit depth of the pixel points in the game picture and further reduces the precision of the game picture to a certain extent. In the third embodiment, the image processing chip also uses the original image data of the game rendering picture when performing the interpolation operation, and does not need to compress and encode the game picture. Therefore, the third embodiment can further improve the picture quality of the game picture on the basis of the second embodiment.
[0154] The above-mentioned various method embodiments, or various possible implementation manners of the various method embodiments, can be executed independently, or, in the absence of contradictions, can also be executed in combination with each other. The specific execution can be determined according to actual use requirements, and the embodiments of the present application do not limit this.
[0155] The image processing method provided in the embodiments of the present application can be executed by the image processing device. In the embodiments of the present application, the image processing device provided in the embodiments of the present application is described by taking the image processing device executing the image processing method as an example.
[0156] FIG. 10 is a structural schematic diagram of the image processing device provided in the embodiments of the present application. The image processing device includes a master chip 1001 and an image processing chip 1002. The master chip 1001 is configured to obtain a first picture based on a target resolution; the target resolution is less than or equal to a first resolution; the first resolution is the maximum resolution of an image supported by the image processing chip for processing; the master chip 1001 is further configured to transmit the first picture to the image processing chip 1002; and the image processing chip 1002 is configured to process the first picture to obtain a second picture, the resolution of the second picture being equal to the resolution of a screen, and the screen being configured to display the second picture.
[0157] In some embodiments of the present application, the first picture is a picture of the first application, and the master control chip 1001 is specifically configured to: render the first picture content of the first application according to a target resolution to obtain a first picture, and the target resolution is the resolution of the picture output by the first application.
[0158] In some embodiments of the present application, the image processing chip 1002 is specifically configured to:
[0159] interpolate the first picture to obtain a first interpolated picture, the resolution of the first interpolated picture is consistent with the resolution of the first picture; and process the first interpolated picture according to the resolution of the screen to obtain a second picture.
[0160] In some embodiments of the present application, the first picture is a picture of the first application, and the master control chip 1001 is specifically configured to: render the first picture content of the first application according to a target resolution to obtain a first picture, and the target resolution is the resolution of the picture output by the first application.
[0161] In some embodiments of the present application, the image processing chip 1002 is specifically configured to: compress the first picture to obtain a first compressed picture, the bit depth of the pixel points in the first compressed picture is less than the bit depth of the pixel points in the first picture; interpolate the first compressed picture to obtain a second interpolated picture; decompress the second interpolated picture to obtain a first decompressed picture, the bit depth of the pixel points in the first decompressed picture is equal to the bit depth of the pixel points in the first picture; and process the first decompressed picture according to the resolution of the screen to obtain a second picture.
[0162] The image processing device provided by the embodiments of the present application can obtain a first picture based on a target resolution by a master control chip, so that the resolution of the first picture is less than or equal to an image processing chip, and then the image processing chip can store the first picture. Thus, when the master control chip transmits the first picture to the image processing chip, the image processing chip can directly process the first picture to obtain a second picture, without the need for precision processing of the picture transmitted by the master control chip, thereby avoiding the loss of picture content caused by precision processing of the picture, and further ensuring that the picture content of the picture transmitted by the master control chip will not be lost when the picture quality of the picture transmitted by the master control chip is improved, so that the picture quality of the finally displayed image is effectively improved.
[0163] The image processing apparatus on the embodiments of the present applicationapplicationbe an electronic device, or a component on an electronic device, such as an integrated circuit or a chip. The electronic deviceapplicationbe a terminal, or other devices than a terminal. For example, the electronic deviceapplicationbe a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a Mobile Internet Device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc., or a server, a Network Attached Storage (NAS), a personal computer (PC), a television (TV), a teller machine, or a self-service machine, etc., and the embodiments of the present application do not make a specific limitation.
[0164] The image processing apparatus on the embodiments of the present applicationapplicationbe a device with an operating system. The operating systemapplicationbe an Android operating system, an ios operating system, or other possible operating systems, and the embodiments of the present application do not make a specific limitation.
[0165] The image processing apparatus provided by the embodiments of the present applicationapplicationimplement each process implemented by the method embodiments of FIG. 1 to FIG. 9, and thus the details are not repeated here.
[0166] Optionally, as shown in FIG. 11, the embodiments of the present application further provide an electronic device 1100, which includes a processor 1101 and a memory 1102, and the memory 1102 stores programs or instructions executable on the processor 1101, which, when executed by the processor 1101, implement each step of the above image processing method embodiments and achieve the same technical effects, and thus the details are not repeated here.
[0167] It should be noted that the electronic device on the embodiments of the present applicationapplicationinclude the above-mentioned mobile electronic device and non-mobile electronic device.
[0168] FIG. 12 is a schematic diagram of the hardware structure of an electronic device for implementing the embodiments of the present application.
[0169] The electronic device 1200 includes, but is not limited to, a radio frequency unit 1201, a network module 1202, an audio output unit 1203, an input unit 1204, a sensor 1205, a display unit 1206, a user input unit 1207, an interface unit 1208, a memory 1209, and a processor 1210, and the like. The electronic device also includes a master control chip and an image processing chip.
[0170] Those skilled in the art can understand that the electronic device 1200 can also include a power supply (such as a battery) for supplying power to each component, and the power supply can be logically connected to the processor 1210 through a power management system, so as to realize functions such as management of charging, discharging, and power consumption management through the power management system. The electronic device structure shown in FIG. 12 does not constitute a limitation on the electronic device, and the electronic device can include more or fewer components than shown, or combine certain components, or different component arrangements, which will not be described here.
[0171] The processor 1210 is configured to: obtain, by the master control chip, a first picture based on a target resolution; the target resolution is less than or equal to a first resolution; the first resolution is a maximum resolution of an image supported by the image processing chip; transmit, by the master control chip, the first picture to the image processing chip; and process, by the image processing chip, the first picture to obtain a second picture, a resolution of the second picture being equal to a resolution of a screen used for displaying the second picture.
[0172] In some embodiments of the present application, the first picture is a picture of a first application, and the processor 1210 is specifically configured to: render, by the master control chip, content of the first picture of the first application according to a target resolution to obtain the first picture, the target resolution being a resolution of a picture output by the first application.
[0173] In some embodiments of the present application, the processor 1210 is specifically configured to: perform frame interpolation, by the image processing chip, on the first picture to obtain a first interpolated image, a resolution of the first interpolated image being consistent with a resolution of the first picture; and process, by the image processing chip, the first interpolated image according to the resolution of the screen to obtain the second picture.
[0174] In some embodiments of the present application, the first picture is a picture of a first application, and the processor 1210 is specifically configured to: render, by the master control chip, content of the first picture of the first application according to a target resolution to obtain a first rendered picture, the target resolution being a resolution of a picture output by the first application; and enlarge, by the master control chip, the first rendered picture according to the first resolution to obtain the first picture.
[0175] In some embodiments of the present application, the processor 1210 is specifically configured to: compress the first picture through an image processing chip to obtain a first compressed picture, a bit depth of a pixel point in the first compressed picture being less than a bit depth of a pixel point in the first picture; perform frame insertion on the first compressed picture through the image processing chip to obtain a second frame-inserted picture; perform decompression on the second frame-inserted picture through the image processing chip to obtain a first decompressed picture, a bit depth of a pixel point in the first decompressed picture being equal to the bit depth of the pixel point in the first picture; and process the first decompressed picture according to a resolution of a screen through the image processing chip to obtain the second picture.
[0176] The electronic device provided in the embodiments of the present application can obtain the first picture based on the target resolution through the master control chip, so that the resolution of the first picture is less than or equal to the image processing chip, and then the image processing chip is sufficient to store the first picture. In this way, after the master control chip transmits the first picture to the image processing chip, the image processing chip can directly process the first picture to obtain the second picture, without the need for precision processing on the picture transmitted by the master control chip, thereby avoiding the loss of picture content caused by precision processing on the picture, and further ensuring that the picture content of the picture transmitted by the master control chip will not be lost while the picture quality of the picture transmitted by the master control chip is improved, so that the picture quality of the finally displayed image is effectively improved.
[0177] It should be understood that in the embodiments of the present application, the input unit 1204 can include a graphics processor (GPU) 12041 and a microphone 12042. The graphics processor 12041 processes image data of a still picture or a video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 1206 can include a display panel 12061, which can be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 1207 includes at least one of a touch panel 12071 and other input devices 12072. The touch panel 12071 is also called a touch screen. The touch panel 12071 can include a touch detection device and a touch controller. The other input devices 12072 can include, but are not limited to, a physical keyboard, function keys (such as volume control keys, on-off keys, etc.), trackballs, mice, joysticks, and the like, which will not be described here.
[0178] The memory 1209 can be used to store software programs and various data. The memory 1209 can mainly include a first storage area storing programs or instructions and a second storage area storing data, wherein the first storage area can store an operating system, application programs or instructions required by at least one function (such as a sound playing function, an image playing function, etc.), and the like. In addition, the memory 1209 can include a volatile memory or a non-volatile memory, or the memory 1209 can include both volatile and non-volatile memories. The non-volatile memory can be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically EPROM (EEPROM), or a flash memory. The volatile memory can be a Random Access Memory (RAM), a Static RAM (SRAM), a Dynamic RAM (DRAM), a Synchronous DRAM (SDRAM), a Double Data Rate SDRAM (DDR SDRAM), an Enhanced SDRAM (ESDRAM), a Synch link DRAM (SLDRAM), and a Direct Rambus RAM (DRRAM). The memory 1209 on the embodiment of the present application includes but is not limited to these and any other suitable type of memory.
[0179] The processor 1210 can include one or more processing units; optionally, the processor 1210 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a UI, and an application program, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It can be understood that the above-mentioned modem processor can also not be integrated into the processor 1210.
[0180] The embodiment of the present application also provides a readable storage medium, the readable storage medium stores a program or instructions, the program or instructions are executed by a processor to realize various processes of the above-mentioned image processing method embodiment, and the same technical effects can be achieved, to avoid repetition, which will not be described here.
[0181] The processor is the processor of the electronic device in the above embodiments. The readable storage medium includes a computer readable storage medium, such as a computer readable only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.
[0182] The embodiment of the present application further provides a chip, which comprises a processor and a communication interface, the communication interface is coupled with the processor, the processor is used for running programs or instructions to realize the processes of the above image processing method embodiments and achieve the same technical effects. To avoid repetition, details are not described here.
[0183] It should be understood that the chip mentioned in the embodiment of the present application can also be referred to as a system level chip, a system chip, a chip system or a system on chip, etc.
[0184] The embodiment of the present application provides a computer program product, which is stored in a storage medium, and is executed by at least one processor to realize the processes of the above image processing method embodiments and achieve the same technical effects. To avoid repetition, details are not described here.
[0185] It should be noted that in this paper, the term "includes", "contains" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or device. Without more limitations, the element defined by the statement "includes a" does not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the method and device of the present application is not limited to the order of the functions shown or discussed, but can also include the functions performed in a substantially simultaneous manner or in the opposite order, for example, the described method can be performed in an order different from that described, and various steps can also be added, omitted or combined. In addition, the features described with reference to some examples can be combined in other examples.
[0186] Through the above description of the embodiments, those skilled in the art can clearly understand that the above-mentioned example methods can be realized by means of software and a necessary general hardware platform, and of course, can also be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a computer software product in essence or in the form of a part that contributes to the prior art, which is stored in a storage medium (such as a ROM / RAM, a magnetic disk, or an optical disk) and includes a plurality of instructions for causing a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in the various embodiments of the present application.
[0187] The embodiments of the present application are described above in combination with the drawings, but the present application is not limited to the above-mentioned specific embodiments, and the above-mentioned specific embodiments are only illustrative and not restrictive. Those skilled in the art can make many forms under the inspiration of the present application without departing from the scope of the present application and the scope protected by the claims.
Claims
1. An image processing method applied to an image processing device, the image processing device comprising a main control chip and an image processing chip, comprising: The main control chip obtains the first image based on the target resolution; The target resolution is less than or equal to the first resolution; The first resolution is the maximum resolution of the image that the image processing chip supports processing; The first image is transmitted to the image processing chip via the main control chip; The image processing chip processes the first image to obtain a second image, the resolution of which is equal to the resolution of the screen, and the screen is used to display the second image.
2. The method according to claim 1, wherein, The first screen is the screen of the first application. The process of obtaining the first screen based on the target resolution using the main control chip includes: The main control chip renders the first screen content of the first application according to the target resolution to obtain the first screen, where the target resolution is the resolution of the screen output by the first application.
3. The method according to claim 2, wherein, The process of processing the first image using the image processing chip to obtain the second image includes: The image processing chip interpolates frames from the first frame to obtain a first interpolated image, the resolution of which is the same as that of the first frame. The image processing chip processes the first interpolated frame image according to the screen resolution to obtain the second image.
4. The method according to claim 1, wherein, The first screen is the screen of the first application. The process of obtaining the first screen based on the target resolution using the main control chip includes: The main control chip renders the first screen content of the first application according to the target resolution to obtain the first rendered screen, wherein the target resolution is the resolution of the screen output by the first application; The first image is obtained by magnifying the first rendered image according to the first resolution using the main control chip.
5. The method according to any one of claims 1 to 4, wherein, The process of processing the first image using the image processing chip to obtain the second image includes: The first image is compressed by the image processing chip to obtain a first compressed image, wherein the bit depth of the pixels in the first compressed image is smaller than the bit depth of the pixels in the first image. The image processing chip interpolates frames from the first compressed image to obtain a second interpolated image; The image processing chip decompresses the second interpolated image to obtain a first decompressed image, wherein the bit depth of the pixels in the first decompressed image is equal to the bit depth of the pixels in the first image. The image processing chip processes the first decompressed image according to the screen resolution to obtain the second image.
6. An image processing apparatus, comprising a main control chip and an image processing chip, comprising: The main control chip is used to obtain the first image based on the target resolution; The target resolution is less than or equal to the first resolution; The first resolution is the maximum resolution of the image that the image processing chip supports processing; The main control chip is also used to transmit the first image to the image processing chip; The image processing chip is used to process the first image to obtain a second image, the resolution of the second image being equal to the resolution of the screen, and the screen being used to display the second image.
7. The apparatus according to claim 6, wherein, The first screen is the screen of the first application, and the main control chip is specifically used for: The first screen content of the first application is rendered according to the target resolution to obtain the first screen, wherein the target resolution is the resolution of the screen output by the first application.
8. The apparatus according to claim 7, wherein, The image processing chip is specifically used for: Interpolate frames from the first frame to obtain a first interpolated frame image, the resolution of the first interpolated frame image being the same as the resolution of the first frame; The first interpolated frame image is processed according to the screen resolution to obtain the second image.
9. The apparatus according to claim 6, wherein, The first screen is the screen of the first application, and the main control chip is specifically used for: According to the target resolution, the first screen content of the first application is rendered to obtain the first rendered screen, where the target resolution is the resolution of the screen output by the first application; The first rendered image is enlarged according to the first resolution to obtain the first image.
10. The apparatus according to any one of claims 6 to 9, wherein, The image processing chip is specifically used for: The first image is compressed to obtain a first compressed image, wherein the bit depth of the pixels in the first compressed image is less than the bit depth of the pixels in the first image. The first compressed image is interpolated to obtain a second interpolated image; Decompress the second interpolated image to obtain a first decompressed image, wherein the bit depth of the pixels in the first decompressed image is equal to the bit depth of the pixels in the first image. The first decompressed image is processed according to the screen resolution to obtain the second image.
11. An electronic device comprising a processor and a memory, the memory storing a program or instructions executable on the processor, the program or instructions, when executed by the processor, implementing the steps of the image processing method as claimed in any one of claims 1 to 5.
12. A readable storage medium storing a program or instructions that, when executed by a processor, implement the steps of the image processing method as claimed in any one of claims 1 to 5.
13. A computer program product, wherein, The program product is stored in a storage medium and is executed by at least one processor to implement the method as described in the first aspect.
Citation Information
Patent Citations
Panoramic video frame insertion method and device and corresponding storage medium
CN111372087A
Coding method and device, electronic equipment and computer readable storage medium
CN112929624A
Image processing circuit, image processing method and electronic equipment
CN115514859A
Image processing method, image processing device and storage medium
CN116939225A
Image processing method, image processing device, electronic equipment and storage medium
CN118803179A